AWS Data Engineer

3 days ago

Chennai, Tamil Nadu, India Risk Resources LLP Full time

Role : AWS Data Engineer

Required Technical Skill Set : ETL, SQL & AWS

Desired Competencies (Technical/Behavioral Competency) :

Must-Have :

- Strong Knowledge of Aws Glue/AWS REDSHIFt/SQL/ETL.Good knowledge and experience in Pyspark for forming complex Transformation logic.

Good-to-Have : Python

Responsibility of / Expectations from the Role :

1. Good knowledge of SQL and Data warehousing Concepts

2. Experienced in AWS cloud services such as AWS EC2, AWS S3, AWS Lambda, AWS Glue and AWS Redshift

3. Hand on knowledge of Using Python & Pyspark for Data transformations

4. Good knowledge in glue to write transformation logic/ call custom code written in SQL /Pysprak file with transformation logic

5. To handle complex data processing using air flow

6. Cloud watch, custom logging using python

7. To perform data quality analysis using glue/pyspark

Key Responsibilities :

- Design, build, and maintain scalable data pipelines using AWS Glue and Redshift.

- Implement ETL processes to transform and prepare data for analysis.

- Develop and optimize SQL queries for efficient data retrieval and manipulation.

- Collaborate with data scientists and analysts to understand data requirements and deliver solutions.

- Utilize Apache Airflow for workflow management and to schedule data jobs.

- Ensure data quality and integrity across all data pipelines.

- Monitor performance and troubleshoot issues in data workflows.

- Document data models, workflows, and architecture for knowledge sharing.

- Stay updated with industry trends and AWS services to enhance data architecture.

- Work on data security protocols and ensure compliance with regulations.

- Participate in code reviews and contribute to best practices in data engineering.

- Assist in capacity planning and scaling of the data infrastructure.

- Create dashboards and reports to visualize data trends and insights.

- Train and mentor junior team members on data engineering best practices.

- Support data governance initiatives and contribute to a data-driven culture.

(ref:hirist.tech)

  • AWS Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India B1 IT Solutions Inc. Full time

    Key Job Summary:We are seeking a highly skilled AWS Data Engineer to join our team at B1 IT Solutions Inc. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems on the Amazon Web Services (AWS) platform.Job Description:The AWS Data Engineer will work closely with cross-functional teams to...

  • Analyst

    3 days ago

    Chennai, Tamil Nadu, India Data Engineer Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer with expertise in deploying Machine Learning, Vision Language Models, and Large Language Models into production using cloud platforms such as Runway or other cloud-based tools.Key Responsibilities:Build and Manage Data Pipelines: Design and implement data pipelines to support the deployment of ML,...

  • Aws Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Opportunity: AWS Data Engineer at Tata Consultancy ServicesWe are seeking a highly skilled AWS Data Engineer to join our team at TCS.Mandatory Skills:AWSPythonLocation: Chennai, Pune, Bangalore, HyderabadExperience: 8-12 yearsThe ideal candidate will have strong expertise in designing, developing, and maintaining large-scale data processing systems on...

  • AWS Data Engineer

    7 days ago

    Chennai, Tamil Nadu, India beBee Careers Full time

    We are looking for a highly skilled Data Engineer to design and implement scalable data pipelines using AWS services.Key ResponsibilitiesThe ideal candidate will have strong expertise in AWS technologies and be responsible for designing, building, and maintaining scalable data pipelines. They will work with large datasets and implement solutions for data...

  • AWS Data Engineer Position

    2 weeks ago

    Chennai, Tamil Nadu, India beBee Careers Full time

    We are seeking a highly skilled AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing and implementing data engineering solutions using AWS technologies.Key Responsibilities:Design and implement data pipelines using AWS services such as S3, Glue, and Redshift.Develop and maintain ETL processes using Apache Spark...

  • AWS Data Engineer Position

    5 days ago

    Chennai, Tamil Nadu, India beBee Careers Full time

    AWS Data Engineer Role OverviewAWS Data Engineer is a vital position that requires expertise in designing, building, and maintaining large-scale data systems on Amazon Web Services (AWS). This role involves architecting data pipelines, integrating with various AWS services, and ensuring high availability and scalability of data infrastructure. To excel in...

  • AWS Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India B1 IT Solutions Inc. Full time

    HiTittle: AWS Data engineerLocation: Pune and Chennai (Offshore)ContractJD:AWS GluePython Scriptingterraform Scripting.NETPlease share resumes to

  • AWS Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India B1 IT Solutions Inc. Full time

    HiTittle: AWS Data engineerLocation: Pune and Chennai (Offshore)ContractJD:AWS GluePython Scriptingterraform Scripting.NETPlease share resumes to Rajesh@b1itsolutions.com

  • AWS Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India B1 IT Solutions Inc. Full time

    Hi Tittle: AWS Data engineer Location: Pune and Chennai (Offshore) Contract JD: AWS Glue Python Scripting terraform Scripting .NET Please share resumes to

  • Senior Data Engineer AWS

    5 days ago

    Chennai, Tamil Nadu, India beBee Careers Full time

    Data Engineering Expertise RequiredIn this AWS Data Engineer role, we are seeking an expert who can design, build, and maintain scalable and efficient data systems on AWS. The ideal candidate will have hands-on experience with AWS services, including S3, Glue, Lambda, and DynamoDB, and a strong understanding of data engineering principles. Additionally, the...