AWS Data Engineer

3 weeks ago


ChennaiPuneBangaloreNoida, India Ilink Systems Pvt Ltd Full time

Job Description :


- AWS Data Engineer with min of 5 to 7 years of experience.

- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.

- Connect with stakeholders daily to discuss project progress and updates.

- Work within an Agile process to deliver projects in a timely and efficient manner.

- Design and develop Airflow DAGs to schedule and manage ETL workflows.

- Transform SQL queries into Spark SQL code for ETL pipelines.

- Develop custom Python functions to handle data quality and validation.

- Write PySpark scripts to process data and perform transformations.

- Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes

- Run Spark jobs on AWS EMR cluster using Airflow DAGs.

- Monitor and troubleshoot ETL pipelines to ensure smooth operation.

- Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture.

- Collaborate with other members of the data engineering team to improve processes and implement new technologies.

- Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness.

(ref:hirist.tech)

  • bangalore, India AWS India - Karnataka - D11 Full time

    AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success....

  • AWS Data Engineer

    6 days ago


    Noida, Uttar Pradesh, India Infogain Full time

    AWS Data Engineer (Lead) with skills AWS - EKS, AWS - CloudFormation, AWS-Apps, AWS-Infra, AWS DBA, Python, Apache Hive, SQL for location Noida, India Posted on: May 24, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Job description Responsibilities · Provide consultation on appropriate use of AWS for Data...

  • Data Engineer

    2 months ago


    Bangalore/Chennai, Tamil Nadu, India Notus Full time

    AWS Data EngineerJob Title: AWS Data EngineerLocation: Bangalore / ChennaiExperience: 8+ YearsJob Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services, Kafka,...

  • Data Engineer

    3 weeks ago


    Bangalore/Chennai, India Notus Full time

    AWS Data Engineer Job Title: AWS Data Engineer Location: Bangalore / Chennai Experience: 8+ Years Job Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services,...

  • Data Engineer

    2 months ago


    Bangalore/Chennai, India Notus Full time

    AWS Data Engineer Job Title: AWS Data Engineer Location: Bangalore / Chennai Experience: 8+ Years Job Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services,...

  • Data Engineer

    7 days ago


    Chennai, India NTT DATA Full time

    Job Description Req ID: 282638 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob...

  • Data Engineer

    6 days ago


    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe...

  • Aptus Data Labs

    2 months ago


    bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    2 months ago


    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • AWS Data Engineer

    6 days ago


    Chennai, Tamil Nadu, India CliqHR Full time

    Job Description :Must have minimum 5+ years of experience as AWS Data EngineerNice to have : AWS Certified Data Analytics Specialty certification Experience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patterns Work closely with DevOps engineer to support...

  • AWS Data Engineer

    7 days ago


    bangalore, India EXL Full time

    Job Description: As an AWS Data Engineer, you will be responsible for designing, developing, and managing our cloud-based data infrastructure on Amazon Web Services (AWS). The ideal candidate will have extensive experience with AWS services, strong expertise in data engineering principles, and a passion for building robust and scalable data solutions. Key...

  • AWS Data Engineer

    2 weeks ago


    bangalore, India Torry Harris Full time

    Are you an AWS Data Engineer looking for an exciting new opportunity? Look no further than Torry Harris! We are a leading digital transformation company, and we are currently seeking a talented and experienced AWS Data Engineer to join our team.As an AWS Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining our...


  • bangalore, India AWS India - Karnataka - D11 Full time

    AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success....


  • bangalore, India AWS India - Karnataka - D11 Full time

    AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success....

  • AWS Data Engineer

    3 weeks ago


    Chennai/Pune/Bangalore/Noida, IN Ilink Systems Pvt Ltd Full time

    Job Description :- AWS Data Engineer with min of 5 to 7 years of experience.- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.- Connect with stakeholders daily to discuss project progress and updates.- Work within an Agile process to deliver projects in a timely and efficient manner.- Design and...

  • AWS Data Engineer

    3 weeks ago


    Chennai/Pune/Bangalore/Noida, IN Ilink Systems Pvt Ltd Full time

    Job Description :- AWS Data Engineer with min of 5 to 7 years of experience.- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.- Connect with stakeholders daily to discuss project progress and updates.- Work within an Agile process to deliver projects in a timely and efficient manner.- Design and...

  • Data Engineer

    4 weeks ago


    bangalore, India Concentrix Full time

    Job Description:Experience: 4 Years - 8 YearsJob Location: PAN IndiaNotice Period: Immediate/ 15 DaysShift Timings: 03:00 PM to 12:00 AM (IST)Skills: Data Engineering; data Pipeline; ETL, AWS (and frameworks), Pyspark/ scala; SQL & pythonJob Description:We are seeking an experienced Data Engineer to join our team. The ideal candidate should have a...

  • Data Engineer

    3 weeks ago


    bangalore, India Concentrix Full time

    Job Description:Experience: 4 Years - 8 YearsJob Location: PAN IndiaNotice Period: Immediate/ 15 DaysShift Timings: 03:00 PM to 12:00 AM (IST)Skills: Data Engineering; data Pipeline; ETL, AWS (and frameworks), Pyspark/ scala; SQL & pythonJob Description:We are seeking an experienced Data Engineer to join our team. The ideal candidate should have a...

  • AWS Data Engineer

    3 weeks ago


    bangalore, India PradeepIT Consulting Services Pvt Ltd Full time

    Job Description: As an AWS Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and data storage solutions on Amazon Web Services (AWS). Your expertise will help us leverage data for critical business insights and analytics. Primary Skills: Experience in implementing at least 2 end-to-end Data Engineering projects....

  • AWS Data Engineer

    1 month ago


    bangalore, India PradeepIT Consulting Services Pvt Ltd Full time

    Job Description: As an AWS Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and data storage solutions on Amazon Web Services (AWS). Your expertise will help us leverage data for critical business insights and analytics. Primary Skills: Experience in implementing at least 2 end-to-end Data Engineering projects....