AWS Data Engineer

2 months ago

Hyderabad, India DATAECONOMY Full time
AWS Data Engineer

We are seeking a highly motivated AWS data engineer to join our team. In this role you will be responsible for designing developing and implementing data pipelines that ingest transform and load data into our data warehouse and data lake on AWS.

Responsibilities:

  • Design develop and maintain scalable and efficient data pipelines for batch and realtime data sources utilizing AWS services like S3 Redshift Glue Lambda DynamoDB and Kinesis.
  • Build ETL/ELT pipelines to handle both structured and unstructured data.
  • Utilize Python and PySpark to process and transform large datasets.
  • Implement ETL (Extract Transform Load) processes using a combination of Informatica PowerCenter and custombuilt Python scripts.
  • Build and maintain data models to optimize data storage retrieval and analysis.
  • Collaborate with data analysts data scientists and business stakeholders to understand data requirements and translate them into technical solutions.
  • Develop and implement unit tests and integration tests to ensure data quality and pipeline reliability.
  • Monitor and troubleshoot data pipelines to identify and resolve issues proactively.
  • Automate data pipeline deployment processes using AWS CodePipeline or similar tools.
  • Stay uptodate on the latest trends and technologies in cloud data engineering.

Previous Working Experience:

  • Experience building data ingestion (ETL/ELT) pipelines for various data sources.
  • Experience building data warehouses and data lakes.


Requirements


Qualifications:

  • 510 years of experience in data engineering or a related field.
  • Proven experience with AWS cloud services including S3 Redshift Glue Lambda DynamoDB and Kinesis.
  • Proficiency in Python and PySpark for data processing and transformation.
  • Experience with ETL tools like Informatica PowerCenter.
  • Strong understanding of data modeling concepts and techniques.
  • Excellent problemsolving and analytical skills.
  • Experience working in a collaborative and fastpaced environment.
  • Excellent communication and interpersonal skills.

Bonus Points:

  • Experience with CI/CD pipelines for data engineering.
  • Experience with cloud security best practices.
  • Experience with data governance and compliance.
  • Experience with data visualization tools.


Benefits

Benefits

Opportunity to work with cuttingedge technologies in a fastpaced environment.

Be part of a collaborative and supportive team

Work on impactful projects that make a difference.



AWS Data Engineer We are seeking a highly motivated AWS Data Engineer to join our team. In this role, you will be responsible for designing, developing, and implementing data pipelines that ingest, transform, and load data into our data warehouse and data lake on AWS. Responsibilities: Design, develop, and maintain scalable and efficient data pipelines for batch and real-time data sources, utilizing AWS services like S3, Redshift, Glue, Lambda, DynamoDB, and Kinesis. Build ETL/ELT pipelines to handle both structured and unstructured data. Utilize Python and PySpark to process and transform large datasets. Implement ETL (Extract, Transform, Load) processes using a combination of Informatica PowerCenter and custom-built Python scripts. Build and maintain data models to optimize data storage, retrieval, and analysis. Collaborate with data analysts, scientists, and business stakeholders to understand and translate data requirements into technical solutions. Develop and implement unit and integration tests to ensure data quality and pipeline reliability. Monitor and troubleshoot data pipelines to identify and resolve issues proactively. Automate data pipeline deployment processes using AWS CodePipeline or similar tools. Stay up-to-date on the latest trends and technologies in cloud data engineering. Previous Working Experience: Experience building data ingestion (ETL/ELT) pipelines for various sources. Experience building data warehouses and data lakes. Qualifications: 5-10 years of experience in data engineering or a related field. Proven experience with AWS cloud services, including S3, Redshift, Glue, Lambda, DynamoDB, and Kinesis. Proficiency in Python and PySpark for data processing and transformation. Experience with ETL tools like Informatica PowerCenter. Strong understanding of data modelling concepts and techniques. Excellent problem-solving and analytical skills. Experience working in a collaborative and fast-paced environment. Excellent communication and interpersonal skills. Bonus Points: Experience with CI/CD pipelines for data engineering. Experience with cloud security best practices. Experience with data governance and compliance. Experience with data visualization tools. Benefits Opportunity to work with cutting-edge technologies in a fast-paced environment. Be part of a collaborative and supportive team Work on impactful projects that make a difference.

  • AWS Data Engineer

    2 months ago

    hyderabad, India Coforge Full time

    Job Summary: - We're looking for an AWS Data Engineer who is passionate about building scalable, efficient, and secure data pipelines on AWS. As an AWS Data Engineer at Coforge, you will design, develop, and maintain our data infrastructure using AWS services, Python, and Airflow. If you have a strong background in data engineering and a passion for cloud...

  • Data Engineer

    2 weeks ago

    Hyderabad, India MNR Solutions Full time

    Job Description :We are looking for an experienced AWS Data Engineer to join our team. The ideal candidate will have extensive knowledge of AWS data services and a strong background in data engineering. This role involves designing, implementing, and maintaining data pipelines and architectures to support business intelligence and analytics initiatives.Key...

  • AWS Data Engineer

    4 weeks ago

    hyderabad, India DATAECONOMY Full time

    AWS Data EngineerWe are seeking a highly motivated AWS data engineer to join our team. In this role you will be responsible for designing developing and implementing data pipelines that ingest transform and load data into our data warehouse and data lake on AWS.Responsibilities:Design develop and maintain scalable and efficient data pipelines for batch and...

  • AWS Data Engineer

    5 months ago

    Hyderabad, India HGS Full time

    Job Description We are looking for an AWS Data Engineer toadd to our cloud practice. Webelieve that Data Engineer enables data-driven decision making bycollecting, transforming, and publishing data. A Data Engineer should be ableto design, build, operationalize, secure, and monitor data processing systemswith a particular emphasis on security and...

  • AWS Data Engineer

    1 month ago

    Hyderabad, India FLYONIT Full time

    Job Summary: We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for designing...

  • AWS Data Engineer

    2 months ago

    hyderabad, India Coforge Full time

    Job Summary: - We're looking for an AWS Data Engineer who is passionate about building scalable, efficient, and secure data pipelines on AWS. As an AWS Data Engineer at Coforge, you will design, develop, and maintain our data infrastructure using AWS services, Python, and Airflow. If you have a strong background in data engineering and a passion for cloud...

  • AWS Data Engineer

    2 months ago

    hyderabad, India Coforge Full time

    Job Summary: - We're looking for an AWS Data Engineer who is passionate about building scalable, efficient, and secure data pipelines on AWS. As an AWS Data Engineer at Coforge, you will design, develop, and maintain our data infrastructure using AWS services, Python, and Airflow. If you have a strong background in data engineering and a passion for cloud...

  • AWS Data Engineer

    2 months ago

    Hyderabad, India Coforge Full time

    Job Summary: - We're looking for an AWS Data Engineer who is passionate about building scalable, efficient, and secure data pipelines on AWS. As an AWS Data Engineer at Coforge, you will design, develop, and maintain our data infrastructure using AWS services, Python, and Airflow. If you have a strong background in data engineering and a passion for cloud...

  • AWS Data Engineer

    2 months ago

    Hyderabad, India Coforge Full time

    Job Summary: - We're looking for an AWS Data Engineer who is passionate about building scalable, efficient, and secure data pipelines on AWS. As an AWS Data Engineer at Coforge, you will design, develop, and maintain our data infrastructure using AWS services, Python, and Airflow. If you have a strong background in data engineering and a passion for cloud...

  • AWS Data Engineer

    3 weeks ago

    Hyderabad, India I square soft Full time

    Job Title: AWS Data EngineerJob Summary:We are seeking an experienced AWS Data Engineer to join our team at I Square Soft. The successful candidate will be responsible for designing, developing, and maintaining robust ETL pipelines using Python and PySpark to process large-scale datasets efficiently.Key Responsibilities:Develop and deploy ETL pipelines using...

  • AWS Data Engineer

    1 month ago

    Hyderabad, India Tata Consultancy Services Full time

    TCS Inviting Applications for Role : AWS Data EngineerExperience : 4- 8 yrsLocation : Walk-In At Hyderabad Mandatory skills and experience: (Please include skills related to technical as well as domain and non-technical skills and experience as applicable to the position) Working on EMR, good knowledge of CDK and setting up ETL and Data pipeline Coding -...

  • AWS Data Engineer

    1 month ago

    hyderabad, India Tata Consultancy Services Full time

    TCS Inviting Applications for Role : AWS Data EngineerExperience : 4- 8 yrsLocation : Walk-In At Hyderabad Mandatory skills and experience: (Please include skills related to technical as well as domain and non-technical skills and experience as applicable to the position) Working on EMR, good knowledge of CDK and setting up ETL and Data pipeline Coding -...

  • AWS Data Engineer

    1 month ago

    Hyderabad, India Tata Consultancy Services Full time

    TCS Inviting Applications for Role : AWS Data EngineerExperience : 4- 8 yrsLocation : Walk-In At Hyderabad Mandatory skills and experience: (Please include skills related to technical as well as domain and non-technical skills and experience as applicable to the position) Working on EMR, good knowledge of CDK and setting up ETL and Data pipeline Coding -...

  • AWS Data Engineer

    1 month ago

    Hyderabad, India Tata Consultancy Services Full time

    TCS Inviting Applications for Role : AWS Data Engineer Experience : 4- 8 yrs Location : Walk-In At Hyderabad Mandatory skills and experience: (Please include skills related to technical as well as domain and non-technical skills and experience as applicable to the position) Working on EMR, good knowledge of CDK and setting up ETL and Data pipeline ...

  • AWS Data Engineer

    3 months ago

    Hyderabad, India DATAECONOMY Full time

    AWS DataEngineerWe are seekinga highly motivated AWS data engineer to join ourteam. In thisrole you will be responsible fordesigningdeveloping and implementing data pipelinesthat ingesttransform and load data into our datawarehouse and data lake onAWS.Responsibilities:Designdevelop and maintain scalable andefficient data pipelines for batch andrealtime...

  • Aws data engineer

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Dear Candidate, Greetings from TCS Human Resources Team!! Job Role: AWS Data Engineer Job Locations: Hyderabad Experience Range: 7 to 10 years Job Description:- Key Responsibilities : Lead the design, implementation, and optimization of data pipelines and architectures using AWS services like S3, Redshift, Glue, Lambda, and Step Functions. ...

  • AWS Data Engineer

    6 hours ago

    hyderabad, India Tata Consultancy Services Full time

    Dear Candidate, Greetings from TCS Human Resources Team!! Job Role: AWS Data Engineer Job Locations: Hyderabad Experience Range: 7 to 10 years Job Description:- Key Responsibilities: - Lead the design, implementation, and optimization of data pipelines and architectures using AWS services like S3, Redshift, Glue, Lambda, and Step Functions. -...

  • Aws data engineer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Dear Candidate, Greetings from TCS Human Resources Team!! Job Role: AWS Data Engineer Job Locations: Hyderabad Experience Range: 7 to 10 years Job Description:- Key Responsibilities : Lead the design, implementation, and optimization of data pipelines and architectures using AWS services like S3, Redshift, Glue, Lambda, and Step Functions. Architect...

  • AWS Data Engineer/Lead

    3 weeks ago

    Hyderabad, Telangana, India HGS - Hinduja Global Solutions Full time

    Job Title: AWS Data Engineer/LeadLocation: Hyderabad, IndiaJob Type: Full-timeAbout the Role:We are seeking an experienced AWS Data Engineer/Lead to join our team at HGS - Hinduja Global Solutions. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems on AWS.Key...

  • AWS Data Engineer

    4 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Dear Candidate,Greetings from TCS Human Resources Team!!Job Role: AWS Data EngineerJob Locations: HyderabadExperience Range: 7 to 10 yearsJob Description:-Key Responsibilities:- Lead the design, implementation, and optimization of data pipelines and architectures using AWS services like S3, Redshift, Glue, Lambda, and Step Functions.- Architect data...