AWS Data Pipeline Engineer

7 days ago

Bengaluru, Karnataka, India IDESLABS PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per year

We are looking for a skilled AWS Data Pipeline Engineer with 4 to 12 years of experience to manage data storage solutions on AWS, implement data processing workflows, and collaborate with cross-functional teams. The ideal candidate will have a strong understanding of core AWS services, cloud concepts, and the AWS Well-Architected Framework.

Roles and Responsibility

  • Managing data storage solutions on AWS, including Amazon S3, Amazon Redshift, and Amazon DynamoDB.
  • Implementing and optimizing data processing workflows using AWS services like AWS Glue, Amazon EMR, and AWS Lambda.
  • Collaborating with Spotfire Engineers and business analysts to ensure data accessibility and usability for analysis and visualization.
  • Working with other engineers and business stakeholders to understand requirements and deliver solutions.
  • Writing code in languages like SQL, Python, or Scala to build and maintain data pipelines and applications.
  • Using Infrastructure as Code (IaC) tools to automate the deployment and management of data infrastructure.

Job Requirements

  • Strong understanding of core AWS services, cloud concepts, and the AWS Well-Architected Framework.
  • Experience with data pipeline design and development using AWS services.
  • Knowledge of SQL, Python, or Scala programming languages.
  • Familiarity with Infrastructure as Code (IaC) tools.
  • Understanding of data integration and workflow optimization techniques.
  • Ability to work closely with data engineers and other stakeholders to understand data requirements.

  • AWS Sr Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Sr Data Engineer to join our team in Bangalore or Remote, Karnātaka (IN-KA), India (IN). Position Location:OUS with...

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • AWS Data Engineer

    4 days ago

    Bengaluru, Karnataka, India HireWand Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The AWS Data Engineer will design, develop, and maintain scalable data pipelines and architectures using AWS Glue, Amazon Redshift, AWS Lambda, and Amazon S3. This role requires expertise in AWS Kinesis, AWS CloudFormation, Apache Spark, Python, and AWS IAM to ensure secure and efficient data processing. The candidate will leverage AWS Data Pipeline, AWS...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India eSkillport Management Services Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description Job Title: AWS Data Engineer (IoT/Streaming Data) Location: Chennai or Bangalore. Experience: 3 Years Employment Type: Full-time About the Role We are seeking a highly skilled AWS Data Engineer to design, build, and optimize large-scale data pipelines and analytics platforms. The ideal candidate will have strong...

  • Data Engineer with AWS

    2 weeks ago

    Bengaluru, Karnataka, India Luxoft Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Project description We are looking for a skilled Data Engineer with strong experience in AWS and Apache Airflow to join a dynamic data team. You will be responsible for building and maintaining scalable data pipelines, orchestrating workflows, and ensuring data quality and availability across platforms. - Responsibilities- ?Data Pipeline DevelopmentDesign,...

  • AWS Data Engineer

    1 week ago

    Bengaluru, Karnataka, India DoctusTech Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Position:AWS Data EngineerExperience:5–7 yearsDomain Preference:Healthcare data engineeringAbout the RoleWe are seeking a highly skilled AWS Data Engineer with 5–7 years of experience to join our data engineering team. The ideal candidate will design, build, and maintain robust, secure, and scalable data pipelines on AWS. Prior experience in healthcare...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...

  • Aws Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Coforge Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    AWS Data EngineerJob Location: BengaluruExperience Required: 5+ YearsMandatory Skills: AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShellJob Description:We are looking for an experienced AWS Engineer with around 5-8 years of hands-on experience in...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Info Origin Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Note: Virtual Drive on 14th and 15th OctRole OverviewWe are looking for an experienced AWS Engineer with around 5-7 years of hands-on experience in designing, deploying, and managing applications on the AWS cloud platform. The ideal candidate should have strong expertise in AWS services, automation, and cloud security, along with the ability to collaborate...

  • Aws Data Engineer

    1 week ago

    Bengaluru, Karnataka, India LatentView Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience: 7+ YearsLocation: BangaloreKey ResponsibilitiesDesign, develop, and maintain scalable ETL pipelines using AWS Glue and PySpark.Lead the data engineering team, ensuring best practices in coding, testing, and deployment.Implement workflow orchestration solutions for complex data pipelines.Optimize data pipelines and queries for advanced SQL...