Aws Data Engineer

1 week ago

Hyderabad Noida Pune, India Celebal Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

DATA ENGINEER (Databricks & AWS)

Overview: As a Data Engineer, you will work with multiple teams to deliver solutions on the AWS Cloud using core cloud data engineering tools such as Databricks on AWS, AWS Glue, Amazon Redshift, Athena, and other Big Data-related technologies. This role focuses on building the next generation of application-level data platforms and improving recent implementations. Hands-on experience with Apache Spark (PySpark, SparkSQL), Delta Lake, Iceberg, and Databricks is essential.

Responsibilities:
• Define, design, develop, and test software components/applications using AWS-native data services: Databricks on AWS, AWS Glue, Amazon S3, Amazon Redshift, Athena, AWS Lambda, Secrets Manager
• Build and maintain ETL/ELT pipelines for both batch and streaming data.
• Work with structured and unstructured datasets at scale.
• Apply Data Modeling principles and advanced SQL techniques.
• Implement and manage pipelines using Apache Spark (PySpark, SparkSQL) and Delta Lake/Iceberg formats.
• Collaborate with product teams to understand requirements and deliver optimized data solutions.
• Utilize CI/CD pipelines with DBX and AWS for continuous delivery and deployment of Databricks code.
• Work independently with minimal supervision and strong ownership of deliverables.

Must Have:
• 4+ years of experience in Data Engineering on AWS Cloud.
• Hands-on expertise in: o Apache Spark (PySpark, SparkSQL) o Delta Lake / Iceberg formats o Databricks on AWS o AWS Glue, Amazon Athena, Amazon Redshift
• Strong SQL skills and performance tuning experience on large datasets.
• Good understanding of CI/CD pipelines, especially using DBX and AWS tools.
• Experience with environment setup, cluster management, user roles, and authentication in Databricks.
• Certified as a Databricks Certified Data Engineer Professional (mandatory).

Good To Have:
• Experience migrating ETL pipelines from on-premise or other clouds to AWS Databricks.
• Experience with Databricks ML or Spark 3.x upgrades.
• Familiarity with Airflow, Step Functions, or other orchestration tools.
• Experience integrating Databricks with AWS services in a secured, production-ready environment.
• Experience with monitoring and cost optimization in AWS.

Key Skills:
• Languages: Python, SQL, PySpark
• Big Data Tools: Apache Spark, Delta Lake, Iceberg
• Databricks on AWS
• AWS Services: AWS Glue, Athena, Redshift, Lambda, S3, Secrets Manager
• Version Control & CI/CD: Git, DBX, AWS CodePipeline/CodeBuild
• Other: Data Modeling, ETL Methodology, Performance Optimizatio

  • Aws Data Engineer

    2 weeks ago

    Greater Noida, Hyderabad, Pune, India Coforge Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Location:- Hyderabad & NoidaExperience Required: 5 to 8 YearsMandatory Skills (Hands on experience required)- Spark, Scala, Big Data (Hadoop), AWS, SQLShift- UK ShiftStreaming data Technical skills requirements :-Experience- 5+ Years Solid hands-on and Solution Architecting experience in Big-Data Technologies (AWS preferred)- Hands on experience...

  • AWS Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 8,33,333 - ₹ 25,00,000 per year

    AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferredSkills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shiftGood communication skills and can deliver independently*Mandatory Competencies*Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS...

  • Aws Data Engineer

    2 weeks ago

    Chennai, Hyderabad, Noida, India Innova Solutions Full time

    About the Role :Sr. AWS Data EngineerSpecialization :Must have : AWS(8)Key Responsibilities :8+ Exp8+ years of Data Engineering experience in a Production cloud infrastructure AWS services - Glue, Redshift, RDS, CloudWatch, CloudFormation, S3, IAM etc.5+ years' experience working in a Big Data ecosystem processing data; includes file...

  • Aws Data Engineer

    2 weeks ago

    Kolkata, Noida, Pune, India Tekskills Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title: EngineerSkills Required: AWS Data EngineerExperience Range Required: 4+ YearsMandatory Skills:Data Engineering( Snowflake, Python)

  • AWS Data engineer

    7 days ago

    Bengaluru, Hyderabad, Pune, India Tata Consultancy Services Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Airflow Data Engineer in AWS platformJob Title Apache Airflow Data EngineerROLE" as per TCS RoleMaster • 4-8 years of experience in AWS, Apache Airflow (on Astronomer platform), Python, Pyspark, SQL • Good hands-on knowledge on SQL and Data Warehousing life cycle is an absolute requirement. • Experience in creating data pipelines and orchestrating...

  • AWS Data Engineer

    2 weeks ago

    Hyderabad, India Coforge Full time

    We’re Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred.Job Locations: Hyderabad & Greater NoidaExperience Required: 5 to 7 YearsSend your CV to Gaurav.2.Kumar@coforge.comAbout the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and...

  • AWS Data Engineer

    1 week ago

    Hyderabad, India Coforge Full time

    We’re Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred.Job Locations: Hyderabad & Greater NoidaExperience Required: 5 to 7 YearsSend your CV to Gaurav.2.Kumar@coforge.comAbout the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and...

  • AWS Data Engineer

    2 weeks ago

    Hyderabad, India Coforge Full time

    We’re Hiring : AWS Data Engineers at Coforge Ltd . Immediate Joiners Preferred. Job Locations: Hyderabad & Greater Noida Experience Required: 5 to 7 Years Send your CV to About the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS. You’ll...

  • AWS Data Engineer

    2 weeks ago

    Hyderabad, India Coforge Full time

    We’re Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred.Job Locations: Hyderabad & Greater NoidaExperience Required: 5 to 7 YearsSend your CV to the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS. You’ll work with...

  • Aws data engineer

    3 weeks ago

    Hyderabad, India Coforge Full time

    We’re Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred.Job Locations: Hyderabad & Greater NoidaExperience Required: 5 to 7 YearsSend your CV to Gaurav.2. About the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS....