Aws Data Engineer

1 week ago

Hyderabad Noida Pune, India Celebal Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

DATA ENGINEER (Databricks & AWS)

Overview: As a Data Engineer, you will work with multiple teams to deliver solutions on the AWS Cloud using core cloud data engineering tools such as Databricks on AWS, AWS Glue, Amazon Redshift, Athena, and other Big Data-related technologies. This role focuses on building the next generation of application-level data platforms and improving recent implementations. Hands-on experience with Apache Spark (PySpark, SparkSQL), Delta Lake, Iceberg, and Databricks is essential.

Responsibilities:
• Define, design, develop, and test software components/applications using AWS-native data services: Databricks on AWS, AWS Glue, Amazon S3, Amazon Redshift, Athena, AWS Lambda, Secrets Manager
• Build and maintain ETL/ELT pipelines for both batch and streaming data.
• Work with structured and unstructured datasets at scale.
• Apply Data Modeling principles and advanced SQL techniques.
• Implement and manage pipelines using Apache Spark (PySpark, SparkSQL) and Delta Lake/Iceberg formats.
• Collaborate with product teams to understand requirements and deliver optimized data solutions.
• Utilize CI/CD pipelines with DBX and AWS for continuous delivery and deployment of Databricks code.
• Work independently with minimal supervision and strong ownership of deliverables.

Must Have:
• 4+ years of experience in Data Engineering on AWS Cloud.
• Hands-on expertise in: o Apache Spark (PySpark, SparkSQL) o Delta Lake / Iceberg formats o Databricks on AWS o AWS Glue, Amazon Athena, Amazon Redshift
• Strong SQL skills and performance tuning experience on large datasets.
• Good understanding of CI/CD pipelines, especially using DBX and AWS tools.
• Experience with environment setup, cluster management, user roles, and authentication in Databricks.
• Certified as a Databricks Certified Data Engineer Professional (mandatory).

Good To Have:
• Experience migrating ETL pipelines from on-premise or other clouds to AWS Databricks.
• Experience with Databricks ML or Spark 3.x upgrades.
• Familiarity with Airflow, Step Functions, or other orchestration tools.
• Experience integrating Databricks with AWS services in a secured, production-ready environment.
• Experience with monitoring and cost optimization in AWS.

Key Skills:
• Languages: Python, SQL, PySpark
• Big Data Tools: Apache Spark, Delta Lake, Iceberg
• Databricks on AWS
• AWS Services: AWS Glue, Athena, Redshift, Lambda, S3, Secrets Manager
• Version Control & CI/CD: Git, DBX, AWS CodePipeline/CodeBuild
• Other: Data Modeling, ETL Methodology, Performance Optimizatio

  • Aws Data Engineer

    3 weeks ago

    Hyderabad, India Data Economy Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions. Key...

  • Aws Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Data Economy Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions.Key...

  • Aws Data Engineer

    2 weeks ago

    Greater Noida, Hyderabad, Pune, India Coforge Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Location:- Hyderabad & NoidaExperience Required: 5 to 8 YearsMandatory Skills (Hands on experience required)- Spark, Scala, Big Data (Hadoop), AWS, SQLShift- UK ShiftStreaming data Technical skills requirements :-Experience- 5+ Years Solid hands-on and Solution Architecting experience in Big-Data Technologies (AWS preferred)- Hands on experience...

  • Aws data engineer

    3 weeks ago

    Noida, India Coforge Full time

    Role - AWS Data Engineer Skills - AWS & Py Spark Job Locations - Pune, Greater Noida & Hyderabad Experience - 6+ years We at Coforge are hiring AWS Data Engineers with the following skill-set: Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar. Build and optimize data architectures (data lakes,...

  • AWS Data Engineer

    4 weeks ago

    Noida, India Coforge Full time

    Role - AWS Data Engineer Skills - AWS & PySpark Job Locations - Pune, Greater Noida & Hyderabad Experience - 6+ years We at Coforge are hiring AWS Data Engineers with the following skill-set: - Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar. - Build and optimize data architectures (data lakes,...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Hyderabad, Pune, India Globant Full time US$ 90,000 - US$ 1,20,000 per year

    We seek a Senior-Level AWS Data Engineer who shares our passion for innovation and change. This role is critical to helping our business partners evolve and adapt to consumers' personalized expectations in this new technological era.Looking at highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have a strong...

  • AWS Data Engineer

    3 weeks ago

    Noida, India Coforge Full time

    Role - AWS Data EngineerSkills - AWS & PySparkJob Locations - Pune, Greater Noida & HyderabadExperience - 6+ yearsWe at Coforge are hiring AWS Data Engineers with the following skill-set:Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar.Build and optimize data architectures (data lakes, data...

  • Aws data engineer

    3 weeks ago

    Noida, India Coforge Full time

    Role - AWS Data EngineerSkills - AWS & Py SparkJob Locations - Pune, Greater Noida & HyderabadExperience - 6+ years We at Coforge are hiring AWS Data Engineers with the following skill-set:Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar.Build and optimize data architectures (data lakes, data...

  • AWS Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 8,33,333 - ₹ 25,00,000 per year

    AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferredSkills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shiftGood communication skills and can deliver independently*Mandatory Competencies*Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS...

  • AWS Data Engineer

    3 weeks ago

    Noida, India Coforge Full time

    Role - AWS Data EngineerSkills - AWS & PySparkJob Locations - Pune, Greater Noida & HyderabadExperience - 6+ yearsWe at Coforge are hiring AWS Data Engineers with the following skill-set:- Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar.- Build and optimize data architectures (data lakes, data...