Senior AWS Data Engineer

2 weeks ago


Gurgaon, Haryana, India Kaivale Technologies Full time

Senior AWS Data Engineer

Experience : 9-12 years, Relevant with AWS: 5+ Years

Locations : Gurugram.

Hybrid Model.

Notice period : 0-60 days.

Role Description :

As a Senior AWS Data Engineer, you will be a crucial architect and implementer of our data engineering initiatives. You will be responsible for enhancing existing ETL processes, developing new data pipelines, resolving defects, and providing proactive production support. Your advanced knowledge of AWS Glue, Lambda, S3, and other AWS services will be essential for ensuring the efficiency, reliability, and security of our data infrastructure.

Responsibilities :

- Design, develop, and optimize complex ETL processes using AWS native services, with a focus on AWS Glue and Lambda.

- Proactively resolve defects, troubleshoot performance bottlenecks, and provide expert-level production support for critical ETL pipelines.

- Author and optimize highly efficient ETL processes using Python and PySpark, ensuring data integrity and performance.

- Design and implement sophisticated data models to support diverse and complex data integration needs.

- Strategically integrate diverse datasets using AWS services, ensuring data quality, consistency, and alignment with business requirements.

- Establish robust connections with various data sources, including S3, and implement advanced data validation using Athena.

- Leverage AWS Glue (Crawler, Data Catalog) for advanced data discovery, metadata management, and schema evolution.

- Architect and implement serverless functions using AWS Lambda for event-driven data processing and automation.

- Manage and optimize data storage and retrieval using AWS S3, implementing best practices for data lifecycle management and security.

- Design and implement sophisticated alerting and notification systems using AWS SNS for proactive monitoring and incident response.

- Implement and manage robust security measures using AWS Secret Manager to protect sensitive data.

- Utilize Athena for advanced data analysis, querying, and validation.

- Monitor ETL process using CloudWatch events.

- Implement and manage highly scalable and resilient infrastructure using CloudFormation and Terraform.

- Collaborate closely with cross-functional teams, including data scientists, analysts, and developers, to drive data-driven initiatives.

- Communicate complex technical concepts and solutions effectively to both technical and non-technical Skills :

- Extensive AWS experience (5+ years relevant experience).

- Advanced Data Modeling expertise.

- Expert-level ETL development skills.

- Proficiency in Python (3+ years hands-on).

- Deep technical skills in AWS Glue (5+ years).

- Comprehensive knowledge of AWS Services (Lambda, S3, SNS, Secret Manager, Athena).

- Valid AWS Certification.

(ref:hirist.tech)

  • Gurgaon, Haryana, India Kaivale Technologies Full time

    Job DescriptionSenior AWS Data EngineerExperience: 9-12 years, Relevant with AWS: 5+ YearsLocations: Gurugram. Hybrid ModelNotice period: 0-60 daysMandatory skills: AWS, Data Modelling, ETL, Python, AWS Glue, AWS Services, Lambda, S3.Certified in AWS.------------------------------------------------Primary Responsibilities:Enhancements, new development,...

  • AWS Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India Infogain Full time

    AWS Data Engineer (Senior) with skills Data Engineering, Kafka, Python, Scala, postgreSQL Development, AWS - EKS, AWS - CloudFormation, Data Modeling, ETL, Apache Hive, AWS-Apps, AWS-Infra, Apache Airflow, SQL, Datadog, Splunk, Apache Spark, AWS DBA for location Gurugram, India Posted on: July 30, Share on Linkedin Share on Twitter Share on Facebook ...

  • AWS Data Engineer

    2 weeks ago


    Gurgaon, Haryana, India Tata Consultancy Services Full time

    Required Information Details Role** AWS Data Engineer Required Technical Skill Set** AWS Pyspark/ Python/Hive -Primary AWS Glue, Lambda, Athena-Secondary Desired Experience Range**5 to8 yrs Location of Requirement PAN India Good hands-on experience in Python programming and Pyspark/Scala Data Engineering experience using AWS core services (Lambda, Glue, EMR,...

  • AWS Data Engineer

    2 weeks ago


    Gurgaon, Haryana, India Tata Consultancy Services Full time

    Required InformationDetailsRole**AWS Data EngineerRequired Technical Skill Set**AWS Pyspark/ Python/Hive -PrimaryAWS Glue, Lambda, Athena-SecondaryDesired Experience Range**5 to8 yrsLocation of Requirement PAN IndiaGood hands-on experience in Python programming and Pyspark/ScalaData Engineering experience using AWS core services (Lambda, Glue, EMR, S3 and...

  • AWS Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India Infogain Full time

    AWS Data Engineer (Lead) with skills Data Engineering, Python, AWS - CloudFormation, Apache Hive, MySQL, SQL, Azure SQL DBA, Azure SQL Development, AWS DBA for location Gurugram, India Posted on: July 29, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Job Description Responsibilities Lead prototyping efforts...

  • Senior Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India Admin Looks Full time

    Urgently looking for the Senior Data Engineer for onsite at the location of GurgaonJob description:We are seeking a passionate, hands-on and experienced Senior Data Engineer to join our team. You will play a key role in implementing large scale Data platforms with our customers. The candidate will collaborate with internal and customer teams on multiple...

  • Senior Data Engineer

    2 weeks ago


    Gurgaon, Haryana, India Admin Looks Full time

    Job DescriptionUrgently looking for the Senior Data Engineer for onsite at the location of GurgaonJob description:We are seeking a passionate, hands-on and experienced Senior Data Engineer to join our team. You will play a key role in implementing large scale Data platforms with our customers. The candidate will collaborate with internal and customer teams...

  • Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India Gravity Infosolutions Full time

    Job Title: Senior Data Engineer (Contexa, AWS, Spark) Location : Gurugram, India (Hybrid – 3 days in office, 2 days WFH) Term : 12+ months Job Overview: We are seeking a Senior Data Engineer with expertise in VMware Contexa, Spark, AWS, and ETL for a high-impact role in the banking & finance sector . The ideal candidate will have strong experience in big...


  • Gurgaon, Haryana, India Incedo Inc. Full time

    Urgent opening for Senior Data Engineer with AWS @Incedo Technology Solutions Dear Candidate Greetings of the dayIncedo is a US-based consulting, data science and technology services firm with over 2,500 people helping clients from our six offices across US and India. We help our clients achieve competitive advantage through end-to-end digital...


  • Gurgaon, Haryana, India Incedo Inc. Full time

    Urgent opening for Senior Data Engineer with AWS @Incedo Technology Solutions Dear Candidate Greetings of the day Incedo is a US-based consulting, data science and technology services firm with over 2,500 people helping clients from our six offices across US and India . We help our clients achieve competitive advantage through end-to-end digital...


  • Gurgaon, Haryana, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doingRole - Data Engineer Snowflake + AWSYEO - 5-10 yearsLocation - Mumbai, Pune, Chennai, Bangalore, GurugramWe are looking for a talented Snowflake Data Engineer with expertise in DBT to join our dynamic data team. In this role, you will design, build, and maintain our data...


  • Gurgaon, Haryana, India Nexthire Full time

    ROLE-AWS Data EngineerEXP-3-5 YearsLOCATION-Preferably Chennai, or Gurgaon/ Bangalore/ Mumbai/ Kolkata, WFO 5 daysJob Overview:We are looking for an AWS Glue Consultant with 3-5 years of experience to join our Cloud Solutions team. The ideal candidate will be responsible for designing, developing, and optimizing data pipelines using AWS Glue, integrating...


  • Gurgaon, Haryana, India Thinkparms Infotech Pvt Ltd Full time

    Role SummaryWe are seeking an experienced Data Engineer II to join our McKinsey analytics platform team.Main ResponsibilitiesDevelop and maintain efficient ETL processes using AWS native services, ensuring seamless data extraction and processing.Collaborate with cross-functional teams to design and implement scalable data architectures for rapid ingestion...

  • AWS Data Scientist

    4 weeks ago


    Gurgaon, Haryana, India Appzlogic Full time

    Job DescriptionJDCandidates MUST be located in one of the following locations:Bangalore, Chennai, Gurgaon, Pune, or Mumbai.We are seeking a highly skilled and experienced Data Scientist for AWS to join our team and play a crucial role in designing and implementing data analytics solutions on the Amazon Web Services (AWS) platform. The ideal candidate will...


  • Gurgaon, Haryana, India AWS Proserve IN – Haryana Full time

    At AWS, we are looking for a Delivery Practice Manager with a successful record of leading enterprise customers through a variety of transformative projects involving IT Strategy, distributed architecture, and hybrid cloud operationsProfessional Services engage in a wide variety of projects for customers and partners, providing collective experience from...


  • Gurgaon, Haryana, India Incedo Inc. Full time

    Job Description:As a Senior Data Engineer at Incedo Inc., you will play a key role in designing and developing scalable data pipelines to store, manage, and retrieve structured and unstructured data using cloud services (AWS).You will collaborate with AI engineers to support model training and inference workflows and develop and maintain knowledge graphs and...

  • AWS Cloud Engineer

    2 weeks ago


    Gurgaon, Haryana, India Maxcurve Technologies Full time

    Job Description: We seek an experienced AWS Cloud Engineer to design, deploy, and optimize secure, scalable cloud infrastructure. You'll collaborate with cross-functional teams to build robust solutions aligned with business goals, focusing on automation, security, and performance. Location: Bengaluru / Chennai / Gurgoan Job Type: Full Time (Hybrid)...


  • Gurgaon, Haryana, India Admin Looks Full time

    Job Title: Senior Data EngineerWe are seeking a passionate and experienced Senior Data Engineer to join our team at Admin Looks. The ideal candidate will play a key role in implementing large scale data platforms on hyper scalers such as AWS/GCP/Azure, including data pipelines, data warehousing, and machine learning workflows.The successful candidate will...

  • AWS Cloud Engineer

    3 weeks ago


    Gurgaon, Haryana, India Maxcurve Technologies Full time

    Job Description: We seek an experienced AWS Cloud Engineer to design, deploy, and optimize secure, scalable cloud infrastructure. You'll collaborate with cross-functional teams to build robust solutions aligned with business goals, focusing on automation, security, and performance. Responsibilities Develop and implement applications using API Gateway,...

  • Senior Data Engineer

    4 weeks ago


    Gurgaon, Haryana, India Randstad Full time

    Sr Data Engineer / Data (Ops)Experience : 4-7 YearsJob Location : Gurgaon (Hybrid)Notice period : 60 Days MaxJob overview and responsibilities :- BS/BA, in computer science or related STEM field - 4+ years of IT experience in software development - 3+ years of development experience using Java, Python, Scala - 2+ years of experience with Big Data...