Data Engineer

7 days ago

Gurgaon, Haryana, India Weekday AI Full time ₹ 8,00,000 - ₹ 24,00,000 per year

This role is for one of Weekday's clients

Min Experience: 5 years

Location: Gurgaon, Gurugram

JobType: full-time

Requirements

We are seeking an experienced Data Engineer with strong expertise in AWS, Databricks, PySpark, and SQL to design, develop, and optimize scalable data pipelines. The ideal candidate will have a deep understanding of modern data architectures, ETL frameworks, and cloud-based data ecosystems. You will work closely with data scientists, analysts, and business stakeholders to ensure reliable, high-quality, and timely data delivery that powers key business decisions and analytics initiatives.

This role requires both hands-on technical capability and strategic thinking, as you'll contribute to building robust data foundations and scalable data platforms.

Key Responsibilities

  • Data Pipeline Development:

  • Design, build, and maintain scalable ETL/ELT pipelines for both batch and streaming data processing using PySpark and Databricks.

  • Optimize and automate data workflows to ensure efficient and reliable data movement across systems.

  • Develop end-to-end data integration solutions from diverse data sources to centralized data lakes and warehouses.

  • Cloud Data Engineering (AWS):

  • Work extensively with AWS data services such as S3, Glue, Kinesis, and Redshift to design and manage modern data architectures.

  • Implement data lake and data warehouse solutions ensuring scalability, security, and performance.

  • Build workflow orchestration using Airflow, AWS Step Functions, or similar tools for automation and scheduling.

  • Data Modeling & Optimization:

  • Develop and optimize SQL queries for performance, scalability, and data quality.

  • Design data models and schemas to support analytical workloads and reporting.

  • Ensure data accuracy, consistency, and lineage through validation and quality checks.

  • Collaboration & Cross-Functional Support:

  • Work closely with data scientists, analysts, and product teams to understand data requirements and deliver relevant datasets for analytics and machine learning use cases.

  • Partner with platform and DevOps teams to ensure smooth data pipeline deployment and monitoring.

  • Translate complex technical concepts into business-friendly insights and documentation.

  • Data Governance & Security:

  • Implement data management best practices, including metadata management, access controls, and compliance with data governance standards.

  • Ensure adherence to security and privacy guidelines across all data solutions.
Key Skills and Qualifications
  • 5+ years of professional experience as a Data Engineer or similar role in a cloud-based environment.
  • Expertise in PySpark for distributed data processing and transformation.
  • Advanced proficiency in SQL—query optimization, performance tuning, and large-scale data manipulation.
  • Hands-on experience with Databricks for collaborative data development and pipeline orchestration.
  • Strong understanding of AWS Data Stack, including S3, Glue, Kinesis, Lambda, and Redshift.
  • Experience in building and maintaining data lakes and data pipelines (batch and streaming).
  • Proficiency in workflow orchestration tools such as Airflow or AWS Step Functions.
  • Familiarity with data versioning, CI/CD pipelines, and infrastructure-as-code (IaC) is a plus.
  • Strong problem-solving skills, attention to detail, and ability to work in fast-paced, agile environments.

  • Senior/Lead Data Engineer

    6 days ago

    Gurgaon, Haryana, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Lead Data EngineerAbout The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...

  • Data Engineer Advisor

    6 days ago

    Gurgaon, Haryana, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    We are currently seeking a Data Engineer Advisor to join our team in Gurgaon, Haryna (IN-HR), India (IN).Technical Support:Provide L1, L2 and L3 support for software applications. Troubleshoot and resolve application-related issues for end-users. Collaborate with developers, IT teams, and external vendors to address issues and implement fixes.Escalate...

  • Data Engineer Advisor

    2 weeks ago

    Gurgaon, Haryana, India NTT DATA Global Delivery Services Ltd Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Data Engineer Advisor Req ID: 338198 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Advisor to join our team in Gurgaon, Haryāna (IN-HR), India (IN). ...

  • Senior Tableau Data Consultant

    1 week ago

    Gurgaon, Haryana, India Eucloid Data Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    We are looking for a high-energy individual for the role of Data Consultant – Tableau Expert at Eucloid. The candidate will collaborate with client stakeholders on multiple projects, primarily focusing on building impactful visualizations and dashboards that drive business decisions.The candidate is expected to lead the following work-streams: Partner...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India AuxoAI Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Role SummaryAuxoAI is seeking a skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have 7-10 years of prior experience in data engineering, with a strong background in Databricks. This role offers an exciting opportunity to work on diverse projects, collaborating with cross-functional teams to design, build, and optimize...

  • Data Engineer

    6 days ago

    Gurgaon, Haryana, India Strategic Talent Partner Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role: Data Engineer for financial datasets in a quant research & trading environment.Key Responsibilities:Build Python-driven data ingestion pipelines from market & internal sources.Ensure data quality with automated validation & anomaly detection.Manage data vendors, optimize costs, & expand data pipeline.Collaborate with quants & engineers for seamless...

  • Data Engineer

    5 days ago

    Gurgaon, Haryana, India NatWest Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Data Engineer, VP Join us as a Data EngineerYou'll be the voice of our customers, using data to tell their stories and put them at the heart of all decision-making We'll look to you to drive the build of effortless, digital first customer experiences If you're ready for a new challenge and want to make a far-reaching impact through your work, this...

  • Data Engineer

    7 days ago

    Gurgaon, Haryana, India NatWest Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Data Engineer, VP Join us as a Data EngineerYou'll be the voice of our customers, using data to tell their stories and put them at the heart of all decision-making We'll look to you to drive the build of effortless, digital first customer experiences If you're ready for a new challenge and want to make a far-reaching impact through your work, this...

  • Data Engineer

    3 days ago

    Gurgaon, Haryana, India NatWest Group Full time US$ 1,50,000 - US$ 2,00,000 per year

    Join us as a Data Engineering LeadThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank through developing innovative data driven solutions, inspiring to be commercially successful through insight, and keeping our customers' and the...

  • Data Engineer

    5 days ago

    Gurgaon, Haryana, India NatWest Group Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Data Engineer Join us as a Data EngineerThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences You'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the...