Lead Data Engineer

3 days ago

Hyderabad, Telangana, India EverestDX Full time ₹ 12,00,000 - ₹ 30,00,000 per year

Description :

We are seeking a highly skilled Lead Data Engineer to design, build, and scale robust data platforms and pipelines that empower business decisions and analytics.

This role combines deep technical expertise with strategic leadership, guiding a team of data engineers to deliver scalable, reliable, and high-performing data solutions.

The ideal candidate will have strong experience in cloud data ecosystems, data modeling, data quality frameworks, and cross-functional collaboration.

Key Responsibilities :

Data Architecture & Engineering :

- Design and implement scalable, high-performance data pipelines for ingestion, transformation, and processing of structured and unstructured data.

- Architect data lake, data warehouse, and real-time streaming solutions using modern cloud platforms (AWS, Azure, or GCP).

- Develop and maintain ETL/ELT processes ensuring data accuracy, consistency, and integrity across systems.

- Build and optimize data models (OLAP and OLTP) to support business intelligence, analytics, and reporting.

- Evaluate and integrate new data management tools and frameworks to enhance data engineering capabilities.

Leadership & Collaboration :

- Lead a team of data engineers mentor, review code, and enforce engineering best practices.

- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.

- Establish and enforce data governance, quality, and security standards in alignment with enterprise policies.

- Partner with DevOps teams to ensure CI/CD automation, testing, and deployment of data pipelines.

Performance & Optimization :

- Monitor data pipeline performance and proactively resolve bottlenecks or failures.

- Optimize data workflows for cost efficiency, scalability, and processing speed.

- Drive adoption of observability and monitoring frameworks (e.g., Datadog, Prometheus, or custom dashboards).

Required Skills & Experience :

- 8 years of professional experience in data engineering, with at least 23 years in a lead or senior capacity.

- Strong proficiency in Python, SQL, and one or more data pipeline orchestration tools (Airflow, Dagster, Prefect, etc.).

- Deep understanding of data warehousing concepts (e.g., Snowflake, Redshift, BigQuery, Synapse).

- Experience with streaming technologies such as Kafka, Spark Streaming, or Flink.

- Hands-on experience with cloud platforms (AWS, Azure, or GCP) particularly data services like S3, Glue, Dataflow, or Databricks.

- Expertise in schema design, data modeling, and performance tuning.

- Familiarity with containerization and orchestration tools (Docker, Kubernetes).

- Strong understanding of CI/CD principles, version control (Git), and infrastructure-as-code (Terraform, CloudFormation).

- Knowledge of data security, encryption, and compliance frameworks (GDPR, SOC 2).

Preferred Qualifications :

- Experience leading large-scale data platform modernization or migration projects.

- Exposure to machine learning pipeline orchestration and MLOps.

- Certification in cloud data engineering (AWS Certified Data Analytics, GCP Data Engineer, etc.).

- Familiarity with modern data stack tools (dbt, Fivetran, Looker, Power BI).

- Strong communication skills and ability to collaborate in cross-functional agile environments

  • Azure Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • PeopleSoft to Workday Data Conversion Technical Lead

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job summary The PeopleSoft to Workday Data Conversion Technical Lead will be responsible for the technical design, development, and execution of the data migration from PeopleSoft to Workday. This hands-on role requires deep technical expertise in both PeopleSoft and Workday data structures and tools. The lead will manage the technical conversion team,...

  • Data Delivery Lead

    7 days ago

    Hyderabad, Telangana, India Data Unveil Full time

    Description : About us : Data Unveil is the next generation provider of best-in-class data aggregation services. Our solutions and methodologies have been honed over the past 10 years by experienced practitioners who have collectively supported 100 brands, 100 data partners and 25 new drug launches. Our integrated capabilities create a...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Azure Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Azure Data Engineer

    22 hours ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Senior Data Engineer

    6 days ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Lead Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Primary Job Title:Data Engineering LeadAbout The OpportunityWe are seeking a highly skilledLead Data Engineerwith strong expertise inPython, Pandas, PySpark, AWS, and SQLto design, build, and manage scalable data solutions. The ideal candidate will lead a team of data engineers, develop robust ETL pipelines, and collaborate with analytics, data science, and...

  • Senior Data Engineer

    7 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Data Conversion Technical Lead

    1 week ago

    Hyderabad, Telangana, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    PeopleSoft to Workday Data Conversion Technical Lead Job summary The PeopleSoft to Workday Data Conversion Technical Lead will be responsible for the technical design, development, and execution of the data migration from PeopleSoft to Workday. This hands-on role requires deep technical expertise in both PeopleSoft and Workday data structures and tools....