Lead Data Engineer

5 days ago

Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Primary Job Title:
Data Engineering Lead

About The Opportunity
We are seeking a highly skilled
Lead Data Engineer
with strong expertise in
Python, Pandas, PySpark, AWS, and SQL
to design, build, and manage scalable data solutions. The ideal candidate will lead a team of data engineers, develop robust ETL pipelines, and collaborate with analytics, data science, and business teams to ensure high data quality and performance across cloud-based environments.

Role & Responsibilities

  • Lead the design and development of data pipelines for ingestion, transformation, and integration from multiple sources into the enterprise data platform.
  • Implement data quality frameworks, validation checks, and monitoring solutions using Python and SQL.
  • Optimize PySpark jobs for performance and scalability in a distributed computing environment (AWS EMR/Glue).
  • Develop reusable ETL frameworks using PySpark and Pandas for data transformation and analytics.
  • Manage and maintain cloud-based infrastructure and data storage (AWS S3, Redshift, Lambda, Glue, Athena).
  • Collaborate with data scientists, analysts, and stakeholders to provide clean, structured, and accessible datasets.
  • Oversee code reviews, performance tuning, and mentoring junior data engineers.
  • Establish best practices for data governance, version control, and CI/CD integration.
  • Troubleshoot production data issues and ensure system reliability, availability, and efficiency.

Must-Have Skills

  • Programming: Python (advanced scripting, Pandas, PySpark)
  • Cloud: AWS (S3, Glue, Lambda, Redshift, Athena, EMR)
  • Database / Querying: Advanced SQL (Joins, Window Functions, Query Optimization)
  • Big Data Tools: PySpark, Spark SQL
  • ETL Development: Data ingestion, transformation, and validation pipelines
  • Version Control: Git / GitHub / Bitbucket
  • Workflow Orchestration: Apache Airflow or equivalent (preferred)

Good-to-Have Skills

  • Experience with Docker or Kubernetes for containerization.
  • Familiarity with CI/CD pipelines and DevOps practices.
  • Exposure to data modeling, schema design, and partitioning strategies.
  • Understanding of data lake and data warehouse architecture.
  • Knowledge of monitoring tools (CloudWatch, Datadog, or Prometheus).

Qualifications

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • 11–16 years of total experience with at least 3–4 years leading data engineering projects.
  • Proven track record in handling large-scale data pipelines and cloud migrations.

Skills: python,aws,sql,pyspark

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Sr Operations Data Lead

    3 days ago

    Hyderabad, Telangana, India Data Unveil Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    JOB DESCRIPTION:Position Title: Sr Operations Data LeadExperience:4 Years to 6 YearsLocation:Hyderabad, TelanganaHire Type:Full Time, On-siteStart Date:ImmediateOverview:The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery...

  • PeopleSoft To Workday Data Conversion Technical Lead

    1 week ago

    Hyderabad, Telangana, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job summaryThe PeopleSoft to Workday Data Conversion Technical Lead will be responsible for the technical design, development, and execution of the data migration from PeopleSoft to Workday. This hands-on role requires deep technical expertise in both PeopleSoft and Workday data structures and tools.The lead will manage the technical conversion team,...

  • Lead Data Engineer

    3 days ago

    Hyderabad, Telangana, India Argano Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description JOB TITLE: Lead Data EngineerJOB SUMMARY:A Lead Data Engineer at Argano is key player in shaping the data engineering strategy and implementing the most complex and leading data solutions. They inform the build-out of information systems to collect, manage, and convert raw data into actionable intelligence for risk analysts and technology...

  • Lead Data Engineer

    3 days ago

    Hyderabad, Telangana, India Argano Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    JOB TITLE: Lead Data Engineer JOB SUMMARY: A Lead Data Engineer at Argano is key player in shaping the data engineering strategy and implementing the most complex and leading data solutions. They inform the build-out of information systems to collect, manage, and convert raw data into actionable intelligence for risk analysts and technology stakeholders....

  • Data Engineer Lead

    1 week ago

    Hyderabad, Telangana, India 6de69dcd-810e-48f0-b2ca-7f2997d6762e Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionCYTEL STATISTICAL SOFTWARE & SERVICES PRIVATE LIMITED is a professional organization based in Pune, Maharashtra, India. Operating out of the "Lohia-Jain IT Park" in Kothrud, the company is dedicated to providing innovative solutions in the statistical software and services domain. Known for its expertise and commitment to excellence, the...

  • Lead Data Engineer

    1 week ago

    Hyderabad, Telangana, India Proclink Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    DescriptionProclink is looking for Data Engineer Lead.Experience :9+ years.Location :Hyderabad.Position OverviewWe are seeking an experienced Data Engineer with over 10 years of experience in designing, developing, and optimizing enterprise-scale data solutions.The ideal candidate will lead our data engineering strategy, architect cloud-based data platforms,...

  • Data Engineer Lead

    2 weeks ago

    Hyderabad, Telangana, India Proclink Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Proclinkis looking forData Engineer LeadExperience -9+ yearsLocation- HyderabadPosition OverviewWe are seeking an experiencedData Engineerwith over 10 years of experience in designing, developing, and optimizing enterprise-scale data solutions. The ideal candidate will lead our data engineering strategy, architect cloud-based data platforms, and mentor...

  • Lead Data Engineer

    3 days ago

    Hyderabad, Telangana, India c117953c-c4fb-48c5-aabe-fdde07f38d5d Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    JOB TITLE: Lead Data EngineerJOB SUMMARY:A Lead Data Engineer at Argano is key player in shaping the data engineering strategy and implementing the most complex and leading data solutions. They inform the build-out of information systems to collect, manage, and convert raw data into actionable intelligence for risk analysts and technology stakeholders. They...

  • Lead Data Engineer

    4 days ago

    Hyderabad, Telangana, India SourcingXPress Full time ₹ 2,50,00,000 - ₹ 3,00,00,000 per year

    Company:KanerikaWebsite:Visit WebsiteBusiness Type:StartupCompany Type:Product & ServiceBusiness Model:B2BFunding Stage:Pre-seedIndustry:Data and AISalary Range:₹ 25-30 Lacs PAJob DescriptionLead Data Engineer (Architect):We're looking for an experiencedData Engineering Lead/Architectto design, build, and scale modern, cloud-based data ecosystems that...