Lead Data Engineer
7 days ago
Lead Data Engineer
Experience: 10+ Years
Location: Bangalore / Hyderabad / Noida
Mandatory Skills: Databricks, AWS, PySpark, Airflow
Role Overview
We are seeking a Lead Data Engineer to design, build, and maintain scalable data platforms and pipelines. This role requires strong hands-on expertise in cloud-based data engineering, distributed data processing, and workflow orchestration, along with the ability to guide teams and deliver high-quality data solutions in a fast-paced environment.
Core Responsibilities
- Design, develop, and manage scalable and reliable data pipelines using PySpark and Databricks.
- Build and maintain data orchestration workflows using Apache Airflow.
- Architect, implement, and optimize cloud-based data solutions on AWS.
- Work extensively with AWS services including S3, Glue, Redshift, EMR, Lambda, and IAM.
- Ensure high performance, reliability, and scalability of large-scale data processing systems.
- Perform data modeling, SQL optimization, and performance tuning.
- Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.
- Lead technical discussions, mentor junior engineers, and provide technical guidance.
- Implement best practices for data quality, security, and governance.
- Support CI/CD pipelines and follow version control best practices using Git and automated deployments.
- Contribute to containerized deployments using Docker/Kubernetes where applicable.
Skills & Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 4+ years of hands-on experience in Data Engineering.
- Strong expertise in PySpark, Databricks, and Apache Airflow.
- Solid hands-on experience with AWS cloud services.
- Strong proficiency in SQL and data performance tuning.
- Experience with CI/CD pipelines, version control (Git).
- Exposure to Docker and Kubernetes is an added advantage.
- Strong analytical, problem-solving, and communication skills.
- Ability to work effectively in a fast-paced, collaborative environment.
-
Data Engineering Subject Matter Expert
2 weeks ago
Bengaluru, Karnataka, India Data Engineer Academy Full time US$ 4,80,000 - US$ 12,00,000 per yearWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & DatabricksRemote | Part Time | Flexible Timings | Pay: $600 – $1000/MonthlyAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 9-15 years of experience in cloud...
-
Cloud/Snowflake Support Engineer
2 weeks ago
Bengaluru, Karnataka, India Data Engineer Academy Full time US$ 60,000 - US$ 1,20,000 per yearWe're Hiring:Cloud/Snowflake Support Engineer( SME Coach)Remote | Full Time | 7AM EST to 3PM EST| Pay: $ /MonthlyAbout the OpportunityThis role is a blend of a Subject Matter Expert (SME) and support engineer. The primary responsibility is to clear project issues for students while working on multiple projects involving AWS, Snowflake, and dbt. The engineer...
-
Lead Data Engineer
2 weeks ago
Bengaluru, Karnataka, India, Karnataka Dr. Martens plc Full timeSO, WHAT'S THE STORY? As a Lead Data Engineer, you will play a key role in the development and maintenance of the organization's data infrastructure. Working within a multi-disciplined team led by the Senior Manager - Data Engineer, you will focus on building and optimizing scalable data pipelines and supporting the delivery of high-quality, reliable data...
-
Lead Data Engineer
5 days ago
Bengaluru, Karnataka, India, Karnataka Movate Full timeJob title: Lead Data EngineerLocation: BangaloreExperience: 6+ YearsSummary: We are seeking an experienced Data Lead to own and drive the design, development, and optimization of modern data platform using Snowflake & DBT. The candidate needs to have hands-on expertise with Snowflake, DBT, and PySpark, combined with strong data architecture, team leadership,...
-
Lead Data Engineer
5 days ago
Bengaluru, Karnataka, India, Karnataka KPI Partners Full timeKPI Partners is seeking a highly skilled Lead Data Engineer with 6 to 8 years of experience to join our dynamic team. The ideal candidate will play a pivotal role in designing and implementing data solutions that meet our clients' needs, leveraging cutting-edge technologies.Key Responsibilities:Design, develop, and maintain ETL pipelines using Snowflake,...
-
Lead Data Engineer
2 weeks ago
Bengaluru, Karnataka, India, Karnataka SPIRO Full timePosition: Lead Data EngineerLocation: BengaluruExperience: 10+ yearsJob Summary:We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.Key...
-
Lead GCP Data Engineer
2 weeks ago
Bengaluru, Karnataka, India, Karnataka Impetus Full timeJob Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)Location: BengaluruExperience: 8+ years (data engineering / analytics engineering), with previous lead responsibilitiesAbout the Role:You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...
-
AWS Lead Data engineer
2 weeks ago
Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full timeJob Summary: In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the Data Engineering organisation to design and implement scalable data infrastructure and processes using...
-
Enterprise Data Architect
2 weeks ago
Bengaluru, Karnataka, India, Karnataka Aptus Data Labs Full timeEnterprise Data Architect – Job DescriptionLocation: Bangalore (Hybrid)Experience: 15+ years in Data Engineering & Data PlatformsEmployment Type: Full-time About Aptus Data LabsAptus Data Labs is a global Data Engineering and AI solutions partner helping enterprises build modern, scalable, and intelligence-driven organizations. With deep expertise across...
-
Data Delivery Lead
7 days ago
Bengaluru, Karnataka, India NTT DATA Full timeJob Duties: The Data Delivery Lead is responsible for overseeing the entire lifecycle of our data projects, from initial stakeholder engagement, through data collection and transformation to final delivery, ensuring accurate, timely, and compliant data and insight is provided to stakeholders while managing project timelines, risks, and dependencies across a...