Lead data engineer
3 weeks ago
Job Title: Lead Data EngineerExperience: 8–10 YearsLocation: Remote ( 1 week from noida office then remote)Job Overview:We are looking for an accomplished Lead Data Engineer with 8–10 years of experience inarchitecting, building, and managing complex data ecosystems using Python, Databricks(Delta Lake, Spark, MLflow), and modern orchestration frameworks. The candidate shouldpossess strong leadership and technical acumen to drive data strategy, pipelineoptimization, and AI/ML workflow automation across large-scale projects.The role involves architecting scalable data solutions, ensuring data governance andcompliance (HIPAA, SOC 2, GDPR), and mentoring data engineering teams to deliver highperformance solutions in healthcare or life sciences domains.Key Responsibilities:Lead the architecture, design, and implementation of scalable and reliable datasolutions using Databricks, Delta Lake, and Spark.Oversee the development and optimization of ETL/ELT pipelines using Python andmodern orchestration tools (Airflow, Prefect, Dagster).Drive data platform modernization and migration to cloud-native architectures(AWS, Azure, or GCP).Collaborate with Data Scientists, Analysts, and Architects to enable advancedanalytics and ML model deployment using MLflow.Establish and enforce data engineering standards, best practices, and code reviewsacross teams.Ensure data governance, lineage, and compliance with regulatory frameworks(HIPAA, SOC 2, GDPR).Manage performance tuning, cost optimization, and scalability planning for dataworkflows.Mentor and guide junior data engineers, fostering a culture of technical excellence.Partner with stakeholders to align business objectives with data strategy and deliveryroadmap.Technical Skills Required:Languages: Python, SQL, Py SparkData Platforms: Databricks, Delta Lake, MLflow, Apache SparkWorkflow Orchestration: Airflow, Prefect, DagsterCloud Platforms: AWS, Azure, or GCP (with focus on data services)Data Architecture: Data Lakes, Warehouses, and Streaming ArchitecturesDev Ops & Version Control: Git, Jenkins, Terraform, CI/CD pipelinesGovernance & Security: HIPAA, SOC 2, GDPR compliance expertiseNice to Have: Knowledge of Kafka, dbt, and Infrastructure-as-Code (Ia C) toolsSoft Skills:Proven leadership and mentorship capabilitiesExcellent communication and client interaction skillsStrategic mindset with strong analytical and problem-solving abilityAbility to manage multiple projects and distributed teams in Agile environmentsEducation:Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related fieldChances of ClosureYes
-
Lead Data Engineer
3 hours ago
Chennai, Coimbatore, Kochi, India Anlage Infotech Full time ₹ 6,00,000 - ₹ 18,00,000 per yearRole & responsibilitiesMandate skills - Pyspark + Azure DataBricks + Azure Data FactoryExperience- 8+ yearsWe are looking for an experienced and hands-on Data Engineering Lead to guide and mentor a team of dataengineers in delivering scalable and reliable data solutions. This role demands strong technical expertise in AzureDatabricks, Azure Data Factory, and...
-
Data Engineering Lead
2 weeks ago
Kochi, India Velodata Global Pvt Ltd Full timeAbout the job :Location : Kochi / Bangalore (initially in Kochi)Role Summary :We are seeking a Data Engineering Lead to architect, build, and optimize scalable data pipelines and data platforms that power critical business decisions. The ideal candidate will have deep expertise in PySpark, ETL frameworks, SQL Stored Procedures, and Data Modeling, along with...
-
Lead Data Engineer
3 weeks ago
India, Cochin / Kochi / Ernakulam Velodata Global Pvt Ltd Full timeJob Description Job Title: Lead Data Engineer Location: Kochi / Trivandrum Experience: 10+ years Notice Period: Immediate to 15 days Budget: Up to 23 LPA Primary Skills - Core: AWS, Python Job Overview Seeking an experienced Senior/Lead Data Engineer to design and implement scalable data ingestion frameworks, ensure data quality and validation, and build...
-
Senior/Lead Data Engineer
3 weeks ago
Kochi, India Velodata Global Pvt Ltd Full timeJob Title : Lead Data EngineerLocation : Kochi / TrivandrumExperience : 10+ yearsNotice Period : Immediate to 15 daysPrimary Skills : AWS, PythonJob Overview :Seeking an experienced Senior/Lead Data Engineer to design and implement scalable data ingestion frameworks, ensure data quality and validation, and build robust APIs for seamless data integration. The...
-
Data Lead
2 days ago
Chennai, Coimbatore, Kochi, India Anlage Infotech Full time ₹ 8,00,000 - ₹ 24,00,000 per yearNotice Period-Immediate Joiner or Max 10 days (Do not share long notice period profile.)Permanent Payroll - Anlage InfotechClient - Orion InnovationLocation- Kochi - Chennai - Coimbatore - HYBRID (2/3 days in a week)Role & responsibilities -Key Responsibilities:Lead the design and implementation of robust data pipelines and architectures using Azure...
-
Senior Data Engineer
3 days ago
kochi, India Milestone Technologies, Inc. Full timeRole Overview:Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management.Core Responsibilities:· Build and manage high-volume data pipelines using...
-
Senior Data Engineer
4 weeks ago
Kochi, India Velodata Global Pvt Ltd Full timeAbout the job :Role : Lead/ Senior Data Engineer - AWS, Python, PysparkMandatory Skills : AWS, Python, PysparkNotice Period : Immediate to 15 daysExperience Range : 7+ YearsLocation : Kerala (Local candidates only Kochi/Trivandrum)Job Overview : We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework...
-
Data Engineer
3 days ago
Kochi, India Collabera Full timeData Engineer REMOTE, INDIA Day to day: As a Data Engineer, you will design, build, and maintain data products such as pipelines, models, APIs, and visualizations using best-in-class tools and DataOps practices. Your role involves creating scalable solutions that integrate machine learning and AI capabilities, implementing software engineering standards like...
-
Data Engineer
3 weeks ago
Kochi, India Exult Global Full timeRole: Data Engineer Experience: 3-5 yrsNotice Period: ImmediateWork Mode: HybridJob DescriptionRequirements:• Proficient in Python (Including popular python packages e.g. Pandas, NumPy etc.) and SQL• Strong background in distributed data processing and storage (e.g. Apache, Spark, Hadoop)• Large scale (TBs of data) data engineering skills - Model data,...
-
Data Engineer
4 weeks ago
Kochi, India Exult Global Full timeRole: Data Engineer Experience: 3-5 yrs Notice Period: Immediate Work Mode: Hybrid Job Description Requirements: • Proficient in Python (Including popular python packages e.g. Pandas, NumPy etc.) and SQL • Strong background in distributed data processing and storage (e.g. Apache, Spark, Hadoop) • Large scale (TBs of data) data engineering skills -...