Data Engineering Lead

1 day ago

Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

About the job :

Location : Kochi / Bangalore (initially in Kochi)

Role Summary :

We are seeking a Data Engineering Lead to architect, build, and optimize scalable data pipelines and data platforms that power critical business decisions. The ideal candidate will have deep expertise in PySpark, ETL frameworks, SQL Stored Procedures, and Data Modeling, along with a strong focus on performance tuning across large datasets.

Key Responsibilities :

- Lead the design and development of scalable data pipelines and ETL workflows using PySpark and SQL

- Develop and maintain Stored Procedures to support batch processes and data transformations

- Design and implement robust data models (Star, Snowflake, and normalized models) across data warehouse and lake environments

- Work closely with BI, Analytics, and Product teams to understand data requirements and ensure data quality, lineage, and integrity

- Optimize data workflows for performance, cost, and scalability across distributed systems

- Manage data ingestion from structured and semi-structured sources (e.g., APIs, files, databases, streams)

- Support CI/CD and DevOps practices for data pipeline deployments

- Collaborate with cross-functional teams on data governance, access controls, and compliance

- Guide and mentor junior data engineers; perform code reviews and technical planning

Required Skills & Experience :

- 5 years of experience in data engineering and data platform development

- Experience with Azure ADlS Synapse or Microsoft Fabric

- Expert in PySpark / Spark SQL for large-scale distributed data processing

- Solid understanding of ETL/ELT architectures, data ingestion, and transformation strategies

- Experience in data modeling techniques and tools

- Proven experience in performance tuning of queries, jobs, and pipelines

- Experience with tools like Airflow or equivalent for orchestration and transformations

- Hands-on experience with version control, CI/CD, and data testing frameworks

Nice To Have :

- Exposure to Data Virtualization platforms (Denodo, Dremio, etc.)

- Exposure to Purview or any Data Governance tools.

  • Lead Data Engineer

    2 weeks ago

    Cochin, Kerala, India Careersteer services private limited Full time ₹ 10,00,000 - ₹ 23,00,000 per year

    We are seeking a highly skilled Lead Data Engineer with strong hands-on experience in AWS, Python, and PySpark. The ideal candidate will design, develop, and manage scalable data pipelines and architectures, lead a team of data engineers, and ensure data availability, reliability, and performance to support analytics, reporting, and business intelligence...

  • Lead Data Engineer(AWS)

    3 days ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 15,00,000 - ₹ 23,00,000 per year

    Job Title: Lead Data Engineer – AWS, Python, PySparkLocation: Kochi/ThiruvananthapuramExperience: 7+ YearsBudget: Up to 23 LPANotice Period: Immediate to 15 daysJob OverviewWe are seeking an experienced Lead Data Engineer to design and manage a scalable data ingestion framework with strong focus on data quality, validation, and API development. The ideal...

  • Lead Data Engineer

    1 day ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job OverviewWe are seeking an experienced Senior Data Engineer to lead the development of a scalable dataingestion framework while ensuring high data quality and validation. The successful candidatewill also be responsible for designing and implementing robust APIs for seamless dataintegration. This role is ideal for someone with deep expertise in building...

  • Lead Data Engineer

    3 days ago

    Cochin, Kerala, India A2Z Hire Full time ₹ 20,00,000 - ₹ 23,00,000 per year

    Job OverviewWe are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for someone with deep expertise in...

  • Lead Data Analyst

    3 days ago

    Cochin, Kerala, India Difinity Digital Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are seeking an experienced and strategicLead Data Analystto join our growing data analytics team. The ideal candidate will have over 5 years of experience in data analytics and business intelligence, with deep expertise inPower BIand a strong understanding of data modeling, DAX, and storytelling through data.This role will involve leading data...

  • Lead Data Architect

    1 week ago

    Cochin, Kerala, India Tamcherry Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description: Data and AI Lead ArchitectWe are seeking an experienced Data and AI Lead Architect with 12–15 years of expertise in large-scale data and cloud architecture, particularly on AWS or Google Cloud, who has successfully supported enterprise customers across the US and UK/Europe. The ideal candidate will be based in Kochi (Kerala in general) or...

  • Senior Data Engineer

    1 week ago

    Cochin, Kerala, India Experion Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Location: KochiRemoteTrivandrumExperience5+ YearsJob PurposeWe are seeking an experienced Senior Big Data Engineer to take a leading role in designing, building, and managing the data driven apps for one of our customers. You will be responsible for understanding evolving customer needs and translating them into robust, scalable, and cost-effective data...

  • Senior Data Engineer

    3 days ago

    Cochin, Kerala, India Milestone Technologies, Inc. Full time

    Role Overview:Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management.Core Responsibilities:· Build and manage high-volume data pipelines using...

  • Data Engineer

    1 week ago

    Cochin, Kerala, India NOV Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    This role is part of the Digital Technology Services team at NOV. As a Data Engineer, you'll support data and analytics initiatives by helping to build and maintain data pipelines, data infrastructure, and operationalize analytics applications. You'll have the opportunity to learn a wide variety of technologies and work closely with experienced engineers,...

  • Data Engineer

    5 days ago

    Cochin, Kerala, India VGreen Technology Solutions (VGreenTEK) Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Role: Data EngineerExperience: 4 to 5yearsJob Location: Kochi, KeralaJob Type: Full-time, PermanentNotice: Immediate/15 days or currently serving (LWD within 30 days)Candidates from Kerala are the first priority.We are seeking an experienced and driven Data Engineer with 4-5 years of hands-on experience in building scalable data infrastructure and...