Lead Data Engineer

2 days ago

Kochi, India Staffington Consulting PVT Ltd Full time

We are seeking a highly skilled and experienced Lead Data Engineer to join our team.

The ideal candidate will be a hands-on expert in Microsoft Fabric and the broader Azure data stack, with a proven track record of designing, building, and managing robust data pipelines and analytics solutions.

This role requires a strong leader who can architect scalable data platforms and guide a team to deliver high-quality data products.


Key Responsibilities :


- Lead the design, development, and maintenance of scalable and reliable data pipelines using Microsoft Fabric and Azure Data Factory (ADF).

- Architect and manage a modern data platform, including data ingestion, transformation, and storage within a Data Lake and Lakehouse environment.

- Collaborate with data scientists, business analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.

- Ensure data quality, integrity, and security across the data platform.

- Develop and implement strategies for data governance and compliance.

- Optimize data processing jobs and data storage for performance and cost efficiency.

- Mentor junior data engineers, providing technical guidance and fostering a culture of best practices.

- Create and maintain comprehensive documentation for data pipelines and system architecture.


Technical Skills :


Mandatory Skills :


- Microsoft Fabric : 6 months to 2 years of hands-on, practical experience is highly mandatory.


Azure Stack :


- Expertise with Azure Data Factory (ADF) for ETL/ELT processes.

- Strong experience with Azure Data Lake Storage and its integration with other services.

- In-depth knowledge of Azure Lakehouse architecture and implementation.

- Proficiency with Power BI for data visualization and reporting.


Additional Skills :


- Strong programming skills in languages such as Python or Scala.

- Experience with other Azure services like Azure Databricks, Synapse Analytics, or Azure Functions.

- Knowledge of SQL and experience with various database systems (e.g., SQL Server, PostgreSQL, Cosmos DB).

- Familiarity with version control systems, especially Git.

- Understanding of data modeling, data warehousing, and distributed computing concepts.


Experience and Education :


Experience : A minimum of 8+ years of total experience in a data engineering role.

Education : Bachelor's degree in Computer Science, Information Technology, or a related field


(ref:hirist.tech)

  • Lead Data Engineer

    2 weeks ago

    Kochi, Thiruvananthapuram, India IBS Software Services Full time US$ 80,000 - US$ 1,50,000 per year

    Role & responsibilitiesYou will be working as a lead data engineer building data pipelines following data lake architecture oriented towards the data mesh framework.You will guide and work with a team of 3-5 experienced data engineers driving the business objectives.You will be doing ETL/ELTs primarily with python programming to expose the data which...

  • Lead Data Platform Engineer

    2 days ago

    Kochi, India Black Dog Labs Full time

    Position: Lead Data Platform EngineerLocation: Remote (collaboration across time zones), India or LATAM preferredEngagement Type: ContractLanguage: Fluent EnglishExperience: 9+ years in Data Engineering / Backend Engineering / DevOps, including leadership of a team (or end-to-end ownership of large, multi-stakeholder projects)About the RoleWe’re looking...

  • Lead Data Engineer

    2 days ago

    Kochi, India Velodata Global Pvt Ltd Full time

    About the job :Job Title : Lead Data Engineer (Python, SQL, AWS)Location : Kochi / Trivandrum / RemoteExperience : 7+ Years (Minimum 5+ years relevant experience)Notice Period : Immediate About the Role : Were looking for a Lead Data Engineer to join our dynamic data engineering team. This is a senior-level position that requires hands-on experience with...

  • Data engineer

    1 day ago

    Kochi, India Bahwan CyberTek Full time

    Job Title: Data Engineer – Google Cloud Platform (GCP) Job Summary We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data solutions on Google Cloud Platform. The ideal candidate will be proficient in GCP services like Pub/Sub, Dataflow, Cloud Storage, and Big Query, with a...

  • Senior Data Engineer

    2 days ago

    Kochi, India Velodata Global Pvt Ltd Full time

    Job Title : Senior Data EngineerLocation : Kochi / Trivandrum / BangaloreExperience : 5+ yearsNotice period : Immediate JoinersJob Summary : We are looking for an experienced Senior Data Engineer to join our team and lead the design, development, and deployment of enterprise data solutions. The ideal candidate is proficient in MS SQL, SSIS, Azure Data...

  • Lead Data Engineer

    1 week ago

    Kochi, Thiruvananthapuram, India Place Elements Hr Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Manadatory skills : Strong in MS SQL and SSIS , Data Lake, Azure SQL, SSIS, ADF , Lead experience , Good communicationNotice period : immediate - 20 days

  • Data Engineer

    2 days ago

    Kochi, India Exult Global Full time

    Role: Data Engineer Experience: 3-5 yrs Notice Period: Immediate Work Mode: Hybrid Job Description Requirements: • Proficient in Python (Including popular python packages e.g. Pandas, NumPy etc.) and SQL • Strong background in distributed data processing and storage (e.g. Apache, Spark, Hadoop) • Large scale (TBs of data) data...

  • Lead Data Engineer

    2 weeks ago

    Bengaluru, Kochi, Thiruvananthapuram, India Experion Full time US$ 1,00,000 - US$ 1,50,000 per year

    Role & responsibilitiesThe job duties and requirements are defined for the role of Informatica IICS data engineer.The senior role provides technical leadership and mentorship to junior team members.The candidate should have relevant experience working in at least 2 to 4 end to end project involving IICS.This position ensures the performance of all duties in...

  • Data Engineer

    2 days ago

    Kochi, India Exult Global Full time

    Role: Data EngineerExperience: 3-5 yrsNotice Period: ImmediateWork Mode: HybridJob DescriptionRequirements:• Proficient in Python (Including popular python packages e.g. Pandas, NumPy etc.) and SQL• Strong background in distributed data processing and storage (e.g. Apache, Spark, Hadoop)• Large scale (TBs of data) data engineering skills - Model data,...

  • Data Engineer

    2 days ago

    Kochi, India Exult Global Full time

    Role: Data EngineerExperience: 3-5 yrsNotice Period: ImmediateWork Mode: Hybrid Job DescriptionRequirements:• Proficient in Python (Including popular python packages e.g. Pandas, NumPy etc.) and SQL• Strong background in distributed data processing and storage (e.g. Apache, Spark, Hadoop)• Large scale (TBs of data) data engineering skills - Model data,...