Data Engineering Lead

1 month ago

India Knack Consulting Services Pvt Ltd. Full time

At Knack Consulting Services Pvt. Ltd., we're looking for a skilled Data Engineering Lead to join our team in Gurugram.

As a seasoned professional with 6+ years of experience, you'll be responsible for designing and implementing data pipelines using Azure Databricks, Azure Synapse, and Azure Data Factory.

We estimate the salary for this position to be around ₹1,200,000 - ₹1,800,000 per year, based on industry standards and the location.

About the Role

The ideal candidate will have hands-on experience with programming languages such as Python and SQL, as well as knowledge of data warehousing, business intelligence, and ETL/ELT data processing issues.

You'll be working closely with our team to ensure that data is modelled and processed according to architecture and requirements, both functional and non-functional.

A key aspect of this role is delivering right solution architecture, automation, and technology choices, while working cross-functionally with enterprise architects, information security teams, and platform teams.

Responsibilities include:

  • Designing and implementing ETL/ELT processes in different tools (ADF, Databricks Workflows)
  • Experience working with Databricks platform: workspace, delta lake, workflows, jobs, Unity Catalog
  • Understanding of SQL and relational databases
  • Practical knowledge of various relational and non-relational database engines in the cloud (Azure SQL Database, Azure Cosmos DB, Microsoft Fabric, Databricks)
  • Hands-on experience with data services offered by Azure cloud
  • Knowledge of Apache Spark (Databricks, Azure Synapse Spark Pools)
Requirements

To be successful in this role, you'll need:

  • 6+ years of experience in data engineering
  • Hands-on experience with programming languages such as Python and SQL
  • Knowledge of data warehousing, business intelligence, and ETL/ELT data processing issues
  • Ability to create and orchestrate ETL/ELT processes in different tools
  • Experience working with Databricks platform
  • Understanding of SQL and relational databases
  • Practical knowledge of various relational and non-relational database engines in the cloud
About Us

Knack Consulting Services Pvt. Ltd. is a cohesive Human Resource Solutions organization with its head office in New Delhi, India.

We look beyond the formula of merely supplying resumes or placing people and work on the dynamics of scouting the right talent for the right positions.

  • Data engineer

    4 weeks ago

    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on...

  • Data Engineer

    1 month ago

    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on...

  • Data Engineer

    1 month ago

    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...

  • Data Engineer

    1 month ago

    India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in...

  • Pyspark data engineer

    4 weeks ago

    India ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are...

  • Senior data engineer

    4 days ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Senior Data Engineer with over 5 years of expertise in data engineering. As a Senior Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...

  • ITI Data | PySpark Data Engineer

    1 month ago

    india ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...

  • ITI Data | PySpark Data Engineer

    1 month ago

    india ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...

  • Lead Masters AI | Software Engineer Intern

    3 days ago

    india Lead Masters AI Full time

    Company Description LeadMasters.ai is an AI-driven lead generation and ad optimization platform aimed at helping businesses maximize their marketing potential through data-driven strategies. Our platform analyzes top-performing ads on various social media platforms using advanced AI algorithms to provide actionable insights and automated ad template...

  • Lead Masters AI | Software Engineer Intern

    3 days ago

    india Lead Masters AI Full time

    Company Description LeadMasters.ai is an AI-driven lead generation and ad optimization platform aimed at helping businesses maximize their marketing potential through data-driven strategies. Our platform analyzes top-performing ads on various social media platforms using advanced AI algorithms to provide actionable insights and automated ad template...

  • Senior Data Engineer

    5 days ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Senior Data Engineer with over 5 years of expertise in data engineering. As a Senior Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...

  • Senior Data Engineer

    6 days ago

    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Senior Data Engineer with over 5 years of expertise in data engineering.As a Senior Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for success.Key...

  • Senior Data Engineer

    5 days ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Senior Data Engineer with over 5 years of expertise in data engineering. As a Senior Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for success. ...

  • PySpark Data Engineer

    1 month ago

    India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...

  • PySpark Data Engineer

    1 month ago

    India ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...

  • Data Engineering Lead

    2 months ago

    India Welspun Transformation Services Limited Full time

    As a Data Engineering Lead, you will be responsible for managing and leading the data engineering team in our IT department. You will play a crucial role in designing, building, and maintaining our data infrastructure, data processing systems, and data pipelines. You will also be responsible for implementing data visualization tools and techniques to help...

  • Data Platform Engineer

    1 month ago

    India OSD Data Services Full time

    Data Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...

  • Data Platform Engineer

    1 month ago

    India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Lead data engineer

    2 weeks ago

    India Enterprise Minds, Inc Full time

    Job Opening: Data Engineer (7-10 Years Experience) Are you a passionate Data Engineer looking to work in a dynamic and challenging environment? Job Title: Data Engineer Lead – Expertise in either* of (Azure, AWS, or Google Cloud) Job Location: USA Experience: 7-10 years of experience Qualifications: Bachelor's in engineering (preferably...

  • Leading Data Architect for Scalable Solutions

    6 days ago

    India Wavicle Data Solutions Full time

    Job OverviewWe are seeking a highly skilled Senior Data Engineer with extensive experience in data engineering to join Wavicle Data Solutions. As a key member of our team, you will play a pivotal role in architecting and implementing scalable data solutions using cutting-edge technologies.