Lead Data Engineer

5 days ago

Pune, Maharashtra, India Arting Digital Private Limited Full time ₹ 1,04,000 - ₹ 1,30,878 per year

Posting title: Lead Data Engineer (Databricks)

Experience: 7+ Years

Location: Pune/ Ahmedabad

Work mode: Hybrid

Primary skills: Databricks, Data Modelling/ Data Lakehouse, Gen AI, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue, Docker, Team Lead

Qualification: Any Technical Degree

Roles & Responsibilities:

Lead the design, development, and optimization of data solutions using Databricks, ensuring they are scalable, efficient, and secure.

Collaborate with cross-functional teams to gather and analyse data requirements, translating them into robust data architectures and solutions.

Develop and maintain ETL pipelines, leveraging Databricks and integrating with Azure Data Factory as needed.

Implement machine learning models and advanced analytics solutions, incorporating Generative AI to drive innovation.

Ensure data quality, governance, and security practices are adhered to, maintaining the integrity and reliability of data solutions.

Provide technical leadership and mentorship to junior engineers, fostering an environment of learning and growth.

- Stay updated on the latest trends and advancements in data engineering, Databricks, Generative AI, and Azure Data Factory to continually enhance team capabilities.

Required Qualifications:

Bachelor's or master's degree in computer science, Information Technology, or a related field.

7+ to 10 years of experience in data engineering, with a focus on Databricks.

Proven expertise in building and optimizing data solutions using Databricks and integrating with Azure Data Factory/AWS Glue.

Proficiency in SQL and programming languages such as Python or Scala.

Strong understanding of data modelling, ETL processes, and Data Warehousing/Data Lakehouse concepts.

Familiarity with cloud platforms, particularly Azure, and containerization technologies such as Docker.

Excellent analytical, problem-solving, and communication skills.

- Demonstrated leadership ability with experience mentoring and guiding junior team members.

Preferred Skills:

  • Experience with Generative AI technologies and their applications.
  • Familiarity with other cloud platforms, such as AWS or GCP.
  • Knowledge of data governance frameworks and tools.

  • Data Engineer

    2 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    7 days ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Data Engineering Lead

    2 weeks ago

    Pune, Maharashtra, India Ascentt Full time US$ 1,25,000 - US$ 1,75,000 per year

    Job Title: Data Engineering LeadJob Summary:We are seeking an experienced Data Engineering Lead to oversee and guide our organization's data engineering function. The ideal candidate will combine deep technical expertise in big data and data engineering with strong leadership skills to drive innovation, best practices, and excellence across our data...

  • Lead Data Engineer

    3 days ago

    Pune, Maharashtra, India North Hires Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Company DescriptionNorth Hires is a premier consulting firm specializing in Custom Software Development, Recruitment, Sourcing, and Executive Search services. Our mission is to empower businesses by providing them with the finest human capital. We strive to be the go-to consulting partner for companies seeking exceptional talent, fostering growth,...

  • Lead Data Engineer

    1 week ago

    Pune, Maharashtra, India Rearc Full time US$ 1,04,000 - US$ 1,30,878 per year

    About RearcFounded in 2016, we pride ourselves on fostering an environment where creativity flourishes, bureaucracy is non-existent, and individuals are encouraged to challenge the status quo. We're not just a company; we're a community of problem-solvers dedicated to improving the lives of fellow software engineers.Our commitment is simple - finding the...

  • Lead Software Engineer

    1 week ago

    Pune, Maharashtra, India Data Direct Networks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Overview This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...

  • 10/09/2025 Digital Engineering Lead Engineer

    6 days ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 277728NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Lead Engineer to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN Roles ...

  • Lead Software Engineer

    1 week ago

    Pune, Maharashtra, India Data Direct Networks Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    OverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...

  • Data Operations Engineer

    1 week ago

    Pune, Maharashtra, India Mars Data Insights Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...

  • Data Engineering Lead

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineering Full time US$ 1,30,000 - US$ 1,70,000

    Job Title: Data Engineering LeadWe are seeking a highly skilled and experienced data engineering lead to design, implement, and manage large-scale data solutions using Azure technologies. The ideal candidate will have a proven track record of designing, implementing, and managing complex system integration processes focused primarily on the use of Azure SQL,...