Azure Databricks Lead

1 day ago


Chennai, Tamil Nadu, India GIG Consultants Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Description :

Key Responsibilities :

- Lead the design, development, and optimization of large-scale data solutions using Azure Databricks, Azure Data Factory (ADF), and Azure Synapse Analytics.

- Architect and implement efficient ETL/ELT pipelines for ingesting, transforming, and processing structured and unstructured data.

- Develop scalable data processing frameworks using PySpark and Python within the Azure ecosystem.

- Collaborate with data scientists, analysts, and business stakeholders to deliver reliable, high-performance data solutions.

- Ensure best practices in data governance, performance tuning, and cost optimization across Azure services.

- Mentor and guide junior engineers and drive technical excellence within the data team.

Technical Skills & Requirements:

- Primary Skills: Azure, Databricks, ADF, PySpark, Python

Experience :

1. 10 years in Data Warehousing and ETL development

2. 5 years of hands-on experience with Azure Databricks

3. Strong working knowledge of Azure Data Factory and Azure Synapse

4. Proven expertise in data architecture, pipeline orchestration, and performance optimization.

5. Solid understanding of CI/CD practices, version control (Git), and cloud-native deployment pipelines



  • Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 5,00,000 - ₹ 20,00,000 per year

    Azure Databricks: Hands-on experience working with Azure Databricks for building scalable ETL pipelines and integrating with Azure Data Lake Storage.ETL Development: Strong experience in building ETL pipelines to manage large-scale data flows and data integration.Data Lake Storage: Familiarity with Azure Data Lake Storage and its integration into the broader...


  • Chennai, Tamil Nadu, India Capgemini Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Databrick

    3 days ago


    Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data governance.Key...


  • Chennai, Tamil Nadu, India PSIOG DIGITAL PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Description : About Psiog : Psiog Digital is a pure play software services specialist focusing on delivering technology services & solutions in the areas of operational efficiency & customer experience. Headquartered in Chennai, India, Psiog services global customers in North America, EMEA, ANZ & APAC across a variety of industries such as...


  • Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Skill: DatabricksExperience: 6 to 13 yearsLocation: BhubaneswarJob descriptionResponsibilities:Designing, building, and deploying data pipelines and workflows using Databricks.Developing and optimizing Apache Spark applications for data processing and analytics.Integrating Databricks with various data sources and platforms.Implementing data quality checks...


  • Chennai, Tamil Nadu, India NotionMindz Technology LLP Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role:Databricks ArchitectDesignation:Data ArchitectExperience:7–10 yearsLocation:ChennaiAbout the role:We're looking for aDatabricks Architectto design, build, and optimize data pipelines and large-scale integrations for enterprise-grade data environments. The ideal candidate will bring strong experience inAzure Databricks, Data Factory, and SQL-based data...


  • Chennai, Tamil Nadu, India Primoris Systems LLC Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Location: Chennai/HyderabadNotice Period: Immediate to 15 daysContract to Hire PositionWalk-in Drive, only 1 round interviewChennai Drive Date: 25th Sep 2026, 26th Sep 2025, 27th Sep 2025Hyderabad Drive Date: 26th Sep 2025, 27th Sep 2025RequiredOverall Experience should be 5+ YearsRelevant Experience should be 3+ YearsJob DescriptionDevelop and maintain data...

  • Azure Data Lead

    2 weeks ago


    Chennai, Tamil Nadu, India TVS Next Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    What you'll do:Lead the design, development, and maintenance of scalable data pipelines and lakehouse architectures using Azure Databricks (PySpark, SQL).Architect and implement Medallion Architecture (Bronze, Silver, Gold layers) to drive optimal data transformation and organization.Oversee data governance, access control, and lineage using Databricks Unity...

  • Databricks+Spark

    3 days ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: - Databricks+SparkLocation: - KolkataMust Have SkillsMinimum 6 to 9 years of experienceHands on experience with Azure Databricks, Spark, Azure SQL DW/Synapse, and Azure functions.In-depth knowledge of relational database design, data warehousing and dimensional data modeling conceptsWorking experience with Python, Spark,.


  • Chennai, Tamil Nadu, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key ResponsibilitiesDesign and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources.Optimize performance and scalability of data flows using tools like Apache Spark, Databricks, or AWS Glue.Collaborate with domain experts...