Azure Databricks Lead
1 day ago
Description :
Key Responsibilities :
- Lead the design, development, and optimization of large-scale data solutions using Azure Databricks, Azure Data Factory (ADF), and Azure Synapse Analytics.
- Architect and implement efficient ETL/ELT pipelines for ingesting, transforming, and processing structured and unstructured data.
- Develop scalable data processing frameworks using PySpark and Python within the Azure ecosystem.
- Collaborate with data scientists, analysts, and business stakeholders to deliver reliable, high-performance data solutions.
- Ensure best practices in data governance, performance tuning, and cost optimization across Azure services.
- Mentor and guide junior engineers and drive technical excellence within the data team.
Technical Skills & Requirements:
- Primary Skills: Azure, Databricks, ADF, PySpark, Python
Experience :
1. 10 years in Data Warehousing and ETL development
2. 5 years of hands-on experience with Azure Databricks
3. Strong working knowledge of Azure Data Factory and Azure Synapse
4. Proven expertise in data architecture, pipeline orchestration, and performance optimization.
5. Solid understanding of CI/CD practices, version control (Git), and cloud-native deployment pipelines
-
Azure Databricks Engineer
24 hours ago
Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 5,00,000 - ₹ 20,00,000 per yearAzure Databricks: Hands-on experience working with Azure Databricks for building scalable ETL pipelines and integrating with Azure Data Lake Storage.ETL Development: Strong experience in building ETL pipelines to manage large-scale data flows and data integration.Data Lake Storage: Familiarity with Azure Data Lake Storage and its integration into the broader...
-
Azure Databricks Engineer
5 days ago
Chennai, Tamil Nadu, India Capgemini Full time ₹ 6,00,000 - ₹ 18,00,000 per yearChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...
-
Databrick
3 days ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data governance.Key...
-
Chennai, Tamil Nadu, India PSIOG DIGITAL PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per yearDescription : About Psiog : Psiog Digital is a pure play software services specialist focusing on delivering technology services & solutions in the areas of operational efficiency & customer experience. Headquartered in Chennai, India, Psiog services global customers in North America, EMEA, ANZ & APAC across a variety of industries such as...
-
Azure Databricks, Data Factory and SQL
3 days ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per yearSkill: DatabricksExperience: 6 to 13 yearsLocation: BhubaneswarJob descriptionResponsibilities:Designing, building, and deploying data pipelines and workflows using Databricks.Developing and optimizing Apache Spark applications for data processing and analytics.Integrating Databricks with various data sources and platforms.Implementing data quality checks...
-
Databricks Architect
3 days ago
Chennai, Tamil Nadu, India NotionMindz Technology LLP Full time ₹ 20,00,000 - ₹ 25,00,000 per yearRole:Databricks ArchitectDesignation:Data ArchitectExperience:7–10 yearsLocation:ChennaiAbout the role:We're looking for aDatabricks Architectto design, build, and optimize data pipelines and large-scale integrations for enterprise-grade data environments. The ideal candidate will bring strong experience inAzure Databricks, Data Factory, and SQL-based data...
-
Azure Databricks Python Developer
3 days ago
Chennai, Tamil Nadu, India Primoris Systems LLC Full time ₹ 15,00,000 - ₹ 25,00,000 per yearLocation: Chennai/HyderabadNotice Period: Immediate to 15 daysContract to Hire PositionWalk-in Drive, only 1 round interviewChennai Drive Date: 25th Sep 2026, 26th Sep 2025, 27th Sep 2025Hyderabad Drive Date: 26th Sep 2025, 27th Sep 2025RequiredOverall Experience should be 5+ YearsRelevant Experience should be 3+ YearsJob DescriptionDevelop and maintain data...
-
Azure Data Lead
2 weeks ago
Chennai, Tamil Nadu, India TVS Next Full time ₹ 12,00,000 - ₹ 24,00,000 per yearWhat you'll do:Lead the design, development, and maintenance of scalable data pipelines and lakehouse architectures using Azure Databricks (PySpark, SQL).Architect and implement Medallion Architecture (Bronze, Silver, Gold layers) to drive optimal data transformation and organization.Oversee data governance, access control, and lineage using Databricks Unity...
-
Databricks+Spark
3 days ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Title: - Databricks+SparkLocation: - KolkataMust Have SkillsMinimum 6 to 9 years of experienceHands on experience with Azure Databricks, Spark, Azure SQL DW/Synapse, and Azure functions.In-depth knowledge of relational database design, data warehousing and dimensional data modeling conceptsWorking experience with Python, Spark,.
-
Chennai, Tamil Nadu, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per yearExperience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key ResponsibilitiesDesign and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources.Optimize performance and scalability of data flows using tools like Apache Spark, Databricks, or AWS Glue.Collaborate with domain experts...