Databricks-PySpark
2 weeks ago
We are looking for a Senior Data Engineer with 6+ years of experience to design, build, and optimize scalable data solutions. The ideal candidate will have deep expertise in Databricks, Azure, Python, PySpark, Scala, ETL, and data governance. You will lead the development of efficient data pipelines and mentor junior engineers, ensuring operational excellence across data systems.
Key Responsibilities:
- Data Pipeline Development:
Design and implement batch and real-time ETL pipelines using Databricks, Azure Synapse, ADF, and other data platforms, working with both structured and unstructured data. - Leadership & Mentorship:
Advise and mentor teams on best practices for scalable data architectures, code quality, and CI/CD integration. Lead code and design reviews. - Advanced SQL & Platform Expertise:
Develop advanced SQL queries, stored procedures, and optimize Synapse and SQL Server environments for performance and scalability. - Collaboration & Problem Solving:
Partner with business analysts and solutions architects to deliver data solutions that align with business goals. Conduct root cause analysis to resolve data issues and improve processes. - Best Practices:
Ensure adherence to data governance standards, dimensional modeling, and efficient data warehousing practices. - Optional (Preferred):
Experience with Boomi for data integration.
-
Azure Databricks with Pyspark
2 weeks ago
Bengaluru, Karnataka, India BirlaSoft Full timeCountry/Region: IN - Requisition ID: 25277 - Work Model: - Position Type: - Salary Range: - Location: INDIA - BENGALURU - HP **Title**:Azure Databricks with Pyspark**: - Description: **Area(s) of responsibility**: Birlasoft, a global leader at the forefront of Cloud, AI, and Digital technologies, seamlessly blends domain expertise with enterprise...
-
Python, Pyspark Developer with Databricks
2 weeks ago
Pune, India InfoBeans Full timeJob title : Python, Pyspark Developer with DatabricksSkills : Python, Pyspark, Databricks, SQL, AzureExperience Required : 8-10Location : Indore, PuneNotice Period : Immediate to 15 days, Serving noticeOverview:We are seeking a highly skilled Python and PySpark Developer who is passionate about building robust data solutions from the ground up. The ideal...
-
Python, Pyspark Developer with Databricks
2 weeks ago
Pune, India InfoBeans Full timeJob title : Python, Pyspark Developer with DatabricksSkills : Python, Pyspark, Databricks, SQL, AzureExperience Required : 8-10Location : Indore, PuneNotice Period : Immediate to 15 days, Serving noticeOverview:We are seeking a highly skilled Python and PySpark Developer who is passionate about building robust data solutions from the ground up. The ideal...
-
Python, Pyspark Developer with Databricks
2 weeks ago
Pune, India InfoBeans Full timeJob title : Python, Pyspark Developer with Databricks Skills : Python, Pyspark, Databricks, SQL, Azure Experience Required : 8-10 Location : Indore, Pune Notice Period : Immediate to 15 days, Serving notice Overview: We are seeking a highly skilled Python and PySpark Developer who is passionate about building robust data solutions from the ground up. The...
-
Azure databricks, Pyhton, Pyspark
3 weeks ago
Pune, India Avertis Infotech Pvt. Ltd. Full timeCompany Description Avertis Infotech Pvt. Ltd. is an IT services company that began as an application development company specializing in integrating high-tech healthcare machinery. Today, we have expanded our expertise to various industries, adapting to the evolving business landscape. Our goal is to provide innovative solutions and exceptional services to...
-
Azure databricks, Pyhton, Pyspark
2 weeks ago
Pune, Maharashtra, India Avertis Infotech Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per yearCompany DescriptionAvertis Infotech Pvt. Ltd. is an IT services company that began as an application development company specializing in integrating high-tech healthcare machinery. Today, we have expanded our expertise to various industries, adapting to the evolving business landscape. Our goal is to provide innovative solutions and exceptional services to...
-
Azure databricks, PySpark
3 weeks ago
Bengaluru, India Tata Consultancy Services Full timeRole: Azure Data Engineer(ADF, ADB) Required Technical Skill Set: Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQL Exp : 4 to 6 Year Location : Kolkata, Pune, Mumbai, Bangalore, Bhubaneshwar Must-Have · Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse; establishing the cloud connectivity...
-
Azure databricks, PySpark
3 weeks ago
Bengaluru, India Tata Consultancy Services Full timeRole: Azure Data Engineer(ADF, ADB)Required Technical Skill Set: Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQLExp : 4 to 6 YearLocation : Kolkata, Pune, Mumbai, Bangalore, BhubaneshwarMust-Have · Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse; establishing the cloud connectivity between...
-
Azure databricks, PySpark
3 weeks ago
Bengaluru, India Tata Consultancy Services Full timeRole: Azure Data Engineer(ADF, ADB) Required Technical Skill Set: Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQL Exp : 4 to 6 Year Location : Kolkata, Pune, Mumbai, Bangalore, Bhubaneshwar Must-Have · Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse; establishing the cloud connectivity between...
-
Azure databricks, PySpark
3 weeks ago
Bengaluru, India Tata Consultancy Services Full timeRole: Azure Data Engineer(ADF, ADB)Required Technical Skill Set: Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQLExp : 4 to 6 YearLocation : Kolkata, Pune, Mumbai, Bangalore, BhubaneshwarMust-Have · Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse; establishing the cloud connectivity between...
