Unity Catalog and Databricks Engineer
2 days ago
JD for Unity Catalog and Databricks Engineer
Role C2H
Experience-6 to 9yrs overall,
Also experience in Pyspark, Databricks
Location-PAN INDIA(except Hyderabad and Chennai as preferred location)
NP-Immediate/15 days
Hybrid-2 or 3 days WFO
Unity Catalog Adoption Data Engineer 3-6 Years, PySpark, Databricks, Unity Catalog JD Design, develop, and maintain efficient and scalable data pipelines using PySpark, Databricks. Utilize Databricks to orchestrate and automate data workflows.
Implement and manage data storage solutions using Unity Catalog for effective data governance. Collaborate with data scientists, analysts, and business stakeholders to ensure smooth data flow and integration.
Write optimized SQL queries for data extraction, transformation, and analysis. Develop and implement data models and data structures to meet business requirements.
Perform data quality checks and ensure that all data is accurate and accessible.
Troubleshoot and resolve issues related to data processing, data integration, and performance.
Optimize performance and scalability of data systems and workflows. Document technical solutions, processes, and best practices for future reference and collaboration.
-
Databricks Engineer
1 week ago
Pune, Maharashtra, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKey Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...
-
Databricks Engineer
4 days ago
Pune, Maharashtra, India Virtusa Full time ₹ 10,00,000 - ₹ 30,00,000 per yearKey Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...
-
Senior Azure Databricks Engineer
4 days ago
Pune, Maharashtra, India Newscape Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe're Hiring: Senior Databricks Engineer / Azure Data Engineer / Lead Data engineer Location:Baner, Pune (Onsite Only) Work Mode:Full-time | Office-based Availability:Immediate Joiners / Notice Period ≤ 15 Days Note:Only local Pune candidates may apply.* L2 interviews will be conductedin person— apply only if you are open to face-to-face interviews....
-
Databricks Administrator
1 week ago
Pune, Maharashtra, India AltSense Full time ₹ 12,00,000 - ₹ 24,00,000 per yearJob Title: Databricks AdministratorLocation: Pune (3 days WFO, but will change based on the business need)Shift timings: Night shift (6.30 PM IST to 2.30 AM IST / it will get shift by 1 hour in daylight saving)Notice period:Immediate joiner or less than 30daysExperience Level:Experience Level: Overall 5 to 7 yrsMust Have Skills:2 to 4 years of exp in the...
-
Databricks Administrator
1 week ago
Pune, Maharashtra, India Birlasoft Full time ₹ 21,00,000 per yearCountry/Region: INRequisition ID: 30190Work Model:Position Type:Salary Range:Location: INDIA - PUNE - NORTHERN TRUSTTitle: Databricks AdministratorDescription:Job Title : Databricks AdministratorLocation : Pune (3 days WFO, but will change based on the business need)Shift timings : Night shift (6.30PM IST to 2.30AM IST / it will get shift by 1hr in day light...
-
Databricks Solution Architect
1 week ago
Pune, Maharashtra, India InspireXT Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescriptionAbout InspireXT :InspireXT is on a mission to build the most trusted supply chains in the world.Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail.We are investing significantly in our Databricks alliance...
-
Data Engineer with Databricks Expertise
1 week ago
Pune, Maharashtra, India Mphasis Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSenior Software Engineer Job Description: Data Engineer with Databricks Expertise Job Summary We are seeking a highly skilled Data Engineer with Databricks certifications and extensive practical experience working with the Databricks Lakehouse platform and its supporting capabilities. The ideal candidate will possess a robust understanding of AWS...
-
Pune, Maharashtra, India InfoCepts Technologies Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescription : Key Responsibilities : Data Pipeline Development : - Design and implement robust batch and real-time streaming data pipelines leveraging Azure Databricks and Apache Spark. - Build scalable and maintainable ETL/ELT workflows to support data ingestion, transformation, and integration from diverse sources. Data Architecture Implementation :...
-
Lead Data Engineer –Azure
1 week ago
Pune, Maharashtra, India Admin Looks Full time ₹ 12,00,000 - ₹ 36,00,000 per yearUrgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent...
-
Azure data factory
7 hours ago
Pune, Maharashtra, India ID4 Consultancy Full time ₹ 9,00,000 - ₹ 12,00,000 per yearAzure Data Factory: Experience in building and managing data pipelines. Azure Data Lake Gen 2: Proficient in data storage and management within Azure'sdata lake environment. Azure Databricks / Apache Spark: Hands-on skill with distributed data processing,transformations, and analytics. Power BI: Expertise in data visualization and reporting.Good to...