Azure Databricks Engineer
2 weeks ago
The Azure Data Bricks Engineer plays a critical role in establishing and maintaining an efficient data ecosystem within an organization.
This position is integral to the development of data solutions leveraging the capabilities of Microsoft Azure Data Bricks.
The engineer will work closely with data scientists and analytics teams to facilitate the transformation of raw data into actionable insights.
With increasing reliance on big data technologies and cloud-based solutions, having an expert on board is vital for driving data-driven decision-making processes.
The Azure Data Bricks Engineer will also be responsible for optimizing data workflows, ensuring data quality, and deploying scalable data solutions that align with organizational goals.
This role requires not only technical expertise in handling large volumes of data but also the ability to collaborate across various functional teams to enhance operational efficiency.
Design and implement scalable data pipelines using Azure Data Bricks.
Develop ETL processes to efficiently extract, transform, and load data.
Collaborate with data scientists and analysts to define and refine data requirements.
Optimize Spark jobs for performance and efficiency.
Monitor and troubleshoot production workflows and jobs.
Implement data quality checks and validation processes.
Create and maintain technical documentation related to data architecture.
Conduct code reviews to ensure best practices are followed.
Work on integrating data from various sources including databases, APIs, and third-party
services.
Utilize SQL and Python for data manipulation and analysis.
Collaborate with DevOps teams to deploy and maintain data solutions.
Stay updated with the latest trends and updates in Azure Data Bricks and related technologies.
Facilitate data visualization initiatives for better data-driven insights.
Provide training and support to team members on data tools and practices.
Participate in cross-functional projects to enhance data sharing and access.
Bachelor's degree in Computer Science, Information Technology, or a related field.
Minimum of 6 years of experience in data engineering or a related domain.
Strong expertise in Azure Data Bricks and data lake concepts.
Proficiency with SQL, Python, and Spark.
Solid understanding of data warehousing concepts.
Experience with ETL tools and frameworks.
Familiarity with cloud platforms such as Azure, AWS, or Google Cloud.
Excellent problem-solving and analytical skills.
Ability to work collaboratively in a diverse team environment.
Experience with data visualization tools such as Power BI or Tableau.
Strong communication skills with the ability to convey technical concepts to non-technical
stakeholders.
Knowledge of data governance and data quality best practices.
Hands-on experience with big data technologies and frameworks.
A relevant certification in Azure is a plus.
Ability to adapt to changing technologies and evolving business requirements.
-
Senior Azure Databricks Engineer
2 weeks ago
Mumbai, Maharashtra, India MLAI Digital Private Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per yearCompany DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL) Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...
-
Microsoft Azure, Databricks
4 days ago
Mumbai, Maharashtra, India Natobotics Full time ₹ 20,00,000 - ₹ 25,00,000 per yearHi ConnectionsWe are Hiringhashtag#MicrosoftAzure, Digital: Python for Data Science, Digital: Databricks, Digital: PySpark, Azure Data Factory # Immediate Joiners Job Title: Developer Work Location: Mumbai, MH / Hyderabad, TG / Chennai, TN / Bhubaneswar, OR / Bangalore, KA Skill Required: Digital: Microsoft Azure, Digital: Python for Data Science, Digital:...
-
Azure Databricks Engineer
1 week ago
Mumbai, Maharashtra, India Capgemini Engineering Full time ₹ 20,00,000 - ₹ 25,00,000 per yearChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...
-
Databricks Architect
5 hours ago
Mumbai, Maharashtra, India Jio Full time US$ 1,20,000 - US$ 2,40,000 per yearTitle: Senior Databricks ArchitectLocation: Mumbai, Gurgaon, HyderabadAbout the RoleWe are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor...
-
Data Engineer- databricks
1 week ago
Mumbai, Maharashtra, India Qualintia Solutions Full time ₹ 8,00,000 - ₹ 25,00,000 per yearRole- Data Engineer- DatabricksExp- 8+ years,Job Type- ContractualLocation- MumbaiWork Mode- WFO• Learning & Certification Opportunities: Enhance your professional growth.• Comprehensive Medical Coverage and Life Insurance: For your well-being.• Flexible Work Environment: Enjoy a 5-day work week.• Collaborative Culture: Be part of a fun, innovative...
-
Senior Databricks Architect
2 hours ago
Mumbai, Maharashtra, India Jio Platforms Limited (JPL) Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWork Locations: Mumbai OR Hyderabad OR GurgaonAbout the Role:We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to...
-
Senior Databricks Architect
6 hours ago
Mumbai, Maharashtra, India Jio Full time ₹ 15,00,000 - ₹ 30,00,000 per yearAbout the RoleWe are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to deliver high-quality data solutions.Key...
-
Databricks Developer
2 weeks ago
Mumbai, Maharashtra, India Seaspan Corporation Full time ₹ 12,00,000 - ₹ 24,00,000 per yearSeaspan teams are goal-driven and share a high-performance culture, focusing on building services offerings to become a leading asset manager. Seaspan provides many of the world's major shipping lines with alternatives to vessel ownership by offering long-term leases on large, modern containerships and pure car, truck carriers (PCTCs) combined with industry...
-
Senior Data Engineer- Databricks
7 days ago
Mumbai, Maharashtra, India Koantek Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industryexperience. The ideal candidate will have a proven track record of working on live projects,preferably within the manufacturing or energy sectors. He/she will play a key role in developingand maintaining scalable data solutions using Databricks and related...
-
Informatica Developer with Databricks
1 week ago
Navi Mumbai, Maharashtra, India Celebal Technologies Full time ₹ 6,00,000 - ₹ 12,00,000 per yearJob Title: ETL Migration Specialist (Informatica to Databricks)Location: Navi MumbaiExperience: 5-7+ YearsDuration: FulltimePosition OverviewWe are looking for an experienced ETL Migration Specialist with strong expertise in Informatica PowerCenter and Databricks (PySpark). The ideal candidate will be responsible for analysing and reverse engineering...