
Azure Databricks
1 day ago
**Data Architect (Azure, ADF, Databricks) - 14+ Years Experience**
**About the Role**:
**Responsibilities**:
- **Data Platform Architecture**:
- Design and architect a comprehensive data platform on Azure, leveraging best practices for scalability, performance, security, and cost optimization.
- Define the overall data architecture framework, including data ingestion, storage, processing, and consumption layers.
- Select and evaluate appropriate Azure services and technologies to meet business requirements.
- Develop and maintain architectural blueprints, standards, and guidelines.
- **Solution Design and Implementation**:
- Lead the design and implementation of complex data solutions using Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics (or similar DW solutions), Azure Data Lake Storage (ADLS), and other relevant Azure services.
- Develop data pipelines for batch and real-time data ingestion, transformation, and loading.
- Implement data quality frameworks and processes to ensure data accuracy and consistency.
- Design and implement data governance and security policies.
- **Technical Leadership and Mentorship**:
- Provide technical leadership and guidance to data engineers and developers.
- Mentor junior architects and contribute to their professional development.
- Foster a culture of technical excellence and innovation within the team.
- Lead code reviews and ensure adherence to best practices.
- **Stakeholder Management**:
- Collaborate with business stakeholders to understand data requirements and translate them into technical solutions.
- Communicate effectively with technical and non-technical audiences.
- Present architectural designs and recommendations to senior management.
- Manage expectations and ensure alignment between business needs and technical capabilities.
- **Continuous Improvement**:
- Stay up-to-date with the latest Azure services, features, and best practices.
- Research and evaluate new technologies to improve our data platform.
- Identify opportunities for optimization and cost reduction.
- Contribute to the development of best practices and documentation.
**Qualifications**:
- **Essential**:
- Bachelor's degree in Computer Science or a related field (or equivalent experience).
- 14+ years of experience in data architecture and development.
- Deep expertise in Azure cloud services, including Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage (ADLS), Azure Synapse Analytics (or similar DW solutions), and related technologies.
- Proven experience in designing and implementing complex data solutions on Azure.
- Strong understanding of data modeling, data warehousing, and data integration concepts.
- Experience with data governance, security, and compliance.
- Excellent communication, presentation, and leadership skills.
- **Preferred**:
- Master's degree in Computer Science or a related field.
- Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert).
- Experience with real-time data streaming technologies (e.g., Azure Event Hubs, Azure Stream Analytics).
- Experience with DevOps practices and tools.
- Experience with Agile development methodologies.
- Experience in specific industry domains (e.g., finance, healthcare, retail)
-
Azure Databricks Engineer
4 days ago
India Proso Full timeProso AI is Hiring – Azure Databricks Engineer (Contract Role) We are looking for an experienced Azure Databricks Engineer for a short-term role (3–4 months). Experience Required: 7+ years Key Skills & Responsibilities: Create/modify Azure Data Factory pipelines Develop and optimize Databricks notebooks using SQL & Python Work with file formats:...
-
Azure Databricks Engineer
2 days ago
India Proso Full timeProso AI is Hiring – Azure Databricks Engineer (Contract Role)We are looking for an experienced Azure Databricks Engineer for a short-term role (3–4 months). Experience Required: 7+ years Key Skills & Responsibilities:- Create/modify Azure Data Factory pipelines- Develop and optimize Databricks notebooks using SQL & Python- Work with file formats:...
-
Azure Databricks Lead Engineer
4 weeks ago
India Alcor Solutions, Inc. Full timeAlcor Solutions is a leading digital transformation and cloud consulting firm, enabling enterprises to leverage modern data platforms, cloud-native solutions, and emerging technologies to drive innovation and business outcomes.We are seeking an Azure Databricks Lead Engineer to architect, administer, and scale our enterprise Databricks environment while...
-
Senior Azure Databricks Engineer
4 weeks ago
India Quant-data Full timeWe're Hiring: Senior Azure Databricks Engineer (Remote | Full-Time) Join us to build scalable, cloud-native data solutions using cutting-edge technologiesWe're looking for an experienced and driven Senior Azure Databricks Engineer to join our growing team. This role is ideal for professionals with 6–10 years of experience in the data engineering space,...
-
India beBeeDataIngestion Full time US$ 90,000 - US$ 1,20,000Job Title: Azure Databricks Engineer with Injection experience Description: We are seeking an experienced Data Ingestion Engineer to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.About the Role:The ideal candidate will have hands-on experience with data...
-
India Nexify Infosystems Full timeTitle: Azure Databricks Engineer with Injection experienceLocation: Remote (India)Duration: 6 Month, (if the candidate is good with work, it can be extended to 1+ year )Time: 10.00 AM- 7.00 PM ISTNeed good comm skills – they will be coordinating with Americans on daily basesfor clarity : We are seeking an Ingestion Engineer with expertise in CI/CD and...
-
Databricks Sme
4 weeks ago
India KPG99 INC Full timePlease find below the Job Description and let me know if you are interested?Position: Databricks SME with Azure Infrastructure Location: 100% Remote (Offshore- for Any Country out of USA)Preferred: Independent Consultant Duration: 6+ Months (Will be a Long Term Contract)JOB DESCRIPTION: Databricks Handon SME Engineer Architect, configure, and optimize...
-
Databricks Admin
8 hours ago
India growel softech Full time**Databricks Admin 4+ years Remote Max 1.5 LPM **Responsibilities**: - Install, configure, and maintain Databricks environments to support data engineering and analytics activities. - Collaborate with cross-functional teams to understand data requirements and optimize Databricks clusters accordingly. - Monitor Databricks performance, troubleshoot issues,...
-
Databricks Admin
4 weeks ago
India Numeric Technologies Full timeRemote, Rotational shift Need immediate joiners only Required Skills & Qualifications:7+ years of experience as a Databricks Administrator or in a similar role.Strong knowledge of Azure/AWS Databricks and cloud computing platforms.Hands-on experience with Databricks clusters, notebooks, libraries, and job scheduling.Expertise in Spark optimization, data...
-
Databricks admin
4 weeks ago
India Numeric Technologies Full timeRemote, Rotational shiftNeed immediate joiners onlyRequired Skills & Qualifications:7+ years of experience as a Databricks Administrator or in a similar role.Strong knowledge of Azure/AWS Databricks and cloud computing platforms.Hands-on experience with Databricks clusters, notebooks, libraries, and job scheduling.Expertise in Spark optimization, data...