Databricks Architect

1 day ago


India Oracle Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Description

We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS. The role involves designing scalable, secure, and high-performing data platforms based on the medallion architecture (bronze, silver, gold layers), supporting large-scale ingestion, transformation, and publishing of data.



Responsibilities

Key Responsibilities 


• Define and design cloud-native data architectures on Databricks using Delta Lake, Unity Catalog, and related components. 


• Develop and execute migration strategies for moving on-premises data workloads (Oracle, Exadata, Hadoop) to Databricks on Azure or AWS. 


• Architect and oversee data pipelines that support ingestion, curation, transformation, and analytics within the bronze/silver/gold architecture model. 


• Lead data modeling, schema design, and performance optimization, ensuring scalability and governance compliance. 


• Collaborate with data engineering, platform, and security teams to deliver robust, production-ready solutions. 


• Establish standards for ingestion frameworks, orchestration (Airflow, Databricks Workflows), and data quality validation. 


• Drive cost optimization, scalability design, and operational monitoring best practices. 


• Mentor engineering teams, providing architectural guidance during development and migration phases. 

4. Qualifications & Skills 

Mandatory: 


• 10+ years in data architecture or engineering, including 3+ years in cloud-based big data environments. 


• Proven hands-on experience with Databricks on Azure or AWS. 


• Deep understanding of Delta Lake, Medallion Architecture, and data governance tools such as Unity Catalog or Purview. 


• Expertise in Spark (PySpark/Scala) and large-scale data processing optimization. 


• Strong background in migrating large datasets and batch/streaming pipelines from on-prem to cloud. 


• Familiarity with ingestion from RDBMS systems (Oracle, SQL Server) and Hadoop ecosystems. 


• Proficiency with orchestration tools like Databricks Workflows, Airflow, Azure Data Factory, or AWS Glue. 


• Solid grasp of cloud-native services—storage, compute, networking, and security. 

Good-to-Have: 


• Databricks Certified Data Engineer or Architect Certification. 


• Azure or AWS Cloud Certifications. 


• Experience with real-time data ingestion (Kafka, Kinesis, Event Hubs). 


• Knowledge of data quality frameworks (Deequ, Great Expectations). 


• Exposure to BFSI or financial data environments. 

Self-Assessment Questions 

Use the following questions to assess your readiness for this role: 

1. Have I architected or migrated enterprise-scale data solutions from on-premises systems (e.g., Oracle, Hadoop) to Databricks on Azure or AWS? 

2. Do I have hands-on experience implementing Medallion Architecture (bronze/silver/gold) and using Delta Lake effectively? 

3. Can I confidently design and optimize Spark-based data pipelines for performance and scalability? 

4. Have I worked with data governance and security frameworks such as Unity Catalog or Purview in a production environment? 

5. Am I comfortable acting as an individual contributor and architectural leader, collaborating across engineering and platform teams? 

Qualifications

Career Level - IC3



  • India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    CSQ326R400As a Resident Solutions Architect in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Databricks Architect

    3 weeks ago


    Hyderabad, India Jio Full time

    Job Description Skills: Databricks, Apache Spark, SQL, Python, Big Data, Azure, Data Modeling, Azure Data Services, Title: Senior Databricks Architect Location: Mumbai, Gurgaon, Hyderabad About The Role We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using...


  • India Stefanini Group Full time ₹ 1,00,00,000 - ₹ 3,00,00,000 per year

    Details:Role Overview:A Data Architect designs, implements, and manages scalable data solutions on the IICS and Databricks platform. This role involves collaborating with business stakeholders to develop data pipelines, optimize performance, and ensure best practices in data handling and analytics.Key Responsibilities:Solution Design & Architecture : Design...


  • India Stefanini Group Full time ₹ 12,00,000 - ₹ 36,00,000 per year

      Job DescriptionRole Overview:A Data Architect designs, implements, and manages scalable data solutions on the IICS and Databricks platform. This role involves collaborating with business stakeholders to develop data pipelines, optimize performance, and ensure best practices in data handling and analytics.Key Responsibilities:Solution Design &...


  • Hyderabad, India Jio Full time

    Job Description Skills: Data Engineering, Azure Databricks, Data Modeling, architecture, pyspark, scala, SQL, About The Role We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion,...


  • Hyderabad, India Oracle Full time

    Job Description Job Description We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS. The role involves designing scalable, secure, and high-performing data platforms based on...


  • India Oracle Full time

    Job Description We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS. The role involves designing scalable, secure, and high-performing data platforms based on the medallion...


  • Bengaluru, Karnataka, India, Karnataka Spectral Consultants Full time

    Hiring: Azure Databricks Architect | Locations – Chennai | Bangalore | Hyderabad | We’re looking for an experienced Azure Databricks Architect to design and deliver scalable, modern data platforms across Azure and Databricks. This role blends hands-on technical architecture, team leadership, and innovation — perfect for those who thrive on building...


  • India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    CSQ426R284The Databricks Professional Services team accelerates our customers' outcomes and platform adoption through expert delivery, enablement, and innovation. As our customers scale their use of the Databricks Data Intelligence Platform, our mission is to guide them through the evolving data and AI landscape with speed, precision, and strategic insight....


  • Remote - India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    CSQ426R227As a Big Data Manager in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks...