Technical Architect-Databricks

7 days ago

Pune India Atos Full time

Job Description

Role Overview

The Technical Architect - Databricks designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modeling, and cloud integration, ensuring high performance, security, and reliability.

Responsibilities

- Design and implement Databricks-based data architectures to meet business requirements.
- Develop and optimize data pipelines using PySpark, Scala, or SQL.
- Establish the Databricks Lakehouse architecture for batch and streaming data.
- Collaborate with cross-functional teams to integrate Databricks with cloud platforms (e.g., AWS, Azure, GCP).
- Ensure data security and compliance with best practices.
- Monitor and troubleshoot Databricks environments for performance and reliability.
- Stay updated on Databricks advancements and industry trends.

Key Technical Skills & Responsibilities

- 12+ years of experience in data engineering using Databricks or Apache Spark-based platforms.
- Proven track record of building and optimizing ETL/ELT pipelines for batch and streaming data ingestion.
- Hands-on experience with Azure services such as Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, or Azure SQL Data Warehouse.
- Proficiency in programming languages such as Python, Scala, or SQL for data processing and transformation.
- Expertise in Spark (PySpark, Spark SQL, or Scala) and Databricks notebooks for large-scale data processing.
- Familiarity with Delta Lake, Delta Live Tables, and medallion architecture for data lakehouse implementations.
- Build and query deltalake storage solutions
- Process streaming data with Azure Databricks structured streaming
- Design Azure Databricks security and data protection solutions
- Flatten nested structures and explode arrays with spark
- Transfer data outside using sparkpools using pyspark connector
- Optimizing spark jobs
- Implementing best practices in spark/databricks
- Experience with orchestration tools like Azure Data Factory or Databricks Jobs for scheduling and automation.
- Knowledge of Git for source control and CI/CD integration for Databricks workflows, cost optimization, performance tuning.
- Familiarity with Unity Catalog, RBAC, or enterprise-level Databricks setups.
- Ability to create reusable components, templates, and documentation to standardize data engineering workflows.
- Solutioning and presales - Architecting frameworks, defining roadmaps, and engaging with stakeholders.
- Experience in defining data strategy, evaluating new tools/technologies, and driving adoption across the organization.
- Must have experience of working with streaming data sources and Kafka (preferred).

Eligibility Criteria

- Bachelor's degree in computer science, Information Technology, or related field
- Proven experience as a Databricks Architect or similar role
- Complete knowledge in Azure Databricks platform architecture
- Databricks certification (e.g., Certified Data Engineer, Associate Developer)
- Expertise in Python/Scala/ SQL/R
- Experience with cloud platforms like AWS, Azure, or GCP
- Strong understanding of data modeling and cloud integration
- Experience with cluster sizing and security implementation
- Excellent problem-solving and communication skills

  • Technical Architect-Databricks

    1 week ago

    Pune, Maharashtra, India Atos Full time ₹ 8,00,000 - ₹ 20,00,000 per year

    Role Overview:The Technical Architect - Databricks designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modeling, and cloud integration, ensuring high performance, security, and reliability.Responsibilities:Design and implement Databricks-based data architectures to meet business...

  • Technical Architect-Databricks

    1 week ago

    Pune, Maharashtra, India Atos Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role OverviewThe Technical Architect - Databricks designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modeling, and cloud integration, ensuring high performance, security, and reliability.ResponsibilitiesDesign and implement Databricks-based data architectures to meet business...

  • Sr. Solutions Architect

    1 week ago

    Bengaluru, India Databricks Full time

    Job Description FEQ426R101 As a Senior Solutions Architect, you will shape the future of the Data & AI landscape by working with the most sophisticated data engineering and data science teams in the world. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will...

  • Data Architect- Databricks

    2 weeks ago

    India InOrg Global Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Data Architect – DatabricksCompany: Type: Full-timeExperience Level: Senior We're seeking a skilled Data Architect with hands-on Databricks experience to help build robust pipelines and support scalable analytics and machine learning initiatives.Key ResponsibilitiesDatabricks Solution Architecture: Design and implement scalable, secure, and...

  • Databricks Solution Architect

    2 weeks ago

    Pune, Maharashtra, India Tudip Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking a highly skilled Databricks Solution Architect to join our team. The ideal candidate will have deep expertise in cloud-based data platforms, advanced analytics, and modern data engineering practices. You will be responsible for designing, implementing, and optimizing scalable data solutions using Databricks and related cloud technologies. This...

  • Databricks Architect

    3 weeks ago

    Delhi, Bengaluru, Pune, India Impetus Technologies Full time

    Job Description - Overall 10-18 yrs. of Data Engineering experience with Minimum 4+ years of hands on experience in Databricks. Ready to travel Onsite and work at client location. - Proven hands-on experience as a Databricks Architect or similar role with a deep understanding of the Databricks platform and its capabilities. - Analyze business requirements...

  • Databricks Solution Architect

    5 days ago

    Pune, India InspireXT Full time

    Description :About InspireXT :InspireXT is on a mission to build the most trusted supply chains in the world.Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail.We are investing significantly in our Databricks...

  • Databricks Architect

    3 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Databricks Architect to join our team in Bangalore, Karntaka (IN-KA), India (IN). Databricks Data Platform -...

  • Databricks Solution Architect

    3 weeks ago

    Pune, India InspireXT Full time

    About InspireXT InspireXT is on a mission to build the most trusted supply chains in the world. Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail. We are investing significantly in our Databricks alliance and...

  • Databricks Solution Architect

    4 days ago

    Pune, Maharashtra, India InspireXT Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    About InspireXTInspireXT is on a mission to build the most trusted supply chains in the world. Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail.We are investing significantly in our Databricks alliance and building...