Technical Architect-Databricks

22 hours ago

Pune, Maharashtra, India Atos Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Role Overview
The Technical Architect - Databricks designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modeling, and cloud integration, ensuring high performance, security, and reliability.
Responsibilities

  • Design and implement Databricks-based data architectures to meet business requirements.
  • Develop and optimize data pipelines using PySpark, Scala, or SQL.
  • Establish the Databricks Lakehouse architecture for batch and streaming data.
  • Collaborate with cross-functional teams to integrate Databricks with cloud platforms (e.g., AWS, Azure, GCP).
  • Ensure data security and compliance with best practices.
  • Monitor and troubleshoot Databricks environments for performance and reliability.
  • Stay updated on Databricks advancements and industry trends.

Key Technical Skills & Responsibilities

  • 12+ years of experience in data engineering using Databricks or Apache Spark-based platforms.
  • Proven track record of building and optimizing ETL/ELT pipelines for batch and streaming data ingestion.
  • Hands-on experience with Azure services such as Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, or Azure SQL Data Warehouse.
  • Proficiency in programming languages such as Python, Scala, or SQL for data processing and transformation.
  • Expertise in Spark (PySpark, Spark SQL, or Scala) and Databricks notebooks for large-scale data processing.
  • Familiarity with Delta Lake, Delta Live Tables, and medallion architecture for data lakehouse implementations.
  • Build and query deltalake storage solutions
  • Process streaming data with Azure Databricks structured streaming
  • Design Azure Databricks security and data protection solutions
  • Flatten nested structures and explode arrays with spark
  • Transfer data outside using sparkpools using pyspark connector
  • Optimizing spark jobs
  • Implementing best practices in spark/databricks
  • Experience with orchestration tools like Azure Data Factory or Databricks Jobs for scheduling and automation.
  • Knowledge of Git for source control and CI/CD integration for Databricks workflows, cost optimization, performance tuning.
  • Familiarity with Unity Catalog, RBAC, or enterprise-level Databricks setups.
  • Ability to create reusable components, templates, and documentation to standardize data engineering workflows.
  • Solutioning and presales - Architecting frameworks, defining roadmaps, and engaging with stakeholders.
  • Experience in defining data strategy, evaluating new tools/technologies, and driving adoption across the organization.
  • Must have experience of working with streaming data sources and Kafka (preferred).

Eligibility Criteria

  • Bachelor's degree in computer science, Information Technology, or related field
  • Proven experience as a Databricks Architect or similar role
  • Complete knowledge in Azure Databricks platform architecture
  • Databricks certification (e.g., Certified Data Engineer, Associate Developer)
  • Expertise in Python/Scala/ SQL/R
  • Experience with cloud platforms like AWS, Azure, or GCP
  • Strong understanding of data modeling and cloud integration
  • Experience with cluster sizing and security implementation
  • Excellent problem-solving and communication skills

  • Technical Architect-Databricks

    3 days ago

    Pune, Maharashtra, India Atos Full time ₹ 8,00,000 - ₹ 20,00,000 per year

    Role Overview:The Technical Architect - Databricks designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modeling, and cloud integration, ensuring high performance, security, and reliability.Responsibilities:Design and implement Databricks-based data architectures to meet business...

  • Databricks Solution Architect

    1 week ago

    Pune, Maharashtra, India InspireXT Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionAbout InspireXT :InspireXT is on a mission to build the most trusted supply chains in the world.Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail.We are investing significantly in our Databricks alliance...

  • technical architect

    1 week ago

    Pune, Maharashtra, India Atos Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Eviden, part of the Atos Group, with an annual revenue of circa € 5 billion is a global leader in data-driven, trusted and sustainable digital transformation. As a next generation digital business with worldwide leading positions in digital, cloud, data, advanced computing and security, it brings deep expertise for all industries in more than 47 countries....

  • Databricks Engineer

    1 week ago

    Pune, Maharashtra, India InfoCepts Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Data Engineer- Databricks

    1 week ago

    Pune, Maharashtra, India InfoCepts Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Databricks Engineer- Technical lead

    1 week ago

    Pune, Maharashtra, India Symphoni Hr Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Locations:Pune, Maharashtra, IndiaMinimum Experience:8Maximum Experience:12Skill to Evaluate:azure/aws,databricks,SQL,PYSPARK, Team HandlingJob Title: Technical LeadCompany Name: NCSIThis role is accountable for running day to day operations of Data Platform in Azure / AWS Databricks NCS. Data Engineer is accountable for ongoing Development, Enhancement...

  • Technical Architect

    1 week ago

    Pune, Maharashtra, India YASH Technologies Full time ₹ 17,50,000 - ₹ 25,00,000 per year

    Date: Sep 18, 2025Job Requisition Id: 62294Location:Hyderabad, TG, IN Indore, IN Pune, IN Pune, MH, INYASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.At YASH, we're a cluster...

  • Technical Architect

    3 days ago

    Pune, Maharashtra, India Yash Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.At YASH, we're a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single...

  • Databricks

    1 week ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As the undisputed leader in professional services, Our Client is where you will find unrivaled opportunities to succeed and realize your full potential.We are seeking highly skilled Databricks Data Engineers to join...

  • Databricks Developer

    1 week ago

    Pune, Maharashtra, India Luxoft Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Project descriptionYou will be working in a global team that manages and performs a global technical control. You'll be joining Assets Management team which is looking after asset management data foundation and operates a set of in-house developed tooling. As an IT engineer you'll play an important role in ensuring the development methodology is...