Databricks Architect

3 weeks ago


NCR, India Bean Hr Consulting Full time

Databricks Data Engineer

Experience: 3-6 years
Location: India
Compensation: Up to 30 LPA

Key Responsibilities

  • Design, develop, and maintain data pipelines and ETL workflows using Databricks and Apache Spark
  • Implement Delta Lake and Medallion architecture (Bronze/Silver/Gold layers) for structured data processing
  • Integrate data from multiple sources into cloud-based data lakes and warehouses
  • Collaborate with analytics teams to enable self-service BI and reporting
  • Optimize Spark jobs for performance and cost efficiency
  • Ensure data quality, governance, and security in pipelines

Required Skills

  • Strong programming in Python or Scala
  • Hands-on expertise with Databricks and Apache Spark
  • Experience with ETL/ELT pipelines, Delta Lake, and ADF (Azure Data Factory)
  • Exposure to AWS, Azure, or GCP cloud services
  • Knowledge of SQL and data warehousing concepts
  • Bonus: Databricks Certification (Associate level preferred)

Tech Stack

  • Languages: Python, Scala, SQL
  • Frameworks/Platforms: Apache Spark, Databricks, Delta Lake
  • ETL & Orchestration: Azure Data Factory, Airflow
  • Cloud: Azure (preferred), AWS, GCP
  • DevOps Tools: Git, CI/CD pipelines
  • Databases: SQL Server, Snowflake, Redshift, Synapse

Databricks Lead Engineer

Experience: 610 years
Location: India
Compensation: Up to 43 LPA

Key Responsibilities

  • Lead design and implementation of scalable, high-performance data solutions on Databricks
  • Architect and optimize data pipelines and workflows leveraging Spark and Delta Lake
  • Mentor and guide junior data engineers in best practices and coding standards
  • Collaborate with data scientists, analysts, and business teams to deliver solutions
  • Manage and optimize Databricks environments including clusters, security, and notebooks
  • Implement CI/CD pipelines and infrastructure as code (Terraform) for data projects
  • Drive cost optimization, performance tuning, and automation initiatives

Required Skills

  • Strong proficiency in Python/Scala, Spark, and SQL
  • Extensive experience with Databricks, Delta Lake, and Medallion architecture
  • Knowledge of ADF, Iceberg, and orchestration frameworks
  • Hands-on expertise with cloud platforms (Azure preferred, AWS/GCP)
  • Familiarity with MLOps, ML model integration, and deployment on Databricks
  • Databricks Professional certification preferred

Tech Stack

  • Languages: Python, Scala, SQL, Java (optional)
  • Frameworks/Platforms: Apache Spark, Databricks, Delta Lake, Iceberg
  • ETL & Orchestration: Azure Data Factory, Airflow, Synapse Pipelines
  • Cloud: Azure (primary), AWS, GCP
  • DevOps/IaC: GitHub Actions, Jenkins, Terraform, Docker
  • Databases: Snowflake, Synapse, BigQuery, Redshift
  • ML/AI Tools: MLflow, Databricks ML, TensorFlow (basic integration)

Databricks Architect

Experience: 10–14 years
Location: India
Compensation: Up to 70 LPA

Key Responsibilities

  • Own and define the enterprise-level data architecture strategy using Databricks
  • Design, build, and scale end-to-end data platforms integrating structured/unstructured data
  • Implement and enforce Medallion architecture standards across projects
  • Guide teams in data lakehouse design, governance, and security frameworks
  • Provide leadership on AI/ML integration, model deployment, and advanced analytics
  • Manage complex multi-cloud and hybrid deployments on Databricks
  • Establish best practices, reusable frameworks, and automation strategies for data engineering

Required Skills

  • Expert-level knowledge of Databricks, Apache Spark, Delta Lake, Iceberg
  • Strong programming and solutioning in Python, Scala, SQL
  • Proven expertise in Azure Data Factory, pipelines, orchestration, and governance
  • Experience with multi-cloud environments (Azure/AWS/GCP)
  • Proficiency with Terraform, CI/CD, containerization (Docker, Kubernetes)
  • Deep understanding of machine learning, deep learning, and MLOps frameworks
  • Excellent leadership, architectural thinking, and problem-solving skills
  • Databricks Architect or Professional certification highly preferred

Tech Stack

  • Languages: Python, Scala, SQL, R (for advanced analytics)
  • Frameworks/Platforms: Apache Spark, Databricks, Delta Lake, Iceberg, Unity Catalog
  • ETL & Orchestration: Azure Data Factory, Airflow, Synapse, Dataflow
  • Cloud: Multi-cloud (Azure, AWS, GCP)
  • DevOps/IaC: Terraform, Jenkins, GitHub Actions, Docker, Kubernetes
  • Databases/Warehouses: Snowflake, Synapse, BigQuery, Redshift, Lakehouse architectures
  • ML/AI Tools: MLflow, Databricks ML, TensorFlow, PyTorch, Hugging Face
  • Security/Governance: Unity Catalog, RBAC, data encryption

  • Databricks Architect

    2 weeks ago


    Delhi, NCR, India Bean Hr Consulting Full time ₹ 3,00,00,000 - ₹ 7,00,00,000 per year

    Databricks Data EngineerExperience: 3-6 yearsLocation: IndiaCompensation: Up to 30 LPAKey ResponsibilitiesDesign, develop, and maintain data pipelines and ETL workflows using Databricks and Apache SparkImplement Delta Lake and Medallion architecture (Bronze/Silver/Gold layers) for structured data processingIntegrate data from multiple sources into...


  • Bengaluru, Delhi, Hyderabad, NCR, India Genpact Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking a highly skilled and experienced Databricks Platform Architect to lead the design, implementation, and optimization ofh our Databricks platform. The ideal candidate will have a strong background in cloud-based data processing systems, data warehousing, and big data technologies. They will work closely with our data engineering team to ensure...


  • Delhi, NCR, India KS Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job role:Architect Databricks ML-REMOTEResponsibilities:* Design and implement data-driven solutions using Al, Machine Learning & AI.* Collaborate with cross-functional teams on project delivery.* Develop computer vision models for image analysis.


  • Delhi, NCR, India Zorba Consulting Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Primary Roles And Responsibilities :Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in existing pipelines and fix...

  • Data Architect

    2 days ago


    Delhi, NCR, India Clarity Consulting Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Data Architect Azure DatabricksBand- C2/ D1 : 10 + Years ExperienceMust Have: SQL, Pyspark and Python, Lakehouse architecture, delta tables, Data Architect with functional Data lakes, knows how to set up a Data Warehouse, for a group or analytics team, in and out worked with Azure tech stacks Database. Data Modelling, engineering pipeline and getting it...

  • Data Architect

    2 weeks ago


    Bengaluru, Delhi, Hyderabad, NCR, India Teamlease Digital Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesData Architect, Data Modeling, Data Architect, Data base knowledge, DBA and how to design end to end database, Python + SQLor, Databricks + AWS - Kafka, Pyspark Or Databricks + Any cloud technologyPreferred candidate profile ;1 Senior Con (6yrs to 12yrs ) & 1 Con (8yrs to 15yrs5 days WFO , Regular Shif


  • Delhi, NCR, India Mancer Consulting Services Full time ₹ 8,33,333 - ₹ 25,00,000 per year

    Preferred candidate profile :Solution Architect Data to lead the design and implementation of scalable, secure, and high-performance data solutions.You will play a key role in defining the data architecture and strategy across enterprise platforms, ensuring alignment with business goals and IT standards.18+ years of IT experience with Atleast 5 years of...

  • AWS Data Architect

    1 week ago


    Bengaluru, Delhi, Mumbai, NCR, India Infogain Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Exp: 10+ yearsJob Role : AWS Architect with DatabricksJob Location: Noida / Mumbai / Pune / Bangalore / Gurgaon / Kochi (Hybrid Work)Role & responsibilitiesDesign, build, and optimize ETL/ELT pipelines using Databricks (PySpark, Delta Lake) on AWS.Ingest and process structured, semi-structured, and unstructured data from multiple sources (RDBMS, APIs,...


  • Delhi, Mumbai, NCR, Noida, India Artech Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description:We are looking for an experienced Azure Data Architect to design and implement end-to-end cloud-based data solutions on Microsoft Azure. The ideal candidate should have strong experience in cloud data architecture, data engineering, and analytics platforms.Key Responsibilities:Design and implement scalable data architecture on Microsoft...


  • Delhi, Hyderabad, NCR, Pune, India Coforge Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job ResponsibilitiesLead a team of Data Engineers and Senior Data Engineers, providing technical guidance and mentorship.Design, develop, and maintain scalable ETL pipelines using Azure Services.Process, transform, and load large datasets into AWS Datalake or other data stores.Collaborate with cross-functional teams including data architects, analysts, and...