Databricks Architect

2 days ago

Chennai, Tamil Nadu, India Decision Minds Full time

Role Description

This is a full-time hybrid role ( Multiple roles) for a Databricks lead and Architect located in Chennai and Pondicherry, with the flexibility to work remotely on occasion. The Databricks Architect will be responsible for designing scalable architectures, developing software solutions, integrating Databricks with other platforms, and creating efficient architectural designs. Additionally, the role involves collaborating with cross-functional teams, managing projects to ensure timely delivery, and supporting the implementation of Databricks solutions that align with business goals.

Key Responsibilities:

  • Be the go to person for everything related to solutioning and Architecture. Should be leading the the team.
  • Lead the
    migration of Oracle Data Warehouse to Databricks
    , ensuring minimal downtime and data integrity.
  • Work on data pipelines using
    Databricks best practices
    for performance, cost, and reliability, while guiding junior engineers.
  • Optimize Spark/PySpark jobs
    for performance and efficiency in processing large datasets.
  • Implement data quality checks, validation, and reconciliation processes during migration.
  • Work on Hadoop ecosystem (HDFS, Hive, Sqoop) for legacy data integration where needed.
  • Leverage AWS cloud services (S3, EMR, EC2, Lamda, RDS, Glue) for data storage and processing.
  • Implement CI/CD pipelines for automated deployment of Databricks workflows.
  • Ensure data governance, security, and compliance in the cloud environment.

Mandatory Skills & Experience:

  • 5+ years in Data Engineering, with strong expertise in Databricks, Oracle, and Data Warehousing.
  • Hands-on experience in migrating on-prem data warehouses (Oracle) to Databricks.
  • Hands on expertise using key features of Databricks ( Lakeflow connect, Lakebridge, Autoloader, Unity Catalog, Spark Declarative Pipelines, Lakehouse Architecture)
  • Proficiency in 
    PySpark, SQL
    , and ETL/ELT frameworks.
  • Strong knowledge of Hadoop ecosystem (HDFS, Hive, Sqoop).
  • Experience with AWS cloud services (S3, EMR, Glue, Lambda, RDS).
  • Familiarity with data modeling, CDC, and performance tuning in Databricks.
  • Good understanding of orchestration tools (Airflow, Control-M) and CI/CD pipelines.
  • Proficiency in Architecture, Architectural Design, and Integration
  • Strong Project Management skills to lead and ensure project milestones are met
  • Ability to work with cloud-based platforms and familiarity with AI/ML and Big Data technologies
  • Excellent problem-solving and analytical skills
  • Strong communication and collaboration skills to work effectively in a hybrid environment
  • Experience with Databricks and end-to-end deployment of data solutions is highly desirable
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field

  • Databricks Architect

    2 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Mastech Digital Full time

    Job Title: Databricks ArchitectLocation: Chennai/Hyderabad/BangaloreExperience: 10–15 years of overall experience and 5+ years in Data ArchitectureBudget: Open to discussNotice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysAbout the RoleWe are seeking a seasoned Databricks Architect with 10–15 years of overall...

  • Sr. Databricks Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Weekday AI Full time ₹ 5,00,000 - ₹ 20,00,000 per year

    This role is for one of the Weekday's clientsMin Experience: 14 yearsLocation: Bengaluru, Pune, NCR, Hyderabad, Chennai, KolkataJobType: full-timeWe are looking for an experienced Data Architect with strong expertise in Azure Databricks and modern data engineering practices. The ideal candidate combines technical mastery with a creative and analytical...

  • Principal Architect

    2 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tiger Analytics Full time

    Title : Principal Architect – Databricks Location : Chennai, Bengaluru, Hyderabad Who we areTiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer full-stack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission...

  • Data Engineer- Databricks

    12 hours ago

    Chennai, Tamil Nadu, India InfoCepts Full time

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Databricks Lead

    2 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Mastech Digital Full time

    Job Title: Databricks Lead Location: Chennai/Hyderabad/BangaloreExperience: 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projectsBudget: Open to discussNotice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysAbout the RoleWe are looking for a highly skilled Databricks Lead...

  • Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Prodapt Full time US$ 80,000 - US$ 1,20,000 per year

    OverviewRole OverviewWe are looking for a seasoned Data Architect with strong expertise in Databricks to lead the design, development, and optimization of scalable data platforms and analytics solutions. The role involves defining end-to-end data architecture, building cloud-native data pipelines, and enabling advanced analytics and AI workloads for...

  • Senior Solution Architect

    14 hours ago

    Chennai, Tamil Nadu, India Reveille Technologies,Inc Full time

    We're Hiring: Senior Solution Architect - FTE Chennai / Hyderabad NP: 0–20 DaysExperience : 8+ YrsWe are looking for a Senior Solution Architect to lead cloud, data, and GenAI solution design across enterprise platforms.Key Responsibilities:Architect scalable, secure solutions on AWS & Databricks LakehouseLead enterprise web app + OpenSearch...

  • Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 12,00,000 - ₹ 25,00,000 per year

    Overview:Role OverviewWe are looking for a seasoned Data Architect with strong expertise in Databricks to lead the design, development, and optimization of scalable data platforms and analytics solutions. The role involves defining end-to-end data architecture, building cloud-native data pipelines, and enabling advanced analytics and AI workloads for...

  • Senior Data Engineer- Azure Databricks

    18 hours ago

    Chennai, Tamil Nadu, India InfoCepts Full time

    Position: Data Engineer- Azure DatabricksPurpose of the Position:To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, enabling Zodiac Maritime to make faster, data-driven decisions as part of its data transformation journey.Proficiency in data integration techniques, ETL processes and data...

  • MDM Architect

    10 hours ago

    Chennai, Tamil Nadu, India Virtusa Full time

    We are seeking a Reltio Senior System Architect with deep expertise in AWS cloud services and Databricks based Lakehouse architectures to lead enterprise scale Master Data Management MDM solutions This role will own the end to end architecture integrating Reltio MDM Databricks and AWS native services enabling trusted master data across analytics AI and...