Databricks Architect

1 day ago

Chennai, Tamil Nadu, India Datacrew Full time

Job Title: Senior Databricks Data Engineer/Databricks Architect

Experience: 5-8 years

Location: Chennai / Oman (Onsite)

Note: Initial onsite for 3 months at Oman and back to Chennai to work from Offshore

Employment Type: Contract

Role Summary:

The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures leveraging Databricks on public cloud platforms. The ideal candidate is experienced in designing enterprise-grade solutions for batch and real-time data analytics, with hands-on expertise in Databricks, Spark, and cloud-based data services.

Key Responsibilities:

  • Design and develop end-to-end data architectures and pipelines with Databricks to meet business requirements
  • Optimize Databricks performance through efficient data processing, job tuning, and resource management
  • Implement data security, governance, and best practices to safeguard sensitive information within Databricks
  • Collaborate with stakeholders, developers, and data engineers to deliver integrated data solutions across the enterprise
  • Monitor the health of the Databricks environment and implement proactive maintenance and cost-optimization strategies
  • Document architectures, develop and own the architectural roadmap, and communicate status and value to stakeholders
  • Stay current with Databricks and cloud technology best practices, trends, and advancements

Technical Skills Required:

  • Databricks: Advanced hands-on experience with Databricks deployment, configuration, and administration
  • Spark: Expertise in Apache Spark (including Spark SQL and PySpark) for large-scale data processing.
  • Programming: Proficiency in Python and SQL is required
  • Cloud Platforms: Experience implementing solutions on Azure, AWS, or GCP, using cloud-native storage, data lakes, and data orchestration services
  • Data Modeling: Experience with schema design, data modeling, and ETL/ELT process design
  • Big Data Tools: Exposure to related tools such as Delta Lake, Synapse, Data Lake, and data warehousing technologies
  • BI/Visualization: Familiarity with BI tools such as Power BI or Tableau is an advantage
  • Data Security: Strong understanding of data security and compliance best practices in cloud environments

Qualifications:

  • Bachelor's or master's degree in computer science, Information Technology, or related field
  • 5-8 years of overall experience in data engineering, architecture, or related roles, with at least 4+ years working with Databricks and Spark at scale
  • Experience in optimizing, deploying, and maintaining large data workflows and pipelines in cloud environments
  • Excellent analytical, problem-solving, and communication skills
  • (Preferred) Databricks certification (e.g., Databricks Certified Data Engineer).

Desirable Attributes:

  • Demonstrated leadership abilities and a track record of mentoring technical teams.
  • Experience in agile development environments.
  • Consulting or customer-facing experience is a plus.

  • Databricks Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Datacrew Full time

    Job Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...

  • Generative AI/Databricks Architect

    3 weeks ago

    Chennai, Tamil Nadu, India Brisk Win IT PVT Ltd. Full time

    About the Role :We are looking for a highly experienced GenAI + Databricks Architect with strong expertise in advanced analytics, Artificial Intelligence (AI), Machine Learning (ML), and Data Engineering to lead the design and implementation of scalable data solutions. The role demands deep technical knowledge combined with strong architectural skills to...

  • Databricks Solutions Architect

    4 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,50,00,000 - ₹ 3,00,00,000

    Job Overview:Azure Databricks Engineer is a crucial role in our organization.We are seeking an experienced professional to design, develop, and optimize Azure Databricks solutions using SQL, Python, and other relevant technologies.Responsibilities include creating/modifying Azure Data Factory pipelines, working with file formats (Parquet, Delta, CSV), and...

  • Capability Leads- Databricks

    3 weeks ago

    Chennai, Tamil Nadu, India Mastech Digital Full time

    Position: Capability Lead – Databricks (Director/ Enterprise Architect)Location: Chennai, Hyderabad, Bangalore or Noida (Hybrid)- No remote option availableDuration: Full TimeReporting : Practice HeadBudget: 30- 65 LPA (Depending on level of expertise)Notice Period: Immediate Joiner/ Currently Serving/ Notice is less than 60 daysLevel of experience: 12+...

  • Urgent: Capability Leads- Databricks

    3 weeks ago

    Chennai, Tamil Nadu, India Mastech Digital Full time

    Job DescriptionPosition: Capability Lead Databricks (Director/ Enterprise Architect)Location: Chennai, Hyderabad, Bangalore or Noida (Hybrid)- No remote option availableDuration: Full TimeReporting : Practice HeadBudget: 30- 65 LPA (Depending on level of expertise)Notice Period: Immediate Joiner/ Currently Serving/ Notice is less than 60 daysLevel of...

  • Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Hash Agile Technologies Full time

    About UsAt Hash Agile Technologies, we empower businesses with data-driven insights by building scalable, secure, and innovative data solutions. We are looking for a highly skilled Data Architect to design and lead our data ecosystem, ensuring seamless integration, accessibility, and reliability across platforms.Key ResponsibilitiesDesign and implement...

  • Data Architect

    3 days ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    TCS is Hiring Data Architect For Pune and Chennai locationExperience : yearsMode of interview : VirtualLocation : Pune / ChennaiJOB DESCRIPTION:Must have:Proficiency in SQL, data modeling tools, and pipeline orchestration tools.Familiar with modern data stacks (Snowflake, Databricks, Apache Spark, Kafka).Hands-on experience with at least one major cloud...

  • Azure Data Lake Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Expleo Solutions Limited Full time

    Job DescriptionJob Title : Azure Data Lake ArchitectExperience:10+ YearsWork Location Candidate should work in Client Location (Egmore - Chennai) (Monday to Friday) (General Shift Timings) (100% Compulsory Work From Office)Job Description :- Azure Data Lake- Azure Databricks- Azure Data factory- Azure Synapse Analytics- Blob Storage- ETL- SQLJob Overview:-...

  • Azure Data Architect

    3 weeks ago

    Chennai, Tamil Nadu, India VIDPRO CONSULTANCY SERVICES Full time

    Location : Chennai, Kolkata, Gurgaon, Bangalore and : 7-15 Mode : Skills : Python, Pyspark, SQL, ETL, Data Pipeline, Azure Databricks, Azure DataFactory, Azure Synapse, Airflow, and Architect : We are seeking a skilled and motivated Data Engineer with experience in Python, SQL, Azure, and cloud-based technologies to join our dynamic team. The ideal...

  • Data Architect

    1 day ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    TCS is Hiring Data Architect For Pune and Chennai locationExperience : 8 - 12 yearsMode of interview: VirtualLocation : Pune / ChennaiJOB DESCRIPTION:Must have:- Proficiency in SQL, data modeling tools, and pipeline orchestration tools.- Familiar with modern data stacks (Snowflake, Databricks, Apache Spark, Kafka).- Hands-on experience with at least one...