Databricks Architect

3 weeks ago

Chennai, Tamil Nadu, India Datacrew Full time

Job Title: Senior Databricks Data Engineer/Databricks Architect

Experience: 5-8 years

Location: Chennai / Oman (Onsite)

Note: Initial onsite for 3 months at Oman and back to Chennai to work from Offshore

Employment Type: Contract

Role Summary:

The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures leveraging Databricks on public cloud platforms. The ideal candidate is experienced in designing enterprise-grade solutions for batch and real-time data analytics, with hands-on expertise in Databricks, Spark, and cloud-based data services.

Key Responsibilities:

  • Design and develop end-to-end data architectures and pipelines with Databricks to meet business requirements
  • Optimize Databricks performance through efficient data processing, job tuning, and resource management
  • Implement data security, governance, and best practices to safeguard sensitive information within Databricks
  • Collaborate with stakeholders, developers, and data engineers to deliver integrated data solutions across the enterprise
  • Monitor the health of the Databricks environment and implement proactive maintenance and cost-optimization strategies
  • Document architectures, develop and own the architectural roadmap, and communicate status and value to stakeholders
  • Stay current with Databricks and cloud technology best practices, trends, and advancements

Technical Skills Required:

  • Databricks: Advanced hands-on experience with Databricks deployment, configuration, and administration
  • Spark: Expertise in Apache Spark (including Spark SQL and PySpark) for large-scale data processing.
  • Programming: Proficiency in Python and SQL is required
  • Cloud Platforms: Experience implementing solutions on Azure, AWS, or GCP, using cloud-native storage, data lakes, and data orchestration services
  • Data Modeling: Experience with schema design, data modeling, and ETL/ELT process design
  • Big Data Tools: Exposure to related tools such as Delta Lake, Synapse, Data Lake, and data warehousing technologies
  • BI/Visualization: Familiarity with BI tools such as Power BI or Tableau is an advantage
  • Data Security: Strong understanding of data security and compliance best practices in cloud environments

Qualifications:

  • Bachelor's or master's degree in computer science, Information Technology, or related field
  • 5-8 years of overall experience in data engineering, architecture, or related roles, with at least 4+ years working with Databricks and Spark at scale
  • Experience in optimizing, deploying, and maintaining large data workflows and pipelines in cloud environments
  • Excellent analytical, problem-solving, and communication skills
  • (Preferred) Databricks certification (e.g., Databricks Certified Data Engineer).

Desirable Attributes:

  • Demonstrated leadership abilities and a track record of mentoring technical teams.
  • Experience in agile development environments.
  • Consulting or customer-facing experience is a plus.

  • Data Architect- Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India InfoCepts Full time ₹ 6,00,000 - ₹ 8,00,000 per year

    Position: Data Architect (Databricks, Snowflake)Location: Nagpur, Pune, Chennai, BangaloreType of Employment: Full time EmploymentPurpose of the Position:Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engineering, advanced analytics, and AI/ML solutions aligned with business needs.Key...

  • Azure Databricks Solutions Lead

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Senior Data ArchitectWe are seeking an experienced Senior Data Architect to lead the design and implementation of scalable data processing solutions using Azure Databricks.Maintain large-scale data pipelines to ingest data from diverse sources, ensuring seamless integration and efficient data retrieval processes.Collaborate with cross-functional teams to...

  • ETL Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    ETL Data ArchitectJob Summary:We are seeking an experienced ETL Data Architect to design and develop scalable data pipelines and architectures using Databricks.Key Responsibilities:Collaborate with stakeholders to understand data requirements and translate them into technical solutions.Design, develop, and deploy scalable data pipelines and ETL processes...

  • Data Architect for Scalable Solutions

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Title: Data Solutions ArchitectJob Summary: We are seeking a seasoned data solutions architect to join our technology team.This is a critical role that will lead the development of scalable data platforms, ensuring best practices for data quality and integrity.The ideal candidate will have a strong background in data engineering, with experience in big...

  • MSM - Enterprise Architect

    12 hours ago

    Chennai, Tamil Nadu, India Tech Mahindra Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Summary: We are looking for a hands-on Azure Enterprise Architect with strong technical expertise in Azure and Databricks to join our team.This role is critical in driving cloud and data architecture for high-impact projects across multiple accounts. The ideal candidate will not only provide strategic architectural guidance but also be actively involved...

  • Data Architect Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Architect SpecialistWe are seeking a skilled Data Architect to shape the architecture of our data products and features. The ideal candidate will have experience in end-to-end support of data project lifecycles, from conception to finished product.Define and innovate data architectures for new data products and features.Lead projects from...

  • Data Architect

    3 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    TCS is Hiring Data Architect For Pune and Chennai locationExperience : 8 - 12 yearsMode of interview: VirtualLocation : Pune / ChennaiJOB DESCRIPTION:Must have:- Proficiency in SQL, data modeling tools, and pipeline orchestration tools.- Familiar with modern data stacks (Snowflake, Databricks, Apache Spark, Kafka).- Hands-on experience with at least one...

  • Data Architect

    1 week ago

    Chennai, Tamil Nadu, India OP Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Are you a visionary who thrives on designing future-ready data ecosystems? Let's build the next big thing together We're working with top retail and healthcare leaders to transform how they harness data and we're looking for a Data Architect to guide that journey.We are looking for an experienced Data Architect with deep knowledge of Databricks and...

  • Azure Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Azure Databricks ArchitectMust have skillsGood skills in Data warehousing and Datalake architecture; overall 15+ years of experience in Data & Analytics space with more than 3 years of experience on Azure platformEnabled Azure cloud Data platform development by understanding and assessing source systems, identifying ingestion patterns, devising various...

  • Senior Cloud Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking an experienced Senior Cloud Data Architect to lead our data strategy and implement cutting-edge data solutions.This is a fantastic opportunity for a highly skilled professional to take ownership of our data infrastructure and drive innovation in the field of cloud-based data engineering.The ideal candidate will have extensive...