Databricks Architect

1 week ago

bangalore, India Impetus Full time

Joh Description


Overall 8-14 yrs. of Data Engineering experience with 4+ years of hands on experience in Databricks.

Proven experience as a Databricks Architect or similar role with a deep understanding of the Databricks platform and its capabilities.

Analyze business requirements and translate them into technical specifications for data pipelines, data lakes, and analytical processes on the Databricks platform.

Design and architect end-to-end data solutions, including data ingestion, storage, transformation, and presentation layers, to meet business needs and performance requirements.

Lead the setup, configuration, and optimization of Databricks clusters, workspaces, and jobs to ensure the platform operates efficiently and meets performance benchmarks.

Manage access controls and security configurations to ensure data privacy and compliance.

Design and implement data integration processes, ETL workflows, and data pipelines to extract, transform, and load data from various sources into the Databricks platform.

Optimize ETL processes to achieve high data quality and reduce latency.

Monitor and optimize query performance and overall platform performance to ensure efficient execution of analytical queries and data processing jobs.

Identify and resolve performance bottlenecks in the Databricks environment.

Establish and enforce best practices, standards, and guidelines for Databricks development, ensuring data quality, consistency, and maintainability.

Implement data governance and data lineage processes to ensure data accuracy and traceability.

Mentor and train team members on Databricks best practices, features, and capabilities.

Conduct knowledge-sharing sessions and workshops to foster a data-driven culture within the organization.

Will be responsible for Databricks Practice Technical/Partnership initiatives.

Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects.


Skills


In depth hands-on implementation knowledge on Databricks. Delta Lake, Delta table - Managing Delta Tables, Databricks Cluster Configuration, Cluster policies.

Experience handling structured and unstructured datasets

Strong proficiency in programming languages like Python, Pyspark, Scala, or SQL.

Experience with Cloud platforms like AWS understanding of cloud-based data storage and computing services.

Familiarity with big data technologies like Apache Spark, Hadoop, and data lake architectures.

Develop and maintain data pipelines, ETL workflows, and analytical processes on the Databricks platform.

Should have good experience in Data Engineering in Databricks Batch process and Streaming

Should have good experience in creating Workflows & Scheduling the pipelines.

Should have good exposure on how to make packages or libraries available in DB.

Familiarity in Databricks default runtimes

Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

Should have experience working in Agile methodology

Strong verbal and written communication skills.

Strong analytical and problem-solving skills with a high attention to detail.

  • Head of Solutions Architecture

    1 month ago

    bangalore, India Databricks Full time

    FEQ424R284 As a Leader in Solutions Architecture  (Strategic Accounts, Data & AI) , you will lead a team of Solutions Architects (Data & AI) focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, you will build and lead a technical pre-sales team. Your experience partnering with...

  • Leader (Specialist), Data & AI

    2 months ago

    bangalore, India Databricks Full time

    FEQ225R60 As a Leader  (Strategic Accounts, Data & AI) will lead a team of Specialist Solutions Architects (Data & AI), who are Subject Matter Experts in Big Data / Data Engineering / AI & ML, focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, building and lead a technical...

  • Leader (Specialist), Data & AI

    3 weeks ago

    bangalore, India Databricks Full time

    FEQ225R60 As a Leader  (Strategic Accounts, Data & AI) will lead a team of Specialist Solutions Architects (Data & AI), who are Subject Matter Experts in Big Data / Data Engineering / AI & ML, focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, building and lead a technical...

  • Head of Solutions Architecture

    3 weeks ago

    bangalore, India Databricks Full time

    FEQ424R284 As a Leader in Solutions Architecture  (Strategic Accounts, Data & AI) , you will lead a team of Solutions Architects (Data & AI) focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, you will build and lead a technical pre-sales team. Your experience partnering with...

  • Leader , Solutions Architecture (Data & AI)

    2 months ago

    bangalore, India Databricks Full time

    FEQ424R284 As a Senior Manager  (Strategic Accounts, Data & AI) will lead a team of Solutions Architects (Data & AI) focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, you will build and lead a technical pre-sales team. Your experience partnering with the sales organisation...

  • Leader , Solutions Architecture (Data & AI)

    3 weeks ago

    bangalore, India Databricks Full time

    FEQ424R284 As a Senior Manager  (Strategic Accounts, Data & AI) will lead a team of Solutions Architects (Data & AI) focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, you will build and lead a technical pre-sales team. Your experience partnering with the sales organisation...

  • Databricks Lead

    2 months ago

    bangalore, India Wipro Full time

    6-12+ years of experience in architecting large scale data & analytics systems,2+ years of handson experience in complex Databricks implementations,Architect level certification from Databricks,Strong written, verbal communication skills, ability to present to CXOs,Collaboration is key. He / She has to work with different sales, presales and partner teams in...

  • Architect - Azure Databricks

    2 months ago

    bangalore, India Marlabs LLC Full time

    Marlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us – Work Location -...

  • Infinite Computer Solutions

    3 weeks ago

    Bangalore/Chennai/Hyderabad, India Infinite Computer Solutions Full time

    Job Description :As a Databricks Architect with expertise in AWS, you will be responsible for designing and implementing end-to-end data solutions architecture on AWS leveraging Databricks capabilities. You will lead the planning, implementation, optimization, and governance of Databricks deployments on AWS, ensuring scalability, reliability, and performance...

  • Infinite Computer Solutions

    1 month ago

    Bangalore/Chennai/Hyderabad, IN Infinite Computer Solutions Full time

    Job Description :As a Databricks Architect with expertise in AWS, you will be responsible for designing and implementing end-to-end data solutions architecture on AWS leveraging Databricks capabilities. You will lead the planning, implementation, optimization, and governance of Databricks deployments on AWS, ensuring scalability, reliability, and performance...

  • Infinite Computer Solutions

    1 month ago

    Bangalore/Chennai/Hyderabad, India Infinite Computer Solutions Full time

    Job Description :As a Databricks Architect with expertise in AWS, you will be responsible for designing and implementing end-to-end data solutions architecture on AWS leveraging Databricks capabilities. You will lead the planning, implementation, optimization, and governance of Databricks deployments on AWS, ensuring scalability, reliability, and performance...

  • Infinite Computer Solutions

    3 weeks ago

    Bangalore/Chennai/Hyderabad, IN Infinite Computer Solutions Full time

    Job Description :As a Databricks Architect with expertise in AWS, you will be responsible for designing and implementing end-to-end data solutions architecture on AWS leveraging Databricks capabilities. You will lead the planning, implementation, optimization, and governance of Databricks deployments on AWS, ensuring scalability, reliability, and performance...

  • Impetus - Databricks Architect - Big Data

    1 month ago

    bangalore, India Impetus Technologies India Pvt. Ltd Full time

    As a Resident Solutions Architect in our Professional Services team, you will work with customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help customers to get most...

  • Databricks Engineer

    1 month ago

    bangalore, India Prometheus Consulting Full time

    Role : Databricks Engineer.Experience Required : 6 To 10 years.Location : Experience Required : ML Engineer with STRONG Databricks experience, Spark, Python, SQL About the Role : Are you a passionate Databricks engineer looking to join a top MNC and revolutionize the way data is processed and analyzed? We are searching for a talented individual to...

  • Azure Databricks Engineer

    2 months ago

    bangalore, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...

  • Senior Principal Consultant

    3 weeks ago

    bangalore, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • Senior Principal Consultant

    1 month ago

    bangalore, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • Azure Data Architect/ Data Engineer with Databricks

    3 weeks ago

    bangalore, India MNC Full time

    Hi AllUrgent hiring for Azure Data Architect/ Data Engineer with Databricks with MNC for Pan India :Experience: 5 - 12 YrsJob Title Azure Data engineer with DatabricksRelevant Experience &Experience Required(in Yrs) 6+ yearsKey words to search inresume Azure Data Services, and Data BricksTechnical/Functional Skills -MUST HAVE SKILLS · The Engineer with...

  • Azure Data Architect/ Data Engineer with Databricks

    1 month ago

    bangalore, India MNC Full time

    Hi All Urgent hiring for Azure Data Architect/ Data Engineer with Databricks with MNC for Pan India : Experience: 5 - 12 Yrs Job Title Azure Data engineer with Databricks Relevant Experience & Experience Required (in Yrs) 6+ years Key words to search in resume Azure Data Services, and Data Bricks Technical/Functional Skills - MUST HAVE SKILLS · The Engineer...

  • Databricks Architect

    3 weeks ago

    Bangalore, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...