Databricks Architect

4 weeks ago


bangalore, India CGI Full time

Position Description:

Job Description: Databricks Architect
Role Specific Responsibilities Include:
- 10+ years of experience in implementing large data and analytics platforms.
- 5+ years of experience architecting and building data platforms on Azure.
- 5+ years of experience architecting and building data platforms on Databricks from scratch.
- Pro in all Databricks engineering services Unity Catalog, Spark Jobs, Delta Live Table (DLT), DLT Meta, Databricks Workflow, Auto Loader.
- Hands on in Databricks SQL, PySpark
- Understanding of data modelling, data mappings, understand the data model changes and propose the best practices and guidelines.
- Creating technical design based on end-to-end data architecture and frameworks for meta data driven data ingestion, transformation, logging and monitoring.
- Deploying data pipelines/applications to higher environments using CI-CD pipelines
- Experience in writing technical user stories.
- Experience in Agile methodology and scrums.
Key responsibilities:
- Design AWS Databricks platform architecture from scratch.
- Design and build ingestion framework, data processing framework, logging & monitoring framework and, data sharing framework.
- Share Databricks best practices.
- Develop data models in different layers of Databricks.
- Design, build and orchestrate data pipelines in AWS and Databricks
- Define strategy for configuration management and CI/CD
- Perform POCs
Communication:
Excellent communication, presentation and client handling skills written and verbal. Should be able to drive technical discussions with client & partners and share technical thought leadership in architecture and design discussions.

Skills:

Python Security Architecture SQLite

  • bangalore, India Databricks Full time

    CSQ125R58 At Databricks we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Lakehouse platform. As the first Delivery Solutions Architect (DSA) for the team in India, you will play an important role during this journey. You will collaborate with our field engineering teams to accelerate the adoption and...

  • Databricks Lead

    2 weeks ago


    bangalore, India Wipro Full time

    6-12+ years of experience in architecting large scale data & analytics systems,2+ years of handson experience in complex Databricks implementations,Architect level certification from Databricks,Strong written, verbal communication skills, ability to present to CXOs,Collaboration is key. He / She has to work with different sales, presales and partner teams in...


  • bangalore, India Databricks Full time

    FEQ424R284 As a Senior Manager  (Strategic Accounts, Data & AI) will lead a team of Solutions Architects (Data & AI) focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, you will build and lead a technical pre-sales team. Your experience partnering with the sales organisation...


  • bangalore, India Databricks Full time

    FEQ225R60 As a Leader  (Strategic Accounts, Data & AI) will lead a team of Specialist Solutions Architects (Data & AI), who are Subject Matter Experts in Big Data / Data Engineering / AI & ML, focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, building and lead a technical...


  • bangalore, India Marlabs LLC Full time

    Marlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us – Work Location -...


  • Bangalore, India ResourceTree Global Services Full time

    Job Title : Senior Databricks Data EngineerSkillset : Databricks, Datalake Architecture, AzureExperience : 6 - 8 yearsLocation : ChennaiJob Summary : We are seeking an experienced Senior Databricks Data Engineer with a very good understanding of Databricks, Lakehouse concepts, with architecture experience, and a sound knowledge of Azure and its services....


  • bangalore, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...

  • DataBricks Engineer

    1 month ago


    Bangalore, India Magna International Inc. Full time

    About us  We see a future where everyone can live and move without limitations. That’s why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above all, people.   Forward. For all.   Group Summary  Magna is more than one of the world’s largest...

  • DataBricks Engineer

    4 weeks ago


    bangalore, India Magna Full time

    About us We see a future where everyone can live and move without limitations. That’s why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above all, people. Forward. For all. Group Summary Magna is more than one of the world’s largest suppliers in the...


  • Bangalore, India ResourceTree Global Services Full time

    Resource Tree Global Services Pvt Ltd is hiring Senior Databricks Data Engineer for one of its leading client in Content & Data Analytics. Below are the details .Job Title : Senior Databricks Data EngineerSkills Required : Azure, Databricks, Datalake, Python/Scala/Java, Data Migration Strategies, Data Warehiusing, Data Modelling, Strong knowledge on Data...


  • Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...


  • Bangalore, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...


  • bangalore, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...

  • AWS Architect

    4 weeks ago


    Bangalore, India Freelancer Recruiter Full time

    Over 10-14 years of IT experience- Deep expertise in S3, Redshift, Spectrum, Glue, SQS, and SNS services.- Very good Data lake concepts and at least 1 end to end project of data lake using AWS- Deep understanding of architecture and work experience on Databricks, hands-on programming with Data Frames, Python, Scala.- Experience with large data sets, data...

  • AWS Architect

    3 weeks ago


    Bangalore, Karnataka, India Freelancer Recruiter Full time

    Over 10-14 years of IT experience- Deep expertise in S3, Redshift, Spectrum, Glue, SQS, and SNS services.- Very good Data lake concepts and at least 1 end to end project of data lake using AWS- Deep understanding of architecture and work experience on Databricks, hands-on programming with Data Frames, Python, Scala.- Experience with large data sets, data...


  • Bangalore/Chennai/Hyderabad/Mumbai/Pune/Noida, IN ACZ Global Private Limited Full time

    Azure Data ArchitectMandatory Skills : Solution Architecture - Pyspark + Databricks + Adf + Synapse is mandatoryJob Description :We are seeking a highly skilled and experienced Azure Data Architect to join our team. As an Azure Data Architect, you will play a key role in designing and implementing data solutions on the Microsoft Azure platform. The ideal...


  • Bangalore/Chennai/Hyderabad/Mumbai/Pune/Noida, India ACZ Global Private Limited Full time

    Azure Data ArchitectMandatory Skills : Solution Architecture - Pyspark + Databricks + Adf + Synapse is mandatoryJob Description :We are seeking a highly skilled and experienced Azure Data Architect to join our team. As an Azure Data Architect, you will play a key role in designing and implementing data solutions on the Microsoft Azure platform. The ideal...


  • Anywhere in India/Multiple Locations/Kolkata/Chennai/Bangalore/Pune/Gurgaon/Gurugram Tredence Full time

    Job Description : We are seeking an experienced professional who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Roles and Responsibilities :-...


  • bangalore, India MNC Full time

    Hi AllUrgent hiring for Azure Data Architect/ Data Engineer with Databricks with MNC for Pan India :Experience: 5 - 12 YrsJob Title Azure Data engineer with DatabricksRelevant Experience &Experience Required(in Yrs) 6+ yearsKey words to search inresume Azure Data Services, and Data BricksTechnical/Functional Skills -MUST HAVE SKILLS · The Engineer with...

  • Data Scientist

    4 weeks ago


    bangalore, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...