Senior Databricks Developer

4 weeks ago


india Marlabs LLC Full time

Description:

Job Title: Senior Data Engineer - Azure Databricks and Azure Native Services

Location: Bangalore,India

Position Overview:

We are looking for an experienced Senior Data Engineer with 6 to 8 years of hands-on experience working on Azure Databricks and its native services. The Senior Data Engineer will be responsible for designing, building, and optimizing data pipelines to support business objectives, ensuring data quality, reliability, and performance. The ideal candidate will have strong technical skills, a deep understanding of cloud technologies, and a passion for driving innovation in a fast-paced environment.

Key Responsibilities:

Design, develop, and maintain scalable and efficient data pipelines using Azure Databricks and its native services, including Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage. Collaborate with cross-functional teams to understand data requirements, develop technical specifications, and implement solutions that meet business needs. Perform data profiling, cleansing, and transformation to ensure data quality, consistency, and accuracy throughout the data lifecycle. Optimize data pipelines for performance, reliability, and cost-effectiveness, leveraging cloud-native technologies and best practices. Implement security and compliance measures to protect sensitive data and ensure regulatory compliance, including data encryption, access controls, and auditing. Monitor and troubleshoot data pipeline issues, proactively identifying and resolving issues to minimize downtime and ensure data availability. Stay current with emerging technologies and trends in data engineering and cloud computing and evaluate opportunities for innovation and optimization. Mentor junior team members, providing technical guidance, training, and support to foster their professional development and growth.

Qualifications:

Bachelor's or master’s degree in computer science, Engineering, or a related field. 6 to 8 years of experience working as a Data Engineer or a similar role, with a focus on cloud-based data platforms and services, particularly Azure Databricks and its native services. Strong proficiency in SQL, Python, and Spark, with hands-on experience developing ETL processes and data pipelines. Experience working with Azure cloud services such as Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage. Knowledge of data modelling techniques, dimensional modelling, and data warehousing concepts. Excellent analytical and problem-solving skills, with the ability to troubleshoot complex data issues and implement effective solutions. Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.

  • India Marlabs LLC Full time

    Description: Job Title: Senior Data Engineer - Azure Databricks and Azure Native Services Location: Bangalore,India Position Overview: We are looking for an experienced Senior Data Engineer with 6 to 8 years of hands-on experience working on Azure Databricks and its native services. The Senior Data Engineer will be responsible for...

  • Senior Engineer

    4 weeks ago


    India Bristlecone Full time

    ABOUT US : Bristlecone is the leading provider of AI-powered application transformation services for the connected supply chain. We empower our customers with speed, visibility, automation, and resiliency – to thrive on change. Our transformative solutions in Digital Logistics, Cognitive Manufacturing, Autonomous Planning, Smart Procurement and...

  • Senior Engineer

    4 weeks ago


    India Bristlecone Full time

    ABOUT US:Bristlecone is the leading provider of AI-powered application transformation services for the connected supply chain. We empower our customers with speed, visibility, automation, and resiliency – to thrive on change.Our transformative solutions in Digital Logistics, Cognitive Manufacturing, Autonomous Planning, Smart Procurement and Digitalization...


  • india VSquare Systems Pvt. Ltd. Full time

    Job Description - Databricks Required Skills: · 3+ years' experience in PySpark and Python development.-6 · 3+ years of experience in SQL and able to write structured and efficient queries on large data sets - · 3+ years of experience in Databricks · 3+ year's design and/or implementation of data pipelines · Must have professional experience in...

  • Databricks Developer

    2 weeks ago


    india Endurance IT Services Full time

    Job Description Databricks Developer - Virginia Beach (Hybrid On/Off Site)  Key Responsibilities: Design, develop, and maintain robust data pipelines using Azure Databricks and Azure Data Factory.Implement and manage Delta Live Tables for real-time data processing and streaming.Collaborate with data scientists, analysts, and other stakeholders to...

  • Databricks

    6 days ago


    india Tredence Full time

    About Tredence Tredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space. Our...

  • Databricks Engineer

    2 weeks ago


    India Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud. Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company : We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science...

  • Databricks Engineer

    3 weeks ago


    india Arting Digital Private Limited Full time

    Job Description Job Title:-Databricks Engineer Experience:-7+yrLocation:-Hyderabad, Indore, Ahmadabad, Pune, GurgaonWork Mode:- OnsiteQualification:-B.TECH, M.tech, MCASkills:- Databricks, Databricks Admin, Spark, Azure, Docker, Github, Jenkins and Linux/Unix...


  • india Spruce IT Pvt. Ltd. Full time

    Pan India. Experience : 5-8 years. JD : Azure Databricks : Role : Data Engineer (Sr).- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.-...


  • india Exusia Full time

    About The Position Department: Sales and Delivery Team - Empower Industry: Information Technology & Services, Computer Software, Management Consulting Location: Bangalore Experience Range : 5+ years Basic Qualification: Master/Bachelor of Engineering or Equivalent Travel Requirements: Not required Website : ...


  • india Talent Zone Consulting Pvt Ltd Full time

    Job Description :We are seeking a talented and experienced Senior Database Architect with a strong background in the Databricks platform to join our dynamic team. The ideal candidate will have a proven track record of designing and implementing BI, Analytics and DWH solutions, focusing on optimizing performance, scalability, and reliability.Responsibilities...

  • Databricks-de

    4 weeks ago


    India Tredence Full time

    Date: Nov 6, 2023- Location: India- Company: Tredence- Req Id: 4496**About Tredence**: Tredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest...


  • India KARYA CONSULTANTS PRIVATE LIMITED Full time

    Responsibilities :- Closely work with Architect and lead to design solutions to meet functional and non-functional- requirements.- Participate to understand architecture and solution design- artifacts.- Evangelize re-use through the implementation of shared- assets.- Proactively implement engineering methodologies, standards, and leading practices.- Provide...


  • india Marlabs LLC Full time

    Description: Job Title: Data Engineer - Azure Databricks and Azure Native Services Location: Bangalore,India Position Overview: We are looking for a skilled Data Engineer with 3 to 6 years of experience working on Azure Databricks and its native services. The ideal candidate will have a strong background in data...

  • Databricks-de

    2 weeks ago


    India Tredence Full time

    Date: Nov 6, 2023- Location: India- Company: Tredence- Req Id: 4496About Tredence:Tredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in...

  • Databricks Engineer

    2 weeks ago


    india Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud. Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company : We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science...


  • India Developer Studio Full time

    Job Description: IT SENIOR BUSINESS DEVELOPMENT Location: REMOTESalary Package: 3 to 8 LPAJob Summary:We are seeking a dynamic and experienced IT Sales Manager to lead our sales team in driving revenue growth through the sale of IT products and services. The idealcandidate will have a proven track record in IT sales management, a deep understanding of...

  • Manager -Databricks

    4 weeks ago


    india Tredence Full time

    About Tredence Tredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space. Our...

  • Databricks Lead

    4 weeks ago


    india Marlabs LLC Full time

    Description: Job Title: Technical Lead - Azure Databricks Location: Bangalore, India Position Overview: We are looking for an experienced Technical Lead with 8 to 10 years of hands-on experience working on Azure Databricks and Azure native services. The Technical Lead will play a critical role in managing and...


  • India Tredence Full time

    About Tredence Tredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space. Our capabilities...