Azure Databricks Technical Lead

13 hours ago


Pune, Maharashtra, India Hoonar Tekwurks Private Limited Full time
Job Title: Azure Databricks Technical Lead

The ideal candidate for this role will have a minimum of 5 years of experience architecting and building data platforms on Azure. With expertise in Azure Databricks, PySpark, and SQL, the selected individual will play a critical role in designing, implementing, and optimizing data solutions using Azure Databricks.

Our estimate for the salary range for this position is between ₹18,00,000 - ₹30,00,000 per annum, based on national averages and industry standards.

About the Job:
  • We are seeking a highly skilled professional to lead our team in designing and implementing scalable data processing pipelines using Azure Databricks and PySpark.
  • The successful candidate will be responsible for creating ETL processes to ingest, transform, and load data from various sources and collaborating with data engineers and architects to ensure efficient data movement and transformation.
Key Responsibilities:
  • Data Pipeline Design and Development:
    Create data processing pipelines that can handle large volumes of data and provide high performance.
  • Data Quality Implementation:
    Implement data quality checks and validation rules within Azure Databricks and monitor data quality metrics.
  • Unity Catalog Integration:
    Integrate Azure Databricks Unity Catalog to manage metadata, tables, and views.
  • Delta Lake Expertise:
    Understand and utilize Delta Lake for reliable data storage and versioning.
  • Performance Tuning and Query Optimization:
    Analyze query performance and optimize SQL queries, Spark jobs, and transformations for efficiency.
  • Resource Optimization:
    Manage compute resources effectively within Azure Databricks clusters.
  • Source System Integration:
    Integrate Azure Databricks with various source systems.
Requirements:
  • Bachelor's degree in computer science or a related field.
  • Minimum 5 years of experience architecting and building data platforms on Azure.
  • Proficiency in Azure Databricks, PySpark, and SQL.
  • Familiarity with Delta Lake concepts.


  • Pune, Maharashtra, India Hoonar Tekwurks Private Limited Full time

    Job Title: Lead Data Engineer for Azure DatabricksWe are seeking an experienced Lead Data Engineer to join our team at Hoonar Tekwurks Private Limited. The ideal candidate will have a strong background in designing and implementing data solutions using Azure Databricks and a minimum of 5 years of experience working with data platforms on Azure.Our estimated...

  • Data Engineer

    7 days ago


    Pune, Maharashtra, India LTIMindtree Full time

    About the RoleWe are seeking an experienced Data Engineer with expertise in Azure Databricks to join our team at LTIMindtree.Key ResponsibilitiesDesign, construct, install, test, and maintain highly scalable data management systems using Azure DatabricksDevelop data processing pipelines using Databricks Notebooks, Spark SQL, and other Databricks...


  • Pune, Maharashtra, India LTIMindtree Full time

    Azure Databricks Job DescriptionLTIMindtree is a leading consulting and technology services company seeking an experienced Azure Databricks engineer to join our team.As an Azure Databricks engineer, you will design, construct, install, test, and maintain highly scalable data management systems using Azure Databricks. You will also develop data processing...


  • Pune, Maharashtra, India ACL Digital Full time

    About the RoleWe are looking for a highly skilled Machine Learning Engineer to lead our team in training and retraining existing ML models using Databricks on the Azure cloud platform.The ideal candidate will have experience working with Databricks, automating training workflows, and handling data from Google BigQuery. In this role, you will be responsible...

  • Data Engineer

    3 weeks ago


    Pune, Maharashtra, India Tata Consultancy Services Full time

    Welcome to this exciting opportunity at Tata Consultancy Services! As a seasoned Data Engineer, you will play a pivotal role in shaping our client's data strategy using cutting-edge technologies.Job Title: Data Engineer - Azure Databricks ExpertEstimated Salary: ₹1,200,000 - ₹2,400,000 per annumLocation: Bangalore and PuneWe are looking for an...


  • Pune, Maharashtra, India Hoonar Tekwurks Private Limited Full time

    Job Title: Databricks Solutions ArchitectWe are seeking an experienced Databricks Solutions Architect to join our team at Hoonar Tekwurks Private Limited. The ideal candidate will have a strong background in designing and implementing data solutions using Azure Databricks and a minimum of 5 years of experience working with data platforms on Azure.Our...


  • Pune, Maharashtra, India ACL Digital Full time

    ACL Digital is seeking a highly skilled Data Science Engineer to lead the development of machine learning models on Azure Databricks. With a strong background in data engineering and machine learning, this individual will design, implement, and maintain large-scale data pipelines using Databricks on Azure.About the Role:We are looking for an experienced...


  • Pune, Maharashtra, India Genpact Full time

    Unlock Data-Driven Insights with Our Senior Databricks Developer Lead RoleWe are seeking an experienced Senior Databricks Developer Lead to join our team at Genpact, a global professional services and solutions firm. As a key member of our data engineering team, you will be responsible for solving real-world cutting-edge problems and driving business value...


  • Pune, Maharashtra, India N-Systems Technologies Pvt Ltd Full time

    Job Overview:N-Systems Technologies Pvt Ltd is seeking an experienced Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data pipelines using Azure Databricks.Estimated Salary: ₹1,200,000 - ₹1,800,000 per annumKey Responsibilities:Design, develop, and optimize...

  • Databricks Engineer

    2 weeks ago


    Pune, Maharashtra, India LTIMindtree Full time

    At LTIMindtree, we are seeking a highly skilled Databricks engineer to join our team. As a Databricks engineer, you will play a key role in designing and implementing high-quality data management systems using Azure Databricks.The ideal candidate will have experience with Python and Time Series processing, as well as knowledge of Spark SQL and other...


  • Pune, Maharashtra, India Foundit Full time

    **About Foundit**Foundit is a leading organization in the field of data engineering, and we're seeking an experienced Azure Data Engineering Lead to join our team.**Job Summary**We're looking for a highly skilled professional with expertise in Azure development and data solutions. The ideal candidate will have a strong background in cloud data technologies,...

  • Azure Technical Lead

    13 hours ago


    Pune, Maharashtra, India InterSources Inc Full time

    About the OpportunityWe are looking for an experienced Azure Technical Lead to join our team at InterSources Inc. As an Azure Technical Lead, you will be responsible for leading the implementation of Azure-based solutions for our clients.Key ResponsibilitiesDesign and implement scalable and secure cloud architectures on the Azure platform.Develop and...

  • Big Data Engineer

    1 week ago


    Pune, Maharashtra, India LTIMindtree Full time

    Job SummaryWe are seeking a highly skilled Big Data Engineer - Databricks Expert to join our team at LTIMindtree. The ideal candidate will have experience with Azure Databricks, Python, and Time Series Processing.About the RoleAs a Big Data Engineer - Databricks Expert, you will design, construct, install, test, and maintain highly scalable data management...

  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Tata Consultancy Services Full time

    Job SummaryWe are seeking a highly skilled Data Engineer - Databricks Solutions Architect to join our team at Tata Consultancy Services.About the RoleThe successful candidate will be responsible for designing and implementing scalable data solutions using Azure Data Engineering services, including Databricks. You will work closely with cross-functional teams...

  • Databricks Engineer

    3 weeks ago


    Pune, Maharashtra, India LTIMindtree Full time

    LTIMindtree is a global technology consulting and services company.We are seeking a highly skilled Databricks Engineer with expertise in Python and Time Series processing.The ideal candidate will design, construct, install, test, and maintain highly scalable data management systems using Azure Databricks.The salary for this position is estimated to be around...


  • Pune, Maharashtra, India N-Systems Technologies Pvt Ltd Full time

    Job OverviewN-Systems Technologies Pvt Ltd is seeking an experienced Azure Databricks Engineer to join our team. The successful candidate will have a minimum of 5 years of experience in designing, developing, and maintaining data pipelines and data streams using Azure Databricks and Python.About the RoleWe are looking for a skilled professional who can...

  • Senior Data Engineer

    1 month ago


    Pune, Maharashtra, India Genpact Full time

    As a seasoned professional at Genpact, we invite applications for a highly skilled Senior Data Engineer - DataBricks Expert to join our team. This role plays a pivotal part in designing, building, and maintaining scalable and reliable data pipelines using DataBricks, ensuring seamless integration with cross-functional teams. Key Responsibilities: ...


  • Pune, Maharashtra, India MICHELIN Full time

    We are seeking an exceptional Azure Data Engineering Leader to join our team at MICHELIN.About the RoleThis is a challenging and rewarding opportunity for an experienced professional with expertise in Azure data engineering, technical leadership, and stakeholder management.Job DescriptionThe successful candidate will lead the design, development, and...


  • Pune, Maharashtra, India Birlasoft Full time

    About BirlasoftBirlasoft is a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation.As part of the CK Birla Group, a...


  • Pune, Maharashtra, India DFCS Technologies Full time

    **Job Title:** Azure Data Architecture Specialist**Location:** [Location: Assuming based on the job title and company]**Salary:** $180,000 - $220,000 per yearDFCS Technologies is seeking an experienced Azure Data Architecture Specialist to design, develop, and manage scalable, reliable, and secure data pipelines on the Microsoft Azure platform. As a key...