Databricks Engineer with Expertise in Data Engineering

1 week ago


Pune, Maharashtra, India N-Systems Technologies Pvt Ltd Full time

Job Overview

N-Systems Technologies Pvt Ltd is seeking an experienced Azure Databricks Engineer to join our team. The successful candidate will have a minimum of 5 years of experience in designing, developing, and maintaining data pipelines and data streams using Azure Databricks and Python.

About the Role

We are looking for a skilled professional who can extract and transform data, especially unstructured data, across various data processing layers using Databricks, Python. The ideal candidate will be able to design, develop, and optimize data pipelines using Azure Databricks, manage and organize large datasets in Data Lakes, ensuring data quality and integrity.

Responsibilities

  • Design, develop, and optimize data pipelines using Azure Databricks
  • Manage and organize large datasets in Data Lakes, ensuring data quality and integrity
  • Write complex SQL queries to extract, transform, and load data from various sources
  • Monitor and troubleshoot data pipeline performance and resolve issues as they arise
  • Stay up to date with the latest advancements in data engineering and propose innovative solutions to improve data processes
  • Leverage your deep understanding of Azure services to architect solutions that adhere to best practices for security, scalability, and reliability

Required Skills and Qualifications

  • Generic Managerial Skills
  • Experience working in agile development projects and sprint delivery
  • Experience in generating data pipelines in Azure ADF
  • Experience in ingesting data from different Sources using in Azure ADF
  • Experience in transforming the data using Azure Databricks & Delta Lake
  • Experience in Azure DevOps CI/CD Stories, Bugs, and Issue management
  • Implement Integration solution in Microsoft Azure
  • Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
  • Experience working in agile development projects and sprint delivery

Salary Range

The estimated salary for this role is ₹1,500,000 - ₹2,500,000 per annum, based on location and industry standards.


  • Data Engineer

    1 week ago


    Pune, Maharashtra, India Genpact Full time

    About GenpactGenpact is a global professional services company that connects customers to a better future through digital transformation, business process outsourcing, and enterprise cloud applications. We help our clients create and deliver market breakthroughs by combining next-generation digital capabilities such as AI and analytics with deep domain...

  • Data Engineer

    1 week ago


    Pune, Maharashtra, India Tata Consultancy Services Full time

    Welcome to this exciting opportunity at Tata Consultancy Services! As a seasoned Data Engineer, you will play a pivotal role in shaping our client's data strategy using cutting-edge technologies.Job Title: Data Engineer - Azure Databricks ExpertEstimated Salary: ₹1,200,000 - ₹2,400,000 per annumLocation: Bangalore and PuneWe are looking for an...

  • Data Engineer

    5 days ago


    Pune, Maharashtra, India Tata Consultancy Services Full time

    Job SummaryWe are seeking a highly skilled Data Engineer - Databricks Solutions Architect to join our team at Tata Consultancy Services.About the RoleThe successful candidate will be responsible for designing and implementing scalable data solutions using Azure Data Engineering services, including Databricks. You will work closely with cross-functional teams...

  • Big Data Engineer

    2 days ago


    Pune, Maharashtra, India LTIMindtree Full time

    Job SummaryWe are seeking a highly skilled Big Data Engineer - Databricks Expert to join our team at LTIMindtree. The ideal candidate will have experience with Azure Databricks, Python, and Time Series Processing.About the RoleAs a Big Data Engineer - Databricks Expert, you will design, construct, install, test, and maintain highly scalable data management...

  • Databricks Engineer

    1 week ago


    Pune, Maharashtra, India LTIMindtree Full time

    LTIMindtree is a global technology consulting and services company.We are seeking a highly skilled Databricks Engineer with expertise in Python and Time Series processing.The ideal candidate will design, construct, install, test, and maintain highly scalable data management systems using Azure Databricks.The salary for this position is estimated to be around...

  • Data Engineer

    6 minutes ago


    Pune, Maharashtra, India LTIMindtree Full time

    About the RoleWe are seeking an experienced Data Engineer with expertise in Azure Databricks to join our team at LTIMindtree.Key ResponsibilitiesDesign, construct, install, test, and maintain highly scalable data management systems using Azure DatabricksDevelop data processing pipelines using Databricks Notebooks, Spark SQL, and other Databricks...

  • Databricks Engineer

    6 days ago


    Pune, Maharashtra, India LTIMindtree Full time

    At LTIMindtree, we are seeking a highly skilled Databricks engineer to join our team. As a Databricks engineer, you will play a key role in designing and implementing high-quality data management systems using Azure Databricks.The ideal candidate will have experience with Python and Time Series processing, as well as knowledge of Spark SQL and other...


  • Pune, Maharashtra, India LTIMindtree Full time

    Azure Databricks Job DescriptionLTIMindtree is a leading consulting and technology services company seeking an experienced Azure Databricks engineer to join our team.As an Azure Databricks engineer, you will design, construct, install, test, and maintain highly scalable data management systems using Azure Databricks. You will also develop data processing...


  • Pune, Maharashtra, India ACL Digital Full time

    ACL Digital is seeking a highly skilled Data Science Engineer to lead the development of machine learning models on Azure Databricks. With a strong background in data engineering and machine learning, this individual will design, implement, and maintain large-scale data pipelines using Databricks on Azure.About the Role:We are looking for an experienced...


  • Pune, Maharashtra, India Xoriant Solutions Full time

    About the Role:We're looking for an experienced Data Engineer with a strong background in Spark and Scala to join our dynamic team at Xoriant Solutions. As a Data Engineer, you'll play a pivotal role in delivering data and insights to our clients, driving our company's digital transformation, and expanding business capabilities using industry best practices...

  • Senior Data Engineer

    1 month ago


    Pune, Maharashtra, India Genpact Full time

    As a seasoned professional at Genpact, we invite applications for a highly skilled Senior Data Engineer - DataBricks Expert to join our team. This role plays a pivotal part in designing, building, and maintaining scalable and reliable data pipelines using DataBricks, ensuring seamless integration with cross-functional teams. Key Responsibilities: ...


  • Pune, Maharashtra, India Genpact Full time

    Company OverviewGenpact is a global professional services and solutions firm that delivers outcomes that shape the future. Our team of 125,000+ people across 30+ countries is driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients.Job DescriptionWe are inviting applications for the role of Cloud Data Engineer-...


  • Pune, Maharashtra, India PamTen Full time

    Company OverviewPamTen is a leading organization in the field of data engineering and analytics, looking for skilled professionals to join our team.Job SummaryWe are seeking a Python Databricks Data Engineer with expertise in data engineering, analytics, and ETL workflows. The ideal candidate will have hands-on experience in Databricks and strong knowledge...


  • Pune, Maharashtra, India ACL Digital Full time

    We are seeking a highly skilled Machine Learning Engineer to join our team at ACL Digital, based in Pune or Bangalore or Chennai. The successful candidate will have 7+ years of experience in ML Ops and strong expertise in Databricks on AWS.The ideal candidate will have 5+ years of relevant experience in Databricks / ML Ops, with proficiency in automating...


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    Tata Consultancy Services is a leading IT services company with a strong presence in India and globally.The estimated salary range for this role is ₹1,200,000 - ₹2,400,000 per annum based on industry standards and location.Job Overview:We are seeking a highly skilled Senior Data Engineer to join our team in Pune, Mumbai, or Bangalore. The ideal candidate...


  • Pune, Maharashtra, India Softpath Technologies LLC Full time

    Job Title: Data Engineering SpecialistAbout Us:Softpath Technologies LLC is a leading provider of cutting-edge data engineering solutions. Our dynamic team is passionate about delivering high-quality data applications and scalable data pipelines.Salary: $120,000 - $180,000 per annum, depending on experience and qualifications.Job Description:We are seeking a...

  • Azure Data Engineer

    2 days ago


    Pune, Maharashtra, India Talpro Full time

    About This RoleTalpro is seeking a highly skilled Azure Data Engineer to join our team. As an Azure Data Engineer, you will play a key role in designing, building, and maintaining scalable data pipelines and architectures on the Azure platform.Key ResponsibilitiesData Curation and Transformation: Translate business requirements into technical solutions for...


  • Pune, Maharashtra, India Exusia Full time

    OverviewExusia is a cutting-edge digital transformation consultancy that empowers top talent to excel in the DWH & Data Engineering space.Job DescriptionWe are seeking a highly skilled Data Engineer to join our global delivery team's Industry Analytics practice in India. As a key member of our team, you will design, develop, and maintain large-scale Data...


  • Pune, Maharashtra, India ACL Digital Full time

    About the RoleWe are looking for a highly skilled Machine Learning Engineer to lead our team in training and retraining existing ML models using Databricks on the Azure cloud platform.The ideal candidate will have experience working with Databricks, automating training workflows, and handling data from Google BigQuery. In this role, you will be responsible...

  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services (TCS)!We are currently hiring for a challenging role in Data Analytics as an Azure Data Engineer.**Job Overview:**This is an exciting opportunity to work with us on designing and developing solutions using Databricks, SQL, Synapse, Snowflake, Python, and PySpark.Responsibilities:Design and develop data pipelines using...