Azure Databricks Engineer

4 weeks ago


Bengaluru, Karnataka, India Tata Consultancy Services Full time

Job Summary: We are seeking a highly experienced Azure Databricks Engineer with 10-15 years of experience in ADF/Databricks development. The ideal candidate will have excellent data modeling understanding and strong communication skills.

The successful candidate will be responsible for designing and building data pipelines using Spark-SQL and PySpark in Azure Databricks, as well as maintaining Lakehouse architecture in ADLS / Databricks.

Key Responsibilities:

  • Design and build data pipelines using Spark-SQL and PySpark in Azure Databricks
  • Maintain Lakehouse architecture in ADLS / Databricks
  • Perform data preparation tasks including data cleaning, normalization, deduplication, type conversion etc.
  • Work with DevOps team to deploy solutions in production environments
  • Collaborate with Data Science and Business Intelligence teams

Requirements:

  • Minimum 10-12 years' hands on experience in ADF/Databricks development
  • Good data modeling understanding
  • Strong communication skills
  • 2-5 years of relevant IT experience with good exposure to Cloud technologies
  • Experience using Databricks and proficiency in Microsoft Azure platform (incl. ADF and ADLS)
  • Experience querying databases and strong programming skills: PySpark, Python, SQL, etc.

Preferred Qualifications:

  • Knowledge of distributed systems (e.g., Apache Spark or Databricks)
  • Knowledge of Delta Lake and Lakehouse architecture
  • Experience with multiple data programming languages (Spark-SQL, PySpark, Pandas)
  • Experience with On-premises databases such as SQL server, Oracle etc.
  • Experience with version control (e.g., Git), DevOps, CI/CD


  • Bengaluru, Karnataka, India MindKraft IT Solutions Private Limited Full time

    At MindKraft IT Solutions Private Limited, we are seeking an experienced Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure Databricks.Key Responsibilities:Design and implement efficient data pipelines using Apache Spark and...


  • Bengaluru, Karnataka, India Numentica LLC Full time

    This is a remote position.We are seeking an experienced Azure Databricks Engineer to join our team. The ideal candidate will have over seven years of experience in designing, implementing, and managing data solutions using Azure technologies. This role requires a strong background in Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS) Gen 2,...


  • Bengaluru, Karnataka, India Numentica LLC Full time

    Job Description This is a remote position.We are seeking an experienced Azure Databricks Engineer to join our team. The ideal candidate will have over seven years of experience in designing, implementing, and managing data solutions using Azure technologies. This role requires a strong background in Databricks, Azure Data Factory (ADF), Azure Data Lake...


  • Bengaluru, Karnataka, India Pylon Management Consulting Full time

    Job Summary : We are seeking a highly experienced and skilled Azure Databricks Administrator to join our team. The ideal candidate will have a deep understanding of Azure Databricks, cloud infrastructure, and data engineering principles. You will be responsible for the design, deployment, and management of our Azure Databricks environment, ensuring its...

  • Azure databricks

    7 hours ago


    Bengaluru, Karnataka, India MindKraft IT Solutions Private Limited Full time

    Role- Azure DatabricksExp-8-12 yrsLocation- Bangalore(5 days wfo)JOB DESCRIPTION/ REQUIREMENTOverview Data Engineer having good experience on Azure Databricks and PythonMust Have Databricks Python AzureGood to have ADFRequirementsCandidate must be proficient in DatabricksUnderstands where to obtain information needed to make the appropriate...

  • Azure Databricks

    3 weeks ago


    Bengaluru, Karnataka, India NR Consulting Full time

    Profile Azure Databricks Exp 3-6 years NP 30 days Location BangaloreWe are looking for a Senior software engineer having strong software development experience of 3 to 7years on Azure DataBricks Azure Data FactoryTechnical Skills Strong knowledge hands-on experience in Azure Data Bricks Azure Data Factory Extensive experience in developing and...


  • Bengaluru, Karnataka, India Mazenet solution Full time

    Company OverviewMazenet solution is a prominent player in the IT service industry with a workforce of 201-500 employees. Our company, headquartered in Chennai, provides innovative solutions in various IT domains. With a strong presence in the market, Mazenet solution is dedicated to delivering high-quality services and fostering a positive workplace for our...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Role:Azure Databricks EngineerTechnical Skill Set:ADF/DatabricksExperience Range-10 to 15 YearsLocation-Pan IndiaDesired Competencies:Must-Have:Minimum 10-12 years' hands on experience in ADF/Databricks development. Should have good data modeling understanding. Must have very good communication.Good-to-Have:Understand the data modelling concepts in Database...


  • Bengaluru, Karnataka, India Pylon Management Consulting Full time

    Job Summary :We are seeking a highly experienced and skilled Azure Databricks Administrator to join our team. The ideal candidate will have a deep understanding of Azure Databricks, cloud infrastructure, and data engineering principles. You will be responsible for the design, deployment, and management of our Azure Databricks environment, ensuring its...

  • Azure Databricks

    3 weeks ago


    Bengaluru, Karnataka, India Ahvi Infotech Full time

    About the job Azure DatabricksPosition: Lead - Azure DatabricksOverall IT experience: 8 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouseSecondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, HyderabadEssential experience:Experience in building ETL / data warehouse transformation processes Direct...

  • Azure Databricks

    4 days ago


    Bengaluru, Karnataka, India MindKraft IT Solutions Private Limited Full time

    Role- Azure DatabricksExp-8-12 yrsLocation- Bangalore(5 days wfo)JOB DESCRIPTION/ REQUIREMENTOverview Data Engineer having good experience on Azure Databricks and PythonMust Have Databricks Python AzureGood to have ADFRequirementsCandidate must be proficient in DatabricksUnderstands where to obtain information needed to make the appropriate...


  • Bengaluru, Karnataka, India Ahvi Infotech Full time

    Position: Senior Engineer Azure databricksOverall IT experience: 6 to 9 yearsPrimary Skills: Azure Databricks, PySpark, SQLSecondary Skills: ADF/Azure Data factoryWork Location: Bengaluru/HyderabadMode of work: Hybrid Notice Period: 0 to 30 Days Experience & Expertise:Total Experience: 6 to 9 years in Cloud Data Engineering.Azure Databricks & PySpark:...


  • Bengaluru, Karnataka, India Zone IT Solutions Full time

    We are looking for Azure Databricks Engineer for Bengaluru-based projects for a large-scale project. This is a permanent role with a global IT service leader.Requirements- Ensures 2-4ensures2-4 years of relevant experience in data engineering tools and technologies.- Designing and implementing highly performant data ingestion pipelines from multiple sources...


  • Bengaluru, Karnataka, India Tata Consultancy Services Limited Full time

    Job DescriptionWe are seeking an experienced Azure Databricks Data Engineer to implement, operate and maintain OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, Azure Data Lake Store and Azure Data Factory.The ideal candidate should have a good understanding of Microsoft Azure PaaS features, Azure Cloud and Azure Databricks knowledge. Experience...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job Summary:Tata Consultancy Services is seeking an experienced Azure Databricks Developer to join our team.About the Role:The ideal candidate will have a strong background in data engineering, with experience working with Azure Databricks.Key Responsibilities:Design and implement data pipelines using Azure DatabricksDevelop and maintain scalable data...


  • Bengaluru, Karnataka, India Zone IT Solutions Full time

    We are looking for Azure Databricks Engineer for Bengaluru-based projects for a large-scale project. This is a permanent role with a global IT service leader.RequirementsEnsures 2-4ensures2-4 years of relevant experience in data engineering tools and technologies. Designing and implementing highly performant data ingestion pipelines from multiple sources...


  • Bengaluru, Karnataka, India MindKraft IT Solutions Private Limited Full time

    We are looking for an experienced Data Engineering Expert to join our team. As a key member of our engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure Databricks.Key Responsibilities:Design and implement efficient data pipelines using Apache Spark and DatabricksDevelop and...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job Role : Azure DataBricks EnginnerExperience : 5 - 12 YearsLocation : Noida, Bangalore, Thane, Pune, Kolkata, HyderabadMust Have :Build and maintain the technology platform for both on premise and cloud-based solutionsResponsible for engineering a new cloud data platform analyzing different emerging technology solutions that range from Microsoft Synapse,...

  • Azure Databricks

    4 weeks ago


    Bengaluru, Karnataka, India People Prime Worldwide Full time

    About Client Our client is global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies Powered by more than 84 000 entrepreneurial professionals across more than 30 countries it covers to over 700 clients With its extensive domain and technology...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job Role : Azure DataBricks Enginner Experience : 5 - 12 Years Location : Noida, Bangalore, Thane, Pune, Kolkata, Hyderabad Must Have : Build and maintain the technology platform for both on premise and cloud-based solutions Responsible for engineering a new cloud data platform analyzing different emerging technology solutions that range from Microsoft...