Microsoft Azure, Databricks

4 days ago

Mumbai, Maharashtra, India Natobotics Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Hi Connections

We are Hiring
hashtag#Microsoft
Azure, Digital: Python for Data Science, Digital: Databricks, Digital: PySpark, Azure Data Factory # Immediate Joiners

Job Title: Developer

Work Location: Mumbai, MH / Hyderabad, TG / Chennai, TN / Bhubaneswar, OR / Bangalore, KA

Skill Required: Digital: Microsoft Azure, Digital: Python for Data Science, Digital: Databricks, Digital: PySpark, Azure Data Factory

Experience Range in Required Skills: 6-8 Years

Email-

Job Description

  • Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks.
  • Developing scalable and re-usable frameworks for ingesting data sets.
  • Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times.
  • Working with event based streaming technologies to ingest and process data.
  • Working with other members of the project team to support delivery of additional project components (API interfaces, Search).
  • Evaluating the performance and applicability of multiple tools against customer requirements

Key Responsibilities

  • Develop and maintain ETLELT pipelines using Azure Data Factory (ADF) and Azure Databricks.
  • Implement data ingestion flows from diverse sources including Azure Blob Storage, Azure Data Lake, On-Prem SQL, and SFTP.
  • Design and optimize data models and transformations using Oracle, Spark SQL, PySpark, SQL Server, Progress DB SQL.
  • Build orchestration workflows in ADF using activities like Lookup, ForEach, Execute Pipeline, and Set Variable.
  • Perform root cause analysis and resolve production issues in pipelines and notebooks. Collaborate on CICD pipeline creation using Azure DevOps, Jenkins.
  • Apply performance tuning techniques to Azure Synapse Analytics and SQL DW.
  • Maintain documentation including runbooks, technical design specs, and QA test cases Data Pipeline Engineering Design and implement scalable, fault-tolerant data pipelines using Azure Synapse and Data bricks.
  • Ingest data from diverse sources including flat files, DB2, NoSQL, and cloud-native formats (CSV, JSON).
  • Technical Skills Required Cloud Platforms Azure (ADF, ADLS, ADB, Azure SQL, Synapse, Cosmos DB) ETL Tools Azure Data Factory, Azure Databricks Programming SQL, PySpark, Spark SQL DevOps Automation Azure DevOps, Git, CICD, Jenkins

  • Senior Azure Databricks Engineer

    2 weeks ago

    Mumbai, Maharashtra, India MLAI Digital Private Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL) Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • Azure Databricks Engineer

    1 week ago

    Mumbai, Maharashtra, India Capgemini Engineering Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Databricks Developer

    2 weeks ago

    Mumbai, Maharashtra, India Seaspan Corporation Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Seaspan teams are goal-driven and share a high-performance culture, focusing on building services offerings to become a leading asset manager. Seaspan provides many of the world's major shipping lines with alternatives to vessel ownership by offering long-term leases on large, modern containerships and pure car, truck carriers (PCTCs) combined with industry...

  • Databricks Architect

    5 hours ago

    Mumbai, Maharashtra, India Jio Full time US$ 1,20,000 - US$ 2,40,000 per year

    Title: Senior Databricks ArchitectLocation: Mumbai, Gurgaon, HyderabadAbout the RoleWe are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor...

  • Senior Databricks Architect

    2 hours ago

    Mumbai, Maharashtra, India Jio Platforms Limited (JPL) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Work Locations: Mumbai OR Hyderabad OR GurgaonAbout the Role:We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to...

  • Senior Databricks Architect

    5 hours ago

    Mumbai, Maharashtra, India Jio Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    About the RoleWe are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to deliver high-quality data solutions.Key...

  • Azure Databricks Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Zorba Consulting Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    The Azure Data Bricks Engineer plays a critical role in establishing and maintaining an efficient data ecosystem within an organization.This position is integral to the development of data solutions leveraging the capabilities of Microsoft Azure Data Bricks.The engineer will work closely with data scientists and analytics teams to facilitate the...

  • Data Engineer- databricks

    1 week ago

    Mumbai, Maharashtra, India Qualintia Solutions Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    Role- Data Engineer- DatabricksExp- 8+ years,Job Type- ContractualLocation- MumbaiWork Mode- WFO• Learning & Certification Opportunities: Enhance your professional growth.• Comprehensive Medical Coverage and Life Insurance: For your well-being.• Flexible Work Environment: Enjoy a 5-day work week.• Collaborative Culture: Be part of a fun, innovative...

  • Azure Data Architect

    2 weeks ago

    Mumbai, Maharashtra, India ERM Placement Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Azure Data ArchitectExperience: More than 7 yearsLocation: Pan IndiaEmployment Type: Full-TimeTechnology: SQL, ADF, ADLS, Synapse, Pyspark, Databricks, data modellingKey Responsibilities:Requirement gathering and analysisDesign of data architecture and data model to ingest dataExperience with different databases like Synapse, SQL DB, Snowflake...

  • Informatica Developer with Databricks

    1 week ago

    Navi Mumbai, Maharashtra, India Celebal Technologies Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Job Title: ETL Migration Specialist (Informatica to Databricks)Location: Navi MumbaiExperience: 5-7+ YearsDuration: FulltimePosition OverviewWe are looking for an experienced ETL Migration Specialist with strong expertise in Informatica PowerCenter and Databricks (PySpark). The ideal candidate will be responsible for analysing and reverse engineering...