Data Engineer

4 days ago


Jaipur Noida Pune, India Celebal Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Job Description

Data Engineer Microsoft Fabric, Databricks & Azure

Overview:

We are looking for a highly skilled Data Engineer with expertise in Microsoft Fabric, Databricks, Azure Data Factory, SQL, and PySpark to join our data engineering team. This role involves designing and building scalable data pipelines, optimizing data workflows, and enabling advanced analytics across cloud platforms, with a strong focus on Microsoft technologies.

Responsibilities:

  • Design, develop, and maintain data pipelines using Azure Data Factory, Microsoft Fabric, and Databricks.
  • Implement data transformation logic using PySpark and SQL for both batch and streaming workloads.
  • Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver solutions.
  • Manage structured and unstructured data across various sources and formats.
  • Optimize performance of Spark workloads and troubleshoot data pipeline issues.
  • Configure and manage environments, clusters, and user access in Databricks and Microsoft Fabric.
  • Ensure data governance, quality, and security across all data platforms.

Must Have:

  • Hands-on experience with Microsoft Fabric (mandatory).
  • Strong proficiency in SQL and PySpark.
  • Experience with Azure Data Factory for orchestrating data workflows.
  • Solid understanding of Databricks including Spark Core, Spark SQL, and Spark Streaming.
  • Experience with real-time and batch data processing.
  • Familiarity with data modelling and ETL methodologies.

Good to Have:

  • Experience with Azure Synapse Analytics, Azure Data Lake Storage, and Logic Apps.
  • Exposure to Delta Lake, Databricks ML, and Databricks migration projects.
  • Certifications in Microsoft Fabric, Azure Data Engineering, or Databricks.
  • Experience with cloud platforms like AWS or GCP.

Key Skills:

  • SQL, Python, PySpark
  • Microsoft Fabric, Databricks, Azure Data Factory
  • Azure Synapse, Azure Data Lake, Logic Apps
  • Data Modelling, ETL Design, Big Data Technologies

  • Data Engineer

    4 weeks ago


    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 303115NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job Duties As a data engineer you will have a...

  • Data Engineer

    2 weeks ago


    Pune, India Data Axle Full time

    About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Data Engineer

    2 weeks ago


    Pune, India Jash Data Sciences Full time

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you. We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India. We believe in continuous learning and...

  • Data Engineer

    3 days ago


    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India NTT DATA Full time

    Req ID 324612NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Pune Mahxc4x81rxc4x81shtra IN-MH India IN Key Responsibilities Design and...


  • Pune, India Mars Data Insights Full time

    Title: Data Operations Engineer & RUN Support Skills: Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality  Job Location: Pune  Job Type: Fulltime/Hybrid  Work Experience: 5+ years  We are seeking a...


  • Pune, Maharashtra, India Mars Data Insights Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...

  • Mid Data Science

    4 weeks ago


    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 312499 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Mid Data Science AIML GenAI Lead Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job...

  • Data Dynamics

    2 weeks ago


    Pune, India Data Dynamics Full time

    About the Role : We are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...

  • Data engineer

    2 weeks ago


    Jaipur, Rajasthan, India Coforge Full time

    Data Engineer - Informatica.Coforge Ltd. is seeking a Senior Data Engineer with a passion for crafting robust data pipelines to steer business strategies. If you excel in tackling intricate data hurdles and enjoy guiding others, this opportunity in Greater Noida could be your next career move.???? Job Location: Greater Noida???? Experience: 5 to 7 Years????...