Celebal Technologies

7 days ago

Mumbai, India Celebal Technologies Full time

About Us :

Celebal Technologies is a leading Solution Service company that provide Services the field of Data Science, Big Data, Enterprise Cloud & Automation.

We are at the forefront of leveraging cutting-edge technologies to drive innovation and enhance our business processes.

As part of our commitment to staying ahead in the industry, we are seeking a talented and experienced Data & AI Engineer with strong Azure cloud competencies to join our dynamic team.


Job Summary :

We are looking for a highly skilled Azure Data Engineer with a strong background in real-time and batch data ingestion and big data processing, particularly using Kafka and Databricks.

The ideal candidate will have a deep understanding of streaming architectures, Medallion data models, and performance optimization techniques in cloud environments.

This role requires hands-on technical expertise, including live coding during the interview process.


Key Responsibilities :

- Design and implement streaming data pipelines integrating Kafka with Databricks using Structured Streaming.

- Architect and maintain Medallion Architecture with well-defined Bronze, Silver, and Gold layers.

- Implement efficient ingestion using Databricks Autoloader for high-throughput data loads.

- Work with large volumes of structured and unstructured data, ensuring high availability and performance.

- Apply performance tuning techniques such as partitioning, caching, and cluster resource optimization.

- Collaborate with cross-functional teams (data scientists, analysts, business users) to build robust data solutions.

- Establish best practices for code versioning, deployment automation, and data Technical Skills :


- Strong expertise in Azure Databricks and Spark Structured Streaming.


- Processing modes (append, update, complete).

- Output modes (append, complete, update).

- Checkpointing and state management.

- Experience with Kafka integration for real-time data pipelines.

- Deep understanding of Medallion Architecture.

- Proficiency with Databricks Autoloader and schema evolution.

- Deep understanding of Unity Catalog and Foreign catalog.

- Strong knowledge of Spark SQL, Delta Lake, and DataFrames.

- Expertise in performance tuning (query optimization, cluster configuration, caching strategies).

- Must have Data management strategies.

- Excellent with Governance and Access management.

- Strong with Data modelling, Data warehousing concepts, Databricks as a platform.

- Solid understanding of Window functions.


Proven experience in :

- Merge/Upsert logic.

- Implementing SCD Type 1 and Type 2.

- Handling CDC (Change Data Capture) scenarios.

- Retail/Telcom/Energy any one industry expertise.

- Real time use case execution.

- Data modelling.


(ref:hirist.tech)

  • Celebal Technologies

    1 day ago

    Navi Mumbai, India Celebal Technologies Full time

    About Us :Celebal Technologies is a leading Solution Service company that provide Services the field of Data Science, Big Data, Enterprise Cloud & Automation. We are at the forefront of leveraging cutting-edge technologies to drive innovation and enhance our business processes. As part of our commitment to staying ahead in the industry, we are seeking a...

  • Celebal Technologies

    3 days ago

    Navi Mumbai, India Celebal Technologies Full time

    Job Description :Key Responsibilities :ML Pipeline Design & Automation :- Build and maintain CI/CD & CT (Continuous Training) pipelines for ML models using Azure DevOps and Databricks Asset Bundles.- Automate data preprocessing, training, inference and retraining workflows for large-scale ML deployments.- Implement incremental backfills and rolling window...

  • Data Architect-Databricks

    5 days ago

    Navi Mumbai, India Celebal Technologies Full time

    We Are Hiring Databricks Data Architect | Navi Mumbai (Onsite) Are you passionate about designing scalable, enterprise-grade data platforms?Join Celebal Technologies and work on cutting-edge Azure Databricks solutions in the manufacturing and energy sectors Role: Databricks Data Architect Experience: 10+ Years Location: Navi Mumbai (Onsite) Notice Period:...

  • Financial Advisor

    2 weeks ago

    Mumbai, Maharashtra, India Espirits Corporation Full time US$ 90,000 - US$ 1,20,000 per year

    Job Opportunity: Financial Advisor (Equity-Based) – E CelebsLocation : Mumbai / LondonAre you a finance leader who wants to be part of building the next big thing in entertainment, luxury, and Web3?About E CelebsECelebs is pioneering a digital-first ecosystem at the intersection of celebrities, luxury, technology, and the metaverse. We are building a new...

  • Support Engineer

    5 days ago

    Navi Mumbai, India Celebal Technologies Full time

    Job Title: Support Engineer - Data Engineering & Workflow Monitoring Location: Navi MumbaiDuration: Fulltime Role Overview: We are seeking a proactive and detail-oriented Support Engineer to join our Mumbai team. The ideal candidate will be responsible for monitoring data workflows, debugging pipelines, and ensuring timely resolution of issues. This role...

  • SAP Native HANA Developer

    2 weeks ago

    Mumbai, Maharashtra, India Celebal Technologies Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    OnlyImmediate joinersPosition:SAP HANA View DeveloperLocation:Mumbai (On-site 5 days)Experience:5–8 YearsRole OverviewWe are looking for anSAP Native HANA Developerspecialized inCalculation Views. The role involves designing, optimizing, and supporting migration of SAP HANA views to Databricks. This is adevelopment-focused role(not functional or support),...

  • DevOps Engineer

    5 days ago

    Mumbai, India Celebal Technologies Full time

    We are looking for a highly skilledSenior DevOps Engineerwith deep expertise in Azure cloud and strong hands-on experience with Databricks. The role involves designing, implementing, and optimizing DevOps processes, ensuring seamless CI/CD, automation, and infrastructure scalability to support data and AI-driven projects. Key Responsibilities Design,...

  • Senior SAP Consultant

    3 days ago

    navi mumbai, India Celebal Technologies Full time

    We are seeking an experienced SAP HANA Developer with strong expertise in Calculation Views, SQL Script, and performance optimization. The role is development-focused, involving design, enhancement, and optimization of HANA Views, along with supporting their migration to Databricks.Key Responsibilities:Develop and optimize SAP HANA Calculation Views / SQL...

  • Senior SAP Consultant

    3 days ago

    Navi Mumbai, India Celebal Technologies Full time

    We are seeking an experienced SAP HANA Developer with strong expertise in Calculation Views, SQL Script, and performance optimization . The role is development-focused , involving design, enhancement, and optimization of HANA Views, along with supporting their migration to Databricks . Key Responsibilities: Develop and optimize SAP HANA Calculation Views /...

  • Senior SAP Consultant

    4 days ago

    Navi Mumbai, India Celebal Technologies Full time

    We are seeking an experienced SAP HANA Developer with strong expertise in Calculation Views, SQL Script, and performance optimization. The role is development-focused, involving design, enhancement, and optimization of HANA Views, along with supporting their migration to Databricks.Key Responsibilities:Develop and optimize SAP HANA Calculation Views / SQL...