Azure Data Engineer

6 days ago

Pune, India Cloudesign Technology Full time

Description : Role : Azure Data : 8-10 Years.Location : Pune (Hybrid).Project context.We are seeking an experienced Data Engineer (7+ Years) to lead the design and implementation of scalable data solutions on the Azure Data Platform.The primary focus will be on integrating financial data from SAP BW and SAP BFC into Azure, establishing a reliable and automated data foundation that supports advanced analytics and AI-driven KPI prediction models.This role requires deep technical expertise in Azure cloud services, MS Fabric, Azure Functions, Docker Containers, and Kafka for real-time data processing.The engineer will own the end-to-end data engineering lifecycle from ingestion and transformation to performance optimization and documentation ensuring the delivery of a robust, maintainable, and high-quality data ecosystem.This project is central to transforming how we process and utilize financial data across the enterprise, enabling predictive insights and data-driven decision-making at scale.Key Goals and Deliverables : - Design and implement data pipelines that extract, transform, and load (ETL/ELT) financial data from SAP BW and SAP BFC into Azure using MS Fabric.- Utilize Azure Functions, Kafka for streaming and event-driven architecture to support near real-time data ingestion and analytics.- Employ Docker containers for deployment and scalability of data processing components, ensuring flexibility across environments.- Develop optimized data models to structure financial data for analytical and AI consumption.- Implement data cleansing, transformation, and validation processes to ensure data quality and consistency.- Establish monitoring, alerting, and optimization mechanisms for pipeline performance.- Ensure data integrity, lineage, and compliance with enterprise data governance and security standards.- Prepare high-quality, structured datasets to be consumed by AI models for financial KPI prediction.- Collaborate with data science teams to ensure data readiness and relevance.- Deliver comprehensive technical documentation, architecture diagrams, and maintenance guides.- Conduct training and handover sessions to enable ongoing platform sustainability and support.Ideal Candidate Profile : - Proven experience in Azure Data Engineering and cloud-native data architectures.- Expertise with MS Fabric, Azure Functions, Kafka, and Docker Containers.- Solid understanding of data modeling, ETL/ELT processes, and performance tuning.- Familiarity with SAP BW and SAP BFC data structures for effective source system integration.- Strong sense of ownership, with the ability to work independently and deliver end-to-end solutions.Expected Skills : - Microsoft Fabric (MS Fabric).- Python.- Data warehousing.- Data Governance.- Azure Functions.- Apache Kafka.- Docker Containers.- Data Modeling (Dimensional & Relational).- SAP BW/BFC Data Integration.- Data Governance and Security.- CI/CD and GitHub. (ref:hirist.tech)

  • Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Viraaj HR Solutions Private Limited Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Job Title: Azure Data EngineerIndustry & Sector:Cloud Data & Analytics services within Enterprise IT and Cloud Consulting. We design and deliver scalable Azure-native data platforms, ETL/ELT pipelines, and analytics solutions that power enterprise reporting, analytics, and ML workloads for customers across finance, retail, healthcare, and technology...

  • Azure Data Engineer

    1 week ago

    Pune, Maharashtra, India Mancer Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    NOTE - Only candidates currently based in Pune will be consideredExperience Range - 4-8 Years.We are hiring an experienced Azure Data Engineer to design and deliver scalable data engineering solutions on Microsoft Azure. Youll work on large-scale data platform projects using ADF, Databricks, and Azure Data Lake in a secure and collaborative environment.Roles...

  • Azure Data engineer

    2 weeks ago

    Pune, India Princeton Software Services Pvt. Ltd. Full time

    We are looking for a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. You will work closely with data analysts, scientists, and business stakeholders to ensure efficient data processing, storage, and access. Looking For Banking Domain  Key Responsibilities: · Design and...

  • Data Engineer

    17 hours ago

    Pune, India Worksconsultancy Full time

    Job Description :- Data modeling and architecture: You would be responsible for designing and implementing data models that are optimized for Azure services, including Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.- ETL and data integration: You would be responsible for building and maintaining data pipelines that move data from various...

  • Azure Data Engineer

    2 days ago

    Pune, Maharashtra, India Vidushi Infotech Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking a highly skilled and experienced Azure Data Engineer to join our data team. The ideal candidate will have over five years of professional experience and possess deep expertise in building, managing, and optimizing scalable data pipelines and solutions within the Microsoft Azure ecosystem. This role requires a strong focus on Databricks,...

  • Azure Data Engineer

    2 weeks ago

    Pune, India Tata Consultancy Services Full time

    TCS is Hiring for Azure Data Engineer Experience: 4 - 8 Years Location: PAN India Mode of Interview: Virtual Required Technical Skills Primary: Azure Data Factory (ADF), Azure Databricks (ADB) Secondary: SSIS (SQL Server Integration Services) Strong expertise in Azure Data Engineering & ETL Concepts Hands-on experience with PySpark, Delta Lake, Data Lake /...

  • in Azure Data Engineer.

    2 weeks ago

    Pune, India Radical Technologies Full time

    Apply Before: Position: Azure Data Engineer Location: PuneExperience: 0 to 1 Years.CTC Details: As per company norms About the Role We are looking for a motivated and enthusiastic Fresher Azure Data Engineer to join our dynamic team. This entry-level position is ideal for recent graduates or individuals starting their careers who have a strong interest in...

  • Azure Data engineer

    2 weeks ago

    Pune, India Princeton Software Services Pvt. Ltd. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. You will work closely with data analysts, scientists, and business stakeholders to ensure efficient data processing, storage, and access.Looking For Banking Domain Key Responsibilities:· Design and...

  • Azure Data Engineer

    3 days ago

    Pune, Maharashtra, India Innovative Information Technologies, Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Position: Azure Data EngineerExperience: 5+ YearsLocations:    Pune, India ( Onsite )Mode : HybridJob Description:Responsibilities:1. Data Solutions Design and Implementation:Design and implement modern data architectures using Azure Data Services such as Azure SQL Database, Azure Data Lake, Azure Data Factory,...

  • Azure Data Engineer

    1 week ago

    Pune, Maharashtra, India Cloudesign Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Azure Data EngineerExperience: 8-10 YearsLocation: Pune (Hybrid)Project contextWe are seeking an experienced Data Engineer (7+ Years) to lead the design and implementation of scalable data solutions on the Azure Data Platform. The primary focus will be on integrating financial data from SAP BW and SAP BFC into Azure, establishing a reliable and...