Azure Data Engineer

5 days ago

Pune, Maharashtra, India Cloudesign Full time

Role: Azure Data Engineer
Experience: 8-10 Years
Location: Pune (Hybrid)
Project context
We are seeking an experienced Data Engineer (7+ Years) to lead the design and implementation of scalable data solutions on the Azure Data Platform. The primary focus will be on integrating financial data from SAP BW and SAP BFC into Azure, establishing a reliable and automated data foundation that supports advanced analytics and AI-driven KPI prediction models. This role requires deep technical expertise in Azure cloud services, MS Fabric, Azure Functions, Docker Containers, and Kafka for real-time data processing. The engineer will own the end-to-end data engineering lifecycle from ingestion and transformation to performance optimization and documentation — ensuring the delivery of a robust, maintainable, and high-quality data ecosystem. This project is central to transforming how we process and utilize financial data across the enterprise, enabling predictive insights and data-driven decision-making at scale.

Key Goals and Deliverables

  • Design and implement data pipelines that extract, transform, and load (ETL/ELT) financial data from SAP BW and SAP BFC into Azure using MS Fabric.
  • Utilize Azure Functions, Kafka for streaming and event-driven architecture to support near real-time data ingestion and analytics. Employ Docker containers for deployment and scalability of data processing components, ensuring flexibility across environments.
  • Develop optimized data models to structure financial data for analytical and AI consumption. Implement data cleansing, transformation, and validation processes to ensure data quality and consistency.
  • Establish monitoring, alerting, and optimization mechanisms for pipeline performance. Ensure data integrity, lineage, and compliance with enterprise data governance and security standards.
  • Prepare high-quality, structured datasets to be consumed by AI models for financial KPI prediction. Collaborate with data science teams to ensure data readiness and relevance.
  • Deliver comprehensive technical documentation, architecture diagrams, and maintenance guides. Conduct training and handover sessions to enable ongoing platform sustainability and support.

Ideal Candidate Profile

  • Proven experience in Azure Data Engineering and cloud-native data architectures.
  • Expertise with MS Fabric, Azure Functions, Kafka, and Docker Containers.
  • Solid understanding of data modeling, ETL/ELT processes, and performance tuning.
  • Familiarity with SAP BW and SAP BFC data structures for effective source system integration.
  • Strong sense of ownership, with the ability to work independently and deliver end-to-end solutions.

Expected Skills

  • Microsoft Fabric (MS Fabric)
  • Python
  • Data warehousing
  • Data Governance
  • Azure Functions
  • Apache Kafka
  • Docker Containers
  • Data Modeling (Dimensional & Relational)
  • SAP BW/BFC Data Integration
  • Data Governance and Security
  • CI/CD and GitHub

  • Azure Data Engineer

    1 week ago

    Pune, Maharashtra, India Viraaj HR Solutions Private Limited Full time

    Job Title: Azure Data EngineerIndustry & Sector:Cloud Data & Analytics services within Enterprise IT and Cloud Consulting. We design and deliver scalable Azure-native data platforms, ETL/ELT pipelines, and analytics solutions that power enterprise reporting, analytics, and ML workloads for customers across finance, retail, healthcare, and technology...

  • Azure Data Engineer

    3 days ago

    Pune, Maharashtra, India Bridgenext Full time

    Job ID:Azu-ETP-Pun-1199Location:Pune,OtherJob Summary:We are seeking a skilled and experienced Azure Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining data solutions on the Azure cloud platform. The candidate should have a strong background in data engineering, including ETL...

  • Azure Data Engineer

    5 days ago

    Pune, Maharashtra, India Bridgenext Technologies Full time

    Bridgenext Technologies is looking for Azure Data Engineer to join our team Roles and Responsibility Design, develop, and deploy scalable data pipelines using Azure Data Factory.Collaborate with cross-functional teams to identify and prioritize project requirements.Develop and maintain large-scale data warehouses and data lakes on Azure.Ensure data...

  • Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Elongo Global Solutions Full time

    About the RoleWe are looking for an experiencedAzure Data Engineerto lead the design and implementation ofscalable, high-performance data solutionson theAzure Data Platform.In this role, you will focus onintegrating financial data from SAP BW and SAP BFC into Azure, establishing arobust and automated data foundationthat supportsadvanced...

  • Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India AI Spins INC Full time

    Role: Azure Data EngineerLocation: Pune, IndiaJob Description:Seeking an experienced Azure Cloud Engineer with 7–8 years of IT experience specializing in Azure platform management.Develop, deploy, and maintain Azure cloud services and resources across multiple environments.Configure and manage Azure resources such as VMs, storage accounts, databases, and...

  • Data Engineer

    3 days ago

    Pune, Maharashtra, India Jash Data Sciences Full time

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Azure Data Lead Engineer

    5 days ago

    Pune, Maharashtra, India Persistent Systems Full time

    About Position:We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team.Role: Azure Data Lead EngineerLocation: Pune/ BangaloreExperience: 8 to 10 yearsJob Type: Full Time EmploymentWhat You'll Do:Design and implement complex, scalable data pipelines for ingestion, processing, and...

  • Azure Data Engineer

    3 weeks ago

    Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Job Title: Azure Data EngineerLocation: PuneKey Responsibilities:Developing, managing and optimizing robust and reliable data pipelines using azure native capabilities.Implement ADF workflows that perform data ingestion, data integration/ETL, statistical model executions etc.Creating architecture for data solutions with high performance...

  • Azure Data Engineer

    5 days ago

    Pune, Maharashtra, India CloudMoyo, Inc Full time

    Job DescriptionExperience: 1-3 yearsKey ResponsibilitiesBuild and manage data pipelines using ADF, Data Lake, Fabric, SQL, and DWHDevelop and optimize ETL/ELT processesWrite scripts and automation in Python (AI exposure preferred)Work with cross-functional teams to deliver reliable data solutionsOptional: Work on Databricks and create reports in Power...

  • Azure data engineer

    1 week ago

    Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Role : Azure Data EngineerExperience : 8-12 YearsLocation : PunePlease find the job descriptionDeep hands-on experience with Python,Pyspark,Spark batch,notebook in Azure Experience in Cosmos DB – including data modeling, indexing, partitioning, consistency levels, and performance tuning.Strong understanding of Cosmos DB APIs (Core SQL API, MongoDB API,...