Data Engineer with Azure

4 days ago

Bengaluru India Innova ESI Full time

Job Description Role: Data Engineer with Azure Location Bangalore / Gurugram Type: Fulltime Experience - 9 yrs + Notice:-Immediate Job Description Data Engineer (Azure, ADF, Databricks, PySpark, SCD, Unity Catalog, SQL) Role Overview: Looking for highly skilled experienced Data Engineer with expertise in Azure Data Factory (ADF), Azure Databricks, Delta Tables, Unity Catalog, Slowly Changing Dimension Type 2 (SCD2), and PySpark. The ideal candidate will be responsible for designing, developing, and optimizing data pipelines and ETL workflows while ensuring data integrity, scalability, and security within the Azure ecosystem. Key Responsibilities: - Develop and optimize data pipelines using Azure Data Factory (ADF) and Azure Databricks for large-scale data processing. - Implement Slowly Changing Dimension in Delta Tables to manage historical data changes effectively. - Leverage Unity Catalog for secure and organized data governance, cataloging, and access control across Databricks. - Write efficient PySpark code to process and transform large datasets, ensuring high performance and scalability. - Design and implement ETL/ELT solutions to integrate data from multiple sources into Delta Lake. - Monitor, debug, and optimize existing data pipelines to ensure smooth operations and minimal downtime. - Ensure data quality, consistency, and lineage tracking through best practices and automation. - Collaborate with data architects, analysts, and business teams to define requirements and implement data-driven solutions. Required Skills & Qualifications: - 6+ years of experience in Data Engineering with a focus on Azure technologies. - Expertise in Azure Data Factory (ADF) & Azure Databricks for ETL/ELT workflows. - Strong knowledge of Delta Tables & Unity Catalog for efficient data storage and management. - Experience with Slowly Changing Dimensions (SCD2) implementation in Delta Lake. - Proficiency in PySpark for large-scale data processing & transformation. - Hands-on experience with SQL & performance tuning for data pipelines. - Understanding of data governance, security, and compliance best practices in Azure. - Knowledge of CI/CD, DevOps practices for data pipeline automation. Preferred Qualifications: - Experience with Azure Synapse Analytics, Data Lakes, and Power BI integration. - Knowledge of Kafka or Event Hub for real-time data ingestion. - Certifications in Microsoft Azure (DP-203, DP-900) or Databricks are a plus.

  • Senior .NET Core, Azure, DevOps, and Databricks Engineer

    7 days ago

    Level , Carnival Infopark, Inforpark, Kakkanad Kerala, Kochi, India AZURE,CICD Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities:   Application Development• Design, develop, and maintain high-performance applications using .NET Core.• Collaborate with cross-functional teams to translate business requirements into technical solutions.•  Develop and integrate APIs that support seamless retail operations.   Cloud Architecture & Azure Solutions•...

  • Azure Data Migration

    2 days ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure Data Migration to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Primary...

  • Azure Data Engineer

    1 week ago

    India TCP Corps Full time ₹ 1,20,000 - ₹ 1,80,000 per year

    Job Description: Senior Azure Data Engineer (8+ Years Experience) Location: Remote Salary – Up to 15 LPA   Job Summary:   We are seeking a highly skilled Senior Azure Data Engineer with 8+ years of experience in designing, implementing, and optimizing data solutions on Azure Cloud. The ideal candidate will have strong expertise in Azure Data Factory...

  • Data Engineer

    2 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: Snowflake - working experience...

  • Azure Data Engineer

    19 hours ago

    India Inumellas Full time

    Position - Azure Data Engineer Role - Data Engineer & Senior Data Engineer Exp range - 4 Yrs to 10 Yrs Position Type - Permanent FTE Locations - Bengaluru, Chennai, Hyderabad Company - Global Leader in Data Analytics, Cloud and AI Notice Period - Serving or Immediate Joiners ONLY (Need joining in November or before 15-Dec) Skills & Experience: 5+ years of...

  • Azure Data Engineer Lead

    3 weeks ago

    Bengaluru, India Creative Synergies Group Full time

    Job Description Creative Synergies Group Overview - Creative is a leading Global Technology Services firm delivering innovative solutions that build upon synergies between our Deep Engineering Domain Expertise and Digital Engineering Services - We work with clients across the Global Transportation, Energy/Process, Industrial Products, Hi-Tech, and EdTech...

  • Azure Data Engineer

    3 weeks ago

    india Tata Consultancy Services Full time

    Role - Azure Data Engineer Required Technical Skill Set Azure Data Factory + Azure Databricks. Desired Experience Range - 8 TO 12 years Location of Requirement Mumbai, Bangalore, Hyderabad, Chennai, Gurgaon, Pune.Desired Competencies (Technical/Behavioral Competency) Must-Have Azure Data Factory, Azure Databricks Good-to-Have Python/PysparkResponsibility of...

  • Azure Data Engineer

    3 weeks ago

    India NR Consulting Full time

    Title Azure Data Engineer Location Chennai Hyderabad Bengaluru Exp 4 yrs Key Responsibilities Pipeline Development - Design build and deploy robust ETL ELT pipelines in Databricks PySpark SQL Delta Lake to ingest transform and curate governance and operational metadata from multiple sources landed in Databricks Granular Data Quality Capture - Implement...

  • Azure Data Engineer

    4 days ago

    India SystemBender Full time

    *Role: Azure Data Engineer*• Advance SQL Azure Data Factory (ADF) Databricks with PySpark Azure Synapse (added advantage) • Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and knowledge of Azure Data Factory / Azure Databricks (PySpark) / Azure Data Lake Storage (ADLS Gen 2) • Good to have an excellent...

  • Azure DevOps Engineer

    4 weeks ago

    Remote, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure DevOps Engineer to join our team in Remote, Karntaka (IN-KA), India (IN). Job Duties: Has Azure Experience and...