Azure Data Engineer

3 weeks ago

Bengaluru, Karnataka, India Deqode Full time

We are looking for a passionate and detail-oriented Azure Data Engineer to join our growing data team. In this role, you will be responsible for designing, building, and optimizing scalable data platforms on the cloud. The ideal candidate will have strong expertise in the Azure ecosystem, hands-on experience with Databricks and PySpark, and a solid background in data modeling, ELT, and data integration. If you enjoy solving complex data challenges and enabling businesses with meaningful insights, this role is for you.

Key Responsibilities :

- Design and implement robust, scalable, and secure data pipelines using Azure Data Factory and Databricks.

- Develop, optimize, and maintain PySpark code for large-scale data processing and transformation.

- Design and implement ELT processes to support analytical and reporting requirements.

- Build and maintain logical and physical data models to support business intelligence, analytics, and reporting.

- Ingest and integrate structured, semi-structured, and unstructured data from multiple sources ensuring data quality, consistency, and governance.

- Collaborate closely with data architects, analysts, and business stakeholders to deliver end-to-end data solutions.

- Implement best practices for code quality, version control, and automation using GitHub Actions, Azure DevOps, PyTest, and SonarQube.

- Monitor, troubleshoot, and optimize performance of pipelines and data processes.

- Stay up to date with new trends in cloud data engineering, evaluating new tools and frameworks for adoption.

Required Skills & Experience :

Must-Have :

- Hands-on experience with Databricks for data engineering workflows.

- Strong knowledge of Azure Data Factory for pipeline orchestration.

- Solid programming skills in PySpark for big data processing.

Mastery in :

- Cloud ecosystems (Azure / AWS / SAP).

- Data Modeling (dimensional, relational, and modern warehouse/lakehouse approaches).

- ELT methodologies for scalable data integration.

Additional Skills / Tools :

- Data integration & ingestion from multiple sources.

- Data manipulation and processing at scale.

- Proficiency with SQL Databases, Synapse Analytics, Stream Analytics, Glue, Airflow, Kinesis, and Redshift.

- CI/CD knowledge with GitHub Actions / Azure DevOps.

- Testing and code quality tools such as SonarQube and PyTest.

(ref:hirist.tech)

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India KPMG Assurance and Consulting Services LLP Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title: Azure Data EngineerLocation:BangaloreJob Type: [Full-time / Contract / Remote / Hybrid]Experience: 5yrs-13yrsJob Summary:We are seeking a skilled Azure Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience with Azure Data Factory, Azure Data Lake, and Azure Databricks, and a strong understanding of data...

  • Azure Lead Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 248733NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Azure Lead Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Preferred Experience ...

  • Azure Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Global consulting firm seeking an Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will be responsible for designing and implementing robust data pipelines and workflows using Azure cloud technologies. The ideal candidate will possess a deep understanding of data engineering principles and hands-on experience with Azure data...

  • Azure Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Max Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    REQUIRED SKILLS:Bachelor's degree in Computer Science, Engineering, or a related field. Advanced degree preferred.Proven 6-8 years experience in designing, implementing solutions on the Azure ecosystem including expertise in Azure services such as Azure Data Factory, Azure Databricks, Azure Machine Learning, Azure Data Lake Storage, and Azure SQL Database,...

  • Azure Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Infogain Full time

    Posted on October 24 2024ROLES RESPONSIBILITIESCore Skills- Mastery of Azure data services such as Azure SQL Database Azure Cosmos DB and Azure Data Lake Storage - Deep expertise in ETL Extract Transform Load processes and data integration - Advanced SQL and database querying optimization skills - Experience in leading and managing data...

  • Azure Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are looking for an experienced Azure Data Engineer - Senior Consultant .This role requires expertise in designing, implementing, and managing data solutions on Microsoft Azure. The ideal candidate will be well-versed in data architecture, ETL processes, and the Azure ecosystem.Experience: 7 to 8 years Location: Bangalore RequirementsKey...

  • Azure Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    Reporting Engineer (Azure Data Engineer)Experience Required : 5+ yearsLocation : BangaloreJob Description :We are looking for a highly skilled and experienced Azure Data Engineer to join our team. The ideal candidate will have a robust background in developing and maintaining data solutions in Azure Cloud, with expertise in Azure Data Factory (ADF), SSIS,...

  • Machine Learning Engineer with Azure Databricks

    3 days ago

    Bengaluru, Karnataka, India Enable Data Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Design, implement, and maintain data infrastructure to process and store large-scale vision data setsBuild automated workflows for data ingestion, transformation, and validation within the Azure ML ecosystemDevelop monitoring systems and data quality controls for AML pipeline operationsCreate and maintain data asset management strategies within Azure ML...

  • Azure Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Wenger & Watson Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Azure ADF, Databricks with Pyspark/ PythonData Engineer with Pyspark, Databricks skillset 4+ years of experience Data Engineering with min 3+ years hands on experience in Pyspark for data transformationsSound Knowledge on - Azure Data Bricks, Azure Data Lake.Sound knowledge in Data Bricks & Logic AppsDelta Lake, Azure SQL and Azure blob storage, Azure logic...

  • Azure Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Peoplefy Full time

    Job DescriptionJob Title: Azure Data EngineerLocation: Bengaluru - OnsiteJob Description:We are looking for a skilled Operations Engineer to support our Azure-based Data Engineering platform powered by Databricks. This role blends DevOps practices, system reliability, and security auditing to ensure our data infrastructure is robust, secure, and scalable....