Azure data engineer

6 days ago

Bengaluru, Karnataka, India People Prime Worldwide Full time

Our client is a global technology company headquartered in Santa Clara, California. it focuses on helping organisations harness the power of data to drive digital transformation, enhance operational efficiency, and achieve sustainability. over 100 years of experience in operational technology (OT) and more than 60 years in IT to unlock the power of data from your business, your people and your machines. We help enterprises store, enrich, activate and monetise their data to improve their customers' experiences, develop new revenue streams and lower their business costs. Over 80% of the Fortune 100 trust our client for data solutions.

The company's consolidated revenues for fiscal 2024 (ended March 31, 2024). approximately $57.5 billion USD., and the company has approximately 296,000 employees worldwide. It delivers digital solutions utilising Lumada in five sectors, including Mobility, Smart Life, Industry, Energy and IT, to increase our customers' social, environmental and economic value.

  • Job Title: Azure data engineer
  • Location: Pune
  • Experience: 4 To 12 Years
  • Job Type: Contract to hire.
  • Notice Period: Immediate joiners.
  • Mandatory Skills:Azure Functionapp, Azure Databricks,SQL,T-sql, Data Lake Storage, Synapse, Event Hubs, Key Vault,c#,python,java,ETL.

Job description

Must have :

Primary Skill- Azure Functionapp, Azure Databricks (pyspark) good experience.

Secondary skill- SQL,T-sql, Data Lake Storage, Synapse, Event Hubs, Key Vault

Key Responsibilities:


• Design and implement scalable data pipelines using Azure Databricks (PySpark/Scala).


• Develop and deploy Azure Function Apps for event-driven data processing and automation.


• Integrate Databricks with other Azure services like Data Lake Storage, Synapse, Event Hubs, Key Vault, etc.


• Optimize Spark jobs for performance and cost-efficiency.


• Implement CI/CD pipelines using Azure DevOps for Databricks notebooks and Function Apps.


• Monitor and troubleshoot production workloads, ensuring high availability and reliability.


• Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions.

Required Skills & Qualifications:


• Strong experience with Azure Databricks and Apache Spark (PySpark or Scala).


• Proficiency in developing Azure Function Apps using C#, Python, or JavaScript.


• Solid understanding of Azure Data Lake, Event Hubs, Blob Storage, and Key Vault.


• Experience with CI/CD pipelines, Git, and Infrastructure as Code (ARM/Bicep/Terraform).


• Familiarity with data modeling, ETL/ELT processes, and data governance.


• Strong problem-solving skills and ability to work in an agile environment.

Preferred Qualifications:


• Microsoft Certified: Azure Data Engineer Associate or similar certifications.


• Experience with Delta Lake, MLflow, or Unity Catalog.


• Knowledge of monitoring tools like Azure Monitor, Log Analytics, and Application Insights.

  • Azure Lead Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 248733NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Azure Lead Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Preferred Experience ...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Global consulting firm seeking an Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will be responsible for designing and implementing robust data pipelines and workflows using Azure cloud technologies. The ideal candidate will possess a deep understanding of data engineering principles and hands-on experience with Azure data...

  • Azure Data Engineer

    7 days ago

    Bengaluru, Karnataka, India 3K SOFTECH PRIVATE LIMITED Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Technical Skills :Azure Data Services : In-depth experience with Azure Data Factory, Azure Databricks, and other Azure data solutions like Azure Synapse, Azure Blob Storage, Azure SQL Database, etc. Big Data Technologies : Strong proficiency in Apache Spark and PySpark for processing large datasets, with hands-on experience in optimizing Spark jobs. ...

  • Azure Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Infogain Full time

    Posted on October 24 2024ROLES RESPONSIBILITIESCore Skills- Mastery of Azure data services such as Azure SQL Database Azure Cosmos DB and Azure Data Lake Storage - Deep expertise in ETL Extract Transform Load processes and data integration - Advanced SQL and database querying optimization skills - Experience in leading and managing data...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We are looking for an experienced Azure Data Engineer - Senior Consultant .This role requires expertise in designing, implementing, and managing data solutions on Microsoft Azure. The ideal candidate will be well-versed in data architecture, ETL processes, and the Azure ecosystem.Experience: 7 to 8 years Location: Bangalore RequirementsKey...

  • Azure Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Talent Worx Full time US$ 90,000 - US$ 1,20,000 per year

    We are looking for an experienced Azure Data Engineer Senior Consultant . This role requires expertise in designing, implementing, and managing data solutions on Microsoft Azure. The ideal candidate will be well-versed in data architecture, ETL processes, and the Azure ecosystem.Experience : 7 to 8 years.Location : Bangalore.RequirementsKey Responsibilities...

  • Machine Learning Engineer with Azure Databricks

    7 days ago

    Bengaluru, Karnataka, India Enable Data Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Design, implement, and maintain data infrastructure to process and store large-scale vision data setsBuild automated workflows for data ingestion, transformation, and validation within the Azure ML ecosystemDevelop monitoring systems and data quality controls for AML pipeline operationsCreate and maintain data asset management strategies within Azure ML...

  • Azure Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    Reporting Engineer (Azure Data Engineer)Experience Required : 5+ yearsLocation : BangaloreJob Description :We are looking for a highly skilled and experienced Azure Data Engineer to join our team. The ideal candidate will have a robust background in developing and maintaining data solutions in Azure Cloud, with expertise in Azure Data Factory (ADF), SSIS,...

  • Azure Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Aionos Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are seeking a highly skilled Senior Data Engineer with 12+ years of experience in data engineering and 8+ years of hands-on expertise in Azure technologies. The ideal candidate will have strong skills in ELT, data modeling, integration, and Kubernetes, along with experience in Azure Data Factory and Databricks. This role requires strong technical...

  • Azure Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Peoplefy Full time

    Job DescriptionJob Title: Azure Data EngineerLocation: Bengaluru - OnsiteJob Description:We are looking for a skilled Operations Engineer to support our Azure-based Data Engineering platform powered by Databricks. This role blends DevOps practices, system reliability, and security auditing to ensure our data infrastructure is robust, secure, and scalable....