Azure data engineer

23 hours ago

Anantapur, Andhra Pradesh, India People Prime Worldwide Full time

Our client is a global technology company headquartered in Santa Clara, California. it focuses on helping organisations harness the power of data to drive digital transformation, enhance operational efficiency, and achieve sustainability. over 100 years of experience in operational technology (OT) and more than 60 years in IT to unlock the power of data from your business, your people and your machines. We help enterprises store, enrich, activate and monetise their data to improve their customers' experiences, develop new revenue streams and lower their business costs. Over 80% of the Fortune 100 trust our client for data solutions.

The company's consolidated revenues for fiscal 2024 (ended March 31, 2024). approximately $57.5 billion USD., and the company has approximately 296,000 employees worldwide. It delivers digital solutions utilising Lumada in five sectors, including Mobility, Smart Life, Industry, Energy and IT, to increase our customers' social, environmental and economic value.

  • Job Title: Azure data engineer
  • Location: Pune
  • Experience: 4 To 12 Years
  • Job Type: Contract to hire.
  • Notice Period: Immediate joiners.
  • Mandatory Skills:Azure Functionapp, Azure Databricks,SQL,T-sql, Data Lake Storage, Synapse, Event Hubs, Key Vault,c#,python,java,ETL.

Job description

Must have :

Primary Skill- Azure Functionapp, Azure Databricks (pyspark) good experience.

Secondary skill- SQL,T-sql, Data Lake Storage, Synapse, Event Hubs, Key Vault

Key Responsibilities:


• Design and implement scalable data pipelines using Azure Databricks (PySpark/Scala).


• Develop and deploy Azure Function Apps for event-driven data processing and automation.


• Integrate Databricks with other Azure services like Data Lake Storage, Synapse, Event Hubs, Key Vault, etc.


• Optimize Spark jobs for performance and cost-efficiency.


• Implement CI/CD pipelines using Azure DevOps for Databricks notebooks and Function Apps.


• Monitor and troubleshoot production workloads, ensuring high availability and reliability.


• Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions.

Required Skills & Qualifications:


• Strong experience with Azure Databricks and Apache Spark (PySpark or Scala).


• Proficiency in developing Azure Function Apps using C#, Python, or JavaScript.


• Solid understanding of Azure Data Lake, Event Hubs, Blob Storage, and Key Vault.


• Experience with CI/CD pipelines, Git, and Infrastructure as Code (ARM/Bicep/Terraform).


• Familiarity with data modeling, ETL/ELT processes, and data governance.


• Strong problem-solving skills and ability to work in an agile environment.

Preferred Qualifications:


• Microsoft Certified: Azure Data Engineer Associate or similar certifications.


• Experience with Delta Lake, MLflow, or Unity Catalog.


• Knowledge of monitoring tools like Azure Monitor, Log Analytics, and Application Insights.

  • Azure data engineer

    1 day ago

    Anantapur, Andhra Pradesh, India LTIMindtree Full time

    Role: Azure Data Bricks DeveloperLocation: Nagpur/Bhubaneshwar/KolkataAbout LTIMindtree: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more...

  • Azure Cloud Data Engineer Position

    12 hours ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineering OpportunityWe are seeking an experienced data engineer to develop and maintain scalable data pipelines and build new API integrations.Key Responsibilities:Design and implement efficient data processing solutions using Azure cloud computing services.Collaborate with analytics and business teams to improve data models and increase data...

  • Azure Data Factory Professional

    17 hours ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,06,61,580 - ₹ 1,39,26,970

    About our client : They balance innovation with an open, friendly culture and the backing of a long-established partner company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and...

  • Azure Data and AI Professional

    5 days ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Modern Data and AI ExpertThe role involves driving technical depth and accuracy of training content on Azure's modern data and AI stack.Key Responsibilities:Develop and validate learning content aligned to certification paths such as DP-203, AI-102, and DP-100.Provide technical guidance on Azure data pipelines, lakehouse architecture, and ML/AI...

  • Test Manager

    4 days ago

    Anantapur, Andhra Pradesh, India beBeeAzure Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewThe Senior Test Lead/Manager will be responsible for overseeing the entire testing lifecycle, developing comprehensive test strategies and ensuring the quality of Azure Data solutions.ResponsibilitiesDeveloping and executing test plans to ensure high-quality deliverablesLeading a team of testers and providing guidance on best practices in manual...

  • Senior Cloud Data Engineer

    21 hours ago

    Anantapur, Andhra Pradesh, India beBeeData Full time US$ 1,40,000 - US$ 1,80,000

    Job OverviewWe are seeking a seasoned Data Engineer to join our team. This individual will be responsible for designing, implementing, and maintaining scalable data pipelines and building robust data lakes.Key Responsibilities:Data Pipeline Development: Design, develop, and maintain ETL processes using cloud-native tools such as AWS DMS, AWS Glue, Kafka,...

  • Cloud Data Engineer

    7 days ago

    Anantapur, Andhra Pradesh, India beBee Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Cloud Data EngineerAzure Databricks Engineer with Injection experienceJob DescriptionWe are seeking an experienced Cloud Data Engineer to lead our data ingestion and pipeline development efforts. The ideal candidate will have expertise in CI/CD, Kubernetes, and cloud platforms.The role requires a strong understanding of data ingestion processes,...

  • Data Engineer

    4 days ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineer Remote Work Freelance Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Looking for a data-driven opportunity? We have a fascinating role that could be your perfect fit.Data Engineer - PythonAs a seasoned professional in the field of data engineering, you will play a key role in designing and implementing cloud-based solutions using Azure and Google Cloud platforms. Your expertise in automating data pipelines to facilitate...

  • Senior Data Engineering Professional

    18 hours ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Role: Azure Data EngineerAbout the Opportunity:Develop and maintain large-scale data processing systems using Azure Databricks.Collaborate with cross-functional teams to integrate data engineering solutions into business applications.Design and implement ETL processes using Python, PySpark, and Apache Spark.Analyze complex data sets to identify trends...

  • Cloud Migration Data Engineer

    1 day ago

    Anantapur, Andhra Pradesh, India beBeeDataMigration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineer - Cloud Migration ExpertWe are seeking a skilled data migration specialist with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem.The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex cloud migration...