Azure Data Engineer

4 weeks ago

Bengaluru, India Elanco Full time

Responsibilities:

Provide data engineering subject matter expertise and hands-on data- capture, ingestion, curation, and pipeline development expertise on Azure to deliver cloud optimized data solutions. Provide expert data PaaS on Azure storage; big data platform services; server-less architectures; Azure SQL DB; NoSQL databases and secure, automated data pipelines. Develop and execute test strategies for data pipelines, ETL workflows, and data models. Perform data validation (schema, metadata, row counts, referential integrity, business rules). Automate regression and unit testing for data pipelines using PySpark, SQL, and testing frameworks (, pytest) . Conduct data reconciliation testing between source and target systems. Implement monitoring and alerting for data quality issues . Participate in data/data-pipeline architectural discussions to help build cloud native solutions or migrate existing data applications from on premise to Azure platform. Perform current state “AS-IS” and future state “To-Be” analysis

What You Need to Succeed (minimum qualifications):

Bachelors or higher degree in Computer Science or a related discipline. At least 5 years of data pipeline and data product design, development, delivery experience and deploying ETL/ELT solutions on Azure Data Factory .

What will give you a competitive edge (preferred qualifications):

Azure native data/big-data tools, technologies and services experience including – Storage BLOBS, ADLS, Azure SQL DB, COSMOS DB, NoSQL and SQL Data Warehouse. Sound problem solving skills in developing data pipelines using Data Bricks , Stream Analytics and PowerBI. Strong experience in data testing, ETL testing, and automation frameworks with hands-on expertise in data profiling, reconciliation, and quality checks , along with familiarity with modern data testing tools such Pytest. Knowledge on Distributed System.

Additional Information:

Travel: 0%

Location: India, Bangalore

Don’t meet every single requirement? Studies have shown underrecognized groups are less likely to apply to jobs unless they meet every single qualification. At Elanco we are dedicated to building a diverse and inclusive work environment. If you think you might be a good fit for a role but don't necessarily meet every requirement, we encourage you to apply. You may be the right candidate for this role or other roles

  • Senior Azure Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ERP Senior Specialist Job Title: Azure Senior Data Engineer We are looking a highly skilled and experienced Senior Azure Data Engineer to join our team. This role requires deep expertise in Azure Data Factory and Databricks, including CI/CD setup for Databricks, and strong proficiency in ETL, SQL, and modern data engineering practices. You will be the...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, India Tekskills Inc. Full time

    Job Description Role: Azure Data Engineer Experience: 5-8 years Location: Gurgaon / Pune & Bengaluru Role Overview: We’re looking for a Data Engineer who can design, build, and maintain data pipelines and ETL processes on Azure Cloud, with strong hands-on expertise in Databricks and related Azure data tools. Key Skills Required: Azure Databricks –...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, India Tekskills Inc. Full time

    Job Description Role: Azure Data Engineer Experience: 5-8 years Location: Gurgaon / Pune & Bengaluru Role Overview: We’re looking for a Data Engineer who can design, build, and maintain data pipelines and ETL processes on Azure Cloud, with strong hands-on expertise in Databricks and related Azure data tools. Key Skills Required: Azure Databricks –...

  • Data Engineer(Azure)

    7 days ago

    Bengaluru, India Whatjobs IN C2 Full time

    Skill: Azure Data Engineer Total Experience Required: 4 to 8 years Location: Mumbai/Pune/Bangalore/Gurgaon Overview: We are seeking a highly skilled and motivated Data Engineer to join our growing data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data lake solutions using...

  • Azure Data Engineer

    1 day ago

    Bengaluru, Karnataka, India SWITS DIGITAL Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description: Azure Data EngineerLocations:Pan indiaExperience:5–8 YearsJob OverviewWe are looking for ahands-on Azure Data Engineer / Integration Specialistwith experience inAzure Databricks, Logic Apps, Data Lake, and Data Factory. The candidate will design, develop, and managedata integration pipelines, ETL/ELT processes, and workflow automationon...

  • Azure Data Engineer

    4 weeks ago

    Bengaluru, India Talent Worx Full time

    Global consulting firm seeking an Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will be responsible for designing and implementing robust data pipelines and workflows using Azure cloud technologies. The ideal candidate will possess a deep understanding of data engineering principles and hands-on experience with Azure data...

  • Azure Data Engineer

    4 weeks ago

    Bengaluru, India Talent Worx Full time

    Global consulting firm seeking an Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will be responsible for designing and implementing robust data pipelines and workflows using Azure cloud technologies. The ideal candidate will possess a deep understanding of data engineering principles and hands-on experience with Azure data...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Global consulting firm seeking an Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will be responsible for designing and implementing robust data pipelines and workflows using Azure cloud technologies. The ideal candidate will possess a deep understanding of data engineering principles and hands-on experience with Azure data...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Max Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    REQUIRED SKILLS:Bachelor's degree in Computer Science, Engineering, or a related field. Advanced degree preferred.Proven 6-8 years experience in designing, implementing solutions on the Azure ecosystem including expertise in Azure services such as Azure Data Factory, Azure Databricks, Azure Machine Learning, Azure Data Lake Storage, and Azure SQL Database,...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, India Ascendion Full time

    Experience - 8+ yearsRole - Data Engineer(Tech Lead / Lead Consultant)Location - Bangalore , Hyderabad , ChennaiResponsibilities:Key Responsibility Areas:- Design, build, and manage scalable and reliable data pipelines using Python or PySpark and Azure services.- Lead a team of data engineers; mentor junior team members and enforce best practices in data...