Azure Data Engineer

4 weeks ago

Bengaluru, India Talent Bee Consulting Pvt Ltd Full time

About the job :

Ideal Candidate :

- 3+ years in Azure Data Engineering

- Very good at ADF (Azure Data Factory)

- Hands-on experience in designing and implementing data solutions on Azure

Organization :

A global provider of Automation solutions in Assembly, Inspection, and Testing for manufacturing industries.

With a mission to enhance the efficiency of the manufacturing processes of their customers by providing innovative technological solutions.

Over the last 16+ years, they have been providing automation solutions that are scalable and cost-effective.

Roles And Responsibilities :

We are seeking an experienced Azure Data Engineer with 4 to 5 years of hands-on experience in Azure Data Factory (ADF), Databricks, and Python.

In this role, you will be responsible for designing, implementing, and managing data solutions on Microsoft Azure, with a specific focus on ADF, Databricks, and Python scripting.

You will collaborate with cross-functional teams to gather data requirements, develop efficient data pipelines, and ensure data quality and integrity.

Key Responsibilities :

- Design and implement data solutions on Azure using ADF, Databricks, Stream Analytics / Spark

- Develop and optimize data pipelines to extract, transform, and load data from various sources into Azure data lakes

- Collaborate with data architects and business stakeholders to understand data requirements and translate them into technical solutions.

- Implement data integration and data transformation processes using ADF and Databricks.

- Perform data profiling, validation, and cleansing activities to ensure data accuracy and consistency.

- Develop and maintain data orchestration workflows and scheduling using ADF.

- Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.

- Optimize data storage and retrieval processes for performance and cost-efficiency.

- Implement data security and privacy measures, including data encryption and access controls.

- Document technical specifications, data mappings, and data lineage for future reference.

Candidate :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- 3 to 5 years of hands-on experience in designing and implementing data solutions on Azure, with a focus on ADF, Databricks, Stream Analytics / Spark

- Strong proficiency in ADF, including pipeline development, data integration, and orchestration.

- Experience with Databricks for data transformation, ETL processes, and data analytics.

- Proficiency in Python scripting for data manipulation, transformation, and automation.

- Solid understanding of data modeling, data warehousing concepts, and data integration patterns.

- Experience with data profiling, data quality management, and data governance practices.

- Familiarity with Azure services like Azure Data Lake Storage, Azure SQL Database, and Azure Cosmos DB.

- Strong analytical and problem-solving skills with the ability to troubleshoot and resolve data-related issues.

- Excellent communication and collaboration skills to work effectively with cross-functional teams.

(ref:hirist.tech)

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    4 days ago

    Bengaluru, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years’ overall experience in data domain (data analysis, database developer)Minimum 3 years’ experience as a cloud-based Data EngineerMinimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...

  • Azure Data Engineer

    9 hours ago

    Bengaluru, India Arcadis Full time

    ARCADISis looking for Azure Data Engineer with a passion to drive and execute Digital to the core of everything we do. We firmly believe in Everything Digital, Digital Everything. We are transforming, we are reimagining the industry and we are reimagining how communities and nations can help becoming more sustainable places to live for today and future...

  • Azure Data Engineer

    3 weeks ago

    Bengaluru, India Direct Client Full time

    Azure Data Engineer - Fivetran or Snowflake SpecialistBengaluru, Data & AnalyticsJOB DESCRIPTION1. Design, develop, and deploy data pipelines and workflows using Fivetran or Snowflake on the Azure platform.2. Collaborate with business stakeholders to gather data requirements and translate them into technical specifications and Configure and customize...

  • Aptus Data Labs

    5 days ago

    Bengaluru, India Aptus Data Labs Full time

    Job Description Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Azure Sr ConsultantExperience : 10 - 16 YearsLocation : Mumbai/Hyderabad/Bangalore (Onsite)Skill : Azure Cloud, Databricks, Data Quality, Data Governance & Modelling, ETL (Azure data...

  • Azure Data Engineer

    1 month ago

    Bengaluru, India Nityo Infotech Full time

    Business Intelligence , C , Engineering , Integration , Java , SQL , A , AWS , Achieve , Activities , Adaptability , Agile , Analysis , Analysis Services , Analytic , Analytics , Approach , Automation , Azure , Backgrounds , Bangalore , Based , Belgium , Building , Building Trust , Business , Business Intelligence , Business Requirements , C , CO , CTS ,...

  • Azure Data Engineer

    2 months ago

    Bengaluru, India Nityo Infotech Full time

    Business Intelligence , C , Engineering , Integration , Java , SQL , A , AWS , Achieve , Activities , Adaptability , Agile , Analysis , Analysis Services , Analytic , Analytics , Approach , Automation , Azure , Backgrounds , Bangalore , Based , Belgium , Building , Building Trust , Business , Business Intelligence , Business Requirements , C , CO , CTS ,...

  • Azure Data engineer

    4 weeks ago

    Bengaluru, India Birlasoft Full time

    Job Title: Azure Databricks LeadLocation: Bangalore/Mumbai/Pune/NoidaCompany Description:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses...

  • Azure Data Engineer

    4 days ago

    Bengaluru, India Arus Info Full time

    Position: Azure Data Engineer Employment Type: Full-time Location: Bangalore or Malaysia About Arus: Software services organization specialized in Application Integration, ERP Implementations, Data Engineering, Analytics and Data Science. We, at Arus, aspires to inspire customers through well-crafted software engineering solutions that lays the foundation to...

  • Azure Data Engineer

    1 month ago

    Bengaluru, Karnataka, India DigitalCube Consultancy Full time

    **Azure Data Engineer** **Job Type - Full time** **Location - Bangalore/ Mumbai, India** **Responsibilities**: - Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services. - Utilize Databricks for big data analytics and real-time data processing, ensuring optimal performance and...

  • Azure Data Engineer

    4 days ago

    Bengaluru, India Arus Info Full time

    Position: Azure Data EngineerEmployment Type: Full-timeLocation: Bangalore or MalaysiaAbout Arus:Software services organization specialized in Application Integration, ERP Implementations, Data Engineering, Analytics and Data Science. We, at Arus, aspires to inspire customers through well-crafted software engineering solutions that lays the foundation to...

  • Azure Data engineer

    4 weeks ago

    Bengaluru, India Birlasoft Full time

    Job Title: Azure Databricks LeadLocation: Bangalore/Mumbai/Pune/NoidaCompany Description: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses...

  • Azure Data engineer

    4 weeks ago

    Bengaluru, India Birlasoft Full time

    Job Title: Azure Databricks LeadLocation: Bangalore/Mumbai/Pune/NoidaCompany Description: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, India Torry Harris Integration Solutions Full time

    Job TitleAzure Data EngineerJob LocationBangalore, Karnataka, IndiaJob DescriptionImplement highly available and scalable Azure and Data bricks cloud data solutions that meet business requirements.Collaborate with cross-functional teams to implement solutions that meet business requirements.Developing and maintaining data lake using Data bricks and data...

  • Azure Data Engineer/Senior Azure Data Engineer

    1 month ago

    Bengaluru, India Saaki Argus & Averil Consulting Full time

    About the Client:Our client is focused on AI and Analytics.Skills and Qualifications:Bachelors or Masters degree in computer science or equivalent4 to 9 years of total IT experience with 2+ years in big data engineering and Microsoft AzureHands on experience in SQL, python and Spark (pyspark), Big Data.Experience in Azure Databricks, Azure Data...

  • Azure Data Engineer

    4 weeks ago

    Bengaluru, India Connectio IT Pvt Ltd Full time

    Role Description :This is a full-time Azure Data Engineer role at Connect io IT Pvt Ltd located in Bengaluru. As an Azure Data Engineer, you will be responsible for tasks such as data engineering, data modeling, Extract Transform Load (ETL), data warehousing, and data analytics. You will work on-site in Bengaluru.Qualifications :- Data Engineering, Data...

  • Azure Data Engineer

    4 weeks ago

    Bengaluru, India Tredence Inc. Full time

    About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Azure Data Engineer

    4 weeks ago

    Bengaluru, India Tredence Inc. Full time

    About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Data Engineer

    4 weeks ago

    Bengaluru, India Swift Strategic Staff Solutions INC Full time

    Notice Period : Immediate Joiner to 30 daysMandatory Skills : Azure Data Bricks, Azure Data Factory (ADF), PySpark, Data Flows, Azure DevOpsJob Description :We are seeking a talented and experienced Data Engineer to join our team. The ideal candidate will have strong expertise in building and optimizing data pipelines and data sets using Azure Data Bricks,...

  • Azure Data Engineer

    2 months ago

    Bengaluru, India Orange Shark Full time

    Position : Azure Data EngineerExperience : 6-10 YearsNotice Period : Immediate to 15 DaysLocation : Bangalore.Primary Skills : Azure, DevOps, Azure Data Factory (Min. 4 Years ), Azure SQL/MS SQL.Job Description :We are seeking a skilled Azure Data Engineer to join our dynamic team. The ideal candidate will have hands-on experience designing, implementing,...

  • Azure Data Engineer

    4 weeks ago

    Bengaluru, India Tredence Inc. Full time

    About Tredence:Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...