Azure Data Engineer

3 weeks ago

Bengaluru, Karnataka, India GALAXY I TECHNOLOGIES INC Full time

Role Description :

We are seeking a highly skilled Azure Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust and scalable data pipelines on the Microsoft Azure platform. This role involves integrating, transforming, and consolidating data from various sources to enable business intelligence and analytics. You will work closely with stakeholders to understand their data needs and deliver efficient, high-quality data solutions.

Key Responsibilities :

- Data Pipeline Development: Design and implement data pipelines using Azure Data Factory and Databricks to ingest, transform, and load data from various sources.

- Big Data Processing: Utilize PySpark and Databricks notebooks to process large datasets and implement complex data transformations.

- Data Integration & Consolidation: Integrate and consolidate data from structured and unstructured sources, loading the processed data into Azure Data Lake Storage (ADLS).

- ETL/ELT Processes: Develop and maintain Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes, including the use of SSIS.

- DevOps & CI/CD: Implement Azure DevOps and CI/CD pipelines for automated deployment of data solutions.

- Solution Design: Collaborate with business stakeholders to understand customer needs and translate them into effective technical data solutions.

Technical Skills :

- Azure Services: Azure Databricks (3+ years of experience), Azure Data Factory, Azure Data Lake Storage (ADLS), Storage Services, Azure Functions, Serverless architecture.

- Programming & Scripting: Strong experience in PySpark and Python.

- Databases: Proficiency in SQL or native SQL query languages.

- Data Transformation: Experience with SSIS/ETL transformation processes.

- DevOps: Experience with Azure DevOps and CI/CD deployments.

Education :

- A Bachelor's degree in Computer Science, Information Technology, or a related technical field.

Required Experience :

- 4-6 years of experience in data engineering.

- A minimum of 3 years of relevant experience with PySpark and Azure Databricks.

Certifications (Preferred) :

- DP-203: Data Engineering on Microsoft Azure

(ref:hirist.tech)

  • Azure Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Global consulting firm seeking an Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will be responsible for designing and implementing robust data pipelines and workflows using Azure cloud technologies. The ideal candidate will possess a deep understanding of data engineering principles and hands-on experience with Azure data...

  • Azure Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India ALIQAN Technologies Full time

    Job Title : Senior Azure Data Engineer (Contract)Company : ALIQAN Technologies (Client: MNC)Location : Bangalore, IndiaExperience : 8-13 yearsNotice Period : Immediate joiners onlyJob Type : ContractAbout the Role :We're looking for an experienced Senior Azure Data Engineer to join our client's team in Bangalore. As a Senior Azure Data Engineer, you will...

  • Azure Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We are looking for an experienced Azure Data Engineer - Senior Consultant .This role requires expertise in designing, implementing, and managing data solutions on Microsoft Azure. The ideal candidate will be well-versed in data architecture, ETL processes, and the Azure ecosystem.Experience: 7 to 8 years Location: Bangalore RequirementsKey...

  • Azure Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Talent Worx Full time

    We are looking for an experienced Azure Data Engineer Senior Consultant . This role requires expertise in designing, implementing, and managing data solutions on Microsoft Azure. The ideal candidate will be well-versed in data architecture, ETL processes, and the Azure ecosystem. Experience : 7 to 8 years. Location : Bangalore.Requirements : Key...

  • Azure Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Teamware Solutions Full time

    As a Sr. Azure Cloud Data Engineer, you will play a crucial role in Trane Technologies' organization, in processing and analysing IoT data from our connected products to drive value for our customers. You will be responsible for delivering analytical data solutions for both internal and external customers. The Cloud Data Engineer plays an active role in...

  • Azure Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Elanco Full time US$ 90,000 - US$ 1,20,000 per year

    At Elanco (NYSE: ELAN) – it all starts with animalsAs a global leader in animal health, we are dedicated to innovation and delivering products and services to prevent and treat disease in farm animals and pets. We're driven by our vision of 'Food and Companionship Enriching Life' and our approach to sustainability – the Elanco Healthy Purpose – to...

  • Azure Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Galaxy I Technologies Inc Full time

    Hi, Everyone*****Contract to Hire Only*******Contract to Hire Only*******Job Role: Azure Data Engineer Loc: Hyderabad, Chennai, Bangalore, Pune (WFO)Job Description: Skill Required: Digital: Databricks- Azure Data Factory Experience Range in Required Skills: 4-6 Years Job Description:1.3+ years of relevant experience in Pyspark and Azure...

  • Azure Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Galaxy i technologies Inc Full time

    Hi, Everyone*****Contract to Hire Only*******Contract to Hire Only*******Job Role: Azure Data EngineerLoc: Hyderabad, Chennai, Bangalore, Pune (WFO)Job Description:Skill Required: Digital: Databricks- Azure Data FactoryExperience Range in Required Skills: 4-6 YearsJob Description:1. 3+ years of relevant experience in Pyspark and Azure Databricks.2....

  • Azure Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Galaxy i technologies Inc Full time

    Hi, Everyone *****Contract to Hire Only*******Contract to Hire Only******* Job Role: Azure Data Engineer Loc: Hyderabad, Chennai, Bangalore, Pune (WFO) Job Description: Skill Required: Digital: Databricks- Azure Data Factory Experience Range in Required Skills: 4-6 Years Job Description: 1. 3+ years of relevant experience in Pyspark and Azure...

  • Azure Data Engineer

    13 hours ago

    Bengaluru, Karnataka, India GC Technologies Pvt Ltd Full time

    Data EngineerLocation: Pune -WFONP :15daysExperience : 5+yrsBudget: Max 12 LPAPayroll: Prontoex Consulting Services Pvt LtdEnd Clinet: Comsense Technologies Private Limited , 7th Floor Property bearing No.465/E1, Park Plaza, IndiQube, CTS-1085, Ganeshkhind Rd, Shivajinagar, Pune, Maharashtra 411005JD :Minimum QualificationBachelor's degree in Computer...