Azure Data Engineer

1 week ago


Bengaluru, Karnataka, India Tech Mahindra Full time

Designed Azure ADF pipelines to move data from Open hubs to Azure Data Lake Gen2 and then to Azure Data Warehouse.

Developing notebooks and applying transformation using spark SQL in Azure data bricks.

Testing the notebook and validating the scripts using SQL.Implemented activities Copy activity, Execute Pipeline, Get Meta data, If Condition, Lookup, Set Variable, Filter, For Each pipeline Activities for On-cloud ETL processing.

Load the files to stage tables and then to data warehouse tables in dedicated SQL pool in synapse. Writing views, stored procedures for transformations.
Converting views to external tables for direct query for faster retrieval.
Preparing views data, data models for PBI reports Designed dashboards visuals with slicers, filters, drill through options.
Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements Develop and maintain innovative Azure solutions Solution design using Microsoft Azure services and other tools The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)
Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications Build data pipelines to collectively bring together data Other responsibilities include extracting data, troubleshooting and maintaining the data warehouseRole:

Data Engineer (4-8 year relevant exp)Primary skills:
Advance SQL/DWH,

Strong is SQL hands on experience in writing complex queries/stored procedure, Azure Data Factory, Azure Data Bricks, ADLS)

  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on Apache Spark or...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory,Minimum 3 years' experience on Apache Spark or Azure...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Torry Harris Full time

    Are you an experienced data engineer looking for a new challenge? If so, Torry Harris is seeking a talented Azure Data Engineer to join our team and help drive our data engineering efforts to the next level.As an Azure Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining cloud-based data solutions using Azure...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India CGI Full time

    Job Title : Azure Data EngineerExperience : 4 to 10 yearsCategory : Software Development/ EngineeringLocation : Bangalore onlyNotice Period: Immediate / Max 30 DaysEmployment Type : Full TimeQualifying Criteria : 4+ years of experience in Azure Data Engineer ADF, ADB, ADLS Notice period / Joining duration Immediately / Less than 30 Days Willing to work out...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Arcadis Full time

    ARCADIS is seeking an enthusiastic Azure Data Engineer who is passionate about driving digital transformation. We believe in the power of technology to innovate and reshape industries, envisioning sustainable communities for current and future generations.Technology lies at the heart of our operations, empowering our team members to leverage data and AI/ML...

  • Azure Data engineer

    1 week ago


    Bengaluru, Karnataka, India Trigyn Technologies Full time

    Job Description: Trigyn has an opportunity Azure Data Engineer. This resource will work at our client sites in Mumbai/Pune/Chennai/Bangalore/Hyderabad. Job Responsibilities: Azure Data engineer to deliver the new Data Strategy and Data Governance projects. The resource must have experience in Incorta and Oracle Cloud and be highly skilled in SQL and...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Domniclewis Full time

    Job Description :Responsibilities :Azure Landing Zone Cost Management :Scrutinize and fine-tune costs tied to Azure landing zones, ensuring judicious resource employment. Deploy cost monitoring mechanisms and craft strategies to curtail expenses while preserving peak performance.Data Engineering : Craft, implement, and sustain scalable, economical data...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India OrangeShark Full time

    Azure Data Engineer (Data Engineer, T-SQL/MS SQL/Azure SQL, Azure Devops)Location: BangaloreExperience: Years Responsibilities: Active member of the data engineering team Conduct full lifecycle analysis to include requirements, activities, and design Build data flows for data acquisition, aggregation, and modelling, using both batch and streaming paradigms...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Connectio IT Pvt Ltd Full time

    Role Description :This is a full-time Azure Data Engineer role at Connect io IT Pvt Ltd located in Bengaluru. As an Azure Data Engineer, you will be responsible for tasks such as data engineering, data modeling, Extract Transform Load (ETL), data warehousing, and data analytics. You will work on-site in Bengaluru.Qualifications : Data Engineering, Data...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Torry Harris Integration Solutions Full time

    Job Title Azure Data Engineer Job Location Bangalore, Karnataka, India Job Description Implement highly available and scalable Azure and Data bricks cloud data solutions that meet business requirements. Collaborate with cross-functional teams to implement solutions that meet business requirements. Developing and maintaining data lake using Data bricks and...

  • Azure data engineer

    16 hours ago


    Bengaluru, Karnataka, India Birlasoft Full time

    Dear Folks,Birlasoft is hiringWe are hiring Azure Data Engineer for Bangalore, Hyderabad, Chennai, Coimbatore, Noida, Pune , Mumbai locationExperience Required yearsNotice Period :Immediate to 30 DaysLocation : Bangalore, Hyderabad, Chennai, Coimbatore, Noida, Pune , Mumbai locationKey Responsibilities :Azure Data Engineer-Experience in Perform Design,...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Talent Bee Consulting Pvt Ltd Full time

    About the job :Ideal Job Title:Azure Data Engineer at a Global Provider of Automation SolutionsCandidate : 3+ years' experience in Azure Data Engineering Proficient in ADF (Azure Data Factory) Hands-on experience in designing and implementing data solutions on AzureOrganization :A global provider of Automation solutions in Assembly, Inspection, and Testing...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Visara Full time

    Job Description :We are seeking a highly skilled and dynamic Data Engineering Analyst to join our forward-thinking data engineering team. In this pivotal role, you will be at the heart of our data-driven initiatives, leveraging the power of Azure Databricks to drive business transformation and insights. As a key member of our team, you will bridge the gap...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Torry Harris Integration Solutions Full time

    Job Title Azure Data Engineer Job Location Bangalore, Karnataka, India Job Description Implement highly available and scalable Azure and Data bricks cloud data solutions that meet business requirements. Collaborate with cross-functional teams to implement solutions that meet business requirements. Developing and maintaining data lake using Data bricks and...

  • Azure Data engineer

    1 week ago


    Bengaluru, Karnataka, India Birlasoft Full time

    Job Title: Azure Databricks Lead Location: Bangalore/Mumbai/Pune/Noida Company Description: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Fractal Full time

    JOB DESCRIPTION: If you are an extraordinary developer and who loves to push the boundaries to solve complex business problems using creative solutions, then we wish to talk with you. As a Data Engineer - Azure, you will work in the Technology team that helps deliver our Data Engineering offerings at large scale to our Fortune clients worldwide. The role is...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Arus Info Full time

    Position: Azure Data EngineerEmployment Type: Full-timeLocation: Bangalore or MalaysiaAbout Arus:Software services organization specialized in Application Integration, ERP Implementations, Data Engineering, Analytics and Data Science. We, at Arus, aspires to inspire customers through well-crafted software engineering solutions that lays the foundation to...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Pylon Management Consulting Full time

    Responsibilities: Developing low to high complexity, secure, governed, high quality and efficient data pipelines from a variety of on and off premise, internal and external data source. Ensuring that data is cleansed, mapped, transformed and optimised for storage to meet requirements for business and technical use cases. Building data observability and data...