Senior Azure Data Engineer

4 weeks ago


Bengaluru, India Techno Wise Full time

Responsibilities :

1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.

2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.

3. Optimize and tune existing data pipelines for performance and reliability.

4. Work closely with cloud-based services, particularly Azure or AWS, to deploy and manage data solutions in the cloud environment.

5. Implement data quality and data governance best practices to ensure the accuracy and reliability of the data.

6. Monitor and troubleshoot data pipelines, resolving issues promptly to minimize downtime and data loss.

7. Stay updated with the latest industry trends and technologies related to data engineering, Databricks, PySpark, and cloud platforms.

8. Collaborate with cross-functional teams to integrate data engineering solutions into various applications and systems.

9. Document data engineering processes, architectures, and configurations for reference and knowledge sharing.

10. Provide technical guidance and mentorship to junior data engineers in the team.

Requirements :

Responsibilities :

- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services.

- Utilize Databricks for big data analytics and real-time data processing, ensuring optimal performance and efficiency.

- Collaborate with data architects to design and implement effective data models and architectures to support business requirements.

- Implement ETL processes for data extraction, transformation, and loading, ensuring the integrity and quality of the data.

- Integrate data from various sources, ensuring compatibility, accuracy, and adherence to data governance standards.

- Identify and address performance bottlenecks in data pipelines, optimizing for speed, reliability, and scalability.

- Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.

- Conduct code reviews, enforce best practices in coding and documentation, and mentor junior team members.

Education :

- Bachelor's or master's degree in Computer Science, Information Systems, or a related field.

Experience :

- Minimum of 6 years of hands-on experience as a Data Engineer, with a focus on Azure Data Engineering and Databricks.

Technical Skills :

- Proficiency in Azure Data Factory, Azure Databricks, SQL, Python, and ETL processes.

- Solid understanding of data modelling, data warehousing, and big data concepts.

(ref:hirist.tech)

  • Bengaluru, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years’ overall experience in data domain (data analysis, database developer)Minimum 3 years’ experience as a cloud-based Data EngineerMinimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...


  • Bengaluru, India Telstra Full time

    Employment Type PermanentClosing Date 18 Sept 2023 11:59pmJob Title Senior Azure Data EngineerJob SummaryAs a Data Management - Senior Specialist, you are the go-to person for developing and implementing effective data management strategies which maximise business and customer outcomes. You play a key role as steward of strong governance, architecture and...

  • Aptus Data Labs

    5 days ago


    Bengaluru, India Aptus Data Labs Full time

    Job Description Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Azure Sr ConsultantExperience : 10 - 16 YearsLocation : Mumbai/Hyderabad/Bangalore (Onsite)Skill : Azure Cloud, Databricks, Data Quality, Data Governance & Modelling, ETL (Azure data...


  • Bengaluru, India Telstra Full time

    Employment TypePermanentClosing Date18 Sept 2023 11:59pmJob TitleSenior Azure Data EngineerJob SummaryAs a Data Management - Senior Specialist, you are the go-to person for developing and implementing effective data management strategies which maximise business and customer outcomes. You play a key role as steward of strong governance, architecture and data...


  • Bengaluru, India Saaki Argus & Averil Consulting Full time

    About the Client:Our client is focused on AI and Analytics.Skills and Qualifications:Bachelors or Masters degree in computer science or equivalent4 to 9 years of total IT experience with 2+ years in big data engineering and Microsoft AzureHands on experience in SQL, python and Spark (pyspark), Big Data.Experience in Azure Databricks, Azure Data...


  • Bengaluru, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...


  • Bengaluru, India Onward Technologies Full time

    Onward Technologies is looking for Senior Azure Big Data EngineerThe RoleYou will be responsible for :Developing scripts to process structured and unstructured data.Recommending, developing and implementing ways to improve data reliability, efficiency and quality.Supporting translation of data business needs into technical system requirements.Working with...


  • Bengaluru, India Swiss Re Full time

    About the Role:In this role you will work in one of our agile teams, with ingesting data from private and public cloud into Azure Serverless containers, curate the data using Synapse and do advanced analytics and predictions using our strategic Palantir Foundry platform.Key responsibilitiesDesign and implement data pipelines in collaboration with our data...


  • Bengaluru, India Trueblue HR Consultants Full time

    Position: Sr.Azure Data EngineerQualification: Bachelor of Engineer / Computer Science/ MCA / MS Comp Si + Overall 15-20 years experience with 5+ years experience in developing AI solutions.Willing to work with Start up Senior Data Engineers are responsible for delivering high quality modern data solutions through collaboration with our team and our...

  • Azure Data Engineer

    11 hours ago


    Bengaluru, India Arcadis Full time

    ARCADISis looking for Azure Data Engineer with a passion to drive and execute Digital to the core of everything we do. We firmly believe in Everything Digital, Digital Everything. We are transforming, we are reimagining the industry and we are reimagining how communities and nations can help becoming more sustainable places to live for today and future...

  • Azure Data Engineer

    3 weeks ago


    Bengaluru, India Direct Client Full time

    Azure Data Engineer - Fivetran or Snowflake SpecialistBengaluru, Data & AnalyticsJOB DESCRIPTION1. Design, develop, and deploy data pipelines and workflows using Fivetran or Snowflake on the Azure platform.2. Collaborate with business stakeholders to gather data requirements and translate them into technical specifications and Configure and customize...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, India Giant Eagle GCC Full time

    Sr Data Engineer Data Analytics Grow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the Company Since our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s...


  • Bengaluru, India Swiss Re Full time

    About the Role : In this role you will work in one of our agile teams, with ingesting data from private and public cloud into Azure Serverless containers, curate the data using Synapse and do advanced analytics and predictions using our strategic Palantir Foundry platform. Key responsibilities Design and implement data pipelines in collaboration...


  • Bengaluru, India Tiger Analytics Full time

    Location- Chennai, Bangalore & HyderabadAs an Azure BDE Senior Data Engineer, you will- the design and implementation of data management (Data Lake / Lakehouse/ Data Mesh) solution on the Azure cloud using PaaS services,- with Architects in brainstorming, design patterns, doing POCs, implementation of the solution adhering to the defined architecture and...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, India INI8 LABS Full time

    Job Description: We are looking for an experienced Senior Azure Data Engineer to join our team. The successful candidate should have experience working with Data Architects, Analyst and Stakeholders to develop, maintain and test data platforms. Experience: Minimum 4+ yrs Experience with Azure(Azure data bricks, Azure data factory, PySpark) minimum of 4 yrs...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, India INI8 LABS Full time

    Job Description: We are looking for an experienced Senior Azure Data Engineer to join our team. The successful candidate should have experience working with Data Architects, Analyst and Stakeholders to develop, maintain and test data platforms. Experience: Minimum 4+ yrs Experience with Azure(Azure data bricks, Azure data factory, PySpark) minimum of 4 yrs...

  • Azure Data Engineer

    1 month ago


    Bengaluru, India Nityo Infotech Full time

    Business Intelligence , C , Engineering , Integration , Java , SQL , A , AWS , Achieve , Activities , Adaptability , Agile , Analysis , Analysis Services , Analytic , Analytics , Approach , Automation , Azure , Backgrounds , Bangalore , Based , Belgium , Building , Building Trust , Business , Business Intelligence , Business Requirements , C , CO , CTS ,...

  • Senior Data Engineer

    3 weeks ago


    Bengaluru, India GLAXOSMITHKLINE ASIA PVT. LTD Full time

    A new world-leading consumer health company. Shaped by all who join us. Together, we're improving everyday health for billions of people. By growing and innovating our global portfolio of category-leading brands including Sensodyne, Panadol, Advil, Voltaren, Theraflu, Otrivin, and Centrum through a unique combination of deep human understanding and...


  • Bengaluru, India Tiger Analytics Full time

    Location- Chennai, Bangalore & HyderabadAs an Azure BDE Senior Data Engineer, you willthe design and implementation of data management (Data Lake / Lakehouse/ Data Mesh) solution on the Azure cloud using PaaS services,with Architects in brainstorming, design patterns, doing POCs, implementation of the solution adhering to the defined architecture and...


  • Bengaluru, India Onward Technologies Full time

    Onward Technologies is looking for Senior Azure Big Data EngineerThe Role You will be responsible for : Developing scripts to process structured and unstructured data.Recommending, developing and implementing ways to improve data reliability, efficiency and quality.Supporting translation of data business needs into technical system requirements.Working with...