Senior Azure Data Engineer

3 weeks ago

Bengaluru, India Techno Wise Full time

Responsibilities :

1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.

2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.

3. Optimize and tune existing data pipelines for performance and reliability.

4. Work closely with cloud-based services, particularly Azure or AWS, to deploy and manage data solutions in the cloud environment.

5. Implement data quality and data governance best practices to ensure the accuracy and reliability of the data.

6. Monitor and troubleshoot data pipelines, resolving issues promptly to minimize downtime and data loss.

7. Stay updated with the latest industry trends and technologies related to data engineering, Databricks, PySpark, and cloud platforms.

8. Collaborate with cross-functional teams to integrate data engineering solutions into various applications and systems.

9. Document data engineering processes, architectures, and configurations for reference and knowledge sharing.

10. Provide technical guidance and mentorship to junior data engineers in the team.

Requirements :

Responsibilities :

- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services.

- Utilize Databricks for big data analytics and real-time data processing, ensuring optimal performance and efficiency.

- Collaborate with data architects to design and implement effective data models and architectures to support business requirements.

- Implement ETL processes for data extraction, transformation, and loading, ensuring the integrity and quality of the data.

- Integrate data from various sources, ensuring compatibility, accuracy, and adherence to data governance standards.

- Identify and address performance bottlenecks in data pipelines, optimizing for speed, reliability, and scalability.

- Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.

- Conduct code reviews, enforce best practices in coding and documentation, and mentor junior team members.

Education :

- Bachelor's or master's degree in Computer Science, Information Systems, or a related field.

Experience :

- Minimum of 6 years of hands-on experience as a Data Engineer, with a focus on Azure Data Engineering and Databricks.

Technical Skills :

- Proficiency in Azure Data Factory, Azure Databricks, SQL, Python, and ETL processes.

- Solid understanding of data modelling, data warehousing, and big data concepts.

(ref:hirist.tech)

  • Senior Azure Data Engineer

    6 days ago

    Bengaluru, Karnataka, India INI8 LABS Full time

    Job Title: Senior Data Engineer - AzureJob Description:We are looking for an experienced Senior Azure Data Engineer to join our team. The successful candidate should have experience working with Data Architects, Analyst and Stakeholders to develop, maintain and test data platforms.Experience : 4+ yrsExperience with Azure Databricks, PySpark, Azure Data...

  • Senior Azure Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Spruce InfoTech Inc Full time

    Hope you're doing wellWe are hiring for theSenior Azure Data Engineerrole. Please find the JD belowJOB Designation:Senior Azure Data EngineerJOB Location: Bangalore, IndiaMode of Hiring: Contract [C2H],Notice Period: Immediate to 20 daysExperience: 5-7yearsRequired Skills:5-7 years of experience in Azure cloud platform and data engineering.Proficiency in...

  • Senior Azure Data Engineer

    1 week ago

    Bengaluru, India INI8 LABS Full time

    Job Title: Senior Data Engineer - AzureJob Description:We are looking for an experienced Senior Azure Data Engineer to join our team. The successful candidate should have experience working with Data Architects, Analyst and Stakeholders to develop, maintain and test data platforms.Experience : 4+ yrsExperience with Azure Databricks, PySpark, Azure Data...

  • Senior Azure Data Engineer

    2 weeks ago

    Bengaluru, India Spruce InfoTech Inc Full time

    Hope you're doing wellWe are hiring for theSenior Azure Data Engineerrole. Please find the JD belowJOB Designation:Senior Azure Data EngineerJOB Location: Bangalore, IndiaMode of Hiring: Contract (C2H),Notice Period: Immediate to 20 daysExperience: 5-7yearsRequired Skills:5-7 years of experience in Azure cloud platform and data engineering.Proficiency in...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years’ overall experience in data domain (data analysis, database developer)Minimum 3 years’ experience as a cloud-based Data EngineerMinimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    3 weeks ago

    Bengaluru, India NTT DATA Full time

    Job DescriptionAzure Data Engineer Requirements4+ years’ overall experience in data domain (data analysis, database developer)Minimum 3 years’ experience as a cloud-based Data EngineerMinimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory,Minimum 3 years’ experience...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on Apache Spark or...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory,Minimum 3 years' experience on Apache Spark or Azure...

  • Senior Azure Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Trueblue HR Consultants Full time

    Position: Sr.Azure Data EngineerQualification: Bachelor of Engineer / Computer Science/ MCA / MS Comp Si + Overall 15-20 years experience with 5+ years experience in developing AI solutions.Willing to work with Start up Senior Data Engineers are responsible for delivering high quality modern data solutions through collaboration with our team and our...

  • Senior Azure Data Engineer

    4 weeks ago

    Bengaluru, India Telstra Full time

    Employment Type PermanentClosing Date 18 Sept 2023 11:59pmJob Title Senior Azure Data EngineerJob SummaryAs a Data Management - Senior Specialist, you are the go-to person for developing and implementing effective data management strategies which maximise business and customer outcomes. You play a key role as steward of strong governance, architecture and...

  • Senior Azure Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Unijob Solution & Training Pvt Ltd Full time

    Senior Azure Data Engineer Job Role : Azure Data Engineer. Exp Level : 3-5 Year.Location : Bengaluru (Hybrid).Package : 12-15 LPA.Notice Period : Immediate to 15 Days.Responsibilities: Collecting, storing, and processing substantial amounts of data from various sources. Developing and maintaining data pipelines to ensure efficient and reliable data...

  • Aptus Data Labs

    4 weeks ago

    Bengaluru, India Aptus Data Labs Full time

    Job Description Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Azure Sr ConsultantExperience : 10 - 16 YearsLocation : Mumbai/Hyderabad/Bangalore (Onsite)Skill : Azure Cloud, Databricks, Data Quality, Data Governance & Modelling, ETL (Azure data...

  • Senior Azure Data Engineer

    3 weeks ago

    Bengaluru, India Telstra Full time

    Employment TypePermanentClosing Date18 Sept 2023 11:59pmJob TitleSenior Azure Data EngineerJob SummaryAs a Data Management - Senior Specialist, you are the go-to person for developing and implementing effective data management strategies which maximise business and customer outcomes. You play a key role as steward of strong governance, architecture and data...

  • Senior Azure Data Engineer

    4 weeks ago

    Bengaluru, India Telstra Full time

    Employment TypePermanentClosing Date18 Sept 2023 11:59pmJob TitleSenior Azure Data EngineerJob SummaryAs a Data Management - Senior Specialist, you are the go-to person for developing and implementing effective data management strategies which maximise business and customer outcomes. You play a key role as steward of strong governance, architecture and data...

  • Senior Azure Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Speridian Technologies Full time

    Experience : 5+ Years. Notice Period : Immediate to 30 Days (max). Role: Azure Data Engineer. Location: Bengaluru (Hybrid). Job Description : As an Azure Data Engineer, your role will involve designing, developing, and maintaining data solutions on the Azure platform. You will be responsible for building and optimizing data pipelines, ensuring data quality...

  • Azure data Engineer

    2 days ago

    Bengaluru, India Birlasoft Full time

    Dear Folks,Birlasoft is hiring!!We are hiring Azure Data Engineer for Bangalore, Hyderabad, Chennai, Coimbatore, Noida, Pune , Mumbai location.Experience Required - 4- 7 yearsNotice Period : Immediate to 30 DaysLocation : Bangalore, Hyderabad, Chennai, Coimbatore, Noida, Pune , Mumbai location.Key Responsibilities :Azure Data Engineer-Experience in Perform...

  • Azure data Engineer

    5 days ago

    Bengaluru, India Birlasoft Full time

    Dear Folks,Birlasoft is hiring!!We are hiring Azure Data Engineer for Bangalore, Hyderabad, Chennai, Coimbatore, Noida, Pune , Mumbai location.Experience Required - 4- 7 yearsNotice Period : Immediate to 30 DaysLocation : Bangalore, Hyderabad, Chennai, Coimbatore, Noida, Pune , Mumbai location.Key Responsibilities :Azure Data Engineer-Experience in Perform...

  • Senior Data Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server