Senior Azure Data Engineer

5 months ago

MumbaiBangalore, India Techno Wise Full time

Responsibilities :

1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.

2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.

3. Optimize and tune existing data pipelines for performance and reliability.

4. Work closely with cloud-based services, particularly Azure or AWS, to deploy and manage data solutions in the cloud environment.

5. Implement data quality and data governance best practices to ensure the accuracy and reliability of the data.

6. Monitor and troubleshoot data pipelines, resolving issues promptly to minimize downtime and data loss.

7. Stay updated with the latest industry trends and technologies related to data engineering, Databricks, PySpark, and cloud platforms.

8. Collaborate with cross-functional teams to integrate data engineering solutions into various applications and systems.

9. Document data engineering processes, architectures, and configurations for reference and knowledge sharing.

10. Provide technical guidance and mentorship to junior data engineers in the team.

Requirements :

Responsibilities :

- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services.

- Utilize Databricks for big data analytics and real-time data processing, ensuring optimal performance and efficiency.

- Collaborate with data architects to design and implement effective data models and architectures to support business requirements.

- Implement ETL processes for data extraction, transformation, and loading, ensuring the integrity and quality of the data.

- Integrate data from various sources, ensuring compatibility, accuracy, and adherence to data governance standards.

- Identify and address performance bottlenecks in data pipelines, optimizing for speed, reliability, and scalability.

- Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.

- Conduct code reviews, enforce best practices in coding and documentation, and mentor junior team members.

Education :

- Bachelor's or master's degree in Computer Science, Information Systems, or a related field.

Experience :

- Minimum of 6 years of hands-on experience as a Data Engineer, with a focus on Azure Data Engineering and Databricks.

Technical Skills :

- Proficiency in Azure Data Factory, Azure Databricks, SQL, Python, and ETL processes.

- Solid understanding of data modelling, data warehousing, and big data concepts.

(ref:hirist.tech)

  • Senior Azure Data Engineer

    4 weeks ago

    bangalore, India Vlaunchu Full time

    Overview:The Senior Azure Data Engineer plays a pivotal role in designing implementing and maintaining the data architecture within the Azure environment. This position is crucial for ensuring efficient data storage accessibility and security as well as enabling the organization to leverage data for strategic decisionmaking.Key Responsibilities:Design and...

  • Senior Azure Data Engineer

    2 weeks ago

    bangalore, India Vlaunchu Full time

    Overview: The Senior Azure Data Engineer plays a pivotal role in designing implementing and maintaining the data architecture within the Azure environment. This position is crucial for ensuring efficient data storage accessibility and security as well as enabling the organization to leverage data for strategic decisionmaking.Key Responsibilities: Design and...

  • Senior Azure Data Engineering Manager

    3 weeks ago

    Bangalore, India OSBIndia Private Limited Full time

    Job Title: Senior Azure Data Engineering ManagerJob Summary: We are seeking a highly experienced Senior Azure Data Engineering Manager to lead our data engineering team in delivering end-to-end big data solutions on Azure Cloud.Key Responsibilities:Lead the design and implementation of data pipelines using API ingestion and streaming ingestion...

  • Senior Azure Data Engineer

    2 weeks ago

    Bangalore, India MAYNOR CONSULTING Full time

    Job Description: We are seeking an experienced Senior Azure Data Engineer to join our team at MAYNOR CONSULTING. The ideal candidate will have a strong background in Azure Data Factory, Azure Databricks, and Azure Data Lake. Key responsibilities include designing and implementing ETL/ELT pipelines, working with Azure Analysis Services and Azure SQL Database,...

  • Senior Azure Data Engineer

    3 weeks ago

    Bangalore/Pune/Chennai/Hyderabad, India Foundit Full time

    Job Title: Senior Azure Data EngineerAt Foundit, we're seeking a highly skilled Senior Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data solutions on Azure.Key Responsibilities:Design and implement data pipelines using Azure Data Factory,...

  • Azure Data Engineer Lead

    2 weeks ago

    Bangalore, India Infiniti Research Limited Full time

    Job Title: Senior Data EngineerJob Description:As a Senior Data Engineer at Infiniti Research, you will be responsible for designing and implementing scalable and performant data architectures using Azure services. You will work independently to deliver high-quality solutions and lead a team of junior data engineers.Key Responsibilities:Design and implement...

  • Azure Data Architect Senior Data Engineer

    4 weeks ago

    bangalore, India Numentica LLC Full time

    We are seeking a highly skilled and experienced Azure Data Architect & Senior Data Engineer to join our team. The ideal candidate will have a deep understanding of data engineering principles cloud technologies and Azure platform. They will be responsible for designing implementing and maintaining robust data solutions that support our business...

  • Azure Data Architect Senior Data Engineer

    2 weeks ago

    bangalore, India Numentica LLC Full time

    We are seeking a highly skilled and experienced Azure Data Architect & Senior Data Engineer to join our team. The ideal candidate will have a deep understanding of data engineering principles cloud technologies and Azure platform. They will be responsible for designing implementing and maintaining robust data solutions that support our business...

  • Senior Azure Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Innovation Consulting Services Full time

    Job Title: Senior Azure Data EngineerWe are seeking a highly skilled Senior Azure Data Engineer to join our team at Innovation Consulting Services. As a key member of our Analytics Practice, you will be responsible for providing technical leadership and thought leadership in areas such as data access & ingestion, data processing, data integration, data...

  • Azure Data Engineer Lead

    3 weeks ago

    Navi Mumbai/Pune/Bangalore, India Techno Wise Full time

    Job Title: Senior Azure Data EngineerJob Summary:We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team at Techno Wise. The ideal candidate will have a strong background in Azure data technologies and a proven track record of designing and implementing scalable and efficient data solutions.Key Responsibilities:Design,...

  • Azure Data Engineer

    1 day ago

    bangalore, India Hexaware Technologies Full time

    Experience: 6-9 yrs Work location: Bangalore/Pune/Chennai Notice Period: Immediate - 30 days Senior Data Engineer - Azure Databricks Work timing: UK Shift: 1pm IST to 10PM IST Strong Experience in Azure DB Good Knowledge in Pyspark Experience in SQL Server Experince in Data Migration Experience in Cloud Migration ( Azure DB ) Good Communication...

  • Azure Data Engineer

    2 days ago

    bangalore, India Hexaware Technologies Full time

    Experience: 6-9 yrs Work location: Bangalore/Pune/ChennaiNotice Period: Immediate - 30 days Senior Data Engineer - Azure DatabricksWork timing: UK Shift: 1pm IST to 10PM ISTStrong Experience in Azure DBGood Knowledge in PysparkExperience in SQL ServerExperince in Data MigrationExperience in Cloud Migration ( Azure DB )Good CommunicationFlexibility to work...

  • Data Engineer

    2 weeks ago

    Mumbai/Bangalore, India AuxoAI Full time

    Job Description : We are seeking skilled Data Engineers with prior experience on Azure data engineering services and SQL server to join our team. As a Data Engineer, you will be responsible for designing and implementing robust data infrastructure, building scalable data pipelines, and ensuring efficient data integration and storage.Responsibilities :-...

  • Data Engineer

    1 month ago

    Mumbai/Bangalore, Maharashtra, India AuxoAI Full time

    Job Description : We are seeking skilled Data Engineers with prior experience on Azure data engineering services and SQL server to join our team. As a Data Engineer, you will be responsible for designing and implementing robust data infrastructure, building scalable data pipelines, and ensuring efficient data integration and storage.Responsibilities :-...

  • Senior Data Engineer

    1 month ago

    Bangalore, Karnataka, India Syscort Full time

    Job Title : Senior Data Engineer. Timeline : Immediate only. Experience : 8+Years. Location : Bangalore.Mandatory Required Qualification : - Strong proficiency in Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Storage, etc. - Expertise in DevOps and CI/CD implementation. - Excellent Communication Skills. In This...

  • Azure data engineer

    3 weeks ago

    Bangalore, India IQVIA Full time

    Job Role: Azure Data Engineer Work Experience: 4-8 years Work Location: Bangalore/Gurgaon Work Mode: Hybrid Must Have Skills: Azure Databricks, Pyspark, SQL Good to have Skills: Pharma/Healthcare domain experience Job Overview: Provides high quality, on-time input to client projects in the life sciences field. Assignments range in complexity...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India xanika infotech Full time

    Position : Senior Data Engineer-ADFExperience : 8+ YearsLocation : Bangalore-Kalyan NagarMode : Work from officeEducation : Bachelor's/Master's in Computer's or :8+ years of Hands-on experience in SQL and 5+ yrs of experience in ADF to manipulate data, implement database-driven solutions, build applications and data integration.As an architect we...

  • Senior Data Engineer

    1 month ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    Job Description :We are seeking a highly skilled Senior Data Engineer with extensive experience in Azure Data Factory (ADF) and Snowflake. The ideal candidate will have a strong background in data warehousing, ETL processes, and cloud platforms, particularly Azure. The role involves working with US-based clients and requires excellent technical and...

  • Azure Data Engineer

    3 weeks ago

    bangalore, India Recro Full time

    Job Title: Azure Data Engineer Location: Remote Experience Required: 3+ Years Job Overview:We seek a skilled Azure Data Engineer with 3+ years of experience, specializing in SQL, Data Modeling, and Azure Data Engineering tools. You will be responsible for building and enhancing data models, managing data pipelines with Azure Data Factory, and working with...

  • Azure Data Engineer

    2 months ago

    bangalore, India Recro Full time

    Job Title: Azure Data Engineer Location: Remote Experience Required: 3+ Years Job Overview: We seek a skilled Azure Data Engineer with 3+ years of experience, specializing in SQL, Data Modeling, and Azure Data Engineering tools. You will be responsible for building and enhancing data models, managing data pipelines with Azure Data Factory, and working...