Azure Data Engineering Lead
2 days ago
Job Location :
Hyderabad
Job Type :
Full TIme
Your Role:
As the Data Engineering Lead, you will be a leader of the data engineering team
working on in-house products in for Data Foundation Collaborating closely with Product Owner(s), Product Architect(s) and other DataOps teams you will need to understand the business needs, helping Product Architect(s) to convert those needs into solution architecture specifications and services in line with overall engineering standards and roadmaps. You will be driving excellence in engineering practices to deliver high-quality solutions throughout the software development lifecycle in our IT landscape. This role involves hands-on development work.
This role will directly report to Engineering Manager
Must have skills
- Strong experience in Azure cloud data services & technologies
- Azure Databricks, Unity Catalog, Delta live tables
- Expert in Python, Pyspark and SQL
- Data Modelling & Architecture
- ETL pipeline design
- Azure Data Factory
- Azure DevOps
- Logging and Monitoring using Azure / Databricks services
- Apache Kafka
Responsibilities:
- Lead a team of experienced team members of Data Engineers in designing, developing, and delivering scalable, reliable, and high performing software solutions
- Lead the design, development, and maintenance of scalable data pipelines and ETL processes. Monitor and optimize data infrastructure performance, identifying and resolving bottlenecks and issues.
- Lead the team from a technical standpoint, and drive operational excellence, including code reviews, design reviews, testing, and deployment processes.
- Be an individual contributor (~60%) engineering the software products/solutions, jointly with the team
- Ensure that the team adheres to coding standards, best practices, and architectural guidelines, oversee team spirit and team performance, guide and mentor team members.
- Oversee the implementation of the technical architecture, solve immediate technical challenges.
- Implement good practices, coding standards and modern architecture for DataOps; be a "go-to-person for technical decisions and problem-solving within the team
- Ensure that the execution of DataOps is in place in the team's daily work
- Inspire, advise, and drive the selection of development approach.
- Coordinate software development and address technical debt in the team
- Hire, onboard, mentor, and develop top engineering talents, fostering a culture of learning,
- collaboration, and continuous improvement.
- Lead technical discussions with other teams/departments and oversees state-of-art quality of the stack.
- May be involved in cross-functional discussions, representing the domain in broader technical discussions across domains.
- Responsible for designing and improving processes that enhance efficiency and quality.
- Communication with Engineering Manager, Product Owner, Business Analyst and Scrum Master to align on project. / sprint goals, timeline and resource allocation.
-
Azure Data Engineer
2 weeks ago
Hyderabad, Telangana, India Enable Data Full time ₹ 6,00,000 - ₹ 18,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Azure Data Engineer
12 hours ago
Hyderabad, Telangana, India ValueLabs Full timeJob Role: Azure Data EngineerExperience: 7+ YearsLocation: HyderabadJob Description:We are looking for a talented and driven Data Engineer to join our expanding team. In this role, you will design, build, migrate, and maintain data solutions on the Azure platform. You'll play a key role in modernizing our legacy data systems, developing high-performance data...
-
Azure Data Engineer
2 days ago
Hyderabad, Telangana, India Wall Street Consulting Services LLC Full timeWe have an Immediate Opportunity for aAzure Data Engineer. Looking for only local candidates only.7+ Years candidates only apply. Looking from Immediate joiner or one month notice onlyTitle: Azure Data EngineerLocation: HyderabadMode of work: Work from OfficeType of Work: Full TimeJob Description:We are seeking an experienced Data Engineer with strong...
-
Azure data engineer
3 weeks ago
Hyderabad, Telangana, India, Telangana Stratus Full timeLead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure DatabricksExperience with Agile development methodologies and tools, such as Jira, to plan out Program Increments and SprintsExperienced in end-to-end development of data solutions on Azure using Databricks/SnowflakePerform code reviews and provide...
-
Azure Data Engineer
1 week ago
Hyderabad, Telangana, India Clean Harbors Full timeAbout CleanHarborsClean Harbors Inc. ) is a NYSE listed US based $5.6 billion company. Clean Harbors was founded in 1980 near Boston by Mr. Alan S. McKim, who today remains the company's Chairman and CTO. Everywhere industry meets environment, Clean Harbors is on-site, providing premier environmental, energy and industrial services. Clean Harbors employs a...
-
Azure Data Engineer
2 weeks ago
Hyderabad, Telangana, India Kagool Full time US$ 1,20,000 - US$ 1,80,000 per yearAbout KagoolWe are a fast-growing IT consultancy specialising in the transformation of complex Global enterprises. We are looking for passionate and hardworking individuals that to help deliver for our global customer base. Weembrace the opportunitiesof the future and work proactively tomake good use of technology. As you can imagine, this means that we have...
-
Senior Azure Data Engineer
2 days ago
Hyderabad, Telangana, India Programmers Full timeJob Title: Senior Azure Data EngineerJob Location: RemoteSkills Required: Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics.Experience Range: 8 Years - 12 yearsJob Summary:We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have deep expertise...
-
Senior Azure Data Engineer
23 hours ago
Hyderabad, Telangana, India S2Integrators Full timeJob DescriptionWe are looking for aSenior Azure Data Engineerwith strong hands-on experience inMicrosoft Fabricto design, build, and optimize scalable data platforms on Azure. The ideal candidate will lead end-to-end data engineering solutions using Microsoft Fabric components and work closely with business, analytics, and BI teams.Roles &...
-
Azure Data Engineer
3 weeks ago
Hyderabad, Telangana, India, Telangana Wall Street Consulting Services LLC Full timeJob description:Job Title: Azure Data EngineerLocation: Onsite in Rayadurgam, HyderabadEmployment Type: Full-timeAbout the Role: We are seeking an experienced Azure Data Engineer Architect with hands-on expertise in designing and implementing scalable data platforms in the Microsoft Azure ecosystem. The ideal candidate will have multiple end-to-end project...
-
Azure Data Engineer
1 week ago
Hyderabad, Telangana, India Euclid Innovations Full timeAbout the CompanyWe are looking for a highly skilled Databricks & Azure Senior Data Engineer with at least 6 to 10 years of experience to join our vibrant Data & Analytics team.About the RoleThe ideal candidate should have strong background in Azure data services, including Databricks, Synapse Analytics, Microsoft Fabric, PySpark and SQL. He/She will be...