Cloud Data Engineer Lead

2 weeks ago


Hyderabad, Telangana, India Microsoft Full time

Company Overview

Microsoft is a world of passionate innovators where individuals collaborate to envision what can be and take their careers further. As a company, we are committed to innovation and providing endless opportunities for growth.

The Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. Our portfolio includes Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture.

Job Summary

We are seeking a Principal Software Engineer to join our team in charge of designing, building, and operating a next-generation service that transfers large volumes of data from various source systems to target systems with minimal latency while providing a data-centric orchestration platform. The ideal candidate will have experience working with advanced data movement/replication scenarios and user-friendly interfaces.

About You

To succeed in this role, you will need to have a Bachelor's Degree in Computer Science or related technical discipline and 6+ years of technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python. You must also be able to meet Microsoft, customer, and/or government security screening requirements, which include passing a Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Responsibilities

  • Lead by example within the team by producing extensible and maintainable code. Optimize, debug, refactor, and reuse code to improve performance and maintainability, effectiveness, and return on investment (ROI). Apply metrics to drive the quality and stability of code, as well as appropriate coding patterns and best practices.
  • Apply debugging tools and examine logs, telemetry, and other methods to verify assumptions through writing and developing code proactively before issues occur and reactively as issues occur for products. Conduct retrospective debugging of solutions to identify root causes of problems.
  • Review the code of a product to assure it meets the team's and Microsoft's quality standards, is reliable and accurate, and is appropriate for the scale of the product/solution area. Apply feedback to current and future iterations. Participate in code reviews to ensure coding standards are followed. Consider diagnosability, reliability, and maintainability when reviewing code, and understand when code is ready to be shared or delivered. Apply and screen for coding patterns and best practices in reviews, and provide feedback on code to drive adherence to best practices.
  • Lead discussions for the architecture of products/solutions and create proposals for architecture by testing design hypotheses and helping to refine code plans. Provide reactions, proposed solutions, and inputs to architects. Partially own solutions for architecting of solutions, with minimal technical oversight. Develop design documents for designs or User Stories, and determine the technology that will be leveraged and how it will interact. Share learnings and identified solutions from investigations with the team and own for some design decisions. Assure system architecture meets security and compliance requirements and expectations.
  • Independently create a clear and articulated plan for testing and assuring quality of solutions, and define success for outcomes of tests (e.g., unit tests). Identify needs for a broad versus selected approach in testing mechanisms and make informed decisions to implement the most effective tests. Drive efforts to add new tests, remove antiquated tests, and aggregate tests to improve the test suite. Improve recommendations to the team and augment test cases to ensure that solutions have good test coverage. Drive efforts to continually integrate automation features when planning for testing.
  • Drive identification of dependencies and the development of design documents for a product, application, service, or platform. Identify other teams and technologies that will be leveraged, how they will interact, and when one's own system may provide support to others. Determine back-end dependencies associated with product, application, service, or platform functionality for the solution/product area. Understand up and downstream effects of solutions and work provided to ensure appropriate security and performance, drive reliability in the solutions, and optimize dependency chains and retrieves across teams. Drive identification of areas of dependency and overlap with other teams or team members and drive coordination. Communicate across teams and resolve conflicts between teams.
  • Collaborate with appropriate stakeholders (e.g., project manager, technical lead) to determine user requirements for a scenario. Leverage a variety of feedback channels to incorporate insights into future designs or solution fixes. Ensure appropriate continuous feedback loops measuring customer value, usage patterns, and other actionable metrics of value are incorporated.

Benefits and Perks

We offer a range of benefits and perks to support your career and well-being, including:

  • Industry-leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Estimated Salary: $250,000 - $300,000 per year



  • Hyderabad, Telangana, India Syren Cloud Inc Full time

    Job SummaryWe are seeking a highly skilled Azure Data Engineer to lead our data engineering efforts. As an expert in designing and implementing distributed applications and systems on Azure Cloud platform, you will be responsible for developing, implementing, and managing large-scale data pipelines.

  • Data Science Engineer

    4 weeks ago


    Hyderabad, Telangana, India Banyan Cloud Full time

    About Banyan CloudHonest Data technologies Pvt Ltd, a subsidiary of Banyan Cloud, USA, is a Cyber Security Product Company headquartered in San Jose, California. The company owns the SaaS product Banyan Cloud, a CNAP Platform simplifying code-to-cloud security for multi-cloud and on-premises environments.This is a unique opportunity to be part of our...

  • Data Science Engineer

    2 weeks ago


    Hyderabad, Telangana, India Banyan Cloud Full time

    About UsBanyan Cloud is a cutting-edge Cyber Security Product Company, headquartered in San Jose, California, USA. We own the SaaS product 'Banyan Cloud', a first-of-its-kind Cyber Security CNAP Platform that simplifies code-to-cloud security for multi-cloud and on-premises environments.This is a once-in-a-lifetime opportunity to join our rocket ship startup...

  • Cloud Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Syren Cloud Inc Full time

    We are seeking an experienced Cloud Data Engineer to join our team at Syren Cloud Inc.As a Cloud Data Engineer, you will be responsible for designing, developing, implementing, and managing distributed applications and systems on Azure Cloud platform.Key Responsibilities:Interpret data, analyze results using statistical techniques, and provide ongoing...

  • Cloud Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Syren Cloud Inc Full time

    We are seeking an experienced Cloud Data Engineer to join our team at Syren Cloud Inc. This role will be responsible for designing, developing, implementing, and managing distributed applications and systems on Azure Cloud platform.The ideal candidate will have strong SQL/PLSQL knowledge, data modeling skills, and experience working with Azure Cloud Data...

  • Cloud Architect Lead

    2 weeks ago


    Hyderabad, Telangana, India NTT DATA Full time

    About the Job">The position of Cloud Architect Lead is a seasoned role that involves designing, implementing and managing cloud-based solutions for complex systems and applications. This individual will be responsible for leading a team of cloud architects in creating scalable, secure and cost-effective cloud architectures.">Key...


  • Hyderabad, Telangana, India WaferWire Cloud Technologies Full time

    About UsWaferWire Cloud Technologies is a leading provider of comprehensive cloud, data, and AI solutions. Our expertise spans strategic consulting, data/AI estate modernization, and cloud adoption strategy.Job SummaryWe are seeking a highly skilled Senior Cloud Data Engineer to join our team. This role will focus on designing and developing cloud-based...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    About the RoleAt Tata Consultancy Services, we are seeking a highly skilled Cloud Data Engineering Lead to join our team. As a key member of our organization, you will be responsible for designing and implementing scalable data engineering solutions using Snowflake.The ideal candidate will have 5-10 years of experience in data engineering, with a strong...

  • Cloud Architect

    2 weeks ago


    Hyderabad, Telangana, India WaferWire Cloud Technologies Full time

    About WaferWire Cloud Technologies">We are a leading provider of comprehensive cloud, data, and AI solutions through Microsoft's technology stack. Job Title: Senior Engineering Manager ">This role involves overseeing the development and maintenance of healthcare data migration tools, integration frameworks, and analytic pipelines. ">Responsibilities: Lead...


  • Hyderabad, Telangana, India Creditsafe Technology Full time

    Job SummaryWe are seeking an experienced Cloud Data Engineering Lead to join our team at Creditsafe Technology.


  • Hyderabad, Telangana, India Experian Full time

    Job SummaryWe are seeking a highly skilled and experienced Cloud Data Engineering Team Lead to lead and manage our big data and cloud-based solutions team. As an Engineering Manager, you will be responsible for designing, developing, and optimizing large-scale Batch data processing applications, while also leading a team of talented engineers.Key...


  • Hyderabad, Telangana, India WaferWire Cloud Technologies Full time

    About the RoleAre you an experienced data engineer looking to take your skills to the next level? We are seeking a talented Azure Data Engineer to join our team at WaferWire Cloud Technologies. In this role, you will design and implement scalable and efficient data pipelines using Azure Data Factory, Pyspark notebooks, Spark SQL, and Python.About the JobThis...


  • Hyderabad, Telangana, India Pythian Full time

    Job Description:We are seeking an experienced Cloud Engineering Lead to spearhead our data infrastructure initiatives. This role will be responsible for designing, developing, and deploying scalable cloud-based solutions that meet the needs of our clients.Key Responsibilities:Lead the development of cloud-based data infrastructure solutions using Google...


  • Hyderabad, Telangana, India WaferWire Cloud Technologies Full time

    At WaferWire Cloud Technologies, we are seeking a highly experienced Senior Engineering Manager to lead our development and maintenance of healthcare data migration tools, integration frameworks, and analytic pipelines.About the RoleThis is an exciting opportunity for a seasoned engineering leader to provide technical leadership, drive innovation, and ensure...


  • Hyderabad, Telangana, India data Full time

    Unlock the Power of Big DataWe are seeking an experienced Advanced Data Analytics Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will play a crucial role in designing and implementing innovative data products using agile methodologies and open-source technologies.About the RoleThis is an exciting opportunity to...


  • Hyderabad, Telangana, India WaferWire Cloud Technologies Full time

    Job Title: Cloud Solutions EngineerWe are seeking a highly skilled Cloud Solutions Engineer to join our team at WaferWire Cloud Technologies. This role involves developing, customizing, and maintaining applications using Microsoft Power Platform (Power Apps, Power Automate, Power BI). The successful candidate will collaborate with the Global Partner...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Overview:As a Senior Big Data Developer at Tata Consultancy Services, you will be responsible for designing and implementing scalable data engineering solutions on cloud platforms. With a focus on modern data engineering, data warehousing, and big data tools, you will play a critical role in translating business requirements into actionable...


  • Hyderabad, Telangana, India TechProjects Full time

    Seeking a highly experienced Data Science and Cloud Engineering Lead to join our team at TechProjects. As a key member of our Enterprise Data & Innovation team, you will be responsible for leading the design, development, and deployment of advanced data-driven solutions.Job DescriptionThis is a full-time remote role that requires strong expertise in cloud...

  • Lead Data Engineer

    6 days ago


    Hyderabad, Telangana, India Randstad Enterprise Full time

    Are you a seasoned professional in data engineering with expertise in cloud architecture? We have an exciting opportunity for a Lead Data Engineer to join our team at Randstad Enterprise.About the RoleThis is a high-profile position that involves leading efforts to design and implement complex data pipelines using advanced cloud technologies. The ideal...


  • Hyderabad, Telangana, India WaferWire Cloud Technologies Full time

    Job Title: Python Cloud Engineer for Advanced Healthcare Data SolutionsA career opportunity at WaferWire Technology Solutions awaits a skilled Python Application Engineer. This role focuses on delivering data solutions within the Fabric environment, ensuring seamless data integration and management.We specialize in cloud-based application development using...