Azure Data Engineering Lead

3 weeks ago

bangalore, India GE Aviation Full time
Job Description Summary As the Azure Data Engineering Lead, you will lead the developing and managing of advanced data solutions on the Microsoft Azure platform. You'll oversee the creation of scalable data pipelines, design data architectures, and ensure efficient ETL processes using services like Azure Synapse, Azure Data Factory, and Azure Databricks. Your role involves ensuring data security, compliance, and optimizing performance while collaborating with stakeholders to meet data requirements. You'll also maintain technical documentation and implement continuous improvement practices in application development and the Azure Data Engineering Lead, you will lead the developing and managing of advanced data solutions on the Microsoft Azure platform. You'll oversee the creation of scalable data pipelines, design data architectures, and ensure efficient ETL processes using services like Azure Synapse, Azure Data Factory, and Azure Databricks. Your role involves ensuring data security, compliance, and optimizing performance while collaborating with stakeholders to meet data requirements. You'll also maintain technical documentation and implement continuous improvement practices in application development and operations.

Job Description

Responsibilities

  • Lead a team of Azure data engineers in designing, building, and maintaining scalable and efficient data pipelines on Azure cloud platform, utilizing services like Azure Synapse, Azure Data Factory, Azure Fabric, Azure SQL Database, and others.

  • Design data solutions, including data lakes, data warehouses, and real-time data processing systems, leveraging Azure services like Azure Data Lake Storage, Azure Synapse Analytics

  • Integrate diverse data sources into Azure-based solutions. Ensure smooth and efficient ETL processes, real-time data ingestion, and data transformation. Implement data integration best practices.

  • Design and implement data models and schemas to support business requirements. Ensure data accuracy, consistency, and reliability. Optimize data structures for performance and scalability.

  • Good experience on Azure Purview integrating data pipelines with Purview for Data lineage, experience with Microsoft Fabric, migrating the application from Azure Data Factory and Azure Synapse to Microsoft Fabric

  • Implement robust data security measures, including encryption, access control, and data masking. Ensure compliance with data privacy regulations and company policies.

  • Monitor and optimize data pipelines and queries for performance and efficiency. Implement caching, partitioning, and indexing strategies. Troubleshoot and resolve performance issues.

  • Establish and enforce data quality standards. Implement data governance practices, metadata management, and data lineage tracking. Ensure data quality through validation and cleansing processes.

  • Collaborate with business stakeholders to understand data requirements and deliver.

  • Create and maintain comprehensive technical documentation, including system architecture, design documents, and deployment procedures. Ensure knowledge sharing within the team.

  • Implement Lean daily management and Lean continuous improvement concepts in Application development and operations.

Qualifications

  • Bachelor's or master's degree in computer science, Information Technology, or a related field.

  • Extensive experience in data engineering, with a focus on Azure cloud platform.

  • Proficiency in Azure services like Azure Data Factory, Azure Databricks, Azure SQL Data Warehouse, and Azure Stream Analytics.

  • Strong programming skills in languages such as Python, SQL, or Scala for data manipulation and transformation.

  • Experience with big data technologies like Hadoop, Spark, or Hive is a plus.

  • Familiarity with data visualization tools like Power BI or Tableau.

  • Knowledge of data warehousing concepts, data lakes, and real-time data processing.

  • Excellent problem-solving skills and attention to detail,

  • Strong communication and leadership skills.

  • Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer) are a plus.

Desired Characteristics

  • Effective Communicator: Possess the ability to articulate complex technical concepts in a clear and concise manner, facilitating understanding across a wide range of audiences.

  • Solution-Oriented Mindset: Demonstrated ability to approach challenges with a solutions-first attitude, proactively identifying and addressing potential obstacles.

  • Change Advocate: Capable of spearheading and implementing change, showcasing a proactive approach to driving improvements and leading teams towards new initiatives.

  • Leadership Qualities: Show a strong capacity to lead, influence, and guide teams, fostering a collaborative and productive work environment.

  • Technical Translator: Excel at translating and breaking down intricate technical topics, ensuring that stakeholders at all levels have a clear understanding of the subject matter.

  • Analytical Thinker: Possess an analytical and detail-oriented mindset, critically evaluating information derived from multiple sources and drawing meaningful conclusions.

  • Team Player: Exhibit a strong willingness to collaborate and work cohesively with colleagues, understanding the importance of collective growth and knowledge sharing.

  • Adaptability: Demonstrate resilience and adaptability in an ever-changing environment, staying updated with the latest technological advancements and best practices in the field of database administration.

About Us
GE is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, national or ethnic origin, sex, sexual orientation, gender identity or expression, age, disability, protected veteran status or other characteristics protected by law.
Disclosure of your Gender or Sexual orientation is completely Voluntary and not mandatory.

Additional Information

Relocation Assistance Provided: No

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    3 weeks ago

    Bangalore, India NTT DATA Services Full time

    Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...

  • Lead Azure Data Engineer

    4 weeks ago

    bangalore, India Quantzig Full time

    Warm Greetings from Quantzig!About Quantzig:Quantzig is a global analytics & advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly...

  • Lead Azure Data Engineer

    5 days ago

    bangalore, India Quantzig Full time

    Warm Greetings from Quantzig!About Quantzig:Quantzig is a global analytics & advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly...

  • Azure Data engineer

    2 months ago

    bangalore, India Birlasoft Full time

    Job Title: Azure Databricks LeadLocation: Bangalore/Mumbai/Pune/NoidaCompany Description:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses...

  • Azure Data engineer

    2 months ago

    bangalore, India Birlasoft Full time

    Job Title: Azure Databricks Lead Location: Bangalore/Mumbai/Pune/Noida Company Description: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run...

  • Lead Azure Data Engineer

    3 weeks ago

    bangalore, India Quantzig Full time

    About Quantzig:Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding , Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...

  • Lead Azure Data Engineer

    4 weeks ago

    bangalore, India Quantzig Full time

    Warm Greetings from Quantzig!About Quantzig:Quantzig is a global analytics & advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly...

  • Azure Data Engineer

    4 weeks ago

    bangalore, India Arcadis Full time

    ARCADISis looking for Azure Data Engineer with a passion to drive and execute Digital to the core of everything we do. We firmly believe in Everything Digital, Digital Everything. We are transforming, we are reimagining the industry and we are reimagining how communities and nations can help becoming more sustainable places to live for today and future...

  • Azure Data Engineer

    3 weeks ago

    bangalore, India Arcadis Full time

    ARCADISis looking for Azure Data Engineer with a passion to drive and execute Digital to the core of everything we do. We firmly believe in Everything Digital, Digital Everything. We are transforming, we are reimagining the industry and we are reimagining how communities and nations can help becoming more sustainable places to live for today and future...

  • Azure Data Engineer

    4 days ago

    bangalore, India Torry Harris Full time

    Are you an experienced data engineer looking for a new challenge? If so, Torry Harris is seeking a talented Azure Data Engineer to join our team and help drive our data engineering efforts to the next level.As an Azure Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining cloud-based data solutions using Azure...

  • Azure Lead

    7 days ago

    bangalore, India Birlasoft Full time

    Job Title: Azure Databricks Lead ( Female candidates) Location: Bangalore, Hyderabad,Pune,Noida Company Description: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our...

  • Lead Azure Databricks Engineer

    2 months ago

    Bangalore, India ResourceTree Global Services Full time

    Resource Tree Global Services Pvt Ltd is hiring Senior Databricks Data Engineer for one of its leading client in Content & Data Analytics. Below are the details .Job Title : Senior Databricks Data EngineerSkills Required : Azure, Databricks, Datalake, Python/Scala/Java, Data Migration Strategies, Data Warehiusing, Data Modelling, Strong knowledge on Data...

  • Azure Data Engineer

    2 months ago

    bangalore, India Tredence Inc. Full time

    About Tredence:Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Azure Data Engineer

    2 days ago

    bangalore, India Tredence Inc. Full time

    About Tredence:Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Digital Engineering Lead Engineer

    1 week ago

    bangalore, India NTT DATA Full time

    Job Description Req ID:  274698  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Lead Engineer to join our team in Bengaluru, Karnātaka (IN-KA),...

  • ADC Data Engineering Lead

    2 months ago

    Bangalore, Karnataka, India Growel Softech Pvt. Ltd. Full time

    Job Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...

  • ADC Data Engineering Lead

    1 week ago

    bangalore, India Growel Softech Pvt. Ltd. Full time

    Job Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...

  • ADC Data Engineering Lead

    3 weeks ago

    Bangalore, India Growel Softech Pvt. Ltd. Full time

    Job Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...

  • ADC Data Engineering Lead

    2 months ago

    Bangalore, India Growel Softech Pvt. Ltd. Full time

    Job Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...