Principal Data Pipeline Engineer
6 days ago
We are seeking a highly skilled and motivated Senior Data Engineer/s to architect and implement scalable ETL and data storage solutions using Microsoft Fabric and the broader Azure technology stack. This role will be pivotal in building a metadata driven data lake that ingests data from over 100 structured and semi structured sources, enabling rich insights through canned reports, conversational agents, and analytics dashboards.Key ResponsibilitiesDesign and implement ETL pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse ,warehouse, sql) and Azure Data Factory.Build and maintain a metadata driven Lakehouse architecture with threaded datasets to support multiple consumption patterns.Develop agent specific data lakes and an orchestration layer for an uber agent that can query across agents to answer customer questions.Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics tools.Ensure data quality, lineage, and governance across all ingestion and transformation processes.Collaborate with product teams to understand data needs and deliver scalable solutions.Optimize performance and cost across storage and compute layers.Required Qualifications7 10 years of experience in data engineering with a focus on Microsoft Azure and Fabric technologies.Strong expertise in:Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines, Notebooks)Azure Data Factory, Azure SQL, Azure Data Lake Storage Gen2Power BI and/or other visualization toolsAzure Functions, Logic Apps, and orchestration frameworksSQL, Python and PySpark/ScalaExperience working with structured and semi structured data (JSON, XML, CSV, Parquet).Proven ability to build metadata driven architectures and reusable components.Familiarity with agent based architectures and conversational AI integration is a plus.Strong understanding of data modeling, data governance, and security best practices.Preferred QualificationsExperience with Azure OpenAI, Copilot Studio, or similar conversational platforms.Knowledge of CI/CD pipelines and DevOps practices for data engineering.Experience in building multi tenant data platforms or domain specific lakes
-
Principal Data Engineer
2 weeks ago
Hyderabad, India Evalify-IQ Full timeDescription Principal Data Engineer – Partnership Intelligence We are seeking a Principal Data Engineer to join our Measurement team within the Partnership Intelligence Platform. This is a senior individual contributor role focused on driving technical excellence, architectural direction, and long-term platform strategy. You will bring deep expertise in...
-
Principal Data Engineer
2 weeks ago
Hyderabad, India Evalify-IQ Full timeDescription Principal Data Engineer – Partnership Intelligence We are seeking a Principal Data Engineer to join our Measurement team within the Partnership Intelligence Platform. This is a senior individual contributor role focused on driving technical excellence, architectural direction, and long-term platform strategy. You will bring deep expertise in...
-
Principal Data Engineer
2 weeks ago
Hyderabad, India Evalify-IQ Full timeDescription Principal Data Engineer – Partnership Intelligence We are seeking a Principal Data Engineer to join our Measurement team within the Partnership Intelligence Platform. This is a senior individual contributor role focused on driving technical excellence, architectural direction, and long-term platform strategy. You will bring deep expertise in...
-
Principal Data Engineer
2 weeks ago
Hyderabad, India Evalify-IQ Full timeDescription Principal Data Engineer – Partnership Intelligence We are seeking a Principal Data Engineer to join our Measurement team within the Partnership Intelligence Platform. This is a senior individual contributor role focused on driving technical excellence, architectural direction, and long-term platform strategy. You will bring deep expertise in...
-
Principal Data Engineer
2 weeks ago
Hyderabad, India Evalify-IQ Full timeDescription Principal Data Engineer – Partnership Intelligence We are seeking a Principal Data Engineer to join our Measurement team within the Partnership Intelligence Platform. This is a senior individual contributor role focused on driving technical excellence, architectural direction, and long-term platform strategy. You will bring deep expertise in...
-
Principal Data Engineer
2 weeks ago
Hyderabad, India Evalify-IQ Full timeDescription Principal Data Engineer – Partnership Intelligence We are seeking a Principal Data Engineer to join our Measurement team within the Partnership Intelligence Platform. This is a senior individual contributor role focused on driving technical excellence, architectural direction, and long-term platform strategy. You will bring deep expertise in...
-
Principal Data Engineer
2 weeks ago
hyderabad district, India Evalify-IQ Full timeDescription Principal Data Engineer – Partnership Intelligence We are seeking a Principal Data Engineer to join our Measurement team within the Partnership Intelligence Platform. This is a senior individual contributor role focused on driving technical excellence, architectural direction, and long-term platform strategy. You will bring deep expertise in...
-
Principal Data Pipeline Engineer
2 weeks ago
Hyderabad, India EverestDX Inc Full timeAbout the Company:Everest DX – We are a Digital Platform Services company, headquartered in Stamford. Our Platform/Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterprise IT. Our vision is to enable Digital Transformation for enterprises to deliver seamless customer experience, business efficiency and...
-
Principal Data Pipeline Engineer
2 weeks ago
Hyderabad, India Globant Full timeAt Globant, we are working to make the world a better place, one step at a time. We enhance business development and enterprise solutions to prepare them for a digital future. With a diverse and talented team present in more than 30 countries, we are strategic partners to leading global companies in their business process transformation.Specify, design, and...
-
Data Engineer
1 week ago
Hyderabad, Telangana, India Principal Global Services Full time ₹ 4,50,000 - ₹ 9,00,000 per yearResponsibilitiesRole OverviewWe are looking for a Data Engineer with 2+ years of experience in data engineering and analysis tasks to meet business requirements and maximize effectiveness. The candidate should understand technical aspects of data management, including creating, collecting, loading, transforming, cleansing, processing, storing, analyzing,...
