Principal Data Pipeline Engineer

3 weeks ago


Hyderabad, India People Prime Worldwide Full time

Senior Azure Data EngineerJob Details:Role: Senior Azure Data EngineerExperience: 7-10 YearsLocation: HyderabadInterview Mode: F2FNotice Period Preference: Immediate to 30 DaysJob Overview: We are seeking a highly skilled Senior Data Engineer with deep expertise in Microsoft Azure data ecosystem to design, develop, and maintain scalable data pipelines and architectures. The ideal candidate will play a key role in building robust data solutions that support advanced analytics, BI, and AI workloads across the organization. This role involves working with cross-functional teams — data scientists, analysts, and business stakeholders — to ensure high-quality, secure, and performant data delivery.Required Skills:Core Azure Services: ● Azure Data Factory (ADF) – pipeline orchestration, triggers, linked services, integration runtime. ● Azure Databricks – PySpark, Delta Lake, notebooks, job orchestration. ● Azure Synapse Analytics – dedicated and serverless SQL pools, data modeling, query optimization. ● Azure Data Lake Storage (ADLS Gen2) – hierarchical namespace, lifecycle management. ● Azure Functions / Logic Apps – event-driven data workflows. ● Azure Event Hubs / Kafka / Stream Analytics – real-time data ingestion. Programming & Tools: ● Strong in Python or Scala for data transformations. ● Proficient in SQL (T-SQL, Spark SQL, or Synapse SQL).● Experience with PySpark for distributed data processing.● Knowledge of Git, CI/CD, and DevOps best practices. ● Familiarity with Power BI integration or other reporting tools is a plus



  • Hyderabad, Telangana, India Blackbaud Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The Principal Data Engineer sets the technical direction that assists engineers and data engineers to take on large, complex data problems/initiatives. This role has considerable technical influence within the Data and Software Engineering teams at JustGiving.  This individual acts as an evangelist for proper data strategy with other teams at...


  • Hyderabad, Telangana, India Amgen Inc Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are looking for highly motivated expert Principal Data Engineer who can own the design & development of complex data pipelines, solutions and frameworks.The ideal candidate will be responsible to design, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This...


  • Hyderabad, India HyrEzy Talent Solutions Full time

    Job Title : Principal / Senior Data Engineer - Product Development- Location : Hyderabad (Work from Office only)- Experience : 4 - 7 Years- Notice Period : Maximum 15 daysAbout the Company :We are a new-age, AI-first Digital & Cloud Engineering Services company. Our mission is to combine deep engineering expertise with automation-first thinking and AI-native...


  • Hyderabad, India Tanla Platforms Limited Full time

    We are seeking a skilled Data Engineer with 5–10 years of experience to join our dynamic DataEngineering team. The ideal candidate will design, build, and optimize large-scale data pipelines and warehouses that enable real-time analytics and business intelligence across Tanla’s CPaaS ecosystem.You’ll work on diverse datasets, including Call Detail...


  • Hyderabad, Telangana, India Warner Bros. Discovery Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Welcome to Warner Bros. Discovery… the stuff dreams are made of.Who We Are…When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life,...


  • Hyderabad, Telangana, India Adv Techminds Full time ₹ 2,00,00,000 - ₹ 2,50,00,000 per year

    PRINCIPAL DATA ENGINEERExperiance : 15-20 years, Required Skills:Cloud Data Engineering, GCP, Big Query, CloudRun, Dataform, SQL,Python, Airflow,Pubsub, Kubernetes, Docker, DATAOPS, Grafana, Datadog.Role Overview We are seeking a dynamic and highly skilled Principal Data Engineer who has extensive experience building enterprise scale data platforms and...


  • Hyderabad, India Straive Full time

    Job Summary We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.X), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL/ELT solutions, collaborating with teams...


  • Hyderabad, India YO IT CONSULTING Full time

    Job Description :Title : Principal/ Senior AI Engineer- Graph Data ScienceExperience : 4 to 7 yearsLocation : HyderabadMust Haves :AI/Machine Learning/Neural NetworkRole And Responsibilities :We are seeking a highly skilled Principal/Senior AI Engineer Graph Data Science to join our advanced analytics and AI team. The ideal candidate will have strong...


  • Hyderabad, India Sonata Software Full time

    CategoryDetailsRoleSite Reliability Engineer (SRE) III – Data EngineeringLocationHyderabad- Employment TypeFull TimeExperience7–12 years in site reliability, cloud-based data infrastructure, data pipeline observability, automation, and high-availability engineering within EdTech platforms (2U)Primary Skills (Must-Have)AWS, CI/CD, Jenkins, IAAC,...


  • Hyderabad, India Optum Full time

    Primary Responsibilities:Support the full data engineering lifecycle including research, proof of concepts, design, development, testing, deployment, and maintenance of data management solutionsUtilize knowledge of various data management technologies to drive data engineering projectsLead data acquisition efforts to gather data from various structured or...