Principal Data Engineer

16 hours ago

Hyderabad, Telangana, India Adv Techminds Full time ₹ 2,00,00,000 - ₹ 2,50,00,000 per year


PRINCIPAL DATA ENGINEER

Experiance : 15-20 years, 

Required Skills:Cloud Data Engineering, GCP, Big Query, CloudRun, Dataform, SQL,Python, Airflow,

Pubsub, Kubernetes, Docker, DATAOPS, Grafana, Datadog.

Role Overview

We are seeking a dynamic and highly skilled Principal Data Engineer who has extensive experience

building enterprise scale data platforms and lead these foundational efforts. This role demands

someone who not only possesses a profound understanding of the data engineering landscape but

is also at the forefront of their game. The ideal candidate will contribute significantly to platform

development with diverse skillset while also being very hands-on coding and actively shaping the

future of our data ecosystem.

Responsibilities:

As a principal engineer, you will be responsible for ideation, architecture, design and

development of new enterprise data platform. You will collaborate with other cloud and

security architects to ensure seamless alignment within our overarching technology

strategy.

Architect and design core components with a microservices architecture, abstracting

platform, and infrastructure intricacies.

Create and maintain essential data platform SDKs and libraries, adhering to industry best

practices.

Design and develop connector frameworks and modern connectors to source data from

disparate systems both on-prem and cloud.

Design and optimize data storage, processing, and querying performance for large-scale

datasets using industry best practices while keeping costs in check.

Architect and design the best security patterns and practices

Design and develop data quality frameworks and processes to ensure the accuracy and

reliability of data.

Collaborate with data scientists, analysts, and cross functional teams to design data

models, database schemas and data storage solutions.

Design and develop advanced analytics and machine learning capabilities on the data

platform.

Design and develop observability and data governance frameworks and practices.

Stay up to date with the latest data engineering trends, technologies, and best practices.

Drive the deployment and release cycles, ensuring a robust and scalable platform.

Requirements:

15+ of proven experience in modern cloud data engineering, broader data landscape

experience and exposure and solid software engineering experience.

Prior experience architecting and building successful enterprise scale data platforms in

a green field environment is a must.

Proficiency in building end to end data platforms and data services in GCP is a must.

Proficiency in tools and technologies: BigQuery, Cloud Functions, Cloud Run, Dataform,

Dataflow, Dataproc, SQL, Python, Airflow, PubSub.

Experience with Microservices architectures - Kubernetes, Docker and Cloud Run

Experience building Symantec layers.

Proficiency in architecting and designing and development experience with batch and

real time streaming infrastructure and workloads.

Solid experience with architecting and implementing metadata management including

data catalogues, data lineage, data quality and data observability for big data workflows.

Hands-on experience with GCP ecosystem and data lakehouse architectures.

Strong understanding of data modeling, data architecture, and data governance

principles.

Excellent experience with DataOps principles and test automation.

Excellent experience with observability tooling: Grafana, Datadog.

Nice to have:

Experience with Data Mesh architecture.

Experience building Semantic layers for data platforms.

Experience building scalable IoT architectures


  • Principal Data Engineer

    1 day ago

    Hyderabad, Telangana, India Blackbaud Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The Principal Data Engineer sets the technical direction that assists engineers and data engineers to take on large, complex data problems/initiatives. This role has considerable technical influence within the Data and Software Engineering teams at JustGiving.  This individual acts as an evangelist for proper data strategy with other teams at...

  • Principal Data Engineer

    1 week ago

    Hyderabad, Telangana, India Amgen Inc Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are looking for highly motivated expert Principal Data Engineer who can own the design & development of complex data pipelines, solutions and frameworks.The ideal candidate will be responsible to design, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This...

  • Principal Data Engineer

    6 days ago

    Hyderabad, Telangana, India Warner Bros. Discovery Full time US$ 1,50,000 - US$ 2,00,000 per year

    Welcome to Warner Bros. Discovery… the stuff dreams are made of.Who We Are…When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are thestorytellersbringing our characters to life,...

  • Principal, Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Warner Bros. Discovery Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Welcome to Warner Bros. Discovery… the stuff dreams are made of.Who We Are…When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life,...

  • Software Engineer

    1 week ago

    Hyderabad, Telangana, India Principal Global Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Responsibilities Job Purpose Software Engineer is responsible for developing, testing and maintaining the application/s with established processes. With guidance, conduct analysis, elicit requirements, write correct and clean code leveraging best practices, DevOps, testing/debugging, documentation, quality assurance review, implementation and...

  • Principal Software Engineer

    18 hours ago

    Hyderabad, Telangana, India Nasuni Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Principal Software Engineer – Systems (Platform)About NasuniNasuni is a profitable, growing SaaS data infrastructure company reinventing enterprise file storage and data management in an AI-driven world. We power the data infrastructure of the world's most innovative enterprises. Backed by Vista Equity Partners, our engineers aren't working behind the...

  • Principal Software Engineer

    1 week ago

    Hyderabad, Telangana, India BlueCloud Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Role : Principal Software Engineer Data Platform Modernization Location : Hyderabad or Pune (Hybrid 3 days onsite per week) We are seeking a Principal Software Engineer to lead the modernization of our enterprise data platform and drive the adoption of next-generation data technologies. In this role, you will design and build scalable,...

  • Principal Software Engineer

    2 weeks ago

    Hyderabad, Telangana, India F5 Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are looking for a Principal Software Engineer with deep expertise in marketing technology platforms and strong engineering leadership to build scalable, performant, and integrated MarTech solutionsYou will play a key role in enabling marketing initiatives by engineering end-to-end systems across tools like Salesforce Marketing Cloud, Marketo, Adobe...

  • Senior Software Engineer

    1 week ago

    Hyderabad, Telangana, India Principal Global Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Responsibilities Job Purpose Senior Software Engineer is responsible for developing, testing and maintaining the application/s with established processes by conducting analysis, eliciting requirements, assisting in design, writing correct and clean code leveraging best practices, contributing to DevOps practices, testing/debugging, working on documentation,...

  • Principal Consultant-Data Engineer

    5 days ago

    Hyderabad, Telangana, India Genpact Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Ready to shape the future of work?At Genpact, we don't just adapt to change—we drive it. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of how we're scaling advanced technology solutions to help global enterprises work smarter, grow faster, and...