principal data engineer

3 weeks ago


Hyderabad, Telangana, India DELTACUBES PVT LTD Full time

PRINCIPAL DATA ENGINEER

Experiance : 15-20 years, 

Required Skills:Cloud Data Engineering, GCP, Big Query, CloudRun, Dataform, SQL,Python, Airflow,

Pubsub, Kubernetes, Docker, DATAOPS, Grafana, Datadog.

Role Overview

We are seeking a dynamic and highly skilled Principal Data Engineer who has extensive experience

building enterprise scale data platforms and lead these foundational efforts. This role demands

someone who not only possesses a profound understanding of the data engineering landscape but

is also at the forefront of their game. The ideal candidate will contribute significantly to platform

development with diverse skillset while also being very hands-on coding and actively shaping the

future of our data ecosystem.

Responsibilities:

As a principal engineer, you will be responsible for ideation, architecture, design and

development of new enterprise data platform. You will collaborate with other cloud and

security architects to ensure seamless alignment within our overarching technology

strategy.

Architect and design core components with a microservices architecture, abstracting

platform, and infrastructure intricacies.

Create and maintain essential data platform SDKs and libraries, adhering to industry best

practices.

Design and develop connector frameworks and modern connectors to source data from

disparate systems both on-prem and cloud.

Design and optimize data storage, processing, and querying performance for large-scale

datasets using industry best practices while keeping costs in check.

Architect and design the best security patterns and practices

Design and develop data quality frameworks and processes to ensure the accuracy and

reliability of data.

Collaborate with data scientists, analysts, and cross functional teams to design data

models, database schemas and data storage solutions.

Design and develop advanced analytics and machine learning capabilities on the data

platform.

Design and develop observability and data governance frameworks and practices.

Stay up to date with the latest data engineering trends, technologies, and best practices.

Drive the deployment and release cycles, ensuring a robust and scalable platform.

Requirements:

15+ of proven experience in modern cloud data engineering, broader data landscape

experience and exposure and solid software engineering experience.

Prior experience architecting and building successful enterprise scale data platforms in

a green field environment is a must.

Proficiency in building end to end data platforms and data services in GCP is a must.

Proficiency in tools and technologies: BigQuery, Cloud Functions, Cloud Run, Dataform,

Dataflow, Dataproc, SQL, Python, Airflow, PubSub.

Experience with Microservices architectures - Kubernetes, Docker and Cloud Run

Experience building Symantec layers.

Proficiency in architecting and designing and development experience with batch and

real time streaming infrastructure and workloads.

Solid experience with architecting and implementing metadata management including

data catalogues, data lineage, data quality and data observability for big data workflows.

Hands-on experience with GCP ecosystem and data lakehouse architectures.

Strong understanding of data modeling, data architecture, and data governance

principles.

Excellent experience with DataOps principles and test automation.

Excellent experience with observability tooling: Grafana, Datadog.

Nice to have:

Experience with Data Mesh architecture.

Experience building Semantic layers for data platforms.

Experience building scalable IoT architectures



  • Hyderabad, Telangana, India Principal Global Services Full time

    Responsibilities Indicative years of experience 5 yearsRole Description Principal Pune is hiring a Mainframe Modernization - Sr Infrastructure Engineer This engineer will be a part of the Platform support under Information Services IS and responsible for helping achieve the strategy around availability of our Mainframe environment through adoption of...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Principal Engineer

    3 weeks ago


    Hyderabad, Telangana, India RGS Outsourcing Full time

    Role : Principal Engineer Location : Hyderabad MNCXXXX enables cyber, data and operational resilience for every organization with the Data Resiliency Cloud, the industry's first and only at scale SaaS solution. Customers can radically simplify data protection, streamline data governance, and gain data visibility and insights as they accelerate cloud...


  • Hyderabad, Telangana, India Principal Global Services Full time

    About the RoleWe are seeking a highly skilled Mainframe Modernization Engineer to join our team at Principal Global Services. In this role, you will play a key part in helping us achieve our strategy for availability of our Mainframe environment through adoption of modern philosophies and methodologies.Key ResponsibilitiesEnable the process of migrating and...


  • Hyderabad, Telangana, India Statistics & Data Corporation (SDC) Full time

    Principal Clinical Data ManagerStatistics & Data Corporation (SDC), a specialized contract research organization (CRO) headquartered in Arizona, delivering top-tier clinical trial services to pharmaceutical, biologic, and medical device/diagnostic companies since 2005. SDC providing a technology enabled service offering to provide clients with both clinical...

  • Principal Engineer

    4 weeks ago


    Hyderabad, Telangana, India ElementSkill Full time

    About RoleWe are looking for engineers who are passionate about building value-added services at SaaS scale. You have a deep interest in exploiting characteristics of data and metadata and build architectures that can efficiently and effectively process such data at scale thereby solving for multiple business requirements around data security and data...


  • Hyderabad, Telangana, India SDC (Statistics & Data Corporation) Full time

    Job DescriptionStatistics & Data Corporation (SDC), a specialized contract research organization (CRO) headquartered in Arizona, delivering top-tier clinical trial services to pharmaceutical, biologic, and medical device/diagnostic companies since 2005. SDC providing a technology enabled service offering to provide clients with both clinical services...


  • Hyderabad, Telangana, India Pegasystems Full time

    Meet Our Team: Data engine is one of the most critical pieces in the entire application development lifecycle. We are one of the core engine teams in platform engineering at Pega. It's a small team, highly focused, and follows agile principles. The team is responsible for end-to-end delivery of the software starting from development to release to the...


  • Hyderabad, Telangana, India Micron Full time

    Job DescriptionOur vision is to transform how the world uses information to enrich life for .Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.As a Principal Data Scientist at Micron, you...

  • Principal Engineer

    3 weeks ago


    Hyderabad, Telangana, India The Wells Fargo Foundation Full time

    Job DescriptionAbout this role:Wells Fargo is seeking a Principal Engineer within Wealth and Investment Management Technology on the Data solutions innovation team. A Principal Engineer, who enjoys and thrives on solving complex problems through innovation impacting change at scale in a diverse environment. You will join a focused team of engineers...

  • Principal Engineer

    2 weeks ago


    Hyderabad, Telangana, India WELLS FARGO BANK Full time

    About this role:Wells Fargo is seeking a Principal Engineer within Wealth and Investment Management Technology on the Data solutions innovation team. A Principal Engineer, who enjoys and thrives on solving complex problems through innovation impacting change at scale in a diverse environment. You will join a focused team of engineers introducing and...


  • Hyderabad, Telangana, India Skillsoft Full time

    At Skillsoft, we propel organizations and people to grow together through transformative learning experiences. We believe every team member has the potential to be AMAZING. Join us in our quest to transform learning and help individuals unleash their edge. At Skillsoft, we are all about making work matter. We believe every team member has the potential to...


  • Hyderabad, Telangana, India data Remote Work Freelance Full time

    What can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...


  • Hyderabad, Telangana, India data Remote Work Freelance Full time

    What can you tell your friends when they ask you what you do? "As a Data Analyst at data.ai, I help analyze, monitor, and deliver comprehensive and high-quality app market data to app professionals. I am empowered to work independently with the support of team members spread across APAC, AMER, and EMEA. I am the key contributor to the new and existing...

  • Principal Engineer

    3 weeks ago


    Hyderabad, Telangana, India Cloud4C Services Full time

    Job Title: Principal Engineer - StorageExperience: 7 -10 YearsLocation: Hyderabad( Work From Office)Job Description:We are looking for a skilled NetApp Storage Engineer with a strong understanding of storage systems and Data ONTAP administration in SAN & NAS environments. The ideal candidate will excel in managing storage infrastructure, troubleshooting, and...


  • Hyderabad, Telangana, India Skillsoft Full time

    At Skillsoft, we propel organizations and people to grow together through transformative learning experiences. We believe every team member has the potential to be AMAZING. Join us in our quest to transform learning and help individuals unleash their edge. At Skillsoft, we are all about making work matter. We believe every team member has the potential to...


  • Hyderabad, Telangana, India New Relic, Inc. Full time

    Principal Software Engineer Principal Software Engineer Principal Software Engineer Req ID 7 Location(s) Hyderabad, India; Work arrangement(s) Hybrid (works from home and New Relic office throughout the week), Office (works primarily in a New Relic office) Your opportunity We're looking for a Principal Engineer to head our industry-leading Application...


  • Hyderabad, Telangana, India Genpact Full time

    Job DescriptionGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for...


  • Hyderabad, Telangana, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR56766 Staff Engineer/Principal Engineer Product...


  • Hyderabad, Telangana, India Deliveroo Full time

    Location: Hyderbad or Bangalore, India - HybridWhy Deliveroo?Our mission is to be the definitive food company. We are transforming the way the world eats by making food more convenient and accessible. We give people the opportunity to eat what they want, as they want it, when and where they want it.We are a technology-driven company at the forefront of the...