Principal Data Engineer
2 days ago
Job role: Principal Data Engineer - Remote
Job Type: Full Time
Job Mode: REMOTE
Experience: 8+ Years
Work Hours: 1:00 PM – 10:00 PM IST
Selection Process: Online
Job Summary:
We are looking for an accomplished Principal Data Engineer to lead the ideation, architecture, design and development of our next-generation enterprise data platform. This role requires a visionary technologist with deep hands-on expertise in cloud data engineering (GCP preferred), data architecture, and software engineering.
You will work closely with cloud, security, and infrastructure architects to ensure seamless alignment with the organization's broader technology and business strategies.
Job Role & Responsibility:
- · Lead the end-to-end architecture and development of a modern enterprise-scale data platform from the ground up.
- · Collaborate with cloud and security architects to ensure platform scalability, performance, and compliance.
- · Architect, design, and implement batch and real-time streaming data infrastructures and workloads.
- · Build and maintain data lakehouse architectures within the GCP ecosystem.
- · Design and develop connector frameworks and reusable data ingestion pipelines to source data from both on-premises and cloud systems.
- · Architect and implement metadata management, including data catalogs, lineage, quality, and observability frameworks.
- · Design and develop data quality frameworks and governance processes to ensure reliability and accuracy.
- · Develop microservices-based components using Kubernetes, Docker, and Cloud Run to abstract platform and infrastructure complexities.
- · Design and optimize data storage, transformation, and querying performance for large-scale datasets while ensuring cost efficiency.
- · Implement observability tooling (Grafana, Datadog) and DataOps best practices, including CI/CD and test automation.
- · Collaborate with data scientists and analysts to define data models, schemas, and advanced analytics capabilities.
- · Drive deployment, release management, and platform scalability initiatives.
- · Stay ahead of emerging data engineering trends, tools, and best practices to continuously evolve the platform.
Skills:
- 8+ years of proven experience in modern cloud data engineering and enterprise data platform architecture.
- Demonstrated success in architecting and delivering large-scale greenfield data platform
- projects.
- Deep expertise in Google Cloud Platform (GCP) and its ecosystem — BigQuery, Cloud
- Functions, Cloud Run, Dataform, Dataflow, Dataproc, SQL, Python, and Airflow.
- Strong understanding of streaming technologies such as Kafka or Pub/Sub.
- Hands-on experience with microservices architectures using Kubernetes, Docker, and Cloud Run.
- Proven ability to design semantic layers and metadata-driven architectures.
- Expertise in data modeling, data architecture, and data governance principles.
- Experience with observability and monitoring tools (Grafana, Datadog).
- Strong understanding of DataOps principles, including automation, CI/CD, and testing for data pipelines.
- Experience architecting secure, scalable, and high-performance data solutions.
Job Types: Full-time, Contractual / Temporary
Contract length: 3 months
Pay: ₹1,900, ₹4,000,000.00 per year
Benefits:
- Work from home
Work Location: Remote
-
AWS/Snowflake Support Engineer
1 week ago
Remote, India Data Engineer Academy LLP Full timeWe're Hiring: AWS/Snowflake Support Engineer (SME Role)Remote | Full Time | 7AM EST to 3PM EST| Pay: $ /MonthlyAbout the OpportunityThis role is a blend of a Subject Matter Expert (SME) and support engineer. The primary responsibility is to clear project issues for students while working on multiple projects involving AWS, Snowflake, and dbt. The engineer...
-
sme sql
1 week ago
Remote, India Data Engineer Academy LLP Full timeWe're Hiring: SQL Subject Matter Expert (SME) – Mock Interviews & Mentoring (Part-Time)Remote (India) | Work From Home | Flexible Timings | Pay: $600 – $800 / 80 hoursAbout the OpportunityData Engineer Academy is looking for an experienced SQL Subject Matter Expert (SME) to conduct mock interviews and provide mentorship to aspiring data professionals....
-
Subject Matter Expert Specialist
2 weeks ago
Remote, India Data Engineer Academy LLP Full time ₹ 7,20,000 - ₹ 12,00,000 per yearWe're Hiring: Subject Matter Expert (SME) – Snowflake & Databricks on AWS CloudRemote | Part Time | Flexible Timings | Pay: ₹600 – ₹1000/HourAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 10 years of experience in cloud data...
-
Principal Engineer
2 days ago
Remote, India AkashX Full timePrincipal DevOps EngineerIntroduction:Craft the future of data alongside AkashX, a startup reimagining the modern data infrastructure and architecture from a cost-performance-first mindset We're pioneering a new era in data management, committed to creating a data platform that combines unparalleled performance with exceptional affordability. At AkashX, we...
-
Principal Data Engineer, Marketing
2 days ago
Hybrid Remote, India Progress Full timeWe are Progress (Nasdaq: PRGS) - the trusted provider of software that enables our customers to develop, deploy and manage responsible, AI-powered applications and experience with agility and ease We're proud to have a diverse, global team where we value the individual and enrich our culture by considering varied perspectives because we believe people power...
-
Principal Data Engineer
4 days ago
Remote, India Etaclam Techno Services Full timeExperience Required: 8+ YearsRoles & Responsibilities:-· Lead the end-to-end architecture and development of a modern enterprise-scale data platform from the ground up.· Collaborate with cloud and security architects to ensure platform scalability, performance, and compliance.· Architect, design, and implement batch and real-time streaming data...
-
Principal Data Scientist
1 week ago
Remote, India PHASTAR Full timeOverview: **THE COMPANY** Phastar is a multiple award-winning global biometric Contract Research Organization (CRO) that is accredited as an outstanding company to work for by Best Companies. We partner with pharmaceutical, biotechnology and medical device organizations to provide the expertise and processes to manage and deliver on time, quality...
-
Data Engineer Advisor
1 week ago
Remote, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Advisor to join our team in Remote, Karntaka (IN-KA), India (IN). The SAP-to-Databricks Migration...
-
Principal AI Applications Engineer
1 week ago
Remote, India Deltek Full timeAs the recognized global standard for project-based businesses, Deltek delivers software and information solutions to help organizations achieve their purpose. Our market leadership stems from the work of our diverse employees who are united by a passion for learning, growing and making a difference. At Deltek, we take immense pride in creating a balanced,...
-
Data Analyst/ Engineer
6 days ago
Remote, India TOP RPO LLC Full timeSr. Data Analyst/EngineerLocation: India(Remote)Job Type: Full-time, RemoteAbout the jobA data analyst / scientist with experience in financial data and Investment technology solutions who can develop insights from data and impact strategy and direction of high value business solutions. Require critical thinking and hands on approach using latest AI models...