Principal Data Engineer

2 days ago

Gurgaon, Haryana, India Xebia Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Position name: Principal Data Engineer

Experience: years

Location - Gurugram/Chennai/Jaipur/Pune/Bhopal/Bangalore

Summary of JD: AWS, Spark, Pyspark, Python, SQL, AWS, Data Warehouse design and development, Databricks and dbt, architecting and implementing workflow management systems, Airflow, Spark applications, CI/CD processes, experience with GitHub Actions

Detailed Job Description

About the team: As a Principal Data Engineer in the Data Warehouse team you will be relied on to lead a team of Sr. Data Engineers, propose Architecture, solve complex situations and data model, interact directly with client for requirement gathering, build a holistic roadmap, identify risks and have mitigation strategy, develop and deliver high-quality features and finish tasks to a high standard. You'll be part of an emerging team, focussing on building and improving our innovative Data Warehouse offerings applying marketing suites.

What we are looking for

For this position the ideal candidate has 10+ years of experience in software development, and with data structures/algorithms with a focus on backend and data engineering.

Level of skills and experience:

● Overall 10 + years of experience in data engineering with 4+ years leading team

● 8+ years of hands-on experience in using Python, JVM and Shell Scripting with production experience.

● 5+ years of proven experience on building cloud native data intensive applications, Amazon Web Service experience is a must and good to have experience in GCP.

● Experience on Data Warehouse design and development per the business nature using any of the modern data warehouses.

● Having experience in Databricks and dbt experience is required.

● Highly proficient in architecting and implementing workflow management systems, Airflow is a must.

● Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).

● Hands-on experience of building and maintaining Spark applications.

● Fundamental understanding of Parquet, Delta Lake and other OTFs file formats.

● Proficiency on an IaC tool such as Terraform, CDK or CloudFormation is a must.

● Experience with observability systems (such as Datadog or Prometheus/Grafana)

● Strong experience on building CI/CD processes, experience with GitHub Actions, ArgoCD or Jenkins is good to have.

● Experience with unit testing and test automation frameworks.

● propose and review Architecture

● solve complex situations and data model

Soft skills:

● Lead a team of 4-5 Senior Engineers

● client communication and Requirement gathering

● interact directly with client for requirement gathering

● build a holistic roadmap

● identify risks and have mitigation strategy

● Comfortable providing, receiving constructive feedback, particularly while participating in code reviews and ability to not only code, but also provide good quality readable business documentation.

● Focus on business value vs engineering interest and focus on business value vs engineering interest.

● Pro-active / service-oriented towards our internal customers

  • Principal Software/Data Engineering

    13 hours ago

    Gurgaon, Haryana, India CoPoint Data Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About CoPoint DataCoPoint Data is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients....

  • Principal Data Engineer

    2 days ago

    Gurgaon, Haryana, India Fabric Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Application Link: Job Summary:The Principal Data Engineer - GCP role involves designing and implementing end-to-end data and analytics solutions on Google Cloud Platform. The position requires expertise in GCP services like BigQuery, Dataflow, and Cloud Storage, along with strong data modeling skills. The role includes mentoring teams, participating in...

  • Principal Engineer

    4 days ago

    Gurgaon, Haryana, India NatWest Group Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Principal Engineer, Director Join us as a Principal EngineerThis is a challenging role that will see you design and engineer software with the customer or user experience as the primary objective With your software development background, you'll be working with architects to help define major components of the business-wide target architecture and...

  • Principal Data Engineer

    8 hours ago

    Gurgaon, Haryana, India IndiGo (InterGlobe Aviation Ltd) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position SummaryWe are seeking a skilled Principal Data Engineer to lead and deliver data projects, develop enterprise data roadmaps, implement robust data solutions and support to the business on various Data Requirement. This role involves deploying technologies like Snowflake, Azure, and Data Bricks, managing data pipelines, and resolving complex data...

  • Principal Data Architect

    3 weeks ago

    Gurgaon, Haryana, India PinnacleU HR Full time

    We are seeking a Principal Data Architect to lead our Data Platforms Team and drive innovation in data engineering, analytics, and governance.Role Overview : As a Principal Data Architect, you will be responsible for leading the design, development, and scaling of our data infrastructure. You will collaborate with product managers, data scientists, and...

  • Principal Engineer

    10 hours ago

    Gurgaon, Haryana, India NatWest Group Full time ₹ 15,00,000 - ₹ 60,00,000 per year

    Principal Engineer, VP Join us as a Principal EngineerYou'll drive development software and tools to accomplish project and departmental objectives by converting functional and non-functional requirements into a suitable design As well managing the technical delivery of one or more software engineering teams, you'll lead the wider participation in...

  • Principal Data Engineer

    16 hours ago

    Gurgaon, Haryana, India IndiGo (InterGlobe Aviation Ltd) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position SummaryWe are seeking a skilled Principal Data Engineer to lead and deliver data projects, develop enterprise data roadmaps, implement robust data solutions and support to the business on various Data Requirement. This role involves deploying technologies like Snowflake, Azure, and Data Bricks, managing data pipelines, and resolving complex data...

  • Principal Engineer, Director

    2 weeks ago

    Gurgaon, Haryana, India RBS Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Join us as a Principal EngineerThis is a challenging role that will see you design and engineer software with the customer or user experience as the primary objectiveWith your software development background, you'll be working with architects to help define major components of the business-wide target architecture and roadmapYou'll gain valuable senior...

  • Principal Data Analyst

    11 hours ago

    Gurgaon, Haryana, India Airtel Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Principal Data AnalystDevelop an In-depth understanding of user journeys on Airtel Digital Platforms and generate data driven insights & recommendations to help product business in meticulous decision making. End-to-end ownership of key metrics, work with respective product owners to understand areas we need to measure and ensure the needle is moving in...

  • Managing Principal

    14 hours ago

    Gurgaon, Haryana, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Senior...