Principal Data Engineer

9 hours ago

India Xebia Full time

Position name: Principal Data Engineer

Experience: years

Location - Gurugram/Chennai/Jaipur/Pune/Bhopal/Bangalore

Summary of JD: AWS, Spark, Pyspark, Python, SQL, AWS, Data Warehouse design and development, Databricks and dbt, architecting and implementing workflow management systems, Airflow, Spark applications, CI/CD processes, experience with GitHub Actions

Detailed Job Description

About the team: As a Principal Data Engineer in the Data Warehouse team you will be relied on to lead a team of Sr. Data Engineers, propose Architecture, solve complex situations and data model, interact directly with client for requirement gathering, build a holistic roadmap, identify risks and have mitigation strategy, develop and deliver high-quality features and finish tasks to a high standard. You'll be part of an emerging team, focussing on building and improving our innovative Data Warehouse offerings applying marketing suites.

What we are looking for

For this position the ideal candidate has 10+ years of experience in software development, and with data structures/algorithms with a focus on backend and data engineering.

Level of skills and experience:

● Overall 10 + years of experience in data engineering with 4+ years leading team

● 8+ years of hands-on experience in using Python, JVM and Shell Scripting with production experience.

● 5+ years of proven experience on building cloud native data intensive applications, Amazon Web Service experience is a must and good to have experience in GCP.

● Experience on Data Warehouse design and development per the business nature using any of the modern data warehouses.

● Having experience in Databricks and dbt experience is required.

● Highly proficient in architecting and implementing workflow management systems, Airflow is a must.

● Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).

● Hands-on experience of building and maintaining Spark applications.

● Fundamental understanding of Parquet, Delta Lake and other OTFs file formats.

● Proficiency on an IaC tool such as Terraform, CDK or CloudFormation is a must.

● Experience with observability systems (such as Datadog or Prometheus/Grafana)

● Strong experience on building CI/CD processes, experience with GitHub Actions, ArgoCD or Jenkins is good to have.

● Experience with unit testing and test automation frameworks.

● propose and review Architecture

● solve complex situations and data model

Soft skills:

● Lead a team of 4-5 Senior Engineers

● client communication and Requirement gathering

● interact directly with client for requirement gathering

● build a holistic roadmap

● identify risks and have mitigation strategy

● Comfortable providing, receiving constructive feedback, particularly while participating in code reviews and ability to not only code, but also provide good quality readable business documentation.

● Focus on business value vs engineering interest and focus on business value vs engineering interest.

● Pro-active / service-oriented towards our internal customers

  • Principal Engineer

    2 days ago

    India Recro Full time

    Job Description – Principal Engineer (Java, Spring Boot, Insurance/BFSI)Work Mode: 5 days from officeLocation: WhitefieldWe are looking for a seasoned Principal Engineer with 8+ years of experience insoftware development, specializing in Java and Spring Boot frameworks. The idealcandidate should have hands-on expertise with project management and...

  • Principal Software Engineer

    4 days ago

    India Microsoft Full time

    Job DescriptionAzure Data Manager for Energy (ADME), helps Energy companies gain actionable insights, improve operational efficiency, and accelerate time to market on the enterprise-grade, cloud-based Open Subsurface Data Universe (OSDU) Data Platform service. It supports innovation with a flexible, open energy platform that developers can build upon and...

  • Principal Data Engineer

    2 days ago

    India London Stock Exchange Group Full time

    About Us LSEG London Stock Exchange Group is more than a diversified global financial markets infrastructure and data business We are dedicated open-access partners with a commitment to excellence in delivering the services our customers expect from us With extensive experience deep knowledge and worldwide presence across financial markets we enable...

  • 3 Days Left) Principal Engineer

    3 weeks ago

    India Amazon Music Full time

    Job DescriptionDESCRIPTIONPrincipal Engineers provide technical leadership at Amazon.com. They help establish technical standards and drive Amazon's overall technical architecture, engineering practices, and engineering methodologies. They work on our hardest problems, building high quality, architecturally sound systems that are aligned with our business...

  • Principal Software Engineer

    1 day ago

    India Shakudo Full time US$ 1,25,000 - US$ 1,75,000 per year

    At Shakudo, we're building the world's first operating system for data and AI—a unified platform that streamlines powerful open-source and proprietary tools into a seamless, production-ready environment. We're looking for a Principal Software Development Engineer to lead the development of full end-to-end applications on our platform. This role is ideal...

  • Principal Software Engineer

    1 day ago

    India RN Jobforce Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company Description RN JobForce empowers job seekers and employers worldwide with cutting-edge job search tools and a growing professional community. We work collaboratively with our clients to supply them with only the best and most suitable candidates via our multi-layer candidate delivery function. Our platform provides tailored technology job...

  • Principal Software Engineer

    3 days ago

    India Microsoft Full time

    Job DescriptionBe the voice behind the future-join us to build transformative speech technology for multilingual, intelligent experiences that reach billions.Microsoft is pioneering next-generation AI-driven speech solutions for voice agents, video translation, and call centre analytics.As a Principal Software Engineer in Microsoft's Azure Speech team, you...

  • Principal Software Engineer

    1 week ago

    India Microsoft Full time

    Job DescriptionAre you looking for an opportunity to change the way businesses digitally transform in a mobile first, cloud first world If so, we've got the job for you The Business and Industry Co-pilot group is responsible for the Microsoft Dynamics 365 suite of products, Microsoft Flow, PowerApps, and Power BI in addition to other products and services...

  • Principal Engineering Manager

    4 days ago

    India Microsoft Full time

    Job DescriptionAre you looking for an opportunity to join a team of engineers in positively affecting the experience of every consumer who uses Microsoft products The OSSE team in OPG group is focused on building client experiences and services that light up Microsoft Account experiences across all devices and platforms. We are passionate about working...

  • Principal Engineer

    4 days ago

    India inVentiv Health Clinical SRE, LLC Full time

    Job DescriptionDescriptionPrincipal Engineer (Data Governance)- Hyderabad- hybridSyneos Health is a leading fully integrated biopharmaceutical solutions organization built to accelerate customer success. We translate unique clinical, medical affairs and commercial insights into outcomes to address modern market realities.Every day we perform better because...