Principal Data Engineer

1 day ago

Kolkata, West Bengal, India Xebia Full time

Position name: Principal Data Engineer

Experience: 10 -14 years

Location - Gurugram/Chennai/Jaipur/Pune/Bhopal/Bangalore

Summary of JD: AWS, Spark, Pyspark, Python, SQL, AWS, Data Warehouse design and development, Databricks and dbt, architecting and implementing workflow management systems, Airflow, Spark applications, CI/CD processes, experience with GitHub Actions

Detailed Job Description

About the team: As a Principal Data Engineer in the Data Warehouse team you will be relied on to lead a team of Sr. Data Engineers, propose Architecture, solve complex situations and data model, interact directly with client for requirement gathering, build a holistic roadmap, identify risks and have mitigation strategy, develop and deliver high-quality features and finish tasks to a high standard. You'll be part of an emerging team, focussing on building and improving our innovative Data Warehouse offerings applying marketing suites.

What we are looking for

For this position the ideal candidate has 10+ years of experience in software development, and with data structures/algorithms with a focus on backend and data engineering.

Level of skills and experience:

● Overall 10 + years of experience in data engineering with 4+ years leading team

● 8+ years of hands-on experience in using Python, JVM and Shell Scripting with production experience.

● 5+ years of proven experience on building cloud native data intensive applications, Amazon Web Service experience is a must and good to have experience in GCP.

● Experience on Data Warehouse design and development per the business nature using any of the modern data warehouses.

● Having experience in Databricks and dbt experience is required.

● Highly proficient in architecting and implementing workflow management systems, Airflow is a must.

● Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).

● Hands-on experience of building and maintaining Spark applications.

● Fundamental understanding of Parquet, Delta Lake and other OTFs file formats.

● Proficiency on an IaC tool such as Terraform, CDK or CloudFormation is a must.

● Experience with observability systems (such as Datadog or Prometheus/Grafana)

● Strong experience on building CI/CD processes, experience with GitHub Actions, ArgoCD or Jenkins is good to have.

● Experience with unit testing and test automation frameworks.

● propose and review Architecture

● solve complex situations and data model

Soft skills:

● Lead a team of 4-5 Senior Engineers

● client communication and Requirement gathering

● interact directly with client for requirement gathering

● build a holistic roadmap

● identify risks and have mitigation strategy

● Comfortable providing, receiving constructive feedback, particularly while participating in code reviews and ability to not only code, but also provide good quality readable business documentation.

● Focus on business value vs engineering interest and focus on business value vs engineering interest.

● Pro-active / service-oriented towards our internal customers

  • Principal Consultant– Data Engineer

    4 weeks ago

    Kolkata, West Bengal, India Genpact Full time

    Job DescriptionReady to shape the future of workAt Genpact, we don&rsquot just adapt to change&mdashwe drive it. AI and digital innovation are redefining industries, and we&rsquore leading the charge. Genpact&rsquos , our industry-first accelerator, is an example of how we&rsquore scaling advanced technology solutions to help global enterprises work smarter,...

  • Principal Software Architect

    17 hours ago

    Kolkata, West Bengal, India Mindstech Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Principal Software Architect to lead our cloud-native application architecture, high-scale data systems, and platform strategy.This role blends architecture strategy, engineering leadership, and ownership of critical platform decisions. Required Candidate profileNET Core (5+ years hands-on) with advanced knowledge of async programming, API performance,...

  • Principal Data Scientist/Architect

    4 days ago

    Kolkata, West Bengal, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Lead Data ScientistWe are seeking a seasoned expert to spearhead our data science initiatives. As the Principal Data Scientist/Architect, you will define and drive our data strategy, developing innovative AI/ML solutions that directly impact our business.Key Responsibilities:Strategic Vision: Champion the company's data science vision and strategy, aligning...

  • Principal Backend Engineer

    5 days ago

    Kolkata, West Bengal, India beBeeBackend Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job OverviewWe are seeking a skilled engineer to fill a principal position in our organization.This role involves working on the backend service and is responsible for ensuring high levels of reliability and attention to detail.The ideal candidate will have 8+ years of experience in the field.Tier 1 responsibilities include working on critical tier tickets,...

  • Principal Data Engineer

    1 week ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Key Job Responsibilities:Design and implement scalable data engineering systems using a range of technologies.Develop and maintain large-scale data processing pipelines, focusing on data integration, ETL processes, and real-time analytics.Write efficient SQL queries to optimize database performance and troubleshoot complex issues.Nice-to-Have...

  • Principal Signaling Engineer

    14 hours ago

    Kolkata, West Bengal, India Hitachi Rail Full time US$ 80,000 - US$ 1,20,000 per year

    *About Us*A career at Hitachi Rail will help create a legacy. With operations in every corner of the world, our work goes to the cutting-edge of digital transformation and technology. From the multi-cultural strength of our global organisation to the sustainable and innovative ways we work to bring people together, there's something for everyone to get stuck...

  • 10/08/2025 Principal Consultant-data Modeler- Informatica

    4 weeks ago

    Kolkata, West Bengal, India GENPACT Full time

    Ready to shape the future of work At Genpact we don t just adapt to change we drive it AI and digital innovation are redefining industries and we re leading the charge Genpact s our industry-first accelerator is an example of how we re scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at scale ...

  • Data Engineer

    17 hours ago

    Kolkata, West Bengal, India Synechron Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    oin Our Team as an Azure Data Engineer Are you passionate about data engineering and cloud technologies? We are seeking a dynamic Azure Data Engineer to join our innovative team. If you have 5-7 years of experience in data engineering and transformation on the cloud, with strong expertise in Azure Data Engineering and Databricks, we want to connect with you...

  • Principal Consultant- Systems Engineer

    15 hours ago

    Kolkata, West Bengal, India Genpact Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Description Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000 people across 30 countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for...

  • Manager Data Science

    14 hours ago

    Kolkata, West Bengal, India Applied Data Finance Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are seeking skilled and motivated Data Scientists with 4+ years of experience in data science with good domain understanding. The ideal candidate will have a strong foundation in data science concepts, proficiency in analytical tools, and the ability to translate data insights into actionable business recommendations. This role requires a blend...