Senior Big Data Engineer

2 months ago

gurugram, India dunnhumby Full time

dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First.

Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail – one of the world’s most competitive markets, with a deluge of multi-dimensional data – dunnhumby today enables businesses all over the world, across industries, to be Customer First.

dunnhumby employs nearly 2,500 experts in offices throughout Europe, Asia, Africa, and the Americas working for transformative, iconic brands such as Tesco, Coca-Cola, Meijer, Procter & Gamble and Metro.

What we expect from you

• Prior experience with scalable architecture and distributed processing. 
• Strong Programming expertise in SQL, Pyspark 
• Expertise on major big data solutions like Spark, Hive 
• Experience in big data orchestrator like Airflow 
• Strong programming skills in Python, with experience in FastAPI or any API framework 
• Proficiency in unit testing and code quality assurance. 
• Good hands-on experience on GIT or other code versioning tools 
• Strong spark optimizations/tunning skills 
• Experience on cloud-based data stores like Redshift and Big Query is an advantage. 
• Experience in cloud solution architecture preferrable GCP and Azure. 
• GitLab CI/CD is a plus. 
• Excellent problem-solving and communication skills. 
• Ability to work effectively in a collaborative team environment. 

Nice To Have

• Good experience on microservices architecture, docker and Kubernetes as orchestration. 
• ML ops and ML experience using Spark 
• Understanding of logging, monitoring, and alerting of production big data pipelines 

What you can expect from us

We won’t just meet your expectations. We’ll defy them. So you’ll enjoy the comprehensive rewards package you’d expect from a leading technology company. But also, a degree of personal flexibility you might not expect. Plus, thoughtful perks, like flexible working hours and your birthday off.

You’ll also benefit from an investment in cutting-edge technology that reflects our global ambition. But with a nimble, small-business feel that gives you the freedom to play, experiment and learn.

And we don’t just talk about diversity and inclusion. We live it every day – with thriving networks including dh Gender Equality Network, dh Proud, dh Family, dh One and dh Thrive as the living proof. We want everyone to have the opportunity to shine and perform at your best throughout our recruitment process. Please let us know how we can make this process work best for you. For an informal and confidential chat please contact to discuss how we can meet your needs. 

Our approach to Flexible Working

At dunnhumby, we value and respect difference and are committed to building an inclusive culture by creating an environment where you can balance a successful career with your commitments and interests outside of work.

We believe that you will do your best at work if you have a work / life balance. Some roles lend themselves to flexible options more than others, so if this is important to you please raise this with your recruiter, as we are open to discussing agile working opportunities during the hiring process.

  • Senior Big Data Software Engineer

    2 months ago

    gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Senior Data Engineer

    4 weeks ago

    gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    4 weeks ago

    Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    2 weeks ago

    Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Big Data Engineer

    3 weeks ago

    gurugram, India OmegaHires Full time

    Job Title: Big Data Engineer  Duration: Full-time on OmegaHires Payroll  Location: Gurugram (Should be located near NCR to attend office for 3 days a week)   Should understand the  Credit Card domain and good to have knowledge on Compliance & Operational Risk . Good analytics experience to do data discovery, analyze the gaps in data, partner with Data...

  • Senior Big Data Engineer

    1 month ago

    Gurugram, India dunnhumby Full time

    We’re looking for a Sr Big Data Engineer who expects more from their career. It’s chance to extend and improve dunnhumby’s Data Engineering Team. It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers.  What we expect from you • 5+ years of experience in Information...

  • Senior Big Data Engineer

    2 weeks ago

    gurugram, India dunnhumby Full time

    We’re looking for a Sr Big Data Engineer who expects more from their career. It’s chance to extend and improve dunnhumby’s Data Engineering Team. It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers.  What we expect from you • 5+ years of experience in...

  • Senior Big Data Engineer

    2 weeks ago

    Gurugram, India dunnhumby Full time

    We’re looking for a Sr Big Data Engineer who expects more from their career. It’s chance to extend and improve dunnhumby’s Data Engineering Team. It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers.  What we expect from you • 5+ years of experience in Information...

  • Senior Big Data Engineer

    2 months ago

    Gurugram, India dunnhumby Full time

    dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First. Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail –...

  • Big Data Engineer

    1 month ago

    gurugram, India dunnhumby Full time

    We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...

  • Big Data Engineer

    1 month ago

    Gurugram, India dunnhumby Full time

    We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...

  • Big Data Engineer

    2 weeks ago

    gurugram, India dunnhumby Full time

    We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...

  • Big Data Engineer

    2 weeks ago

    Gurugram, India dunnhumby Full time

    We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...

  • Lead Big Data Software Engineer

    2 months ago

    gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Publicis Sapient

    2 weeks ago

    Gurugram, India Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • Diatoz Solutions

    3 weeks ago

    Gurugram, India DIATOZ Solutions Pvt ltd., Full time

    We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing :- Data Pipeline Development: Design, Develop, And Maintain...