Senior Data Engineer

1 week ago


gurugram, India The Economist Full time

Introduction

Job Title:

Senior Data Engineer

Business Unit:

Technology / Engineering

Location:

London

Direct Reports: 

0

Reporting Manager Title:

Bogdan Vrusias

Date Prepared:

01 / 05 / 2024

Who we are

We are an organisation that exists to drive progress. That's the “red thread” that connects everyone at The Economist Group (TEG). Our businesses share a devotion to innovation, independence and rigour in their fields of expertise. We empower people to understand and tackle the critical challenges and changes facing the world. Our analytical rigour, global expertise and evidence-based insights enable individuals and organisations to make sense of these shifts and chart a course through them.

Our story began in 1843, when a Scottish hat manufacturer founded The Economist newspaper to further the cause of free trade. Since then, we have evolved into a staunchly independent global media and information-services company that provides intelligent thinking for an international audience. We deliver our analysis and insights in many formats to subscribers and clients in 170 countries with four businesses, each of which upholds our global reputation for excellence and integrity. 

Business Unit Intro

Our team of 200 colleagues is at the heart of The Economist Group’s digital-first agenda. Together, we are delivering user-friendly, high-quality digital products that bring data, intelligence and analysis to our growing global audiences across all our four businesses.

Our team develops cutting-edge products that provide valuable insights and analysis to business and government leaders worldwide. Whether it involves creating new products for the Economist Intelligence Unit (EIU), conceptualising mobile applications that deliver personalised content, or enhancing our flagship website, , the Technology team plays a crucial role in shaping how we attract, convert, engage, and retain our 1.2 million subscribers.

The Technology team collaborates closely with other teams to engineer innovative solutions that cater to the evolving needs of our subscribers. This includes leveraging advanced technologies and methodologies to enhance the acquisition of new subscribers, optimise conversion rates, deliver engaging user experiences, and ensure long-term subscriber loyalty.

The role:

We are looking for a Senior Data Engineer to join our Economist Group engineering team. Your primary focus will be to design, develop, ship, maintain and oversee the overall architecture of our data platforms - with a focus on systems related to our customer facing products. The initial focus will be around implementing appropriate data infrastructure required to enable predictive analytics and ML algorithms, and in conjunction with the Head of AI and Data Engineering support the organisation to implement their vision. The team will also support the EIU in similar work related to forecasting technology. You’ll also work with individuals from our corporate data team (responsible for reporting, analytics and insights), as well as work collaboratively with data scientists and analysts in other teams across the organisation.

The role will suit either an existing senior or a mid-level Data Engineer ready for their next challenge, but with at least some experience leading or mentoring a high performing team. You should enjoy working with autonomy in a creative and entrepreneurial environment, and have a strong commitment to producing high quality solutions. We offer flexible working and have recently shifted to a 'remote first' working policy with a minimum expectation of coming to the office two days a month, however you can come in more often if you wish to.

How you will contribute in this role:

Work with data product managers, analysts, and data scientists to architect, build and maintain data processing pipelines in SQL or Python. Build and maintain a data warehouse / data lake-house for analytics, reporting and ML predictions. Implement DataOps and related DevOps focused on creating ETL pipelines for data analytics / reporting Collaborate with the Data Science team to build automated ELT pipelines and feature engineering processed for model training. Support, optimise and transition our current processes to ensure well architected implementations and best practices. Work in an agile environment within a collaborative agile product team using Kanban Collaborate across departments and work closely with data science teams and with business (economists/data) analysts in refining their data requirements for various initiatives and data consumption requirements. Educate and train colleagues such as data scientists, analysts, and stakeholders in data pipelining and preparation techniques, which make it easier for them to integrate and consume the data they need for their own use cases. Participate in ensuring compliance and governance during data use, to ensure that the data users and consumers use the data provisioned to them responsibly through data governance and compliance initiatives. Become a data and analytics evangelist, and promote the available data and analytics capabilities and expertise to business unit leaders, and educate them in leveraging these.

What we’re looking for:

8+ years of professional experience with data processing environments used in large scale digital applications. Extensive experience with programming in Python, Spark( SparkSQL) and SQL Experience with warehouse technologies such as Snowflake, and data modelling, lineage and data governance tools such as Alation. Professional experience of designing, building and managing bespoke data pipelines (including ETL, ELT and lambda architectures), using technologies such as Apache Airflow, Snowflake, Amazon Athena, AWS Glue, Amazon EMR, or other equivalent. Strong, fundamental technical expertise in cloud-native technologies, such as serverless functions, API gateway, relational and NoSQL databases, and caching. Experience in leading / mentoring data engineering teams. Experience in working in teams with data scientists and ML engineers, for building automated pipelines for data pre-processing and feature extraction. An advanced degree in software / data engineering, computer / information science, or a related quantitative field or equivalent work experience. Strong verbal and written communication skills and ability to work well with a wide range of stakeholders. Strong ownership, scrappy and biassed for action.

What we offer

Benefits

We offer excellent benefits including an incentive scheme, generous annual and parental leave policies, volunteering days and well-being support throughout the year, as well as free access to all Economist content. Country specific benefits are also offered.

Our Values

Our values are a collective set of beliefs and behaviours that strengthen The Economist Group's purpose and demonstrate where we want to be as an organisation. They reflect on our mission to pursue progress for individuals, organisations and the world.

Independence

We are not bound to any party or interest and encourage exploration and free-thinking. We champion freedom, both within our organisation and around the world.

Integrity

We are bold in our efforts to uncover the truth and stand up for what we believe in. We inspire trust through our rigour, fact-checking and transparency.

Excellence

We aspire to the highest standards in all we do. We are ambitious and inquisitive in our pursuit of continuous progress and innovation.

Inclusivity

We value diversity in thought and background and encourage healthy debate with a breadth of perspectives. We treat our colleagues and customers fairly and respectfully.

Openness

We foster a collaborative and empathetic culture conducive to the interests, wit and initiative of our colleagues. New ideas are our lifeblood.

The Economist Group values diversity. We are committed to equal opportunities and creating an inclusive environment for all our colleagues and potential colleagues regardless of ethnic origin, national origin, gender, gender identity, race, colour, religious beliefs, disability, sexual orientation, age, marital status or any other status.


The Economist Group values diversity. We are committed to equal opportunities and creating an inclusive environment for all our employees. We welcome applicants regardless of ethnic origin, national origin, gender, gender identity, race, colour, religious beliefs, disability, sexual orientation , age or marital status.

  • Gurugram, India RoundCircle Full time

    Round Circle is a leading technology company dedicated to leveraging data-driven insights to fuel innovation and drive business growth. We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a pivotal role in designing, developing, and optimizing our data infrastructure,...

  • Senior Data Engineer

    1 month ago


    Gurugram, India True Tech Professionals Full time

    Senior Data EngineerLocation: Gurgaon (Hybrid Mode)Experience: 5 years and above. Immediate Joiners Preferred (Notice Period: 10 - 15 days)We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL. The...


  • Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Senior Data description:We are looking for a high-energy individual for the role of Senior Data Analyst at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team. The candidate is expected to lead following work-streams:- Drive client meetings with data-driven insights and observations on key website/app...


  • gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...


  • gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...


  • Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks)About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some of...


  • Gurugram, India True Tech Professionals Full time

    Lead Data EngineerLocation: Remote - Gurgaon (Office visit - once in a while - as and when required)Experience: 7+ yearsAre you passionate about leveraging data to drive business decisions? Do you thrive in a collaborative environment where your expertise in data engineering can make a significant impact? If so, we're looking for you to join our team as a...


  • gurugram, India True Tech Professionals Full time

    Lead Data Engineer Location: Remote - Gurgaon (Office visit - once in a while - as and when required) Experience: 7+ years Are you passionate about leveraging data to drive business decisions? Do you thrive in a collaborative environment where your expertise in data engineering can make a significant impact? If so, we're looking for you to join our team...


  • gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    1 month ago


    gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    1 month ago


    Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    3 weeks ago


    Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...


  • Gurugram, India Valiance Solutions Full time

    About Valiance:Valiance is a niche AI consulting firm dedicated to transforming businesses by leveraging the power of data science, AI, and cloud technologies. With a team of over 120 professionals, we provide cutting-edge solutions to clients in the US and India.Job Overview:We are seeking a highly skilled and experienced Senior AWS Data Engineer to join...


  • gurugram, India Valiance Solutions Full time

    About Valiance: Valiance is a niche AI consulting firm dedicated to transforming businesses by leveraging the power of data science, AI, and cloud technologies. With a team of over 120 professionals, we provide cutting-edge solutions to clients in the US and India. Job Overview: We are seeking a highly skilled and experienced Senior AWS Data Engineer to...

  • Senior Data Engineer

    4 weeks ago


    Gurugram, India Xebia Full time

    Who Are We?With over 20 years of experience, our global network of passionate technologists and pioneering craftsmen deliver cutting-edge technology and game-changing consulting to companies on the brink of transformation. Since 2001, we have grown from a Java company into a full-service digital consulting company with 4500+ professionals working on a...

  • Senior Data Engineer

    4 weeks ago


    gurugram, India Xebia Full time

    Who Are We? With over 20 years of experience, our global network of passionate technologists and pioneering craftsmen deliver cutting-edge technology and game-changing consulting to companies on the brink of transformation. Since 2001, we have grown from a Java company into a full-service digital consulting company with 4500+ professionals working on a...

  • Senior Data Engineer

    4 weeks ago


    Gurugram, India Xebia Full time

    Who Are We?With over 20 years of experience, our global network of passionate technologists and pioneering craftsmen deliver cutting-edge technology and game-changing consulting to companies on the brink of transformation. Since 2001, we have grown from a Java company into a full-service digital consulting company with 4500+ professionals working on a...

  • Senior Data Engineer

    3 weeks ago


    Gurugram, India Xebia Full time

    Who Are We?With over 20 years of experience, our global network of passionate technologists and pioneering craftsmen deliver cutting-edge technology and game-changing consulting to companies on the brink of transformation. Since 2001, we have grown from a Java company into a full-service digital consulting company with 4500+ professionals working on a...

  • Senior Data Engineer

    3 weeks ago


    Gurugram, India Xebia Full time

    Who Are We? With over 20 years of experience, our global network of passionate technologists and pioneering craftsmen deliver cutting-edge technology and game-changing consulting to companies on the brink of transformation. Since 2001, we have grown from a Java company into a full-service digital consulting company with 4500+ professionals working on a...

  • Senior Data Engineer

    3 weeks ago


    Gurugram, India Xebia Full time

    Who Are We?With over 20 years of experience, our global network of passionate technologists and pioneering craftsmen deliver cutting-edge technology and game-changing consulting to companies on the brink of transformation. Since 2001, we have grown from a Java company into a full-service digital consulting company with 4500+ professionals working on a...