Lead - Digital Experimentation

We are an organisation that exists to drive progress. That's the "red thread" that connects everyone at The Economist Group (TEG). Our businesses share a devotion to innovation, independence and rigour in their fields of expertise. We empower people to understand and tackle the critical challenges and changes facing the world. Our analytical rigour, global expertise and evidence-based insights enable individuals and organisations to make sense of these shifts and chart a course through them.

We deliver analysis and insights in many formats to subscribers and clients in 170 countries through our four businesses, The Economist, Economist Impact, Economist Intelligence and Economist Education, which uphold our global reputation for excellence and integrity. 

We are embarking on a major investment to reimagine product insights, marketing analytics, self-serve insights, and experimentation at The Economist Group (TEG) with Amplitude Platform. This role sits at the very heart of that transformation. As a lead on experimentation and AB Testing, you will play a pivotal role in shaping how our organization captures, structures, and leverages data to drive smarter decisions, better customer experiences, and faster experimentation.

Joining at this stage offers an unparalleled opportunity to do something genuinely exciting and career-defining: you will be building the foundations of an analytics ecosystem that will power product innovation and marketing performance across TEG

Over the last three years, The Economist Group has embraced the power of experimentation in driving business results with eight-figure financial benefits from the use of AB testing and experimentation. Our portfolio of experiments has grown rapidly, particularly in our B2C business, and we are seeing significant and sustained financial returns from these efforts. We are now ready to take the next step on our journey by investing further in our experimentation capabilities. As part of a wider investment programme, which includes launching a new experimentation platform and upskilling our staff, we are creating a new Digital Analytics and Experience Centre of Excellence(CoE) in India, which will include Experimentation and AB testing in its remit.

This role is a key part of our Digital Analytics and Experience Centre of Excellence(CoE) in India. This is a brilliant opportunity for someone who is already an expert in the Experimentation, AB Testing and Optimization field, to join this CoE and drive our experimentation stream, working with key stakeholders globally and enablement teams to run the experimentation in the organization

We need a person who combines demonstrated technical and commercial expertise in the experimentation field with a passion for helping businesses achieve tangible impact and benefits using experimentation. This person needs to be a superb communicator and evangelist - proactively building relationships and seeking opportunities to drive the development, adoption and value of our  experimentation capabilities forward.  This person would be a key enabler of our experimentation ambitions by bringing in best practices, latest trends and methodologies and innovation to help teams and stakeholders learn, adopt and run our growing AB/multivariate testing and experimentation. 

While the emphasis of this role is on the enablement of our data, product, marketing and technology teams to run their own experiments, this person would also often be responsible for designing, executing, and analyzing more complex and ambitious AB/multivariate tests across digital platforms to identify optimal user experiences by comparing different variations of a webpage, app feature, or marketing campaign, ultimately providing data-driven insights to improve key business metrics and inform product development decisions. 

How you will contribute in this role:

Key responsibilities:

• Manage the Amplitude experimentation platform to enable other users e.g. setting up standard reporting templates, metrics, audiences, etc. for use by other analysts and engineers
• Identify training and skill development needs amongst Amplitude user community and, based on these needs, organise and/or run training, set up and run user groups, organize best practice clinics and drop-in sessions, etc.
• Ensure that innovative experimentation methodologies and best practices that would add value to The Economist Group are identified, tested and the outcomes widely shared across the business
• Ensure that the results of experimentation portfolio are well curated and widely shared across the business
• Alongside being hands-on designing and evaluating our more complex experiments, act as an advisor and consultant to the wider analyst and stakeholder community in ensuring that all our experiments are well-design, well-executed and rigorously evaluated
• Building excitement and enthusiasm about the capabilities we have and about the power and potential of experimentation
• Building deep technical expertise in our experimentation platforms [particularly Amplitude Experiment]

Hands on Skills:

Experimentation Design & Execution

• Strong ability to design, scope, and implement controlled experiments (A/B, multivariate, Feature Flag experiments [holdout tests]).
• Expertise in defining hypotheses, test metrics, and success criteria aligned with business objectives by choosing the right statistical test for the experiment, knowledge of methodologies for identifying issues or bias when analyzing experiment results.
• Knowledge of randomization techniques, sampling strategies, and statistical significance and the ability to explain these concepts to stakeholders in simpler terms.
• Experience with setting up and monitoring experiment guardrails (e.g., avoiding revenue cannibalization or bias).

Technical & Analytical Proficiency

• Hands-on experience with experimentation platforms (e.g., Amplitude, Optimizely, Adobe Target, Google Optimize, VWO or any such similar platforms).
• Familiarity with statistical methods (t-tests, Bayesian inference [multi-arm bandits etc], regression, uplift modeling, sequential testing).
• Strong SQL skills for querying large datasets and joining multiple sources.
• Proficiency in Python or R for deeper statistical analysis and automation of experimentation workflows.
• Ability to build dashboards and visualization of experiment results (within Amplitude and/or Tableau).

Optimization & Scaling

• Experience running simultaneous experiments across multiple user journeys, platforms, and geographies.
• Ability to prioritize experiments based on business impact and resource availability.
• Comfort with test orchestration in environments with feature flags and continuous deployment.
• Strong understanding of personalization and advanced targeting strategies.

Data Quality & Implementation

• Hands-on ability to validate experiment instrumentation, ensuring events and conversions are tracked correctly.
• Knowledge of web and mobile tagging frameworks (e.g. Tealium, GTM, Segment) for clean experiment setup.
• Familiarity with debugging tools (e.g., Chrome DevTools, Charles Proxy, Firebase DebugView) to troubleshoot test setups.

Collaboration & Communication

• Skilled in translating complex statistical findings into business-friendly insights.
• Ability to coach cross-functional teams (product managers, marketers, engineers, analysts) on best practices in experimentation.
• Hands-on experience creating playbooks, templates, and knowledge-sharing resources for scaling experimentation culture.

Key Stakeholders

• Product teams (web and apps)
• Marketing Teams on conversion rate optimisation
• Customer Experience and In Life (Retention) marketing
• Data Research and Insights (DRI) Team
• Technology Teams (Front end teams, Data engineers etc)

DESIRED QUALIFICATIONS :

1. Has a B.Tech /B.E/MCA.(Bachelor's or Master's degree in Technology) or a relevant degree in Statistics, Data Science, Computer Science, Economics, Mathematics from a reputed institution
2. 6+ years of experience in data-driven product, marketing, or analytics roles, with a strong focus on A/B testing and experimentation.
3. Proven track record of designing, executing, and scaling experimentation programs in high-traffic digital environments (e.g., e-commerce, SaaS, media, or consumer tech).

#LI-Hybrid

We are an innovative organisation that encourages the use of technology. We recognise that candidates may utilise AI tools to support with their job application process. However, it is essential that all information you provide truthfully and accurately reflects your own experience, skills, and qualifications.

Our benefits package is designed to support your wellbeing, growth, and work-life balance. It includes a highly competitive pension or 401(k) plan, private health insurance, and 24/7 access to counselling and wellbeing resources through our Employee Assistance Program.

We also offer a range of lifestyle benefits, including our Work From Anywhere program, which allows you to work from any location where you have the legal right to do so for up to 25 days per year. In addition, we provide generous annual and parental leave, as well as dedicated days off for volunteering and even for moving home.

You will also be given free access to all The Economist content, including an online subscription, our range of apps, podcasts and more.