What is Management Experimentation?

Stop guessing, start testing.

Experimentation in management is about moving beyond opinion, guesswork and shaky research methods to robust testing of what really works – and what doesn’t.

Experimentation underpins organisational decision-making with a reasonable dose of scientific rigour. Its method and the mindsets it encourages are hugely valuable for organisations seeking agility in fast-changing environments.

Why experiment?

Experiments are an incredibly useful way for organisations to learn and catalyse effective change. As the business environment becomes more volatile and uncertain, the need to foster agility and ‘free up’ thinking has grown. Whilst other forms of research, analysis, planning and execution remain useful, for some organisational challenges they cannot provide the answers. Rather than calculate, predict, assume and estimate, it can be better to explore, try, test, learn and refine.

Experiments are usually conducted on a small scale at first, making them easier and faster to implement than typical organisational changes. Designed well, they can produce insights very quickly – and often these insights are more robust than those produced from conventional methods. For example, focus groups might suggest that lots of customers would buy a new product – an experiment can show that they actually do! Experiments are also often less expensive than alternative approaches to gathering insights – and because they typically help to reduce risks, can offer significant financial returns if these insights lead to wide-scale implementation of changes.

Experiments have led to some of humankind’s greatest achievements, and have the potential to stimulate extraordinary innovation and change within organisations too – by challenging assumptions and fostering action learning.

What is an experiment?​

An experiment is a systematic procedure designed to discover facts through altering conditions and observing effects.

Crucially, experimentation is not just ‘trying out new things’ – which most organisations do all the time. Experiments are systematic procedures. They use the fundamental building blocks of the scientific approach – relying on clear hypotheses, careful sampling and management of bias, systematic observation, robust measurement and so on.

Also important in this definition is the point that experimentation involves changing conditions. Most other forms of research commonly used in organisations are observational – for example conducting survey questionnaires or focus groups. Although these can be useful, by themselves, they are not experiments: they don’t change the conditions of respondents in the way that experiments change the conditions for their subjects.

What are experiments not?

Experiments are not like typical change initiatives. They don’t by themselves deliver specific outputs or have direct business performance outcomes. They are explorative, focused on discovery, insight and learning. However, most experiments will inform or develop into change initiatives – making them highly impactful.

Those who experiment in conventional organisations have to be careful not to fall back on a ‘big project’ mindset – planning to deliver ‘perfect’ and complex solutions over long time horizons.

Executing strategy execution through experimentation

Dr Andrew MacLennan has supported thousands of leaders as they design and conduct experiments in organisations.

Andrew has woven experimentation into the core approach he uses for strategy execution – ensuring that 'top down' approaches to implementing strategy can be augmented with 'bottom-up' strategy building. The result is a powerful fusion of systematic and agile realisation of strategy that works.

Andrew supports experimentation through both executive education and consulting – often using the former to introduce the principles, mindset and methods and the latter to ensure rapid business impact and embed experimentation as 'business as usual'.