Skip to main content

Across the health system | A question to investigate

Define the answer before choosing the pilot.

A technology pilot can consume months and still leave a team unsure whether to continue. The problem is often that success was never defined in terms of a decision. Our proposed PHARMORIS evaluation approach starts with a recurring medicines task, its current method and the evidence that would justify change. For a trust, ICB, academic partner or investor, the incentive is a bounded study that can support a credible next step, including an informed decision to stop.

Film credits

In the conversation.

NEUVIOR and our founder’s perspectives have appeared across science, business and technology publications.

University of Warwick IATL | AI Ethics NowpharmaphorumTechRadar ProET PharmaFinancial TimesPharmaceutical TechnologyPharmaTimesManufacturing ChemistDigital HealthDaily BusinessTheBusinessDesk.comStartups MagazineInsider MediaYorkshire PostYork PressBusinessCloud

Reporting, commentary, letters and podcast appearances | Read each feature for its format and source.

Start with the intended use.

NICE's evidence standards framework helps developers plan evidence for digital health technologies (NICE, n.d.). NHS England's clinical safety strategy describes manufacturer and deployment responsibilities (NHS England, n.d.). Neither removes the need to define the actual task and assess the requirements that apply to it. An organisational preparation aid and a patient-specific treatment function are different propositions. The study should say what participants will do, what the technology produces and who reviews the output. Without that definition, claims about evidence or assurance have no stable object.

Choose a comparator people would really use.

The normal workflow may include experienced staff, established templates and existing digital resources. That is the comparator a useful proposition must face. Do not compare a new brief with an intentionally weak process or count only its drafting time while ignoring checks. Agree which parts of the work belong in the measurement, including setup, training, corrections and support. The aim is to discover whether the complete task improves, rather than manufacture a favourable result by selecting the easiest slice of it.

The simplest effort equation is baseline complete-task time minus assisted preparation, checking, correction and support time. Report setup separately and explain how frequently it would recur. Pair that result with the agreed quality threshold; a positive time difference does not rescue an output that fails an important quality condition. This creates a buyer-relevant test of the whole workflow without turning a small preparation study into an unsupported claim of financial or clinical benefit.

Separate feasibility from effectiveness.

A small study may establish that participants can use the workflow and that the required inputs are available. It may not be able to show a reliable performance difference or downstream clinical benefit. State those limits in the plan. Early development can use synthetic or appropriately de-identified examples where suitable; later operational work requires its own approvals and design. The evidence programme should progress because an earlier result supports the next question, not because the word pilot implies that the product is already ready.

Agree outcomes before seeing the results.

A proposed first study could measure quality, traceability, total effort and the kinds of errors reviewers must correct. Define critical failures separately from minor edits. Decide who reviews the outputs, whether reviewers can be blinded to the preparation method and how disagreement will be resolved. The analysis plan should also describe missing observations and participant withdrawal. These choices make a modest study more interpretable and help prevent a striking anecdote from becoming the public claim for the entire programme.

A pilot should answer an investment question.

An investment case gets stronger when it explains the conditions for repetition. Make the next commitment depend on evidence.

A service sponsor wants evidence that can support an actual commissioning or delivery decision. A busy pilot alone does not establish value, attribution or readiness to expand.

Supports an investable boundary: suitable now, suitable after a defined dependency, unsuitable under present conditions or still unknown.

What would we need to understand?

  • Decision owner and intended use
  • Credible existing comparator
  • Pre-agreed outcomes and observation boundary
  • Professional safeguards and workload limit

Constructed decision example | No customer results are shown.

NICE (n.d.) | NHS England (n.d.)

Make the commercial case earn its assumptions.

A buyer needs more than a statistically interesting result. The output must be useful enough to adopt, with training, support and integration requirements included. The evaluation should identify who holds the budget, who experiences the benefit and which constraints could prevent purchase. Time released is not automatically cash released; it may support additional useful work without changing expenditure. Any pricing or revenue scenario would need separate validation. A study should inform those assumptions rather than be presented as proof of a market that has not yet been demonstrated.

Write the stop criteria while enthusiasm is high.

Stop for the agreed critical quality failure, inappropriate use, unavailable inputs or a checking burden that removes the proposed benefit. Set a practical limit on setup and support effort. Define who can halt the study and what happens to unfinished work. A negative result is valuable when it redirects development or prevents a poor investment. The programme should preserve that result, including disagreement and limitations, rather than repeatedly changing the measure until one favourable figure can be advertised.

Bring a task, an owner and a decision.

The most useful conversation involves the people doing the work, an accountable clinical or organisational sponsor and someone who can decide what happens after the study. Bring the recurring problem, the current approach and the result that would change your view. We can discuss whether PHARMORIS offers a testable development proposition for that task. This is an invitation to define evidence with prospective partners; it is not a claim of an approved study, completed pilot, validated product or guaranteed route to procurement.

NEUVIOR Data Analysis

A source.
A question.
A clearer decision.

Useful intelligence keeps its evidence attached.

Our public analysis connects a defined question with named sources, reporting periods and methods. Each source below shows the work available today and the access still needed.

Published-data analysis, research hypotheses and evidence studies are distinct kinds of work. Their meaning should remain clear as the programme grows.

NHS Business Services Authority | Annual

Prescription Cost Analysis

How does activity differ from ingredient-cost concentration?

Analysis available

Official source

NHS Business Services Authority | Monthly

English Prescribing Dataset with SNOMED Code

Which product and organisational patterns merit a closer investigation?

Metadata retrieved

Official source

Medicines and Healthcare products Regulatory Agency | Event-driven; monthly roundup also published

Medicines and device safety communications

Which official communication should a responsible team read next?

Snapshot retrieved

Official source

NHS Business Services Authority and NHS England | Weekly

Dictionary of medicines and devices

Can the same product identity be followed consistently across sources?

Access review

Official source

Explore NEUVIOR Data Analysis

Sources and further reading

Another useful angle.

NEWSPerspectives & features