| Criterion |
Weight |
Evidence to score against |
Scoring guidance (1–5) |
| Functional fit against your top ten scenarios |
20 |
Scripted demonstrations of your scenarios on your data, not the vendor's standard demo |
5 = all ten work today unmodified; 3 = most work with configuration; 1 = key scenarios need roadmap or customisation |
| Delivery track record at your scale |
15 |
Reference calls you sourced yourself, with organisations of similar size and complexity |
5 = three comparable references verified independently; 3 = vendor-supplied references only; 1 = no comparable deployment found |
| Implementation approach and dependency |
10 |
The named delivery team, knowledge-transfer plan and what you can run without them at month eighteen |
5 = credible named team with a dated handover plan; 3 = approach clear but resourcing unconfirmed; 1 = delivery model depends on unnamed partners |
| Total cost over the contract life |
15 |
Five-year cost model including licences, implementation, support, change requests and internal effort |
5 = full model validated by finance; 3 = major elements priced, internal effort estimated; 1 = year-one pricing only |
| Commercial flexibility |
10 |
Contract terms on downscaling, pausing, benchmarking and price caps at renewal |
5 = terms allow volume reduction and cap renewal uplift; 3 = some flexibility, untested; 1 = terms ratchet up only |
| Support and escalation reality |
10 |
Resolution-time data, your own test tickets during evaluation, and the named escalation path |
5 = resolution commitments with credits, verified by references; 3 = response-time SLAs only; 1 = support model untested |
| Roadmap credibility |
5 |
Delivery record against the vendor's previous two years of public roadmap |
5 = roadmap history checks out; 3 = mixed record; 1 = your requirements depend on undelivered roadmap |
| Exit and data portability |
10 |
A rehearsed answer to "what does leaving look like": formats, costs, timelines, in the contract |
5 = contractual exit assistance with defined formats; 3 = export possible, cost unclear; 1 = exit requires vendor professional services at their rates |
| Working relationship signals |
5 |
How the vendor behaved during evaluation: responsiveness, candour about weaknesses, redline behaviour |
5 = admitted limitations unprompted; 3 = polished and evasive in equal measure; 1 = every hard question went to follow-up and stayed there |