Here is the uncomfortable question to ask before you spend money on an awards entry: does your product change anything for a user yet, or does it only promise to? Most innovation award judges care far more about the first half of that question than the second. A clever idea with zero adoption rarely makes a shortlist. A less glamorous product that measurably cuts costs or errors often does.
The reason is definitional, not stylistic. According to Wikipedia, ISO standard 56000:2020 defines innovation as "a new or changed entity, realizing or redistributing value" — which puts value, not novelty, at the center of the concept. Wikipedia's survey of the literature also distinguishes innovation from invention: invention is the new ability, while innovation is the practical implementation that makes an impact in a market or society. Judges read entry forms through that lens. They are not scoring how new something is. They are scoring whether it has been implemented and whether value followed.
This piece walks through how judging panels typically work, what the scoring criteria reward, and why worthy products get left off shortlists. One limitation up front: every awards program writes its own rules, and none of them publish judge deliberations in full. What follows is the durable pattern across programs, not a description of any single competition.
What does "innovation" mean to a judge, precisely?
Judges usually start from a working definition that separates the idea from the outcome. Wikipedia notes that researchers Amabile and Pratt distinguish creativity — the production of novel and useful ideas — from innovation, which they describe as the successful implementation of creative ideas within an organization. That distinction shows up in scoring rubrics as two separate lines: one for originality, one for execution. Readers following this should also see How to Build an Innovation Culture on a Small Team.
It also shows up as a trap. A team can score high on originality and still lose because the execution line is empty. Judges see many entries where the demo is impressive and the deployment is theoretical. The rubric gives them a clean way to say no. This connects to our earlier piece, How Machine Learning Models Score Payment Fraud in Real Time.
A second dimension judges weigh is the degree of novelty. Wikipedia's summary of the research literature describes novelty as a spectrum — new to the firm, new to the market, new to the industry, or new to the world — and notes that innovation can be process change as well as product change. An entry that reengineers an internal process and saves real money competes on equal footing with a flashy new device. Many judges quietly prefer the process entry, because its impact is easier to verify.
Which criteria carry the most weight in scoring?
Rubrics vary, but most programs score against a small set of dimensions. The weighting differs; the dimensions repeat.
- Impact. What changed, for whom, and by how much? Judges look for a before-and-after, stated with numbers the entrant can stand behind. An unquantified claim of "significant improvement" scores poorly against a modest but documented gain.
- Implementation. Is it live, or is it a pilot, a patent application, or a slide? Wikipedia's account of the research is blunt on this point: innovation involves the practical implementation of ideas, not just their generation.
- Problem fit. Does the entry solve a problem real users actually have? Harvard Division of Continuing Education's innovation explainer, drawing on instructor Ben Little, describes the first stage of any innovation process as understanding the problem — researching it, exploring its dynamics, and figuring out where change is possible before building. Judges often probe whether the entrant did that homework.
- Evidence and verifiability. Can a judge check the claim? Customer references, published metrics, third-party audits and regulator filings all raise scores. Marketing copy lowers them.
- Scalability and durability. Does it work beyond one client or one quarter? Judges ask whether the result could spread, which echoes the emphasis on diffusion in the academic definitions Wikipedia summarizes.
Notice what is missing from that list: technology sophistication as a standalone item. A judge may personally admire a novel architecture, but most rubrics fold that into impact and implementation. Sophistication with no user is a science project, and science projects lose to spreadsheets.
How does the judging process actually run?
Most programs follow the same broad sequence, whatever the sector.
- Entry screening. Staff or a preliminary panel checks eligibility, completeness and category fit. Many strong entries die here for administrative reasons — wrong category, missing data, past the deadline — not for quality reasons.
- Independent scoring. Judges score each entry against the rubric, usually before any discussion. This is deliberate: scoring first reduces anchoring, where an early loud voice drags the panel's average.
- Deliberation. The panel meets, compares scores and argues the outliers. Big score gaps get discussed; consensus entries pass quietly.
- Shortlisting and, in some programs, presentations. Finalists may pitch live. A pitch rarely rescues weak evidence, but it can sink an entry that overclaims.
Two practical consequences follow. First, the written entry does most of the work, because deliberations start from written scores. Second, the process is human and finite. Judges have limited time, so entries that bury their strongest evidence on page four lose to entries that lead with it. That is a formatting problem, not a merit problem, and it is one of the most common reasons good products miss the cut.
Why do worthy products fail to make the shortlist?
Several failure modes recur, and none of them involve the product being bad.
- Impact without numbers. The team knows the product helped but never measured how much. Judges cannot score what the entry does not state, so an unmeasured win reads as an unproven one.
- Novelty framed as value. The entry leads with the technology — a new protocol, a new model — and never states what a user gained. Per the ISO definition carried in Wikipedia's overview, value realization is the point of innovation. An entry that proves novelty but not value answers the wrong question.
- Too early. A pre-launch product cannot show implementation. Entering a year too soon burns credibility for the following cycle.
- Poor storytelling for a skeptical reader. Judges are professional skeptics. Entries written like press releases — superlatives, no sources — trigger discounting. Harvard's explainer frames innovation as a process of taking an idea from inception to impact; entries that show that process, step by step, read as credible.
- Category mismatch. A payments infrastructure product entered in a consumer category competes against the wrong evidence. Screening kills more entries than deliberation does.
There is also a quieter structural factor: shortlists are short. A strong cohort year means strong entries miss the cut. Missing a shortlist is evidence of competition, not necessarily of weakness.
What this means: how to write an entry that survives judging
Our analysis of the pattern above reduces to a short checklist for any entrant.
- Lead with the measured result. State the before, the after and the timeframe, and name the source of each figure.
- Show implementation status plainly: live at how many customers, handling what volume, since when.
- Explain the problem first, in the user's terms, before describing the solution. This mirrors the process Harvard's Little describes — understand the problem, explore options, then build.
- Attach verifiable evidence for every material claim, and cut every claim you cannot support.
- Choose the category where your evidence is strongest, not the one with the most flattering title.
If the honest answer to the opening question — has anything changed for a user yet? — is no, the better move is usually to wait a cycle and gather the numbers. Awards reward the value, and value takes time to show up.
The limits of awards as a signal
Judging panels are competent, but the instrument has limits. Judges see what entrants submit, not what customers experience. Entries are self-reported, and even honest entrants select their best numbers. Deliberations are private, so losers rarely learn why they lost. And definitions of innovation vary widely — Wikipedia's literature survey found dozens of competing definitions across research fields — which means two programs can score the same product differently and both be acting in good faith.
The practical takeaway for anyone reading an awards shortlist, rather than writing an entry: treat the badge as one signal among several. A shortlisted product has cleared a structured review by people who asked the implementation and impact questions. That is worth something. It is not a substitute for checking the product's own evidence, and it is not a guarantee of anything about the company behind it.
The evidence in this piece supports a modest conclusion. Innovation awards tend to reward what the research definitions of innovation already imply — implementation, value, and the ability to prove both. Products that can show those things have a real chance, whatever their marketing budget. Products that cannot, usually do not, and no amount of polish changes that arithmetic.
