Stephen Young
Jan. 24, 2017
6:45 p.m. PST

Performance Results

Are you able to provide some clarification, and perhaps an example, of what's expected from a "performance results" statement?

For example, are you expecting...
* false-positive, false-negative, true-positive, true-negative equivalents
* application/device processing time
* staff member time
* successful use rate (identification and enrolment)
* service throughput numbers

Some of these metrics lend themselves to (say) existing biometric methods of identification applied to a standardized corpus. Providing them for a novel solution is going to be more difficult, however. What will be sufficient for such a novel solution?
3 Replies

Barb Sivek moderator
Jan. 27, 2017
noon PST
@Stephen Young
Thanks for your question. You raise some good questions. Our team is discussing your suggestion and we will have a response shortly.

Barb Sivek moderator
Jan. 31, 2017
2:53 p.m. PST
@Stephen Young
In response to your question we will be looking for basic information such as enrollment speed and accuracy levels, throughput, etc. – but are also looking for the innovators to be as expansive and creative as they can be in order to demonstrate how their solution performs. The examples that you have provided are all good. If a novel approach generates different metrics then as long as they are well documented we would review them during the solution assessment. Does that info help?

Stephen Young
Jan. 31, 2017
6:55 p.m. PST
That helps. Thanks Barb.
Post Your Reply