12,213
Credibility Assessment Standardized Evaluation (CASE) Prize Challenge

Credibility Assessment Standardized Evaluation (CASE) Prize Challenge

Develop a ground-breaking and innovative solution to evaluate credibility tools and techniques Read Overview...
Overview

Every day we make decisions about whether the people and information sources around us are reliable, honest, and trustworthy – the person, their actions, what they say, a particular news source, or the actual information being conveyed. Often, the only tool to help us make those decisions are our own judgments based on current or past experiences.

For some in-person and virtual interactions there are tools to aid our judgments. These might include listening to the way someone tells a story, asking specific questions, looking at a user badge or rating system, asking for confirming information from other people - or in more formal settings, verifying biometrics or recording someone’s physiological responses, such as is the case with the polygraph. Each of these examples uses a very different type of tool to augment our ability to evaluate credibility. Yet there are no standardized and rigorous tests to evaluate how accurate such tools really are.

Countless studies have tested a variety of credibility assessment techniques and have attempted to use them to rigorously determine when a source and/or a message is credible and, more specifically, when a person is lying or telling the truth. Despite the large and lengthy investment in such research, a rigorous set of valid methods that are useful in determining the credibility of a source or their information across different applications remains difficult to achieve.

 

Challenge Focus

This challenge is focused on the methods used to evaluate credibility assessment techniques or technologies, rather than on the techniques or technologies themselves. In this context, a method is a detailed plan or set of actions that can be easily followed and replicated. 

In this challenge, we ask that your solution is a method for conducting a study, which includes background information, the objectives of the research, study design, the logistics and means for running the study, and details about what data would be collected if your solution were implemented. 

The Intelligence Advanced Research Projects Activity (IARPA) invests in high-risk, high-payoff research programs to tackle some of the most difficult challenges facing the US Government’s Intelligence Community (IC). An important challenge facing the IC is knowing who, or what, is credible. By sharing this challenge with the Hero-X community, IARPA seeks to motivate good ideas from people with diverse backgrounds. Successful solutions could be used to inform future research efforts, to help the Government evaluate new tools, and to develop a deeper understanding of what it means to be credible and how we can evaluate credibility across diverse domains – in person, in virtual spaces, and in the information and media we consume. 

The challenge of developing a useful evaluation of credibility assessment techniques and technologies lies in the method’s design for drawing out real behavior, credible or not, from an individual or other source and then having a valid means to test it. This can be difficult as many current techniques involve actors or games where individuals may not feel that they need to be honest or do not truly act as they would in a real-life scenario. How to Get Involved

 

  • Click FOLLOW above to receive an update once the CASE Challenge is fully launched.
  • Share this CASE Challenge on social media using the Share button above. Show your colleagues, friends, family, or anyone you know who has a passion for discovery!
  • Start a conversation in our Forum, ask questions or connect with other innovators.
Guidelines
Timeline
Updates 8

Just the Weekend Left to Submit your Solutions for the CASE Challenge!

April 12, 2019, 11:30 a.m. PDT by Liz Treadwell

 

Dear CASE Challengers,

There are only a few days left to finalize your solutions! The submission form will be CLOSED on 8:59 p.m. PDT Sunday, April 14th for the CASE Challenge. The Challenge Team looks forward to reviewing your submissions!

Feel free to reach out to  if you have any questions.

 

Good luck!

-The CASE Challenge Team


Less than a week left to Submit your Solutions for the CASE Challenge!

April 8, 2019, 12:43 p.m. PDT by Liz Treadwell

 

Dear CASE Challengers,

 

There are only a few days left to finalize your solutions! The submission form will be CLOSED on Sunday, April 14th for the CASE Challenge. As a reminder, be sure to utilize the Example Solution Submission and additional resources located on our microsite: https://www.iarpa.gov/challenges/casechallenge.html

The Challenge Team looks forward to reviewing your submissions. 

Feel free to reach out to or create a new topic in the Forum if you have any questions.

 

Good luck!

-The CASE Challenge Team


Almost 10 days remain!

April 3, 2019, 10 a.m. PDT by Liz Treadwell

Dear CASE Challengers,

There are just over 10 days left to finalize your submissions! If you have any last-minute questions be sure to ask The Challenge Team and utilize these resources.

Feel free to reach out to  or create a new topic in the Forum if you have any other questions.

Good luck!

-The CASE Challenge Team 


Reminder: Submission Deadline is Approaching!

March 28, 2019, 9:21 a.m. PDT by Liz Treadwell

 

Dear solvers, 

 

There are about two weeks left to finalize your submissions! If you have any last-minute questions be sure to ask The Challenge Team and utilize these resources.  

As a reminder, the new submission deadline is April 14th, 11:59 PM EST.

 

Good luck! 

 

-The CASE Challenge Team 


Submission Deadline Change

March 15, 2019, 1:29 p.m. PDT by Despina Maliaka

 

Dear Innovators,         

          

We are excited to announce that we have extended the submission deadline to Sunday, April 14th 11:59 PM EST for the CASE Challenge! We hope that you can take advantage of the additional 14 days to finalize your submissions. Please remember that the HeroX platform is automated so your submission must be finalized before that time for it to be considered for the judging stage.

 

Curious about what a completed Solution would look like?  You can use the Submission Example from the CASE Challenge Microsite as a reference: https://www.iarpa.gov/challenges/casechallenge/docs/CASE_Challenge_Submission_Example.pdf

 

If you have questions while completing your submission, check out the HeroX How-To video here: https://herox.com/help/98-how-to-submit-an-entry-screencast

 

Feel free to reach out to  or create a new topic in the Forum if you have any other questions.

 


Forum 11
Community 364
Press
FAQ
Rules