menu

IARPA

 67,804

Geopolitical Forecasting [GF] Challenge 2

We’re on a mission to improve the accuracy and timeliness of geopolitical forecasts by advancing the science of forecasting.

This challenge is closed

stage:
Winners Announced
prize:
$250,000

This challenge is closed

more
Summary
Timeline
Updates8
Forum165
Teams1.2K
FAQ
Resources
Summary

Overview

Overview

Geopolitical Forecasting Challenge 2 encourages novel approaches that embrace non-traditional methods and harnesses the collective community, while offering Solvers the chance to win a share of $250,000 in prize money. 

The collective effort of GF Challenge 2 stimulates breakthroughs in the science of forecasting, leading to greater strategic advantages for maintaining global security, predicting economic trends, and directing the need for humanitarian efforts. 

Solvers, whether individuals or teams, will create innovative solutions and methods to produce forecasts to a set of more than 300 questions referred to as Individual Forecasting Problems (IFPs), released regularly over the course of the nine-month Challenge. Each IFP includes a set of exhaustive and mutually exclusive response options, as well as firm resolution criteria. IFPs remain open until a final specified closing date or until the event defined in the IFP is reported as occurring. 

 

Sample Questions: 

  • How many missile test events will North Korea conduct in August 2019?
  • Will there be a locally-transmitted case of the Zika virus in Brazil in July 2019?
  • What will be the daily closing price of gold on June 2019 in USD?
  • Which political party will win the most seats during the Polish Parliamentary Election?

 

A continuously updated stream of probabilistic forecasts from human forecasters in JSON format will be provided to Solvers which can be used to generate solutions, and Solvers are encouraged to use their own data and models to supplement their forecasts. As long as an IFP is open, Solvers can continue to update their forecast for that question. 

The administration of the Challenge is automated and secured through an API that provides the forecasting questions and individual human forecasts and receives forecast submissions, so having at least one team member with programming or developer skills is essential for participation.

 


Guidelines

 

2-Step Registration to Get Started

  1. Sign Up: Register on HeroX as an individual Solver or Solver Team. You can create or join a team later. When registration opens, just click on “Accept the Challenge” at the top of this page. You’ll continue to come back to the Challenge page for updates and Challenge details, as well as to participate in the Challenge Forum.
  2. Connect to the Cultivate API: Register with Cultivate Labs, and one representative per team should acquire your API token. Via the API, Solvers will receive all Individual Forecasting Problems (IFPs) and a continuously updating human forecaster data stream. The official Challenge Leaderboard and all technical interactions with the Challenge API happen though Cultivate Labs.

 

Prizes 

1st Place:   $33,000

2nd Place: $22,000

3rd Place:  $15,000

4th Place:  $10,000

5th Place:  $7,500

 

Potential Bonus Pool:

Qualifying Overall winners split a potential bonus pool of $120,000

  • There are 4 Tiers representing increasing levels of performance. Tier 4 is the highest level of performance.
  • Tiers are determined based on the percent improvement (IMP) of Solver/team score as compared to the baseline.
  • The total bonus pool is determined by the tier achieved by the 1st place overall winner. If 1st place hits Tier 4, the collective bonus pool for all qualifying winners will be $120,000.
  • Each of the top 5 overall winners who achieve Tier 1 or better receive shares of the total bonus pool equal to the top tier they reach. A team reaching Tier 3 would receive 3 shares.
TierMeasurementTotal Bonus Pool
4IMP ≥ 0.20$120,000
3IMP ≥ 0.15$90,000
2IMP ≥ 0.10$60,000
1IMP ≥ 0.05$30,000

 

Example Bonus Calculation:

 

 

If these are the top Tiers for the overall winners:
Total Bonus Pool = $120,000

Total Shares Awarded = 14

 

 

Example Bonus Awards:

1st Place​

2nd Place​

3rd Place​

4th Place​

5th Place​

 $ 34,285.71 ​

 $ 25,714.29 ​

 $ 25,714.29 ​

 $ 17,142.86 ​

 $ 17,142.86 ​

 

Additional Prizes

  • Each prize has a set of minimum prize requirements that will determine a Solver’s eligibility to win that prize as outlined in the Rules (Coming Soon) (link to rules tab)
  • Milestones open and close on the 24-hour Forecasting Day schedule

Milestone Awards: 10 awards of $750 per milestone period

  • Milestone Period 3 (Sep 19 – Nov 29)
  • Milestone Period 2 (July 18 – Sep 19)
  • Milestone Period 1 (May 15 – July 18)

 

Academic Award: $7,500

 

Workshop Presenter Awards: $12,500 (up to 5 awards of $2,500)

 

Timeline
Updates8

Challenge Updates

Save the Date: Join the final GF Challenge 2 Q&A Session on May 6

April 26, 2019, 10:08 a.m. PDT by Despina Maliaka

Learn more about Geopolitical Forecasting Challenge 2 at our last Question & Answer session

 

DATE: May 6
TIME: 12:00 – 1:00pm EDT
VIRTUAL MEETING: This session will be held online using Zoom. Dial in information will be sent to registered users two days prior to the event.

We’ll outline the Challenge rules, structure, and logistics, highlight the major differences between the first and second GF Challenges. You’ll also have an opportunity to ask questions to get any clarification you need.

Register Today!

 

We want to make sure your most pressing questions are answered!

Prior to the session, you can post questions on the HeroX forum, and the GF Challenge 2 team will answer as many of them as possible during the session. You’ll also be able to ask questions throughout the session using Zoom’s chat function.

- The GF Challenge 2 Team


GF Challenge 2 Registration Is Now Open!

April 16, 2019, 5:35 a.m. PDT by Despina Maliaka

Are you ready for the next Challenge?

We hope you’re as excited as we are about the launch of the Geopolitical Forecasting Challenge 2 (GF Challenge 2). We’ve recently released the IP Agreement, Prize Information, and the Challenge Rules.  Best of all, you can now register and begin setting up your API.

 

The Challenge launches  on  May 15,  and
Solvers will compete for up to $250K in prizes! 

REGISTER FOR THE CHALLENGE 

 

Yes, we mean you!

New perspectives can offer innovative insights. To that end, we’re looking for solutions from individuals or teams who think they can help advance the science of forecasting, including forecasting enthusiasts, data scientists, computer programmers, economists, epidemiologists, and even – or especially – experts in disciplines we haven’t yet considered.

Are you in?

IFPs and data start flowing on May 15, so get signed up and register for your API token now.

Accept the Challenge

 


Save the Date: Join the GF Challenge 2 Q&A Session on April 15!

April 8, 2019, 2:05 p.m. PDT by Despina Maliaka

Learn more about Geopolitical Forecasting Challenge 2 at our first of two Question & Answer sessions!

 

DATE: April 15
TIME: 12:00 – 1:00pm EDT
VIRTUAL MEETING: This session will be held online using Zoom. Dial in information will be sent to registered users two days prior to the event.

We’ll outline the Challenge rules, structure, and logistics, and highlight the major differences between the first and second GF Challenges. You’ll also have an opportunity to ask questions to get any clarification you need.

Register Today! https://eventmanagement.cvent.com/GFChallenge2QASession

We want to make sure your most pressing questions are answered!

Prior to the session, you can post questions on the HeroX forum, and the GF Challenge 2 team will answer as many of them as possible during the session. You’ll also be able to ask questions throughout the session using Zoom’s chat function.

- The GF Challenge 2 Team


Forum165
Teams1.2K
FAQ
Resources