4.3.1. Superforecasting and prediction markets
Download PDF
4.3.1. Superforecasting and prediction markets
Use the future to build the present
Superforecasting and prediction markets
Comment
Stakeholder Type
1.1Advanced AI1.2QuantumRevolution1.3UnconventionalComputing1.4AugmentedReality1.5CollectiveIntelligence2.1CognitiveEnhancement2.2HumanApplicationsof GeneticEngineering2.3HealthspanExtension2.4ConsciousnessAugmentation2.5Organoids2.6FutureTherapeutics3.1Decarbonisation3.2EarthSystemsModelling3.3FutureFoodSystems3.4SpaceResources3.5OceanStewardship3.6SolarRadiationModification3.7InfectiousDiseases4.1Science-basedDiplomacy4.2Advancesin ScienceDiplomacy4.3Foresight,Prediction,and FuturesLiteracy4.4Democracy-affirmingTechnologies5.1ComplexSystemsScience5.2Futureof Education5.3Future Economics,Trade andGlobalisation5.4The Scienceof theOrigins of Life5.5SyntheticBiology
1.1Advanced AI1.2QuantumRevolution1.3UnconventionalComputing1.4AugmentedReality1.5CollectiveIntelligence2.1CognitiveEnhancement2.2HumanApplicationsof GeneticEngineering2.3HealthspanExtension2.4ConsciousnessAugmentation2.5Organoids2.6FutureTherapeutics3.1Decarbonisation3.2EarthSystemsModelling3.3FutureFoodSystems3.4SpaceResources3.5OceanStewardship3.6SolarRadiationModification3.7InfectiousDiseases4.1Science-basedDiplomacy4.2Advancesin ScienceDiplomacy4.3Foresight,Prediction,and FuturesLiteracy4.4Democracy-affirmingTechnologies5.1ComplexSystemsScience5.2Futureof Education5.3Future Economics,Trade andGlobalisation5.4The Scienceof theOrigins of Life5.5SyntheticBiology

Sub-Field:

4.3.1Superforecasting and prediction markets

    Evidence has mounted in recent years that some individuals are capable of predicting geopolitical events with a success rate that significantly exceeds that of experts in a given field. These superforecasters' success is rooted in their psychology, including their skill at focusing on a few key determinants of an outcome and exceptional willingness to update their predictions as new information becomes available and arguments are made.1

    Superforecasting appears to be an innate talent, but one that can be significantly improved through training and by organising the best performers into elite teams. The biggest gains appear to be from reduction in noise (filtering out erroneous or irrelevant information) with significant contributions from improved information-gathering and reduction in bias (incorrectly prioritised information).2

    Research is ongoing into how effectively superforecasting can be taught,3 how successfully it can be applied to domains other than geopolitics, and whether predictions can be further improved through integration with expert knowledge. The ability of superforecasters to assess extreme, disruptive risks — “black swans” such as pandemics, for example — is also an area of active debate.4

    Prediction markets also harness the human ability to synthesise many types of information, but do so by aggregating the predictions made by many individuals (some of whom may be superforecasters).5 Participants are offered financial or reputational incentives to make accurate predictions, and market mechanisms are used to establish consensus positions. On political events,6 technological developments7 and corporate strategy.89

    The optimal design of such markets is an area of active investigation.10 One emerging model is “tournaments”, in which participants first make individual forecasts before being asked to collaborate in teams, then to assess other teams’ rationales and update their own predictions. One such tournament, focusing on existential risks, found that the predictions made by expert and superforecaster participants continued to be significantly different.11

    Because the underlying mechanisms of superforecasting remain somewhat obscure, more research and validation are needed to legitimise its use in real-world decision-making. The same is true of the application of artificial intelligence to detect patterns which can be used for prediction, whether independent of human prediction or integrated into it.

    Future Horizons:

    ×××

    5-yearhorizon

    Superforecasting training becomes routine

    The key cognitive processes underpinning superforecasting are identified, and training people to develop their superforecasting abilities becomes routine. Standardised designs for prediction markets and tournaments emerge. Expert knowledge is productively integrated with superforecasting techniques, with artificial intelligence also becoming used.

    10-yearhorizon

    Predictions are increasingly cited

    Robust evidence emerges for the real-world accuracy forecasters and prediction markets, and their predictions are routinely cited by journalists and policymakers. Work continues to integrate expert evidence and incorporate predictions about extreme risks which break markedly from prevailing trends but lead to major disruption.

    25-yearhorizon

    AI assists prediction markets

    Superforecasters, prediction markets and artificial intelligence work together to create forecasts for systems that cannot easily be modelled, over a range of timescales. This approach is as well-established for the political and economic domains as weather forecasting or climate modelling, and used at the highest levels of decision support.

    Superforecasting and prediction markets - Anticipation Scores

    How the experts see this field in terms of the expected time to maturity, transformational effect across science and industries, current state of awareness among stakeholders and its possible impact on people, society and the planet. See methodology for more information.