Collective Intelligence
Comment
Stakeholder Type
GESDA
Exposure time: 3 years" by Helmut Grabner, Zurich University of Applied Sciences - ZHAW
Photo: Exposure time: 3 years" by Helmut Grabner, Zurich University of Applied Sciences - ZHAW

Topic

Collective Intelligence

Anticipation Committee Chair:

Geoff Mulgan

Professor of Collective Intelligence, Public Policy and Social Innovation

University College London

Collective Intelligence

The field of Collective Intelligence (CI) is founded on the principle that when people come together to solve problems, the sum can be greater than its parts. It aims to improve understanding of the dynamics underpinning human collaboration and to enhance and guide these processes to tackle the world’s biggest challenges.
The field of Collective Intelligence (CI) is founded on the principle that when people come together to solve problems, the sum can be greater than its parts. It aims to improve understanding of the dynamics underpinning human collaboration and to enhance and guide these processes to tackle the world’s biggest challenges.

CI is an emerging field, drawing from a broad range of disciplines including biology, psychology, economics and computer science.1 That said, CI methods are already widely used in various fields, such as citizen science, experiments in democracy, mobilising consumers for product design and predictions in finance.

The methods of CI make it possible to look more systematically at how teams, organisations and even entire communities think, observe, analyse, plan and create. Better understanding of these processes can then be used to help groups think more successfully.

Principles from CI are being applied in areas as varied as organisational design, citizen science and open democracy, and can help to improve everything from social-media moderation to predicting and responding to natural disasters. Harnessing CI could provide a new, more inclusive and more effective model for global governance,2 and play a vital role in tackling climate change,3 the UN's Sustainable Development Goals4 and a host of other thorny societal problems.5

In the past decade, there has been significant growth in the use of technology to enhance the CI of groups both large and small.6 This ranges from web platforms designed to coordinate large-scale collaboration to the use of AI to facilitate group discussions. Crowdsourcing information or small chunks of work from large numbers of people can tackle challenges as varied as training AI and predicting floods.7

Citizen-science projects engage the general public to help scientists collect and analyse data. Open innovation platforms like Kaggle and InnoCentive let companies outsource engineering challenges to independent experts. Deliberative democracy is involving everyday citizens in political decision-making in countries.8 The advent of AI chatbots and agents has created a powerful new way for humans to interface with machines, making it increasingly important to consider how AI-human teams will operate in the future.

However, efforts to apply ideas from CI in the real world are piecemeal. The vast majority of organisations are failing to employ simple principles that could significantly enhance their effectiveness, suggesting a need for more translational research. And where there are attempts to harness CI, the practice is often well ahead of the theory. Significant research is required to improve our understanding of the fundamentals underpinning CI and how to design and apply new tools to enhance it. Current models of collective action have delivered innovation, but they themselves have remained remarkably unchanged over centuries; the field of collective intelligence seeks to challenge and alter these paradigms.9

KEY TAKEAWAYS

Solving the world's biggest challenges will require input from large numbers of people with diverse experience and expertise, all of whom must be able to work collaboratively. The field of Collective Intelligence (CI) seeks to understand the theory and practice of human cooperation to make this a reality. Thanks to digital technology, Large-scale collaboration can now be used to solve scientific challenges, innovate new ideas and even revitalise democracy. But organisations and institutions need to be redesigned to help put these ideas into action. Insights into group dynamics and new tools are helping create Smarter teams in a time when working practices are in flux. Increasingly powerful AI agents could soon play a vital supporting role and may eventually become team members themselves. But continuing progress is reliant on better models of Collective cognition — how groups “think” as a unit. The theoretical underpinnings of CI are fragmented, which is holding back efforts to understand and enhance these processes. Attempts to use technology to boost CI also require advances in Human-computer interaction research. Our understanding of how people perceive and use decision-making tools remains piecemeal and AI is a long way from exhibiting the kind of social intelligence required to operate seamlessly alongside human teammates.

Topic:

Anticipation Potential

Collective Intelligence

Sub-Fields:

Large-scale collaboration
Smarter teams
Collective cognition
Human-computer interaction
There is little consensus on how to advance towards Collective cognition, increasing the uncertainty associated with this sub-topic and pushing up its Anticipation Potential score. Large-scale collaboration is another area of Collective Intelligence which scores highly, mainly due to the expected transformative effects of future advances on science and technology, and the requirement for more coordinated international action to drive breakthroughs.

Anticipatory Impact:

Three fundamental questions guide GESDA’s mission and drive its work: Who are we, as humans? How can we all live together? How can we ensure the well-being of humankind and the sustainable future of our planet? We asked researchers from the field to anticipate what impact future breakthroughs could have on each of these dimensions. This wheel summarises their opinions when considering each of these questions, with a higher score indicating high anticipated impact, and vice versa.

  • Anticipated impact on who we are as humans
  • Anticipated impact on how we will all live together
  • Anticipated impact on the well-being of humankind and sustainable future of our planet

Large-scale collaboration

Digital technology allows collaboration on scales unimaginable in the past. This has led to a reimagining of how humans can organise themselves to solve problems.

Future Horizons:

×××

5-yearhorizon

CI approaches gain traction

CCI-based thinking becomes more ingrained in everyday life, with many tools that originated in CI emerging to help people deal with a range of issues, such as getting support for specific medical conditions, DIY home repairs and business or personal mentoring. Increasingly powerful language and vision AI gradually displaces humans in many crowdsourcing and citizen-science applications.

10-yearhorizon

CI applications grow

Tools from CI start to be applied in mainstream applications, as well as helping large-scale approaches to tackling big global challenges such as climate change, access to water and pandemic response. Organisations embrace new tools that combine AI and CI to better organise scientific knowledge and bring in perspectives from more diverse groups. The complicated process of redesigning institutions to better harness CI begins, although organisational inertia and resistance from vested interests holds up progress. Advanced AI agents become ubiquitous, requiring a shift in focus to enhancing the CI of human-AI groups.

25-yearhorizon

Deliberative democracy becomes widespread

Democratic assemblies around the world embrace the CI tools of deliberative democracy as standard practice, helping to involve people far beyond the elected representatives in political decision-making. Companies' use of open innovation to solve problems becomes mainstream.

New tools for gathering and visualising data, and open-source repositories of information and tools, are helping enhance the Collective Intelligence (CI) of large groups. AI is also playing a growing role in facilitating CI by filtering complex data, organising human knowledge and optimising deliberative processes.10 Powerful large language models (LLMs) trained on reams of internet data both encapsulate the CI of millions and can actively support CI by making it easier for people to engage with deliberative and collaborative processes.11,12 Caution is needed because overuse could also lead to a homogenisation of perspectives and illusions of consensus, but there have been notable successes such as the Habermas Machine from Google DeepMind,13 which started with participants submitting written opinions on a question, used the AI to generate group statements and then asked participants to rate and critique them. The machine then refined the statements until the group was satisfied. Another example is SocraSynth, which combines LLMs to help groups think, synthesise and develop more complex solutions to problems.14

While CI has shown promise for generating novel solutions, existing decision-making processes are often too slow and inflexible to take full advantage. This is prompting calls to apply the principles of CI to overhaul corporate structure and culture,15 and to reimagine democratic processes.16,17 Efforts are already under way to design organisations and institutions that actively promote and harness CI to help with multiple aspects of, and approaches to, thought at scale — including observation, interpretation, memory, prediction and creativity.18 Decentralisation technologies like blockchain and quadratic voting also open up avenues for enhancing CI by helping run organisations in a distributed and non-hierarchical fashion.19

Large-scale collaboration - Anticipation Scores

The Anticipation Potential of a research field is determined by the capacity for impactful action in the present, considering possible future transformative breakthroughs in a field over a 25-year outlook. A field with a high Anticipation Potential, therefore, combines the potential range of future transformative possibilities engendered by a research area with a wide field of opportunities for action in the present. We asked researchers in the field to anticipate:

  1. The uncertainty related to future science breakthroughs in the field
  2. The transformative effect anticipated breakthroughs may have on research and society
  3. The scope for action in the present in relation to anticipated breakthroughs.

This chart represents a summary of their responses to each of these elements, which when combined, provide the Anticipation Potential for the topic. See methodology for more information.

Smarter teams

Most human collaboration happens in small groups and this is where the core of CI research is focused. Building on previous work in organisational psychology, behavioural economics and group dynamics, researchers are now trying to understand and enhance the CI of teams.

Future Horizons:

×××

5-yearhorizon

Understanding of team structure and behaviour aids CI

Researchers develop a better understanding of the team structures and behaviours that negatively impact CI, making it possible to develop strategies to neutralise them. Simple AI-powered facilitators designed to lubricate group deliberations become commonplace.

10-yearhorizon

AI moderates discussions

Decisions in crucial areas like medicine and criminal justice are made by systems that combine individual human knowledge, orchestrated CI and AI supervision. More advanced AI systems are now able to moderate discussions between groups of humans in ways designed to enhance CI.

25-yearhorizon

Brain interfaces augment human deliberation

A combination of AI and crowd intelligence provides the populace with a form of “cognitive autocomplete” via brain interfaces that help them quickly access important information and augment their ability to deliberate.

This involves solving several challenges, including goal alignment, task prioritisation, progress tracking, maintaining attention, distribution of responsibilities and ensuring that deliberative processes are efficient and equitable. This is becoming increasingly complicated, as more fluid organisational structures mean team composition and structure is often dynamic20. Globalisation and the rise of hybrid work also means teams frequently work remotely and asynchronously, raising new challenges for group cohesion.21

Nonetheless, research into group dynamics is providing simple yet powerful insights into how to improve the CI of small groups. These include intermittent breaks in collaboration,22 boosting the variety of solutions explored23 and ensuring the right balance of cognitive diversity and gender.24,25 It is also laying the foundations for new tools to enhance team performance. These include real-time visualisations of how much effort members are putting in,26 information dashboards that summarise people's skills27 and chatbots that help teams allocate work based on members’ expertise.28

Recent breakthroughs in LLMs are also opening up the prospect of AI agents working alongside humans in hybrid teams.29 These agents could be a crucial tool for asynchronous collaboration, acting as a “shared brain” for the group and keeping team dialogue flowing even when members can’t speak directly. They could ultimately act as moderators, steering group deliberations to boost CI. Adding AI to teams isn’t a silver bullet, though, and there’s evidence it can degrade performance as often as improve it.30,31 This is driving researchers to think more deeply about how the CI of human-AI groups differs and how to harness it.32,33

Smarter teams - Anticipation Scores

The Anticipation Potential of a research field is determined by the capacity for impactful action in the present, considering possible future transformative breakthroughs in a field over a 25-year outlook. A field with a high Anticipation Potential, therefore, combines the potential range of future transformative possibilities engendered by a research area with a wide field of opportunities for action in the present. We asked researchers in the field to anticipate:

  1. The uncertainty related to future science breakthroughs in the field
  2. The transformative effect anticipated breakthroughs may have on research and society
  3. The scope for action in the present in relation to anticipated breakthroughs.

This chart represents a summary of their responses to each of these elements, which when combined, provide the Anticipation Potential for the topic. See methodology for more information.

Collective cognition

A better understanding of collective cognition — how groups of humans “think” as a unit — will be critical for moving the field forward. Just as in individuals, a group’s cognitive processes can be subdivided into various components such as memory, attention and reasoning. But these operate in very different ways at a group level, necessitating novel theories to explain them.3435

Future Horizons:

×××

5-yearhorizon

Coherent theory of CI emerges

Academic research delineates the various national, cultural and social influences on collective cognition, paving the way for a coherent theory of human CI. Attempts to harness CI for practical applications are increasingly informed by CI theory. A more integrated evolutionary theory of collective intelligence, combining archaeology, primatology, psychology and computer science, among other disciplines, begins to emerge.

10-yearhorizon

Metrics quantify CI

Data-gathering from online collective activities allows researchers to develop metrics for different aspects of CI, producing better models of collective cognition and acting as input for CI-enhancing tools. Large-scale collection of stories from different communities is used to train AI, which can then help analyse the narratives driving the collective cognition of society at large.

25-yearhorizon

CI theory incorporates machines

Comprehensive models of collective cognition make it possible to boost the effectiveness of both small and large groups of humans. CI theory is broadened to incorporate increasingly intelligent machines in theories of collective cognition.

Research has shown that collective cognition is not uniform and is shaped by the social structures in which the groups operate.36 Groups in the real world also have to navigate numerous, disparate and ever-changing challenges, which means they are in a constant process of adaption.37 One particularly understudied aspect of collective cognition is the role of narrative. Stories are central to the way groups coalesce around particular goals or shared visions of reality, which is an essential precursor to any form of collective reasoning.38 Increasing use of technology to enhance Collective Intelligence (CI) also necessitates the development of new metrics of collective cognition that can be used by digital platforms or AI to improve group collaboration.

While there has been progress on defining and even measuring CI itself,39 decisions about what characterises “intelligent” group behaviour often remain subjective. Establishing what we mean by “intelligence” may be a precursor to being able to explain and improve CI.4041 Taking a multidisciplinary approach that pools knowledge from biology, computer science and the social sciences will be crucial for developing a holistic view of CI.42 The life sciences in particular are providing exciting insights into the role CI plays in organising everything from cells to entire animal populations.43,44

Collective cognition - Anticipation Scores

The Anticipation Potential of a research field is determined by the capacity for impactful action in the present, considering possible future transformative breakthroughs in a field over a 25-year outlook. A field with a high Anticipation Potential, therefore, combines the potential range of future transformative possibilities engendered by a research area with a wide field of opportunities for action in the present. We asked researchers in the field to anticipate:

  1. The uncertainty related to future science breakthroughs in the field
  2. The transformative effect anticipated breakthroughs may have on research and society
  3. The scope for action in the present in relation to anticipated breakthroughs.

This chart represents a summary of their responses to each of these elements, which when combined, provide the Anticipation Potential for the topic. See methodology for more information.

Human-computer interaction

Using technology to enhance Collective Intelligence (CI) will require breakthroughs in the theory and practice of human-computer interaction. Computer systems designed to facilitate decision-making have a long history, but have often foundered due to a failure to understand how humans use and perceive such technology. To avoid the mistakes of the past, it is crucial to base the design of interactive systems on fundamental theories of human behaviour.45

Future Horizons:

×××

5-yearhorizon

Improved interaction boosts effectiveness

Renewed focus on improving how humans interact with CI tools significantly improves the tools' effectiveness. The increasing use of technology to boost human collaboration prompts efforts to begin monitoring its impact on human behaviour and relations.

10-yearhorizon

AI breakthroughs bring more effective collaboration

Breakthroughs in key AI capabilities like context awareness and continual learning make it possible for CI tools to adapt to users and more effectively guide human collaboration. Evidence that some efforts to harness CI are actually causing humans' skills to atrophy prompts a refocusing of efforts on tools that enhance human capabilities rather than replacing them.

25-yearhorizon

Artificial agents join collaborative teams

Advances in AI make it possible to imbue AI with a true theory of mind, allowing artificial agents to become equal members in AI-human teams. CI-literate AI is used to represent the interests of nature — forests or ocean ecosystems, say — or to represent the interests of future generations. Organisations such as the Intergovernmental Panel on Climate Change and UN use human-AI teams to aid cross-cultural negotiations.

There is considerable excitement around LLMs, which have opened up an intuitive new way for humans to interface with computers through natural language. But AI struggles with certain challenging aspects of human interaction. Human decision-making is highly context-dependent, for instance, and that context is not static. Group interactions are also governed by subtle cues and complex social conventions.

AI researchers have made some progress in understanding context46 and gesture recognition,47 and there is growing evidence that LLMs have a rudimentary ability to model human mental states (known as theory of mind).48 Multimodal AI models that can interpret more than just text present a promising direction for developing more context-aware AI.49 But imbuing machines with true social intelligence remains a distant goal and will require a multidisciplinary effort spanning the social, behavioural and natural sciences.50,51 A concerted effort is also needed to improve our understanding of how humans perceive and interact with conversational AI.52

In addition, AI chatbots raise significant privacy and security concerns.53 Also, their propensity for sycophancy54 and their tendency to confidently assert incorrect information, or “hallucinate”, makes it essential to ensure people understand the technology’s limits so that they don’t become overly trusting of it.55 As technology increasingly mediates group interactions it will also be important to measure whether it is enhancing human capabilities or causing them to atrophy.

Human-computer interaction - Anticipation Scores

The Anticipation Potential of a research field is determined by the capacity for impactful action in the present, considering possible future transformative breakthroughs in a field over a 25-year outlook. A field with a high Anticipation Potential, therefore, combines the potential range of future transformative possibilities engendered by a research area with a wide field of opportunities for action in the present. We asked researchers in the field to anticipate:

  1. The uncertainty related to future science breakthroughs in the field
  2. The transformative effect anticipated breakthroughs may have on research and society
  3. The scope for action in the present in relation to anticipated breakthroughs.

This chart represents a summary of their responses to each of these elements, which when combined, provide the Anticipation Potential for the topic. See methodology for more information.

Citations

Topic brief

  1. T. Malone and A. Williams Woolley. Collective Intelligence https://doi.org/10.1017/9781108770422.033
  2. Z. Engin et al.. Unleashing Collective Intelligence for Public Decision-Making: The Data for Policy Community https://doi.org/10.1017/dap.2024.2
  3. A. Berditchevskaia et al.. UNTAPPED https://www.nesta.org.uk/report/untapped-collective-intelligence-for-climate-action/
  4. K. Peach et al.. Collective Intelligence for Sustainable Development: Getting Smarter Together https://www.undp.org/acceleratorlabs/publications/collective-intelligence-sustainable-development-getting-smarter-together
  5. A.E. Williams. Are Wicked Problems a Lack of General Collective Intelligence? https://doi.org/10.1007/s00146-021-01297-8
  6. T.W. Malone. Superminds: The Surprising Power of People and Computers Thinking Together https://cci.mit.edu/superminds-by-thomas-w-malone/
  7. M. Kornberger. Strategies for distributed and collective action: Connecting the dots
  8. L. See. A Review of Citizen Science and Crowdsourcing in Applications of Pluvial Flooding https://doi.org/10.3389/feart.2019.00044
  9. vTaiwan. Where do we go as a society? https://info.vtaiwan.tw/

1.6.1 Large-scale collaboration

  1. A. Berditchevskaia and P. Baeck. The Future of Minds and Machines: How Artificial Intelligence Can Enhance Collective Intelligence https://www.nesta.org.uk/report/future-minds-and-machines/
  2. J.W. Burton et al.. How Large Language Models Can Reshape Collective Intelligence https://doi.org/10.1038/s41562-024-01959-9
  3. L. Rosenberg et al.. Conversational Swarm Intelligence (CSI) Enhances Groupwise Deliberation https://doi.org/10.1007/978-981-97-0180-3_1
  4. M.H. Tessler et al.. AI can help humans find common ground in democratic deliberation https://doi.org/10.1126/science.adq2852
  5. E.Chang. SocraSynth: Multi-LLM Reasoning with Conditional Statistics https://doi.org/10.48550/arXiv.2402.06634
  6. J. Kay. The Corporation in the Twenty-First Century https://profilebooks.com/work/the-corporation-in-the-twenty-first-century
  7. S. Boucher et al.. The Routledge Handbook of Collective Intelligence for Democracy and Governance https://www.routledge.com/The-Routledge-Handbook-of-Collective-Intelligence-for-Democracy-and-Governance/Boucher-Hallin-Paulson/p/book/9781032105611
  8. E.G. Weyl et al.. Plurality https://www.plurality.net/.
  9. G. Mulgan. Designing New Institutions: Ideas and Tools for an Emergent Discipline https://tial.org/publications/designing-new-institutions-ideas-and-tools-for-an-emergent-discipline/
  10. A. Skarzauskiene et al.. Developing Blockchain Supported Collective Intelligence in Decentralized Autonomous Organizations https://doi.org/10.1007/978-3-030-63092-8_70

1.6.2 Smarter teams

  1. Z. Lei et al.. Frontiers of Team and Teaming Research: Discovering New Directions and Opportunities https://doi.org/10.5465/AMBPP.2019.12381symposium
  2. S. Morrison-Smith and J. Ruiz. Challenges and Barriers in Virtual Teams: A Literature Review https://doi.org/10.1007/s42452-020-2801-5
  3. E. Bernstein et al.. How Intermittent Breaks in Interaction Improve Collective Intelligence https://doi.org/10.1073/pnas.1802407115
  4. P.E. Smaldino et al.. Maintaining Transient Diversity Is a General Principle for Improving Collective Problem Solving https://doi.org/10.1177/17456916231180100
  5. I. Aggarwal et al.. The Impact of Cognitive Style Diversity on Implicit Learning in Teams https://doi.org/10.3389/fpsyg.2019.00112
  6. A. Williams Woolley et al.. Collective Attention and Collective Intelligence: The Role of Hierarchy and Team Gender Composition https://doi.org/10.1287/orsc.2022.1602
  7. E. Glikson et al.. Visualized Automatic Feedback in Virtual Teams https://doi.org/10.3389/fpsyg.2019.00814
  8. P. Gupta and A. Williams Woolley. Productivity in an Era of Multi-Teaming: The Role of Information Dashboards and Shared Cognition in Team Performance https://doi.org/10.1145/3274331
  9. P. Gupta et al.. Digitally Nudging Team Processes to Enhance Collective Intelligence https://ci.acm.org/2019/assets/proceedings/CI_2019_paper_7.pdf
  10. T. O’Neill et al.. Human–Autonomy Teaming: A Review and Analysis of the Empirical Literature https://doi.org/10.1177/0018720820960865
  11. M. Vaccaro et al.. When Combinations of Humans and AI Are Useful: A Systematic Review and Meta-Analysis https://doi.org/10.1038/s41562-024-02024-1
  12. A. Simkute et al.. Ironies of Generative AI: Understanding and Mitigating Productivity Loss in Human-AI Interaction’ https://doi.org/10.1080/10447318.2024.2405782
  13. P. Gupta et al.. Fostering Collective Intelligence in Human–AI Collaboration: Laying the Groundwork for COHUMAIN https://doi.org/10.1111/tops.12679
  14. H. Cui and T Yasseri. AI-Enhanced Collective Intelligence https://doi.org/10.1016/j.patter.2024.101074

1.6.3 Collective cognition

  1. A. Williams Woolley and P. Gupta. Understanding Collective Intelligence: Investigating the Role of Collective MemoryAttentionand Reasoning Processes https://doi.org/10.1177/17456916231191534
  2. T.W. Malone. Superminds: The Surprising Power of People and Computers Thinking Together https://cci.mit.edu/superminds-by-thomas-w-malone/
  3. I. Momennejad. Collective Minds: Social Network Topology Shapes Collective Cognition https://doi.org/10.1098/rstb.2020.0315
  4. M. Galesic et al.. Beyond Collective Intelligence: Collective Adaptation https://doi.org/10.1098/rsif.2022.0736
  5. S. Dillon and C. Craig. Storylistening: Narrative Evidence and Public Reasoning https://doi.org/10.4324/9780367808426
  6. C. Riedl et al.. Quantifying Collective Intelligence in Human Groups https://doi.org/10.1073/pnas.2005737118
  7. K.J. Friston et al.. Designing Ecosystems of Intelligence from First Principles https://doi.org/10.1177/26339137231222481
  8. F.J. Benjamin et al.. All Intelligence Is Collective Intelligence https://doi.org/10.56280/1564736810
  9. T. Millhouse et al.. Frontiers in Collective Intelligence: A Workshop Report https://doi.org/10.48550/arXiv.2112.06864
  10. P. McMillen and M. Levin. Collective Intelligence: A Unifying Concept for Integrating Biology across Scales and Substrates https://doi.org/10.1038/s42003-024-06037-4
  11. M. Wikelski. The Internet of Animals https://scribepublications.com.au/books-authors/books/the-internet-of-animals-9781922585554

1.6.4 Human-computer interaction

  1. M. Beaudouin-Lafon et al.. Generative Theories of Interaction https://doi.org/10.1145/3468505
  2. S. Kohl et al.. Context Is Key: Mining Social Signals for Automatic Task Detection in Design Thinking Meetings, Design, User Experience, and Usability: UX Research, Design, and Assessment https://doi.org/10.1007/978-3-031-05897-4_2
  3. Z. Lv et al.. Deep Learning for Intelligent Human–Computer Interaction https://doi.org/10.3390/app122211457
  4. J.W.A. Strachan et al.. Testing Theory of Mind in Large Language Models and Humans https://doi.org/10.1038/s41562-024-01882-z
  5. Z. Durante et al.. Agent AI: Surveying the Horizons of Multimodal Interaction https://doi.org/10.48550/arXiv.2401.03568
  6. A. Dafoe et al.. Cooperative AI: Machines Must Learn to Find Common Ground https://doi.org/10.1038/d41586-021-01170-0
  7. L. Mathur et al.. Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questions https://arxiv.org/abs/2404.11023v2
  8. S. Diederich et al.. On the Design of and Interaction with Conversational Agents: An Organizing and Assessing Review of Human-Computer Interaction Research https://doi.org/10.17705/1jais.00724
  9. C. Ischen et al.. Privacy Concerns in Chatbot Interactions https://doi.org/10.1007/978-3-030-39540-7_3
  10. M. Sharma et al.. Towards Understanding Sycophancy in Language Models https://doi.org/10.48550/arXiv.2310.13548
  11. M. Schemmer et al.. Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanations https://doi.org/10.1145/3581641.3584066.