Collective intelligence

Collective intelligence (CI) is shared or group intelligence that emerges from the collaboration, collective efforts, and competition of many individuals and appears in consensus decision making. The term appears in sociobiology, political science and in context of mass peer review and crowdsourcing applications. It may involve consensus, social capital and formalisms such as voting systems, social media and other means of quantifying mass activity.[1] Collective IQ is a measure of collective intelligence, although it is often used interchangeably with the term collective intelligence. Collective intelligence has also been attributed to bacteria and animals.[2]

Types of collective intelligence

It can be understood as an emergent property from the synergies among: 1) data-information-knowledge; 2) software-hardware; and 3) individuals (those with new insights as well as recognized authorities) that continually learns from feedback to produce just-in-time knowledge for better decisions than these three elements acting alone;[1][3] or more narrowly as an emergent property between people and ways of processing information.[4] This notion of collective intelligence is referred to as "symbiotic intelligence" by Norman Lee Johnson.[5] The concept is used in sociology, business, computer science and mass communications: it also appears in science fiction. Pierre Lévy defines collective intelligence as, "It is a form of universally distributed intelligence, constantly enhanced, coordinated in real time, and resulting in the effective mobilization of skills. I'll add the following indispensable characteristic to this definition: The basis and goal of collective intelligence is mutual recognition and enrichment of individuals rather than the cult of fetishized or hypostatized communities."[6] According to researchers Pierre Lévy and Derrick de Kerckhove, it refers to capacity of networked ICTs (Information communication technologies) to enhance the collective pool of social knowledge by simultaneously expanding the extent of human interactions.[7][8] A broader definition was provided by Geoff Mulgan in a series of lectures and reports from 2006 onwards [9] and in the book Big Mind [10] which proposed a framework for analysing any thinking system, including both human and machine intelligence, in terms of functional elements (observation, prediction, creativity, judgement etc), learning loops and forms of organisation. The aim was to provide a way to diagnose, and improve, the collective intelligence of a city, business, NGO or parliament.

Collective intelligence strongly contributes to the shift of knowledge and power from the individual to the collective. According to Eric S. Raymond (1998) and JC Herz (2005), open source intelligence will eventually generate superior outcomes to knowledge generated by proprietary software developed within corporations (Flew 2008). Media theorist Henry Jenkins sees collective intelligence as an 'alternative source of media power', related to convergence culture. He draws attention to education and the way people are learning to participate in knowledge cultures outside formal learning settings. Henry Jenkins criticizes schools which promote 'autonomous problem solvers and self-contained learners' while remaining hostile to learning through the means of collective intelligence.[11] Both Pierre Lévy (2007) and Henry Jenkins (2008) support the claim that collective intelligence is important for democratization, as it is interlinked with knowledge-based culture and sustained by collective idea sharing, and thus contributes to a better understanding of diverse society.

Similar to the g factor (g) for general individual intelligence, a new scientific understanding of collective intelligence aims to extract a general collective intelligence factor c factor for groups indicating a group's ability to perform a wide range of tasks.[12] Definition, operationalization and statistical methods are derived from g. Similarly as g is highly interrelated with the concept of IQ,[13][14] this measurement of collective intelligence can be interpreted as intelligence quotient for groups (Group-IQ) even though the score is not a quotient per se. Causes for c and predictive validity are investigated as well.

Collective intelligence is used to help create widely known platforms including Google, Wikipedia and political groups. Google is a major search engine that is made of millions of websites that have been created by people all around the world. It has the ability to share knowledge and creativity with each other to collaborate and expand thoughts and expressions. Google includes five key dynamics within their teams to create a well-collaborated system. Dynamics include psychological safety, dependability, structure & clarity, meaning of work and impact of work.[15] Their ideas behind their rediscovery of collective intelligence is to ensure that all workers can express themselves without any fear of potential embarrassment.[16] Google's teamwork is said to be one of the main reasons for their success by including the use of emotional and collective intelligence to ensure teamwork is involved in any discussions.[17] The system behind Google exemplifies the combining of knowledge of the web-to-people not just knowledge of people-to-people.[18]

Writers who have influenced the idea of collective intelligence include Francis Galton, Douglas Hofstadter (1979), Peter Russell (1983), Tom Atlee (1993), Pierre Lévy (1994), Howard Bloom (1995), Francis Heylighen (1995), Douglas Engelbart, Louis Rosenberg, Cliff Joslyn, Ron Dembo, Gottfried Mayer-Kress (2003), Geoff Mulgan

History

H.G. Wells World Brain (1936–1938)

The concept (although not so named) originated in 1785 with the Marquis de Condorcet, whose "jury theorem" states that if each member of a voting group is more likely than not to make a correct decision, the probability that the highest vote of the group is the correct decision increases with the number of members of the group (see Condorcet's jury theorem).[19] Many theorists have interpreted Aristotle's statement in the Politics that "a feast to which many contribute is better than a dinner provided out of a single purse" to mean that just as many may bring different dishes to the table, so in a deliberation many may contribute different pieces of information to generate a better decision.[20][21] Recent scholarship,[22] however, suggests that this was probably not what Aristotle meant but is a modern interpretation based on what we now know about team intelligence.[23]

A precursor of the concept is found in entomologist William Morton Wheeler's observation that seemingly independent individuals can cooperate so closely as to become indistinguishable from a single organism (1910).[24] Wheeler saw this collaborative process at work in ants that acted like the cells of a single beast he called a superorganism.

In 1912 Émile Durkheim identified society as the sole source of human logical thought. He argued in "The Elementary Forms of Religious Life" that society constitutes a higher intelligence because it transcends the individual over space and time.[25] Other antecedents are Vladimir Vernadsky and Pierre Teilhard de Chardin's concept of "noosphere" and H.G. Wells's concept of "world brain" (see also the term "global brain"). Peter Russell, Elisabet Sahtouris, and Barbara Marx Hubbard (originator of the term "conscious evolution")[26] are inspired by the visions of a noosphere – a transcendent, rapidly evolving collective intelligence – an informational cortex of the planet. The notion has more recently been examined by the philosopher Pierre Lévy. In a 1962 research report, Douglas Engelbart linked collective intelligence to organizational effectiveness, and predicted that pro-actively 'augmenting human intellect' would yield a multiplier effect in group problem solving: "Three people working together in this augmented mode [would] seem to be more than three times as effective in solving a complex problem as is one augmented person working alone".[27] In 1994, he coined the term 'collective IQ' as a measure of collective intelligence, to focus attention on the opportunity to significantly raise collective IQ in business and society.[28]

The idea of collective intelligence also forms the framework for contemporary democratic theories often referred to as epistemic democracy. Epistemic democratic theories refer to the capacity of the populace, either through deliberation or aggregation of knowledge, to track the truth and relies on mechanisms to synthesize and apply collective intelligence.[29]

Collective intelligence was introduced into the machine learning community in the late 20th century,[30] and matured into a broader consideration of how to design "collectives" of self-interested adaptive agents to meet a system-wide goal.[31][32] This was related to single-agent work on "reward shaping"[33] and has been taken forward by numerous researchers in the game theory and engineering communities.[34]

Dimensions

Complex adaptive systems model

Howard Bloom has discussed mass behavior – collective behavior from the level of quarks to the level of bacterial, plant, animal, and human societies. He stresses the biological adaptations that have turned most of this earth's living beings into components of what he calls "a learning machine". In 1986 Bloom combined the concepts of apoptosis, parallel distributed processing, group selection, and the superorganism to produce a theory of how collective intelligence works.[35] Later he showed how the collective intelligences of competing bacterial colonies and human societies can be explained in terms of computer-generated "complex adaptive systems" and the "genetic algorithms", concepts pioneered by John Holland.[36]

Bloom traced the evolution of collective intelligence to our bacterial ancestors 1 billion years ago and demonstrated how a multi-species intelligence has worked since the beginning of life.[36] Ant societies exhibit more intelligence, in terms of technology, than any other animal except for humans and co-operate in keeping livestock, for example aphids for "milking".[36] Leaf cutters care for fungi and carry leaves to feed the fungi.[36]

David Skrbina[37] cites the concept of a 'group mind' as being derived from Plato's concept of panpsychism (that mind or consciousness is omnipresent and exists in all matter). He develops the concept of a 'group mind' as articulated by Thomas Hobbes in "Leviathan" and Fechner's arguments for a collective consciousness of mankind. He cites Durkheim as the most notable advocate of a "collective consciousness"[38] and Teilhard de Chardin as a thinker who has developed the philosophical implications of the group mind.[39]

Tom Atlee focuses primarily on humans and on work to upgrade what Howard Bloom calls "the group IQ". Atlee feels that collective intelligence can be encouraged "to overcome 'groupthink' and individual cognitive bias in order to allow a collective to cooperate on one process – while achieving enhanced intellectual performance." George Pór defined the collective intelligence phenomenon as "the capacity of human communities to evolve towards higher order complexity and harmony, through such innovation mechanisms as differentiation and integration, competition and collaboration."[40] Atlee and Pór state that "collective intelligence also involves achieving a single focus of attention and standard of metrics which provide an appropriate threshold of action".[41] Their approach is rooted in scientific community metaphor.[41]

The term group intelligence is sometimes used interchangeably with the term collective intelligence. Anita Woolley presents Collective intelligence as a measure of group intelligence and group creativity.[12] The idea is that a measure of collective intelligence covers a broad range of features of the group, mainly group composition and group interaction.[42] The features of composition that lead to increased levels of collective intelligence in groups include criteria such as higher numbers of women in the group as well as increased diversity of the group.[42]

Atlee and Pór suggest that the field of collective intelligence should primarily be seen as a human enterprise in which mind-sets, a willingness to share and an openness to the value of distributed intelligence for the common good are paramount, though group theory and artificial intelligence have something to offer.[41] Individuals who respect collective intelligence are confident of their own abilities and recognize that the whole is indeed greater than the sum of any individual parts.[43] Maximizing collective intelligence relies on the ability of an organization to accept and develop "The Golden Suggestion", which is any potentially useful input from any member.[44] Groupthink often hampers collective intelligence by limiting input to a select few individuals or filtering potential Golden Suggestions without fully developing them to implementation.[41]

Robert David Steele Vivas in The New Craft of Intelligence portrayed all citizens as "intelligence minutemen," drawing only on legal and ethical sources of information, able to create a "public intelligence" that keeps public officials and corporate managers honest, turning the concept of "national intelligence" (previously concerned about spies and secrecy) on its head.[45]

Stigmergic Collaboration: a theoretical framework for mass collaboration

According to Don Tapscott and Anthony D. Williams, collective intelligence is mass collaboration. In order for this concept to happen, four principles need to exist;[46]

Openness

Sharing ideas and intellectual property: though these resources provide the edge over competitors more benefits accrue from allowing others to share ideas and gain significant improvement and scrutiny through collaboration.[46]

Peering

Horizontal organization as with the 'opening up' of the Linux program where users are free to modify and develop it provided that they make it available for others. Peering succeeds because it encourages self-organization – a style of production that works more effectively than hierarchical management for certain tasks.[46]

Sharing

Companies have started to share some ideas while maintaining some degree of control over others, like potential and critical patent rights. Limiting all intellectual property shuts out opportunities, while sharing some expands markets and brings out products faster.[46]

Acting Globally

The advancement in communication technology has prompted the rise of global companies at low overhead costs. The internet is widespread, therefore a globally integrated company has no geographical boundaries and may access new markets, ideas and technology.[46]

Collective intelligence factor c

Scree plot showing percent of explained variance for the first factors in Woolley et al.'s (2010) two original studies.

A new scientific understanding of collective intelligence defines it as a group's general ability to perform a wide range of tasks.[12] Definition, operationalization and statistical methods are similar to the psychometric approach of general individual intelligence. Hereby, an individual's performance on a given set of cognitive tasks is used to measure general cognitive ability indicated by the general intelligence factor g extracted via factor analysis.[47] In the same vein as g serves to display between-individual performance differences on cognitive tasks, collective intelligence research aims to find a parallel intelligence factor for groups 'c factor'[12] (also called 'collective intelligence factor' (CI)[48]) displaying between-group differences on task performance. The collective intelligence score then is used to predict how this same group will perform on any other similar task in the future. Yet tasks, hereby, refer to mental or intellectual tasks performed by small groups[12] even though the concept is hoped to be transferable to other performances and any groups or crowds reaching from families to companies and even whole cities.[49] Since individuals' g factor scores are highly correlated with full-scale IQ scores, which are in turn regarded as good estimates of g,[13][14] this measurement of collective intelligence can also be seen as an intelligence indicator or quotient respectively for a group (Group-IQ) parallel to an individual's intelligence quotient (IQ) even though the score is not a quotient per se.

Mathematically, c and g are both variables summarizing positive correlations among different tasks supposing that performance on one task is comparable with performance on other similar tasks.[50] c thus is a source of variance among groups and can only be considered as a group's standing on the c factor compared to other groups in a given relevant population.[14][51] The concept is in contrast to competing hypotheses including other correlational structures to explain group intelligence,[12] such as a composition out of several equally important but independent factors as found in individual personality research.[52]

Besides, this scientific idea also aims to explore the causes affecting collective intelligence, such as group size, collaboration tools or group members' interpersonal skills.[53] The MIT Center for Collective Intelligence, for instance, announced the detection of The Genome of Collective Intelligence[53] as one of its main goals aiming to develop a taxonomy of organizational building blocks, or genes, that can be combined and recombined to harness the intelligence of crowds.[53]

Causes

Individual intelligence is shown to be genetically and environmentally influenced.[54][55] Analogously, collective intelligence research aims to explore reasons why certain groups perform more intelligently than other groups given that c is just moderately correlated with the intelligence of individual group members.[12] According to Woolley et al.'s results, neither team cohesion nor motivation or satisfaction is correlated with c. However, they claim that three factors were found as significant correlates: the variance in the number of speaking turns, group members' average social sensitivity and the proportion of females. All three had similar predictive power for c, but only social sensitivity was statistically significant (b=0.33, P=0.05).[12]

The number speaking turns indicates that "groups where a few people dominated the conversation were less collectively intelligent than those with a more equal distribution of conversational turn-taking".[48] Hence, providing multiple team members the chance to speak up made a group more intelligent.[12]

Group members' social sensitivity was measured via the Reading the Mind in the Eyes Test[56] (RME) and correlated .26 with c.[12] Hereby, participants are asked to detect thinking or feeling expressed in other peoples' eyes presented on pictures and assessed in a multiple choice format. The test aims to measure peoples' theory of mind (ToM), also called 'mentalizing'[57][58][59][60] or 'mind reading',[61] which refers to the ability to attribute mental states, such as beliefs, desires or intents, to other people and in how far people understand that others have beliefs, desires, intentions or perspectives different from their own ones.[56] RME is a ToM test for adults[56] that shows sufficient test-retest reliability[62] and constantly differentiates control groups from individuals with functional autism or Asperger Syndrome.[56] It is one of the most widely accepted and well-validated tests for ToM within adults.[63] ToM can be regarded as an associated subset of skills and abilities within the broader concept of emotional intelligence.[48][64]

The proportion of females as a predictor of c was largely mediated by social sensitivity (Sobel z = 1.93, P= 0.03)[12] which is in vein with previous research showing that women score higher on social sensitivity tests.[56] While a mediation, statistically speaking, clarifies the mechanism underlying the relationship between a dependent and an independent variable,[65] Wolley agreed in an interview with the Harvard Business Review that these findings are saying that groups of women are smarter than groups of men.[49] However, she relativizes this stating that the actual important thing is the high social sensitivity of group members.[49]

It is theorized that the collective intelligence factor c is an emergent property resulting from bottom-up as well as top-down processes.[42] Hereby, bottom-up processes cover aggregated group-member characteristics. Top-down processes cover group structures and norms that influence a group's way of collaborating and coordinating.[42]

Processes

Predictors for the collective intelligence factor c. Suggested by Woolley, Aggarwal & Malone[42] (2015)

Top-down processes

Top-down processes cover group interaction, such as structures, processes, and norms.[66] An example of such top-down processes is conversational turn-taking.[12] Research further suggest that collectively intelligent groups communicate more in general as well as more equally; same applies for participation and is shown for face-to-face as well as online groups communicating only via writing.[48][67]

Bottom-up processes

Bottom-up processes include group composition,[66] namely the characteristics of group members which are aggregated to the team level.[42] An example of such bottom-up processes is the average social sensitivity or the average and maximum intelligence scores of group members.[12] Furthermore, collective intelligence was found to be related to a group's cognitive diversity[68] including thinking styles and perspectives.[69] Groups that are moderately diverse in cognitive style have higher collective intelligence than those who are very similar in cognitive style or very different. Consequently, groups where members are too similar to each other lack the variety of perspectives and skills needed to perform well. On the other hand, groups whose members are too different seem to have difficulties to communicate and coordinate effectively.[68]

Serial vs Parallel processes

For most of human history, collective intelligence was confined to small tribal groups in which opinions were aggregated through real-time parallel interactions among members.[70] In modern times, mass communication, mass media, and networking technologies have enabled collective intelligence to span massive groups, distributed across continents and time-zones. To accommodate this shift in scale, collective intelligence in large-scale groups been dominated by serialized polling processes such as aggregating up-votes, likes, and ratings over time. In engineering, aggregating many engineering decisions allows for identifying typical good designs.[71] While modern systems benefit from larger group size, the serialized process has been found to introduce substantial noise that distorts the collective output of the group. In one significant study of serialized collective intelligence, it was found that the first vote contributed to a serialized voting system can distort the final result by 34%.[72]

To address the problems of serialized aggregation of input among large-scale groups, recent advancements collective intelligence have worked to replace serialized votes, polls, and markets, with parallel systems such as "human swarms" modeled after synchronous swarms in nature.[73][74] Based on natural process of Swarm Intelligence, these artificial swarms of networked humans enable participants to work together in parallel to answer questions and make predictions as an emergent collective intelligence.[75] In one high-profile example, a human swarm challenge by CBS Interactive to predict the Kentucky Derby. The swarm correctly predicted the first four horses, in order, defying 542–1 odds and turning a $20 bet into $10,800.[76]

The value of parallel collective intelligence was demonstrated in medical applications by researchers at Stanford University School of Medicine and Unanimous AI in a set of published studies wherein groups of human doctors were connected by real-time swarming algorithms and tasked with diagnosing chest x-rays for the presence of pneumonia.[77][78] When working together as "human swarms," the groups of experienced radiologists demonstrated a 33% reduction in diagnostic errors as compared to traditional methods.[79][80]

Evidence

Standardized Regression Coefficients for the collective intelligence factor c as found in Woolley et al.'s[12] (2010) two original studies. c and average (maximum) member intelligence scores are regressed on the criterion tasks.

Woolley, Chabris, Pentland, Hashmi, & Malone (2010),[12] the originators of this scientific understanding of collective intelligence, found a single statistical factor for collective intelligence in their research across 192 groups with people randomly recruited from the public. In Woolley et al.'s two initial studies, groups worked together on different tasks from the McGrath Task Circumplex,[81] a well-established taxonomy of group tasks. Tasks were chosen from all four quadrants of the circumplex and included visual puzzles, brainstorming, making collective moral judgments, and negotiating over limited resources. The results in these tasks were taken to conduct a factor analysis. Both studies showed support for a general collective intelligence factor c underlying differences in group performance with an initial eigenvalue accounting for 43% (44% in study 2) of the variance, whereas the next factor accounted for only 18% (20%). That fits the range normally found in research regarding a general individual intelligence factor g typically accounting for 40% to 50% percent of between-individual performance differences on cognitive tests.[50]

Afterwards, a more complex criterion task was absolved by each group measuring whether the extracted c factor had predictive power for performance outside the original task batteries. Criterion tasks were playing checkers (draughts) against a standardized computer in the first and a complex architectural design task in the second study. In a regression analysis using both individual intelligence of group members and c to predict performance on the criterion tasks, c had a significant effect, but average and maximum individual intelligence had not. While average (r=0.15, P=0.04) and maximum intelligence (r=0.19, P=0.008) of individual group members were moderately correlated with c, c was still a much better predictor of the criterion tasks. According to Woolley et al., this supports the existence of a collective intelligence factor c, because it demonstrates an effect over and beyond group members' individual intelligence and thus that c is more than just the aggregation of the individual IQs or the influence of the group member with the highest IQ.[12]

Engel et al.[48] (2014) replicated Woolley et al.'s findings applying an accelerated battery of tasks with a first factor in the factor analysis explaining 49% of the between-group variance in performance with the following factors explaining less than half of this amount. Moreover, they found a similar result for groups working together online communicating only via text and confirmed the role of female proportion and social sensitivity in causing collective intelligence in both cases. Similarly to Wolley et al.,[12] they also measured social sensitivity with the RME which is actually meant to measure people's ability to detect mental states in other peoples' eyes. The online collaborating participants, however, did neither know nor see each other at all. The authors conclude that scores on the RME must be related to a broader set of abilities of social reasoning than only drawing inferences from other people's eye expressions.[82]

A collective intelligence factor c in the sense of Woolley et al.[12] was further found in groups of MBA students working together over the course of a semester,[83] in online gaming groups[67] as well as in groups from different cultures[84] and groups in different contexts in terms of short-term versus long-term groups.[84] None of these investigations considered team members' individual intelligence scores as control variables.[67][83][84]

Note as well that the field of collective intelligence research is quite young and published empirical evidence is relatively rare yet. However, various proposals and working papers are in progress or already completed but (supposedly) still in a scholarly peer reviewing publication process.[85][86][87][88]

Predictive validity

Next to predicting a group's performance on more complex criterion tasks as shown in the original experiments,[12] the collective intelligence factor c was also found to predict group performance in diverse tasks in MBA classes lasting over several months.[83] Thereby, highly collectively intelligent groups earned significantly higher scores on their group assignments although their members did not do any better on other individually performed assignments. Moreover, highly collective intelligent teams improved performance over time suggesting that more collectively intelligent teams learn better.[83] This is another potential parallel to individual intelligence where more intelligent people are found to acquire new material quicker.[14][89]

Individual intelligence can be used to predict plenty of life outcomes from school attainment[90] and career success[91] to health outcomes[92] and even mortality.[92] Whether collective intelligence is able to predict other outcomes besides group performance on mental tasks has still to be investigated.

Potential connections to individual intelligence

Gladwell[93] (2008) showed that the relationship between individual IQ and success works only to a certain point and that additional IQ points over an estimate of IQ 120 do not translate into real life advantages. If a similar border exists for Group-IQ or if advantages are linear and infinite, has still to be explored. Similarly, demand for further research on possible connections of individual and collective intelligence exists within plenty of other potentially transferable logics of individual intelligence, such as, for instance, the development over time[94] or the question of improving intelligence.[95][96] Whereas it is controversial whether human intelligence can be enhanced via training,[95][96] a group's collective intelligence potentially offers simpler opportunities for improvement by exchanging team members or implementing structures and technologies.[49] Moreover, social sensitivity was found to be, at least temporarily, improvable by reading literary fiction[97] as well as watching drama movies.[98] In how far such training ultimately improves collective intelligence through social sensitivity remains an open question.[99]

There are further more advanced concepts and factor models attempting to explain individual cognitive ability including the categorization of intelligence in fluid and crystallized intelligence[100][101] or the hierarchical model of intelligence differences.[102][103] Further supplementing explanations and conceptualizations for the factor structure of the Genomes of collective intelligence besides a general 'c factor', though, are missing yet.[104]

Controversies

Other scholars explain team performance by aggregating team members' general intelligence to the team level[105][106] instead of building an own overall collective intelligence measure. Devine and Philips[107] (2001) showed in a meta-analysis that mean cognitive ability predicts team performance in laboratory settings (.37) as well as field settings (.14) – note that this is only a small effect. Suggesting a strong dependence on the relevant tasks, other scholars showed that tasks requiring a high degree of communication and cooperation are found to be most influenced by the team member with the lowest cognitive ability.[108] Tasks in which selecting the best team member is the most successful strategy, are shown to be most influenced by the member with the highest cognitive ability.[64]

Since Woolley et al.'s[12] results do not show any influence of group satisfaction, group cohesiveness, or motivation, they, at least implicitly, challenge these concepts regarding the importance for group performance in general and thus contrast meta-analytically proven evidence concerning the positive effects of group cohesion,[109][110][111] motivation[112][113] and satisfaction[114] on group performance.

Noteworthy is also that the involved researchers among the confirming findings widely overlap with each other and with the authors participating in the original first study around Anita Woolley.[12][42][48][68][82]

Alternative mathematical techniques

Computational collective intelligence

Computational Collective Intelligence, by Tadeusz Szuba

In 2001, Tadeusz (Tad) Szuba from the AGH University in Poland proposed a formal model for the phenomenon of collective intelligence. It is assumed to be an unconscious, random, parallel, and distributed computational process, run in mathematical logic by the social structure.[115]

In this model, beings and information are modeled as abstract information molecules carrying expressions of mathematical logic.[115] They are quasi-randomly displacing due to their interaction with their environments with their intended displacements.[115] Their interaction in abstract computational space creates multi-thread inference process which we perceive as collective intelligence.[115] Thus, a non-Turing model of computation is used. This theory allows simple formal definition of collective intelligence as the property of social structure and seems to be working well for a wide spectrum of beings, from bacterial colonies up to human social structures. Collective intelligence considered as a specific computational process is providing a straightforward explanation of several social phenomena. For this model of collective intelligence, the formal definition of IQS (IQ Social) was proposed and was defined as "the probability function over the time and domain of N-element inferences which are reflecting inference activity of the social structure".[115] While IQS seems to be computationally hard, modeling of social structure in terms of a computational process as described above gives a chance for approximation.[115] Prospective applications are optimization of companies through the maximization of their IQS, and the analysis of drug resistance against collective intelligence of bacterial colonies.[115]

Collective intelligence quotient

One measure sometimes applied, especially by more artificial intelligence focused theorists, is a "collective intelligence quotient"[116] (or "cooperation quotient") – which can be normalized from the "individual" intelligence quotient (IQ)[116] – thus making it possible to determine the marginal intelligence added by each new individual participating in the collective action, thus using metrics to avoid the hazards of group think and stupidity.[117]

Applications

There have been many recent applications of collective intelligence, including in fields such as crowd-sourcing, citizen science and prediction markets. The Nesta Centre for Collective Intelligence Design [118] was launched in 2018 and has produced many surveys of applications as well as funding experiments. In 2020 the UNDP Accelerator Labs [119] began using collective intelligence methods in their work to accelerate innovation for the Sustainable Development Goals.

Elicitation of point estimates

Here, the goal is to get an estimate (in a single value) of something. For example, estimating the weight of an object, or the release date of a product or probability of success of a project etc. as seen in prediction markets like Intrade, HSX or InklingMarkets and also in several implementations of crowdsourced estimation of a numeric outcome. Essentially, we try to get the average value of the estimates provided by the members in the crowd.

Opinion aggregation

In this situation, opinions are gathered from the crowd regarding an idea, issue or product. For example, trying to get a rating (on some scale) of a product sold online (such as Amazon's star rating system). Here, the emphasis is to collect and simply aggregate the ratings provided by customers/users.

Idea Collection

In these problems, someone solicits ideas for projects, designs or solutions from the crowd. For example, ideas on solving a data science problem (as in Kaggle) or getting a good design for a T-shirt (as in Threadless) or in getting answers to simple problems that only humans can do well (as in Amazon's Mechanical Turk). The objective is to gather the ideas and devise some selection criteria to choose the best ideas.

James Surowiecki divides the advantages of disorganized decision-making into three main categories, which are cognition, cooperation and coordination.[120]

Market judgment

Because of the Internet's ability to rapidly convey large amounts of information throughout the world, the use of collective intelligence to predict stock prices and stock price direction has become increasingly viable.[121] Websites aggregate stock market information that is as current as possible so professional or amateur stock analysts can publish their viewpoints, enabling amateur investors to submit their financial opinions and create an aggregate opinion.[121] The opinion of all investor can be weighed equally so that a pivotal premise of the effective application of collective intelligence can be applied: the masses, including a broad spectrum of stock market expertise, can be utilized to more accurately predict the behavior of financial markets.[122][123]

Collective intelligence underpins the efficient-market hypothesis of Eugene Fama[124] – although the term collective intelligence is not used explicitly in his paper. Fama cites research conducted by Michael Jensen[125] in which 89 out of 115 selected funds underperformed relative to the index during the period from 1955 to 1964. But after removing the loading charge (up-front fee) only 72 underperformed while after removing brokerage costs only 58 underperformed. On the basis of such evidence index funds became popular investment vehicles using the collective intelligence of the market, rather than the judgement of professional fund managers, as an investment strategy.[125]

Predictions in politics and technology

Voting methods used in the United States 2016

Political parties mobilize large numbers of people to form policy, select candidates and finance and run election campaigns.[126] Knowledge focusing through various voting methods allows perspectives to converge through the assumption that uninformed voting is to some degree random and can be filtered from the decision process leaving only a residue of informed consensus.[126] Critics point out that often bad ideas, misunderstandings, and misconceptions are widely held, and that structuring of the decision process must favor experts who are presumably less prone to random or misinformed voting in a given context.[127]

Companies such as Affinnova (acquired by Nielsen), Google, InnoCentive, Marketocracy, and Threadless[128] have successfully employed the concept of collective intelligence in bringing about the next generation of technological changes through their research and development (R&D), customer service, and knowledge management.[128][129] An example of such application is Google's Project Aristotle in 2012, where the effect of collective intelligence on team makeup was examined in hundreds of the company's R&D teams.[130]

Networks of trust

Application of collective intelligence in the Millennium Project

In 2012, the Global Futures Collective Intelligence System (GFIS) was created by The Millennium Project,[131] which epitomizes collective intelligence as the synergistic intersection among data/information/knowledge, software/hardware, and expertise/insights that has a recursive learning process for better decision-making than the individual players alone.[132]

New media are often associated with the promotion and enhancement of collective intelligence. The ability of new media to easily store and retrieve information, predominantly through databases and the Internet, allows for it to be shared without difficulty. Thus, through interaction with new media, knowledge easily passes between sources (Flew 2008) harv error: multiple targets (2×): CITEREFFlew2008 (help) resulting in a form of collective intelligence. The use of interactive new media, particularly the internet, promotes online interaction and this distribution of knowledge between users.

Francis Heylighen, Valentin Turchin, and Gottfried Mayer-Kress are among those who view collective intelligence through the lens of computer science and cybernetics. In their view, the Internet enables collective intelligence at the widest, planetary scale, thus facilitating the emergence of a global brain.

The developer of the World Wide Web, Tim Berners-Lee, aimed to promote sharing and publishing of information globally. Later his employer opened up the technology for free use. In the early '90s, the Internet's potential was still untapped, until the mid-1990s when 'critical mass', as termed by the head of the Advanced Research Project Agency (ARPA), Dr. J.C.R. Licklider, demanded more accessibility and utility.[133] The driving force of this Internet-based collective intelligence is the digitization of information and communication. Henry Jenkins, a key theorist of new media and media convergence draws on the theory that collective intelligence can be attributed to media convergence and participatory culture (Flew 2008) harv error: multiple targets (2×): CITEREFFlew2008 (help). He criticizes contemporary education for failing to incorporate online trends of collective problem solving into the classroom, stating "whereas a collective intelligence community encourages ownership of work as a group, schools grade individuals". Jenkins argues that interaction within a knowledge community builds vital skills for young people, and teamwork through collective intelligence communities contribute to the development of such skills.[134] Collective intelligence is not merely a quantitative contribution of information from all cultures, it is also qualitative.[134]

Lévy and de Kerckhove consider CI from a mass communications perspective, focusing on the ability of networked information and communication technologies to enhance the community knowledge pool. They suggest that these communications tools enable humans to interact and to share and collaborate with both ease and speed (Flew 2008). With the development of the Internet and its widespread use, the opportunity to contribute to knowledge-building communities, such as Wikipedia, is greater than ever before. These computer networks give participating users the opportunity to store and to retrieve knowledge through the collective access to these databases and allow them to "harness the hive"[135] Researchers at the MIT Center for Collective Intelligence research and explore collective intelligence of groups of people and computers.[136]

In this context collective intelligence is often confused with shared knowledge. The former is the sum total of information held individually by members of a community while the latter is information that is believed to be true and known by all members of the community.[137] Collective intelligence as represented by Web 2.0 has less user engagement than collaborative intelligence. An art project using Web 2.0 platforms is "Shared Galaxy", an experiment developed by an anonymous artist to create a collective identity that shows up as one person on several platforms like MySpace, Facebook, YouTube and Second Life. The password is written in the profiles and the accounts named "Shared Galaxy" are open to be used by anyone. In this way many take part in being one.[138] Another art project using collective intelligence to produce artistic work is Curatron, where a large group of artists together decides on a smaller group that they think would make a good collaborative group. The process is used based on an algorithm computing the collective preferences[139] In creating what he calls 'CI-Art', Nova Scotia based artist Mathew Aldred follows Pierry Lévy's definition of collective intelligence.[140] Aldred's CI-Art event in March 2016 involved over four hundred people from the community of Oxford, Nova Scotia, and internationally.[141][142] Later work developed by Aldred used the UNU swarm intelligence system to create digital drawings and paintings.[143] The Oxford Riverside Gallery (Nova Scotia) held a public CI-Art event in May 2016, which connected with online participants internationally.[144]

Parenting social network and collaborative tagging as pillars for automatic IPTV content blocking system

In social bookmarking (also called collaborative tagging),[145] users assign tags to resources shared with other users, which gives rise to a type of information organisation that emerges from this crowdsourcing process. The resulting information structure can be seen as reflecting the collective knowledge (or collective intelligence) of a community of users and is commonly called a "Folksonomy", and the process can be captured by models of collaborative tagging.[145]

Recent research using data from the social bookmarking website Delicious, has shown that collaborative tagging systems exhibit a form of complex systems (or self-organizing) dynamics.[146][147][148] Although there is no central controlled vocabulary to constrain the actions of individual users, the distributions of tags that describe different resources has been shown to converge over time to a stable power law distributions.[146] Once such stable distributions form, examining the correlations between different tags can be used to construct simple folksonomy graphs, which can be efficiently partitioned to obtained a form of community or shared vocabularies.[149] Such vocabularies can be seen as a form of collective intelligence, emerging from the decentralised actions of a community of users. The Wall-it Project is also an example of social bookmarking.[150]

P2P business

Research performed by Tapscott and Williams has provided a few examples of the benefits of collective intelligence to business:[46]

Talent utilization

At the rate technology is changing, no firm can fully keep up in the innovations needed to compete. Instead, smart firms are drawing on the power of mass collaboration to involve participation of the people they could not employ. This also helps generate continual interest in the firm in the form of those drawn to new idea creation as well as investment opportunities.[46]

Demand creation

Firms can create a new market for complementary goods by engaging in open source community. Firms also are able to expand into new fields that they previously would not have been able to without the addition of resources and collaboration from the community. This creates, as mentioned before, a new market for complementary goods for the products in said new fields.[46]

Costs reduction

Mass collaboration can help to reduce costs dramatically. Firms can release a specific software or product to be evaluated or debugged by online communities. The results will be more personal, robust and error-free products created in a short amount of time and costs. New ideas can also be generated and explored by collaboration of online communities creating opportunities for free R&D outside the confines of the company.[46]

Open source software

Cultural theorist and online community developer, John Banks considered the contribution of online fan communities in the creation of the Trainz product. He argued that its commercial success was fundamentally dependent upon "the formation and growth of an active and vibrant online fan community that would both actively promote the product and create content- extensions and additions to the game software".[151]

The increase in user created content and interactivity gives rise to issues of control over the game itself and ownership of the player-created content. This gives rise to fundamental legal issues, highlighted by Lessig[152] and Bray and Konsynski,[153] such as intellectual property and property ownership rights.

Gosney extends this issue of Collective Intelligence in videogames one step further in his discussion of alternate reality gaming. This genre, he describes as an "across-media game that deliberately blurs the line between the in-game and out-of-game experiences"[154] as events that happen outside the game reality "reach out" into the player's lives in order to bring them together. Solving the game requires "the collective and collaborative efforts of multiple players"; thus the issue of collective and collaborative team play is essential to ARG. Gosney argues that the Alternate Reality genre of gaming dictates an unprecedented level of collaboration and "collective intelligence" in order to solve the mystery of the game.[154]

Benefits of co-operation

Co-operation helps to solve most important and most interesting multi-science problems. In his book, James Surowiecki mentioned that most scientists think that benefits of co-operation have much more value when compared to potential costs. Co-operation works also because at best it guarantees number of different viewpoints. Because of the possibilities of technology global co-operation is nowadays much easier and productive than before. It is clear that, when co-operation goes from university level to global it has significant benefits.

For example, why do scientists co-operate? Science has become more and more isolated and each science field has spread even more and it is impossible for one person to be aware of all developments. This is true especially in experimental research where highly advanced equipment requires special skills. With co-operation scientists can use information from different fields and use it effectively instead of gathering all the information just by reading by themselves."[120]

Ad-hoc communities

Military, trade unions, and corporations satisfy some definitions of CI – the most rigorous definition would require a capacity to respond to very arbitrary conditions without orders or guidance from "law" or "customers" to constrain actions. Online advertising companies are using collective intelligence to bypass traditional marketing and creative agencies.[155]

The UNU open platform for "human swarming" (or "social swarming") establishes real-time closed-loop systems around groups of networked users molded after biological swarms, enabling human participants to behave as a unified collective intelligence.[156][157] When connected to UNU, groups of distributed users collectively answer questions and make predictions in real-time.[158] Early testing shows that human swarms can out-predict individuals.[156] In 2016, an UNU swarm was challenged by a reporter to predict the winners of the Kentucky Derby, and successfully picked the first four horses, in order, beating 540 to 1 odds.[159][160]

Specialized information sites such as Digital Photography Review[161] or Camera Labs[162] is an example of collective intelligence. Anyone who has an access to the internet can contribute to distributing their knowledge over the world through the specialized information sites.

In learner-generated context a group of users marshal resources to create an ecology that meets their needs often (but not only) in relation to the co-configuration, co-creation and co-design of a particular learning space that allows learners to create their own context.[163][164][165] Learner-generated contexts represent an ad hoc community that facilitates coordination of collective action in a network of trust. An example of learner-generated context is found on the Internet when collaborative users pool knowledge in a "shared intelligence space". As the Internet has developed so has the concept of CI as a shared public forum. The global accessibility and availability of the Internet has allowed more people than ever to contribute and access ideas.[135]

Games such as The Sims Series, and Second Life are designed to be non-linear and to depend on collective intelligence for expansion. This way of sharing is gradually evolving and influencing the mindset of the current and future generations.[133] For them, collective intelligence has become a norm. In Terry Flew's discussion of 'interactivity' in the online games environment, the ongoing interactive dialogue between users and game developers,[166] he refers to Pierre Lévy's concept of Collective Intelligence (Lévy 1998) harv error: no target: CITEREFLévy1998 (help) and argues this is active in videogames as clans or guilds in MMORPG constantly work to achieve goals. Henry Jenkins proposes that the participatory cultures emerging between games producers, media companies, and the end-users mark a fundamental shift in the nature of media production and consumption. Jenkins argues that this new participatory culture arises at the intersection of three broad new media trends.[167] Firstly, the development of new media tools/technologies enabling the creation of content. Secondly, the rise of subcultures promoting such creations, and lastly, the growth of value adding media conglomerates, which foster image, idea and narrative flow.

Coordinating collective actions

The cast of After School Improv learns an important lesson about improvisation and life

Improvisational actors also experience a type of collective intelligence which they term "group mind", as theatrical improvisation relies on mutual cooperation and agreement,[168] leading to the unity of "group mind".[168][169]

Growth of the Internet and mobile telecom has also produced "swarming" or "rendezvous" events that enable meetings or even dates on demand.[30] The full impact has yet to be felt but the anti-globalization movement, for example, relies heavily on e-mail, cell phones, pagers, SMS and other means of organizing.[170] The Indymedia organization does this in a more journalistic way.[171] Such resources could combine into a form of collective intelligence accountable only to the current participants yet with some strong moral or linguistic guidance from generations of contributors – or even take on a more obviously democratic form to advance shared goal.[171]

A further application of collective intelligence is found in the "Community Engineering for Innovations".[172] In such an integrated framework proposed by Ebner et al., idea competitions and virtual communities are combined to better realize the potential of the collective intelligence of the participants, particularly in open-source R&D.[173] In management theory the use of collective intelligence and crowd sourcing leads to innovations and very robust answers to quantitative issues.[174] Therefore, collective intelligence and crowd sourcing is not necessaryly leading to the best solution to economic problems, but to a stable, good solution.

Coordination in different types of tasks

Collective actions or tasks require different amounts of coordination depending on the complexity of the task. Tasks vary from being highly independent simple tasks that require very little coordination to complex interdependent tasks that are built by many individuals and require a lot of coordination. In the article written by Kittur, Lee and Kraut the writers introduce a problem in cooperation: "When tasks require high coordination because the work is highly interdependent, having more contributors can increase process losses, reducing the effectiveness of the group below what individual members could optimally accomplish". Having a team too large the overall effectiveness may suffer even when the extra contributors increase the resources. In the end the overall costs from coordination might overwhelm other costs.[175]

Group collective intelligence is a property that emerges through coordination from both bottom-up and top-down processes. In a bottom-up process the different characteristics of each member are involved in contributing and enhancing coordination. Top-down processes are more strict and fixed with norms, group structures and routines that in their own way enhance the group's collective work.[176]

Alternative views

A tool for combating self-preservation

Tom Atlee reflects that, although humans have an innate ability to gather and analyze data, they are affected by culture, education and social institutions.[177] A single person tends to make decisions motivated by self-preservation. Therefore, without collective intelligence, humans may drive themselves into extinction based on their selfish needs.[44]

Separation from IQism

Phillip Brown and Hugh Lauder quotes Bowles and Gintis (1976) that in order to truly define collective intelligence, it is crucial to separate 'intelligence' from IQism.[178] They go on to argue that intelligence is an achievement and can only be developed if allowed to.[178] For example, earlier on, groups from the lower levels of society are severely restricted from aggregating and pooling their intelligence. This is because the elites fear that the collective intelligence would convince the people to rebel. If there is no such capacity and relations, there would be no infrastructure on which collective intelligence is built.[179] This reflects how powerful collective intelligence can be if left to develop.[178]

Artificial intelligence views

Skeptics, especially those critical of artificial intelligence and more inclined to believe that risk of bodily harm and bodily action are the basis of all unity between people, are more likely to emphasize the capacity of a group to take action and withstand harm as one fluid mass mobilization, shrugging off harms the way a body shrugs off the loss of a few cells.[180][181] This train of thought is most obvious in the anti-globalization movement and characterized by the works of John Zerzan, Carol Moore, and Starhawk, who typically shun academics.[180][181] These theorists are more likely to refer to ecological and collective wisdom and to the role of consensus process in making ontological distinctions than to any form of "intelligence" as such, which they often argue does not exist, or is mere "cleverness".[180][181]

Harsh critics of artificial intelligence on ethical grounds are likely to promote collective wisdom-building methods, such as the new tribalists and the Gaians.[182] Whether these can be said to be collective intelligence systems is an open question. Some, e.g. Bill Joy, simply wish to avoid any form of autonomous artificial intelligence and seem willing to work on rigorous collective intelligence in order to remove any possible niche for AI.[183]

In contrast to these views, companies such as Amazon Mechanical Turk and CrowdFlower are using collective intelligence and crowdsourcing or consensus-based assessment to collect the enormous amounts of data for machine learning algorithms.

Solving climate change

Global collective intelligence is seen as the key in solving the challenges humankind faces now and in the future. Climate change is an example of a global issue which collective intelligence is currently trying to tackle. With the help of collective intelligence applications such as online crowdsourcing, people across the globe are collaborating in developing solutions to climate change.[184]

See also

Similar concepts and applications

• Citizen science
• Civic intelligence
• Collaborative filtering
• Collaborative innovation network
• Collective decision-making
• Collective effervescence
• Collective memory
• Collective problem solving
• Crowd psychology
• Global Consciousness Project
• Group behaviour
• Group mind (science fiction)
• Knowledge ecosystem
• Noogenesis – Emergence and evolution of intelligence
• Open source intelligence
• Recommendation system
• Smart mob
• Social commerce
• Social information processing
• Stigmergy
• Syntality
• The Wisdom of Crowds
• Think tank
• Wiki

Computation and computer science

• Bees algorithm
• Cellular automaton
• Collaborative human interpreter
• Collaborative software
• Connectivity (graph theory)
• Enterprise bookmarking
• Human-based computation
• Open-source software
• Organismic computing
• Preference elicitation

Others

• Customer engagement
• Dispersed knowledge
• Distributed cognition
• Facilitation (business)
• Facilitator
• Hundredth monkey effect
• Keeping up with the Joneses
• Library
• Library of Alexandria
• Meme
• Open-space meeting

References

1. Suran, Shweta; Pattanaik, Vishwajeet; Draheim, Dirk (5 February 2020). "Frameworks for Collective Intelligence: A Systematic Literature Review". ACM Computing Surveys. 53 (1): 14:1–14:36. doi:10.1145/3368986.
2. Ngoc Thanh Nguyen (25 July 2011). Transactions on Computational Collective Intelligence III. Springer. pp. 63, 69. ISBN 978-3-642-19967-7. Retrieved 11 June 2013.
3. Glenn, Jerome C. Collective Intelligence – One of the Next Big Things, Futura 4/2009, Finnish Society for Futures Studies, Helsinki, Finland
4. Glenn, Jerome C. Chapter 5, 2008 State of the Future. The Millennium Project, Washington, DC 2008
5. Norman Lee Johnson, Collective Science site Archived 6 October 2011 at the Wayback Machine
6. Levy, Pierre (10 December 1999). Collective Intelligence. Basic Books. p. 14. ISBN 978-0-7382-0261-7. OCLC 249995946.
7. Flew, Terry New Media: An Introduction. Oxford University Press, 2007, p. 21
8. Lévy, Pierre; Farley, Art; Lollini, Massimo (31 December 2019). "Collective Intelligence, the Future of Internet and the IEML: Interview to Pierre Lévy by Art Farley and Massimo Lollini". Humanist Studies & the Digital Age. 6 (1): 5–31. doi:10.5399/uo/hsda.6.1.2. ISSN 2158-3846. Archived from the original on 1 January 2020. Retrieved 29 March 2020.
9. lecture series in Adelaide on 'Collective Intelligence about Collective Intelligence and http://www.thinkers.sa.gov.au/images/Mulgan_Final_Report.pdf
10. Mulgan, Geoff Big Mind: How Collective Intelligence can Change our World, Princeton University Press, 2017
11. Jenkins, Henry Convergence Culture: Where old and new media collide. New York: New York University Press, 2006, p. 259
12. Woolley, Anita Williams; Chabris, Christopher F.; Pentland, Alex; Hashmi, Nada; Malone, Thomas W. (29 October 2010). "Evidence for a Collective Intelligence Factor in the Performance of Human Groups". Science. 330 (6004): 686–688. Bibcode:2010Sci...330..686W. doi:10.1126/science.1193147. PMID 20929725. S2CID 74579.
13. Jensen, Arthur, R. (1992). "Understanding g in terms of information processing". Educational Psychology Review. 4 (3): 271–308. doi:10.1007/bf01417874. S2CID 54739564.
14. Jensen, Arthur, R. (1998). The g factor: The science of mental ability. Westport, CT: Praeger.
15. "re:Work - The five keys to a successful Google team". rework.withgoogle.com. Archived from the original on 15 April 2020. Retrieved 6 April 2020.
16. "Google (re)discovers collective intelligence". Collective Intelligence. 10 April 2018. Archived from the original on 6 April 2020. Retrieved 6 April 2020.
17. Camarote, Robin (14 March 2016). "What Google's New Emotional Intelligence Study Says About Teamwork and Success". Inc.com. Archived from the original on 6 April 2020. Retrieved 6 April 2020.
18. "Collective Intelligence". web.mit.edu. Retrieved 6 April 2020.
19. Landemore, Hélène (2012). Landemore, Democratic Reason: Politics, Collective Intelligence, and the Rule of the Many. Princeton: Princeton University Press. ISBN 978-0691155654.
20. Waldron, Jeremy (1995). "The Wisdom of the Multitude: Some Reflections on Book 3, Chapter 11 of Aristotle's Politics". Political Theory. 23 (4): 563–584. doi:10.1177/0090591795023004001. S2CID 154578834.
21. Ober, Josiah (2008). Democracy and Knowledge. Princeton, N.J.: Princeton University Press. pp. 110–14.
22. Cammack, Daniela (2013). "Aristotle and the Virtue of the Multitude". Political Theory. 41 (2): 175–202. doi:10.1177/0090591712470423. S2CID 220724879.
23. Page, Scott (2008). The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies. Princeton: Princeton University Press.
24. Wheeler, W. M. (1910). Ants: their structure, development and behavior (Vol. 9). Columbia University Press.
25. Émile Durkheim, The Elementary Forms of Religious Life, 1912.
26. "About the Book – Foundation for Conscious Evolution". Foundation for Conscious Evolution. Archived from the original on 18 February 2017. Retrieved 4 December 2016.
27. Engelbart, Douglas (1962) Augmenting Human Intellect: A Conceptual Framework Archived 4 May 2011 at the Wayback Machine – section on Team Cooperation
28. Engelbart, Douglas (1994)Boosting Collective IQ Archived 2 July 2016 at the Wayback Machine (Slide Handouts) – 'Collective IQ' defined on Slide 4; also (1994) BBN Distinguished Guest Lecture (Video) – 'Collective IQ' defined @16:56 "CoDIAK"
29. Landemore, Helene (2013). Democratic Reason: Politics, Collective Intelligence, and the Rule of the Many. Princeton University Press. ISBN 978-0691155654.
30. Wolpert, David H.; Tumer, Kagan; Frank, Jeremy (10 May 1999). "Using Collective Intelligence to Route Internet Traffic". In M. Kearns; S. Solla; D. Cohn (eds.). Advances in Information Processing Systems. 11. MIT Press. arXiv:cs/9905004. Bibcode:1999cs........5004W.
31. Wolpert, David; Tumer, Kagan (2004). "Collective Intelligence, Data Routing and Braess' Paradox". Journal of Artficial Intelligence Research. 16: 359–387. doi:10.1613/jair.995. S2CID 15861702.
32. Tumer, Kagan; Wolpert, David (2004). Collectives and the design of complex systems. Springer.
33. Ng, Andrew; Harada, Daishi; Russell, Stuart (1999). "Policy Invariance Under Reward Transformations: Theory and Application to Reward Shaping". ICML '99 Proceedings of the Sixteenth International Conference on Machine Learning.
34. Marden, Jason; Shamma, Jeff (2017). "Game Theoretic Learning in Distributed Control" (PDF). Handbook of Dynamic Game Theory. Archived (PDF) from the original on 8 January 2019. Retrieved 8 January 2019.
35. Howard Bloom, The Lucifer Principle: A Scientific Expedition into the Forces of History, 1995
36. Howard Bloom, Global Brain: The Evolution of Mass Mind from the Big Bang to the 21st Century, 2000
37. Skrbina, D., 2001, Participation, Organization, and Mind: Toward a Participatory Worldview, ch. 8, Doctoral Thesis, Centre for Action Research in Professional Practice, School of Management, University of Bath: England
38. Levey, Geoffrey Brahm (1 May 2015). Authenticity, Autonomy and Multiculturalism. Routledge. ISBN 9781317535928.
39. Skrbina, David F. (26 January 2007). Panpsychism in the West (1 ed.). The MIT Press. ISBN 9780262693516.
40. George Pór, Blog of Collective Intelligence Archived 2 August 2004 at the Wayback Machine
41. Atlee, Tom. "Collective Intelligence as a Field of Multi‐disciplinary Study and Practice" (PDF). Community Intelligence. CommunityIntelligence. Ltd. Archived from the original (PDF) on 20 December 2016. Retrieved 11 December 2016.
42. Woolley, Anita Williams; Aggarwal, Ishani; Malone, Thomas W. (1 December 2015). "Collective Intelligence and Group Performance". Current Directions in Psychological Science. 24 (6): 420–424. doi:10.1177/0963721415599543. S2CID 146673541.
43. Leimeister, Jan Marco (24 June 2010). "Collective Intelligence" (PDF). Business & Information Systems Engineering. 2 (4): 245–248. doi:10.1007/s12599-010-0114-8. S2CID 7575575.
44. Atlee, T. (2008). Reflections on the evolution of choice and collective intelligence Archived 22 May 2008 at the Wayback Machine, Retrieved 26 August 2008
45. Steele, Robert David (8 April 2002). The New Craft of Intelligence: Personal, Public, & Political—Citizen's Action Handbook for Fighting Terrorism, Genocide, Disease, Toxic Bombs, & Corruption. Oakton, Va.: Oss Pr. ISBN 9780971566118.
46. Tapscott, D., & Williams, A. D. (2008). Wikinomics: How Mass Collaboration Changes Everything Archived 10 November 2011 at the Wayback Machine, USA: Penguin Group
47. Spearman, Charles, E. (1904). ""General intelligence," objectively determined and measured". American Journal of Psychology. 15 (2): 201–293. doi:10.2307/1412107. JSTOR 1412107.
48. Engel, D.; Woolley, A. W.; Jing, L. X.; Chabris, C. F. & Malone, T. W. (2014). "Reading the Mind in the Eyes or reading between the lines? Theory of Mind predicts collective intelligence equally well online and face-to-face". PLOS ONE. 9 (12): e115212. Bibcode:2014PLoSO...9k5212E. doi:10.1371/journal.pone.0115212. PMC 4267836. PMID 25514387.
49. Woolley, A. & Malone, T. (June 2011). "Defend your research: What makes a team smarter? More women". Harvard Business Review. 89 (6): 32–33.
50. Kamphaus, R.W.; Winsor, A.P.; Rowe, E.W. & Kim, S. (2005). A history of intelligence test interpretation. In D.P. Flanagan and P.L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (2nd Ed.). New York, NY: Guilford. pp. 23–38.
51. van der Maas, Han L. J.; Dolan, Conor V.; Grasman, Raoul P. P. P.; Wicherts, Jelte M.; Huizenga, Hilde M.; Raijmakers, Maartje E. J. (1 October 2006). "A dynamical model of general intelligence: the positive manifold of intelligence by mutualism". Psychological Review. 113 (4): 842–861. doi:10.1037/0033-295X.113.4.842. PMID 17014305.
52. McCrae, R. R.; Costa Jr., P. T. (1987). "Validation of the Five-Factor Model of Personality Across Instruments and Observers" (PDF). Journal of Personality and Social Psychology. 52 (1): 81–90. doi:10.1037/0022-3514.52.1.81. PMID 3820081. Archived (PDF) from the original on 21 April 2019.
53. "MIT Center for Collective Intelligence". cci.mit.edu. Archived from the original on 30 March 2016. Retrieved 26 April 2016.
54. Briley, Daniel A.; Tucker-Drob, Elliot M. (1 September 2014). "Genetic and environmental continuity in personality development: a meta-analysis". Psychological Bulletin. 140 (5): 1303–1331. doi:10.1037/a0037091. PMC 4152379. PMID 24956122.
55. Deary, Ian J.; Spinath, Frank M.; Bates, Timothy C. (1 January 2006). "Genetics of intelligence". European Journal of Human Genetics. 14 (6): 690–700. doi:10.1038/sj.ejhg.5201588. PMID 16721405.
56. Baron-Cohen S, Wheelwright S, Hill J, Raste Y, Plumb I (2001). "The Reading the Mind in the Eyes Test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism". Journal of Child Psychology and Psychiatry. 42 (2): 241–251. doi:10.1017/s0021963001006643. PMID 11280420.
57. Apperly, Ian A. (1 May 2012). "What is "theory of mind"? Concepts, cognitive processes and individual differences". The Quarterly Journal of Experimental Psychology. 65 (5): 825–839. doi:10.1080/17470218.2012.676055. PMID 22533318. S2CID 7212563.
58. Baron-Cohen, Simon; Leslie, Alan M.; Frith, Uta (October 1985). "Does the autistic child have a "theory of mind"?". Cognition. 21 (1): 37–46. doi:10.1016/0010-0277(85)90022-8. PMID 2934210. S2CID 14955234. Pdf.
59. Flavell, J. H. (1 January 1999). "Cognitive development: children's knowledge about the mind". Annual Review of Psychology. 50: 21–45. doi:10.1146/annurev.psych.50.1.21. PMID 10074674.
60. Premack, David; Woodruff, Guy (1 December 1978). "Does the chimpanzee have a theory of mind?". Behavioral and Brain Sciences. 1 (4): 515–526. doi:10.1017/S0140525X00076512.
61. Heyes, Cecilia M.; Frith, Chris D. (20 June 2014). "The cultural evolution of mind reading". Science. 344 (6190): 1243091. doi:10.1126/science.1243091. PMID 24948740. S2CID 3139981.
62. Hallerbäck, Maria Unenge; Lugnegård, Tove; Hjärthag, Fredrik; Gillberg, Christopher (1 March 2009). "The Reading the Mind in the Eyes Test: Test–retest reliability of a Swedish version". Cognitive Neuropsychiatry. 14 (2): 127–143. doi:10.1080/13546800902901518. PMID 19370436. S2CID 28946179.
63. Pinkham, Amy E.; Penn, David L.; Green, Michael F.; Buck, Benjamin; Healey, Kristin; Harvey, Philip D. (1 July 2014). "The Social Cognition Psychometric Evaluation Study: Results of the Expert Survey and RAND Panel". Schizophrenia Bulletin. 40 (4): 813–823. doi:10.1093/schbul/sbt081. PMC 4059426. PMID 23728248. Archived from the original on 1 November 2016. Retrieved 26 April 2016.
64. Yip, Jeremy A.; Côté, Stéphane (1 January 2013). "The Emotionally Intelligent Decision Maker Emotion-Understanding Ability Reduces the Effect of Incidental Anxiety on Risk Taking". Psychological Science. 24 (1): 48–55. doi:10.1177/0956797612450031. PMID 23221020. S2CID 33438475.
65. MacKinnon, D. P. (2008). Introduction to Statistical Mediation Analysis. New York, NY: Erlbaum.
66. Woolley, A. W.; Aggarwal, I.; Malone, T. W. (1 December 2015). "Collective Intelligence and Group Performance". Current Directions in Psychological Science. 24 (6): 420–424. doi:10.1177/0963721415599543. S2CID 146673541.
67. Kim, Y. J.; Engel, D.; Woolley, A. W.; Lin, J.; McArthur, N. & Malone, T. W. (2015). "Work together, play smart: Collective intelligence in League of Legends teams". Paper Presented at the 2015 Collective Intelligence Conference, Santa Clara, CA.
68. Aggarwal, I.; Woolley, A. W.; Chabris, C. F. & Malone, T. W. (2015). "Cognitive diversity, collective intelligence, and learning in teams". Paper Presented at the 2015 Collective Intelligence Conference, Santa Clara, CA.
69. Kozhevnikov, M.; Evans, C. & Kosslyn, S. M. (2014). "Cognitive style as environmentally sensitive individual differences in cognition: A modern synthesis and applications in education, business, and management". Psychological Science in the Public Interest. 15 (1): 3–33. doi:10.1177/1529100614525555. PMID 26171827. S2CID 20559112.
70. Greene, Joshua David (30 December 2014). Moral tribes : emotion, reason, and the gap between us and them. ISBN 978-0143126058. OCLC 871336785.
71. Bruch, Marcel; Bodden, Eric; Monperrus, Martin; Mezini, Mira (2010). "IDE 2.0: collective intelligence in software development" (PDF). Proceedings of the FSE/SDP Workshop on Future of Software Engineering Research - FoSER '10. doi:10.1145/1882362.1882374. S2CID 7637561.
72. Muchnik, Lev; Aral, Sinan; Taylor, Sean J. (9 August 2013). "Social Influence Bias: A Randomized Experiment". Science. 341 (6146): 647–651. Bibcode:2013Sci...341..647M. doi:10.1126/science.1240466. ISSN 0036-8075. PMID 23929980. S2CID 15775672.
73. Oxenham, Simon. "Why bees could be the secret to superhuman intelligence". Archived from the original on 25 May 2017. Retrieved 23 May 2017.
74. Rosenberg, L.; Baltaxe, D.; Pescetelli, N. (1 October 2016). Crowds vs swarms, a comparison of intelligence. 2016 Swarm/Human Blended Intelligence Workshop (SHBI). pp. 1–4. doi:10.1109/SHBI.2016.7780278. ISBN 978-1-5090-3502-1. S2CID 12725324.
75. Metcalf, Lynn; Askay, David A.; Rosenberg, Louis B. (2019). "Keeping Humans in the Loop: Pooling Knowledge through Artificial Swarm Intelligence to Improve Business Decision Making". California Management Review. 61 (4): 84–109. doi:10.1177/0008125619862256. ISSN 0008-1256. S2CID 202323483.
76. "Artificial intelligence turns $20 into $11,000 in Kentucky Derby bet". Newsweek. 10 May 2016. Archived from the original on 4 June 2016. Retrieved 23 May 2017.
77. Scudellari, Megan (13 September 2018). "AI-Human "Hive Mind" Diagnoses Pneumonia". IEEE Spectrum: Technology, Engineering, and Science News. Archived from the original on 20 July 2019. Retrieved 20 July 2019.
78. Liu, Fan (27 September 2018). "Artificial swarm intelligence diagnoses pneumonia better than individual computer or doctor". The Stanford Daily. Archived from the original on 20 July 2019. Retrieved 20 July 2019.
79. "A Swarm of Insight - Radiology Today Magazine". www.radiologytoday.net. Archived from the original on 20 July 2019. Retrieved 20 July 2019.
80. Rosenberg, Louis; Lungren, Matthew; Halabi, Safwan; Willcox, Gregg; Baltaxe, David; Lyons, Mimi (November 2018). "Artificial Swarm Intelligence employed to Amplify Diagnostic Accuracy in Radiology". 2018 IEEE 9th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON). Vancouver, BC: IEEE: 1186–1191. doi:10.1109/IEMCON.2018.8614883. ISBN 9781538672662. S2CID 58675679.
81. McGrath, J. E. (1984). Groups: Interaction and Performance. Englewood Cliffs, NJ: Prentice-Hall.
82. Engel, David; Woolley, Anita Williams; Aggarwal, Ishani; Chabris, Christopher F.; Takahashi, Masamichi; Nemoto, Keiichi; Kaiser, Carolin; Kim, Young Ji; Malone, Thomas W. (1 January 2015). Collective Intelligence in Computer-Mediated Collaboration Emerges in Different Contexts and Cultures. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. CHI '15. New York, NY, USA: ACM. pp. 3769–3778. doi:10.1145/2702123.2702259. ISBN 9781450331456. S2CID 14303201.
83. Aggarwal, I. & Woolley, A.W. (2014). "The effects of cognitive diversity on collective intelligence and team learning". Symposium Presented at the 50th Meeting of the Society of Experimental Social Psychology, Columbus, OH.
84. Engel, D.; Woolley, A. W.; Aggarwal, I.; Chabris, C. F.; Takahashi, M.; Nemoto, K.; Malone, T. W. (2015). "Collective intelligence in computer-mediates collaboration emerges in different contexts and cultures". In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15) (Pp. 3769–3778). New York, NY: ACM.
85. "Collective Intelligence 2016". sites.google.com. Archived from the original on 5 August 2016. Retrieved 27 April 2016.
86. "Posters | Collective Intelligence 2015". sites.lsa.umich.edu. Archived from the original on 31 July 2016. Retrieved 27 April 2016.
87. "Proceedings | Collective Intelligence 2014". collective.mech.northwestern.edu. Archived from the original on 4 April 2016. Retrieved 27 April 2016.
88. Malone, Thomas W.; Luis von Ahn (2012). "Collective Intelligence 2012: Proceedings". arXiv:1204.2991 [cs.SI].
89. Schmidt, F.L. & Hunter, J.E. (1998). "The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings". Psychological Bulletin. 124 (2): 262–274. CiteSeerX 10.1.1.172.1733. doi:10.1037/0033-2909.124.2.262.
90. Nathan, B. (1997). "Intelligence, Schooling, and Society". American Psychologist. 52 (10): 1046–1050. doi:10.1037/0003-066x.52.10.1046.
91. Strenze, Tarmo (1 September 2007). "Intelligence and socioeconomic success: A meta-analytic review of longitudinal research". Intelligence. 35 (5): 401–426. doi:10.1016/j.intell.2006.09.004.
92. Deary, I.J.; Weiss, A. & Batty, D.G. (2010). "Intelligence and Personality as Predictors of Illness and Death. How Researchers in Differential Psychology and Chronic Disease Epidemiology Are Collaborating to Understand and Address Health Inequalities" (PDF). Psychological Science in the Public Interest. 11 (2): 53–79. doi:10.1177/1529100610387081. hdl:20.500.11820/134d66d9-98db-447a-a8b2-5b019b96a7bb. PMID 26168413. S2CID 13106622. Archived (PDF) from the original on 19 July 2018. Retrieved 9 December 2019.
93. Gladwell, M. (2008). Outliers. The Story of Success. New York, NY: Little, Brown and Company. ISBN 978-0-316-01792-3.
94. Hedden, Trey; Gabrieli, John D. E. (1 February 2004). "Insights into the ageing mind: a view from cognitive neuroscience". Nature Reviews. Neuroscience. 5 (2): 87–96. doi:10.1038/nrn1323. PMID 14735112. S2CID 9398942.
95. Shipstead, Zach; Redick, Thomas S; Engle, Randall W. (1 October 2010). "Does working memory training generalize?". Psychologica Belgica. 50 (3–4): 245. doi:10.5334/pb-50-3-4-245.
96. Buschkuehl, M.; Jaeggi, S.M. (2010). "Improving intelligence a literature review". Swiss Medical Weekly. 140 (19): 266–72. PMID 20349365.
97. Kidd, David Comer; Castano, Emanuele (18 October 2013). "Reading Literary Fiction Improves Theory of Mind". Science. 342 (6156): 377–380. Bibcode:2013Sci...342..377K. doi:10.1126/science.1239918. PMID 24091705. S2CID 5929573.
98. Black, Jessica; Barnes, Jennifer L. (2015). "Fiction and social cognition: The effect of viewing award-winning television dramas on theory of mind". Psychology of Aesthetics, Creativity, and the Arts. 9 (4): 423–429. doi:10.1037/aca0000031.
99. Malone, T. W. & Bernstein, M.S. (2015). Handbook of Collective Intelligence. Cambridge, MA: MIT Press.
100. Horn, J. (1989). Models of intelligence. In R.L. Linn (Ed.), Intelligence: Measurement, theory, and public policy (pp. 29–73). Urbana, IL: University of Illinois Press.
101. Cattell, R. B. (1971). Abilities: Their structure, growth, and action. Houghton Mifflin: New York, NY.
102. Carroll, J.B. (1993). Human cognitive abilities: A survey of factor analytic studies. Cambridge, England: Cambridge University Press. ISBN 9780521387125.
103. Johnson, Wendy; Bouchard Jr., Thomas J. (1 July 2005). "The structure of human intelligence: It is verbal, perceptual, and image rotation (VPR), not fluid and crystallized". Intelligence. 33 (4): 393–416. doi:10.1016/j.intell.2004.12.002.
104. "MIT Center for Collective Intelligence". cci.mit.edu. Archived from the original on 30 March 2016. Retrieved 27 April 2016.
105. LePine, Jeffery A. (2005). "Adaptation of Teams in Response to Unforeseen Change: Effects of Goal Difficulty and Team Composition in Terms of Cognitive Ability and Goal Orientation". Journal of Applied Psychology. 90 (6): 1153–1167. doi:10.1037/0021-9010.90.6.1153. PMID 16316271.
106. Tziner, Aharon; Eden, Dov (1985). "Effects of crew composition on crew performance: Does the whole equal the sum of its parts?". Journal of Applied Psychology. 70 (1): 85–93. doi:10.1037/0021-9010.70.1.85.
107. Devine, Dennis J.; Philips, Jennifer L. (1 October 2001). "Do Smarter Teams Do Better A Meta-Analysis of Cognitive Ability and Team Performance". Small Group Research. 32 (5): 507–532. doi:10.1177/104649640103200501. S2CID 145635205.
108. O'Brien, G.; Owens, A. (1969). "Effects of organizational structure on correlations between member abilities and group productivity". Journal of Applied Psychology. 53 (6): 525–530. doi:10.1037/h0028659.
109. Evans, Charles R.; Dion, Kenneth L. (1 May 1991). "Group Cohesion and Performance A Meta-Analysis". Small Group Research. 22 (2): 175–186. doi:10.1177/1046496491222002. S2CID 145344583.
110. Gully, Stanley M.; Devine, Dennis J.; Whitney, David J. (1 December 2012). "A Meta-Analysis of Cohesion and Performance Effects of Level of Analysis and Task Interdependence". Small Group Research. 43 (6): 702–725. doi:10.1177/1046496412468069. S2CID 220319732.
111. Beal, Daniel J.; Cohen, Robin R.; Burke, Michael J.; McLendon, Christy L. (December 2003). "Cohesion and Performance in Groups: A Meta-Analytic Clarification of Construct Relations". Journal of Applied Psychology. 88 (6): 989–1004. doi:10.1037/0021-9010.88.6.989. PMID 14640811.
112. O'leary-kelly, Anne M.; Martocchio, Joseph J.; Frink, Dwight D. (1 October 1994). "A Review of the Influence of Group Goals on Group Performance". Academy of Management Journal. 37 (5): 1285–1301. doi:10.2307/256673. JSTOR 256673.
113. Kleingeld, Ad; Mierlo, Heleen van; Arends, Lidia (2011). "The effect of goal setting on group performance: A meta-analysis". Journal of Applied Psychology. 96 (6): 1289–1304. doi:10.1037/a0024315. PMID 21744940.
114. Duffy, M. K.; Shaw, J. D. & Stark, E. M. (2000). "Performance and satisfaction in conflicted interdependent groups: When and how does selfesteem make a difference?". Academy of Management Journal. 43 (4): 772–782. doi:10.2307/1556367. JSTOR 1556367.
115. Szuba T., Computational Collective Intelligence, 420 pages, Wiley NY, 2001
116. Kowalczyk, Ryszard (23 September 2009). Computational Collective Intelligence. Semantic Web, Social Networks and Multiagent Systems: First International Conference, ICCCI 2009, Wroclaw, Poland, October 5–7, 2009, Proceedings. Springer Science & Business Media. ISBN 9783642044403.
117. Administrator. "About Collective IQ - Doug Engelbart Institute". www.dougengelbart.org. Archived from the original on 29 December 2016. Retrieved 11 December 2016.
118. https://www.nesta.org.uk/project/centre-collective-intelligence-design/
119. https://acceleratorlabs.undp.org/
120. Surowiecki, J., 2007 'The Wisdom of crowds. Why the Many Are Smarter Than the Few'
121. Kaplan, Craig A. (2001). "Collective intelligence: A new approach to stock price forecasting". 2001 IEEE International Conference on Systems, Man and Cybernetics. E-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236) (PDF). Proceedings of the 2001 IEEE Systems, Man, and Cybernetics Conference. 5. pp. 2893–2898. doi:10.1109/ICSMC.2001.971949. ISBN 978-0-7803-7087-6. S2CID 4836176. Archived (PDF) from the original on 10 June 2017. Retrieved 12 December 2016.
122. Ma, Ying; Li, Guanyi; Dong, Yingsai; Qin, Zengchang (2010). Minority Game Data Mining for Stock Market Predictions (PDF). Agents and Data Mining Interaction, 6th International Workshopon Agents and Data Mining Interaction, ADMI 2010. Lecture Notes in Computer Science. 5980. Bibcode:2010LNCS.5980.....C. doi:10.1007/978-3-642-15420-1. ISBN 978-3-642-15419-5. S2CID 36758062. Archived from the original (PDF) on 21 October 2012. Retrieved 2 March 2012.
123. Yu, Du; Dong, Yingsai; Qin, Zengchang; Wan, Tao (2011). Exploring Market Behaviors with Evolutionary Mixed-Games Learning Model (PDF). Computational Collective Intelligence. Technologies and Applications – Third International Conference, ICCCI 2011. Lecture Notes in Computer Science. 6922. pp. 244–253. doi:10.1007/978-3-642-23935-9_24. ISBN 978-3-642-23934-2. Archived (PDF) from the original on 19 September 2017. Retrieved 10 May 2019.
124. Fama, E.F. (1970). "Efficient Capital Markets: A Review of Theory and Empirical Work". Journal of Finance. 25 (2): 383–417. doi:10.2307/2325486. JSTOR 2325486.
125. Jensen, M.C (1967). "The Performance of Mutual Funds in the Period 1945–1964". Journal of Finance. 23 (2): 389–416. doi:10.1111/j.1540-6261.1968.tb00815.x. hdl:10.1111/j.1540-6261.1968.tb00815.x.
126. "Vote amount according to "intelligence"". politics.stackexchange.com. Archived from the original on 20 December 2016. Retrieved 12 December 2016.
127. "Landemore, H.: Democratic Reason: Politics, Collective Intelligence, and the Rule of the Many. (eBook and Paperback)". press.princeton.edu. Archived from the original on 20 December 2016. Retrieved 4 December 2016.
128. Bonabeau, E (2009). "The power of collective intelligence". MIT Sloan Management Review. 50: 45–52. ProQuest 224962498.
129. Malone, Thomas W.; Laubacher, Robert; Dellarocas, Chrysanthos (3 February 2009). Harnessing Crowds: Mapping the Genome of Collective Intelligence (Report). Rochester, NY: Social Science Research Network. SSRN 1381502. MIT Sloan Research Paper No. 4732-09.
130. Duhigg, Charles (25 February 2016). "What Google Learned From Its Quest to Build the Perfect Team". The New York Times. Archived from the original on 23 February 2017. Retrieved 11 December 2016.
131. "Global Futures Intelligence System". www.millennium-project.org. Archived from the original on 25 December 2016. Retrieved 7 December 2016.
132. "Global Futures Intelligence System". www.millennium-project.org. Archived from the original on 25 December 2016. Retrieved 11 December 2016.
133. Weiss, A. (2005). The Power of Collective Intelligence. Collective Intelligence, pp. 19–23
134. Henry, Jenkins. "INTERACTIVE AUDIENCES? THE 'COLLECTIVE INTELLIGENCE' OF MEDIA FANS" (PDF). Archived from the original (PDF) on 26 April 2018. Retrieved 11 December 2016.
135. Flew, Terry (2008). New Media: an introduction. Melbourne: Oxford University Press.
136. MIT Center for Collective Intelligence Archived 11 June 2010 at the Wayback Machine. Cci.mit.edu. Retrieved on 2013-07-13.
137. Jenkins, H. 2006. Convergence Culture. New York: New York University Press.
138. Scardamalia, Marlene; Bereiter, Carl (1 July 1994). "Computer Support for Knowledge-Building Communities". Journal of the Learning Sciences. 3 (3): 265–283. CiteSeerX 10.1.1.600.463. doi:10.1207/s15327809jls0303_3.
139. "Math Takes the Guessing Out of Artistic Collaboration". 9 July 2014. Archived from the original on 1 October 2014. Retrieved 30 April 2015.
140. Mathew Aldred, May 2016. "What is Collective Intelligence Art?". 2016. Archived from the original on 2 October 2016. Retrieved 1 October 2016.
141. Amherst News Citizen Record, 17 March 2016. "Community creation taking place in Oxford". 2016. Archived from the original on 6 October 2016. Retrieved 1 October 2016.
142. Oxford Regional Education Centre"Nexus OREC". 2016. Archived from the original on 6 October 2016. Retrieved 1 October 2016.
143. UNU Interview with artist, 23 May 2016. "Artwork from an emergent hive mind". 2016. Archived from the original on 5 October 2016. Retrieved 1 October 2016.
144. Oxford Riverside Gallery News, May 2016. "CI-Art event at Oxford Riverside Gallery 'Nexus' opening". 2016. Archived from the original on 2 October 2016. Retrieved 1 October 2016.
145. Millen, David R.; Feinberg, Jonathan; Kerr, Bernard (1 January 2006). Dogear: Social Bookmarking in the Enterprise. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI '06. New York, NY, USA: ACM. pp. 111–120. doi:10.1145/1124772.1124792. ISBN 978-1595933720. S2CID 18423803.
146. Harry Halpin, Valentin Robu, Hana Shepherd The Complex Dynamics of Collaborative Tagging, Proceedings 6th International Conference on the World Wide Web (WWW'07), Banff, Canada, pp. 211–220, ACM Press, 2007.
147. Fu, Wai-Tat (2010). Semantic imitation in social tagging. ACM Transactions on Computer-Human Interaction. p. 229. doi:10.1145/1460563.1460600. ISBN 9781605580074. S2CID 2202814.
148. Fu, Wai-Tat (August 2009). A Semantic Imitation Model of Social Tagging. Proceedings of the IEEE Conference on Social Computing. pp. 66–72. doi:10.1109/CSE.2009.382. ISBN 978-1-4244-5334-4. S2CID 10229043.
149. Valentin Robu, Harry Halpin, Hana Shepherd Emergence of consensus and shared vocabularies in collaborative tagging systems, ACM Transactions on the Web (TWEB), Vol. 3(4), article 14, ACM Press, September 2009.
150. Carlos J. Costa, January 2012. "Article on Wall-it project". 2012. Archived from the original on 18 December 2013. Retrieved 23 January 2012.
151. John A.L. Banks. Negotiating Participatory Culture in the New Media Environment: Auran and the Trainz Online Community – An (Im)possible Relation, The University of Queensland. School of English, Media Studies and Art History. MelbourneDAC2003
152. L, Lessig,(2006)Code Version 2.0 (2nd ed.). New York: Basic Books.
153. Bray, DA & Konsynski, BR, 2007, Virtual Worlds, Virtual Economies, Virtual Institutions, viewed 10 October 2008, p. 1-27 <http://ssrn.com/abstract=962501>
154. Gosney, J.W, 2005, Beyond Reality: A Guide to Alternate Reality Gaming, Thomson Course Technology, Boston.
155. Lee, Sang M., et al. "Success factors of platform leadership in web 2.0 service business." Service Business 4.2 (2010): 89–103.
156. DNews (3 June 2015). "Swarms of Humans Power A.I. Platform". Archived from the original on 21 June 2015. Retrieved 21 June 2015.
157. Rosenberg, Louis B.; A.I., Unanimous; Francisco, San; California; USA (1 January 2016). 07/20/2015-07/24/2015. 13. pp. 658–659. doi:10.7551/978-0-262-33027-5-ch117. ISBN 9780262330275. Archived from the original on 27 October 2015. Retrieved 12 October 2015.
158. Rosenberg, L.B., "Human swarming, a real-time method for parallel distributed intelligence," in Swarm/Human Blended Intelligence Workshop (SHBI), 2015, vol., no., pp.1–7, 28–29 Sept. 2015 doi: 10.1109/SHBI.2015.7321685
159. "Artificial intelligence turns $20 into $11,000 in Kentucky Derby bet". 10 May 2016. Archived from the original on 4 June 2016. Retrieved 4 June 2016.
160. Ohlheiser, Abby (2 June 2016). "What happened when an A.I. hive mind answered Reddit's burning politics questions". Archived from the original on 4 June 2016. Retrieved 4 June 2016 – via washingtonpost.com.
161. "Digital Photography Review". www.dpreview.com. Archived from the original on 9 December 2016. Retrieved 7 December 2016.
162. "Camera reviews, DSLR reviews, lens reviews, photography guides | Cameralabs". www.cameralabs.com. Archived from the original on 10 December 2016. Retrieved 7 December 2016.
163. Luckin, R., du Boulay, B., Smith, H., Underwood, J., Fitzpatrick, G., Holmberg, J., Kerawalla, L., Tunley, H., Brewster, D. and Pearce, D. (2005), 'Using Mobile Technology to Create Flexible Learning Contexts Archived 8 January 2019 at the Wayback Machine '. Journal of Interactive Media in Education, 22.
164. Luckin, R. (2006), Understanding Learning Contexts as Ecologies of Resources: From the Zone of Proximal Development to Learner Generated Contexts. Paper presented at the Proceedings of World Conference on Elearning in Corporate, Government, Healthcare, and Higher Education 2006.
165. Luckin, R., Shurville, S. and Browne, T. (2007), 'Initiating e-learning by stealth, participation and consultation in a late majority institution Archived 26 August 2019 at the Wayback Machine'. Journal of Organisational Transformation and Social Change, 3 (3), 317–332. doi:10.1386/jots.3.3.317_1
166. Flew, Terry and Humphreys, Sal (2005) "Games: Technology, Industry, Culture" in Terry Flew, New Media: An Introduction (2nd edn), Oxford University Press, South Melbourne 101–114.
167. Henry Jenkins (2002) in Flew, Terry and Humphreys, Sal (2005) Games: Technology, Industry, Culture in Terry Flew, New Media: An Introduction (2nd edn), Oxford University Press, South Melbourne 101–114.
168. Vera, Dusya; Crossan, Mary (1 June 2004). "Theatrical Improvisation: Lessons for Organizations". Organization Studies. 25 (5): 727–749. doi:10.1177/0170840604042412. S2CID 144386272.
169. Sawyer, R. Keith (1 June 2004). "Improvised lessons: collaborative discussion in the constructivist classroom". Teaching Education. 15 (2): 189–201. doi:10.1080/1047621042000213610.
170. Held, David; McGrew, Anthony (19 November 2007). Globalization / Anti-Globalization: Beyond the Great Divide. Polity. ISBN 9780745639116.
171. "'Anti-Globals' Use Internet As Collective Intelligence – UK Indymedia". www.indymedia.org.uk. Archived from the original on 20 December 2016. Retrieved 11 December 2016.
172. Jan Marco Leimeister, Michael Huber, Ulrich Bretschneider, Helmut Krcmar (2009): Leveraging Crowdsourcing: Activation-Supporting Components for IT-Based Ideas Competition. In: Journal of Management Information Systems (2009), Volume: 26, Issue: 1, Publisher: M.E. Sharpe Inc., Pages: 197–224, ISSN 0742-1222, doi:10.2753/MIS0742-1222260108 , Winfried Ebner; Jan Marco Leimeister; Helmut Krcmar (2009): Community Engineering for Innovations – The Ideas Competition as a method to nurture a Virtual Community for Innovations. In: R&D Management, 39 (4), pp 342–356 doi:10.1111/j.1467-9310.2009.00564.x
173. Ebner, Winfried; Leimeister, Jan Marco; Krcmar, Helmut (1 September 2009). "Community engineering for innovations: the ideas competition as a method to nurture a virtual community for innovations" (PDF). R&D Management. 39 (4): 342–356. doi:10.1111/j.1467-9310.2009.00564.x. S2CID 16316321. Archived (PDF) from the original on 22 September 2017. Retrieved 2 October 2019.
174. Fladerer, Johannes-Paul; Kurzmann, Ernst (November 2019). WISDOM OF THE MANY : how to create self -organisation and how to use collective... intelligence in companies and in society from mana (in German). BOOKS ON DEMAND. ISBN 9783750422421. Archived from the original on 23 December 2019. Retrieved 23 December 2019.
175. Kittur, A., Lee, B. and Kraut, R. E. (2009) 'Coordination in collective intelligence: The role of team structure and task interdependence', Conference on Human Factors in Computing Systems - Proceedings, pp. 1495–1504.
176. [18] Woolley, A. W., Aggarwal, I. and Malone, T. W. (2015) 'Collective Intelligence and Group Performance', Current Directions in Psychological Science, 24(6), pp. 420–424.
177. Abdul-Karim, Kashif (23 November 2015). In Search of The Black Seed. Lulu.com. p. 140. ISBN 9781329694897.
178. "Capitalism and Social Progress by Phillip Brown and Hugh Lauder (cont... )". The Guardian. 18 June 2001. Archived from the original on 21 December 2016. Retrieved 12 December 2016.
179. Brown & Lauder 2000, p. 230.
180. "John Zerzan: anti-civilization theorist, writer and speaker". www.johnzerzan.net. Archived from the original on 4 December 2016. Retrieved 12 December 2016.
181. Moore, Jason W. (1 January 2001). Arrighi, Giovanni; Silver, Beverly J. (eds.). "Globalization in Historical Perspective". Science & Society. 65 (3): 386–397. doi:10.1521/siso.65.3.386.17767. JSTOR 40403938.
182. "m e t a m o r p h o p t i c s". metamorphoptics.blogspot.com. Archived from the original on 13 December 2016. Retrieved 12 December 2016.
183. Joy, Bill. "Why the Future Doesn't Need Us". WIRED. Archived from the original on 4 December 2016. Retrieved 12 December 2016.
184. "How Millions of People Can Help Solve Climate Change – NOVA Next | PBS". NOVA Next. 15 January 2014. Archived from the original on 22 October 2017. Retrieved 31 October 2017.

Works cited

• Brown, Philip; Lauder, Hugh (2000). "Collective intelligence". In S. Baron; J. Field; T Schuller (eds.). Social Capital: Critical Perspectives. New York: Oxford University Press. ISBN 9780191583247.
• Flew, Terry (2008). New Media: an introduction. Melbourne: Oxford University Press.

Further reading

• Brown, Philip; Lauder, Hugh (2001). "Collective intelligence". In Brown; Lauder (eds.). Capitalism and social progress: the future of society in a global economy. Palgrave. ISBN 9780333985380.
• Fadul, Jose A. (2009). "Collective Learning: Applying Distributed Cognition for Collective Intelligence". The International Journal of Learning. 16 (4): 211–220. doi:10.18848/1447-9494/cgp/v16i04/46223.
• CIA. (2008). The World Factbook. (accessed 3 September 2008)
• Fladerer, Johannes-Paul (2019). The Wisdom of the Many: How to create Self-Organisation and how to use Collective Intelligence in Companies and in Society From Management to ManagemANT. Norderstedt: BoD. ISBN 978-3750422421.
• Hamann, Heiko (2018). Swarm Robotics: A Formal Approach. New York: Springer. ISBN 9783319745282.
• Hofstadter, Douglas (1979). Gödel, Escher, Bach: an Eternal Golden Braid. New York: Basic Books.
• Leimeister, Jan Marco (2010). "Intelligence". Business & Information Systems Engineering. 2 (4): 245–248. doi:10.1007/s12599-010-0114-8. S2CID 7575575. Archived from the original on 26 July 2011.
• Leiner, Barry, Cerf, Vinton, Clark, David, Kahn, Robert, Kleinrock, Leonard, Lynch, Daniel, Postel, Jon, Roberts, Larry and Wolff, Stephen. 2003. A Brief History of the Internet. Version 3.32 (accessed 3 September 2008)
• Noubel, Jean-François; (2004, rev. 2007), "Collective Intelligence: the Invisible Revolution"
• Por, George (1995). "The Quest for Collective intelligence". In K. Gozdz (ed.). Community Building: Renewing Spirit and Learning in Business. San Francisco: New Leaders Press.
• Rheingold, Howard (2002). Smart Mobs: The Next Social Revolution. Basic Books.
• Ron, Sun (1979). Cognition and Multi-Agent Interaction. Cambridge University Press.
• Rosenberg, L. (2015). Human Swarms, a real time method for Collective Intelligence. Proceedings of the European Conference on Artificial Life (ECAL 2015), pp. 658–659.
• Riedl, Christoph; Blohm, Ivo; Leimeister, Jan Marco; Krcmar, Helmut (2010). "Rating Scales for Collective Intelligence in Innovation Communities: Why Quick and Easy Decision Making Does Not Get It Right" (PDF). Thirty First International Conference on Information Systems, St. Louis 2010. Archived from the original (PDF) on 19 July 2011.
• Radakov, Dmitriĭ Viktorovich (1973). J. Wiley (ed.). Schooling in the ecology of fish.
• Raven, Jean, ed. (2008). Uses and Abuses of Intelligence. Unionville (NY): Royal Fireworks Press. ISBN 978-0-89824-356-7. Lay summary (6 July 2010).
• Roy Chowdhury, Soudip; Rodriguez, Carlos; Daniel, Florian; Casati, Fabio (2010). Wisdom-aware computing: on the interactive recommendation of composition knowledge. Icsoc'10. pp. 144–155. ISBN 9783642193934.
• Stephen R. Diasio, Nuria Agell, "The evolution of expertise in decision support technologies: A challenge for organizations," cscwd, pp. 692–697, 2009 13th International Conference on Computer Supported Cooperative Work in Design, 2009. https://web.archive.org/web/20121009235747/http://www.computer.org/portal/web/csdl/doi/10.1109/CSCWD.2009.4968139
• Kaiser, C., Kröckel, J., Bodendorf, F. (2010). Swarm Intelligence for Analyzing Opinions in Online Communities. Proceedings of the 43rd Hawaii International Conference on System Sciences, pp. 1–9.

External links

• Blog of Collective Intelligence
• GFIS – Global Futures Intelligence System
• CIRI – the Collective Intelligence Research Institute – a R&D non-profit organization on collective intelligence
• An application of Collective Intelligence for the Global Climate Change Situation Room designed and implemented by The Millennium Project in Gimcheon, South Korea in 2009.
• MIT Handbook of Collective Intelligence
• Cultivating Society's Civic Intelligence Doug Schuler Journal of Society, Information and Communication, vol 4 No. 2.
• Jennifer H. Watkins (2007). Prediction Markets as an Aggregation Mechanism for Collective Intelligence Los Alamos National Laboratory article on Collective Intelligence
• Hideyasu Sasaki (2010). International Journal of Organizational and Collective Intelligence (IJOCI), vol 1 No. 1.
• Olivier Zara, Managing Collective Intelligence, Toward a New Corporate Governance, Axiopole editions, 2004
• The collective intelligence framework, open-source framework for leveraging collective intelligence
• Raimund Minichbauer (2012). Fragmented Collectives. On the Politics of "Collective Intelligence" in Electronic Networks, transversal 01 12, 'unsettling knowledges'