"Creative crowdsourcing spans sourcing creative projects such as "graphic design, "crowdsourcing architecture, apparel design, movies, writing, illustration, etc. While crowdsourcing competitions have been used for decades in some creative fields (such as architecture), creative crowdsourcing has proliferated with the recent development of web-based platforms where clients can solicit a wide variety of creative work at lower cost than by traditional means.
Crowdsourcing has also been used for gathering language-related data. For dictionary work, as was mentioned above, over a hundred years ago it was applied by the Oxford English Dictionary editors, using paper and postage. Much later, a call for collecting examples of proverbs on a specific topic (religious pluralism) was printed in a journal. Today, as "crowdsourcing" has the inherent connotation of being web-based, such language-related data gathering is being conducted on the web by crowdsourcing in accelerating ways. Currently, a number of dictionary compilation projects are being conducted on the web, particularly for languages that are not highly academically documented, such as for the "Oromo language. Software programs have been developed for crowdsourced dictionaries, such as WeSay. A slightly different form of crowdsourcing for language data has been the online creation of scientific and mathematical terminology for "American Sign Language. "Proverb collection is also being done via crowdsourcing on the Web, most innovatively for the "Pashto language of Afghanistan and Pakistan. Crowdsourcing has been extensively used to collect high-quality gold standard for creating automatic systems in natural language processing (e.g., "named entity recognition, "entity linking).
|This section does not "cite any "sources. (February 2016) ("Learn how and when to remove this template message)|
Crowdsolving is a collaborative, yet holistic, way of solving a problem using many people, communities, groups, or resources.
Chicago-based startup "Crowdfind, formerly "crowdfynd", uses a version of crowdsourcing best termed as crowdsearching, which differs from microwork in that no payment for taking part in the search is made. Their platform, through geographic location anchoring, builds a virtual search party of smartphone and Internet users to find lost items, pets, or persons, as well as returning them.
TrackR uses a system they call "crowd GPS" to load Bluetooth identities to a central server to track lost or stolen items.
Crowdfunding is the process of funding projects by a multitude of people contributing a small amount to attain a certain monetary goal, typically via the Internet. Two basic crowdfunding models exist. The model that has been around the longest is rewards-based crowdfunding. This is where people can prepurchase products, buy experiences, or simply donate. While this funding may in some cases go towards helping a business, funders are not allowed to invest and become shareholders via rewards-based crowdfunding.
Individuals, businesses, and entrepreneurs can showcase their businesses and projects to the entire world by creating a profile, which typically includes a short video introducing their project, a list of rewards per donation, and illustrations through images. The idea is to create a compelling message towards which readers will be drawn. Funders make monetary contribution for numerous reasons:
- They connect to the greater purpose of the campaign, such as being a part of an entrepreneurial community and supporting an innovative idea or product.
- They connect to a physical aspect of the campaign like rewards and gains from investment.
- They connect to the creative display of the campaign’s presentation.
- They want to see new products before the public.
The dilemma for equity crowdfunding in the US as of 2012 was how the "Securities and Exchange Commission (SEC) is going to regulate the entire process. At the time, rules and regulations were being refined by the SEC, which had until January 1, 2013, to tweak the fundraising methods. The regulators were overwhelmed trying to regulate Dodd – Frank and all the other rules and regulations involving public companies and the way they trade. Advocates of regulation claimed that crowdfunding would open up the flood gates for fraud, called it the "wild west" of fundraising, and compared it to the 1980s days of penny stock "cold-call cowboys". The process allows for up to $1 million to be raised without some of the regulations being involved. Companies under the then-current proposal would have exemptions available and be able to raise capital from a larger pool of persons, which can include lower thresholds for investor criteria, whereas the old rules required that the person be an "accredited" investor. These people are often recruited from social networks, where the funds can be acquired from an equity purchase, loan, donation, or ordering. The amounts collected have become quite high, with requests that are over a million dollars for software such as Trampoline Systems, which used it to finance the commercialization of their new software.
Mobile crowdsourcing involves activities that take place on smartphones or mobile platforms, frequently characterized by GPS technology. This allows for real-time data gathering and gives projects greater reach and accessibility. However, mobile crowdsourcing can lead to an urban bias, as well as safety and privacy concerns.
"Macrowork tasks typically have these characteristics: they can be done independently, they take a fixed amount of time, and they require special skills. Macrotasks could be part of specialized projects or could be part of a large, visible project where workers pitch in wherever they have the required skills. The key distinguishing factors are that macrowork requires specialized skills and typically takes longer, while microwork requires no specialized skills.
"Microwork is a crowdsourcing platform where users do small tasks for which computers lack aptitude for low amounts of money. Amazon’s popular "Mechanical Turk has created many different projects for users to participate in, where each task requires very little time and offers a very small amount in payment. The Chinese versions of this, commonly called "Witkey, are similar and include such sites as Taskcn.com and k68.cn. When choosing tasks, since only certain users “win”, users learn to submit later and pick less popular tasks to increase the likelihood of getting their work chosen. An example of a Mechanical Turk project is when users searched satellite images for a boat to find lost researcher Jim Gray. Based on an elaborate survey of participants in a microtask crowdsourcing platform, Gadiraju et al. have proposed a taxonomy of different types of microtasks that are crowdsourced.
Inducement prize contests
Web-based idea competitions or inducement prize contests often consist of generic ideas, cash prizes, and an Internet-based platform to facilitate easy idea generation and discussion. An example of these competitions includes an event like IBM's 2006 "Innovation Jam", attended by over 140,000 international participants and yielding around 46,000 ideas. Another example is the "Netflix Prize in 2009. The idea was to ask the crowd to come up with a recommendation algorithm more accurate than Netflix's own algorithm. It had a grand prize of US$1,000,000, and it was given to the BellKor's Pragmatic Chaos team which bested Netflix's own algorithm for predicting ratings, by 10.06%.
Another example of competition-based crowdsourcing is the 2009 "DARPA balloon experiment, where DARPA placed 10 balloon markers across the United States and challenged teams to compete to be the first to report the location of all the balloons. A collaboration of efforts was required to complete the challenge quickly and in addition to the competitive motivation of the contest as a whole, the winning team (MIT, in less than nine hours) established its own "collaborapetitive" environment to generate participation in their team. A similar challenge was the "Tag Challenge, funded by the US State Department, which required locating and photographing individuals in five cities in the US and Europe within 12 hours based only on a single photograph. The winning team managed to locate three suspects by mobilizing volunteers worldwide using a similar incentive scheme to the one used in the balloon challenge.
"Open innovation platforms are a very effective way of crowdsourcing people's thoughts and ideas to do research and development. The company "InnoCentive is a crowdsourcing platform for corporate research and development where difficult scientific problems are posted for crowds of solvers to discover the answer and win a cash prize, which can range from $10,000 to $100,000 per challenge. InnoCentive, of Waltham, MA and London, England provides access to millions of scientific and technical experts from around the world. The company claims a success rate of 50% in providing successful solutions to previously unsolved scientific and technical problems. IdeaConnection.com challenges people to come up with new inventions and innovations and Ninesigma.com connects clients with experts in various fields. The "X Prize Foundation creates and runs incentive competitions offering between $1 million and $30 million for solving challenges. "Local Motors is another example of crowdsourcing. A community of 20,000 automotive engineers, designers, and enthusiasts competes to build off-road rally trucks.
Implicit crowdsourcing is less obvious because users do not necessarily know they are contributing, yet can still be very effective in completing certain tasks. Rather than users actively participating in solving a problem or providing information, implicit crowdsourcing involves users doing another task entirely where a third party gains information for another topic based on the user's actions.
A good example of implicit crowdsourcing is the "ESP game, where users guess what images are and then these labels are used to tag Google images. Another popular use of implicit crowdsourcing is through "reCAPTCHA, which asks people to solve "CAPTCHAs to prove they are human, and then provides CAPTCHAs from old books that cannot be deciphered by computers, to digitize them for the web. Like many tasks solved using the Mechanical Turk, CAPTCHAs are simple for humans, but often very difficult for computers.
Piggyback crowdsourcing can be seen most frequently by websites such as Google that data-mine a user's search history and websites to discover keywords for ads, spelling corrections, and finding synonyms. In this way, users are unintentionally helping to modify existing systems, such as Google's "AdWords.
Research has emerged that outlines the use of crowdsourcing techniques in the public health domain. The collective intelligence outcomes from crowdsourcing are being generated in three broad categories of public health care; health promotion, health research, and health maintenance. Crowdsourcing also enables researchers to move from small homogeneous groups of participants to large heterogenous groups, beyond convenience samples such as students or higher educated people.
Crowdsourcing in agriculture
Crowdsource research also reaches to the field of agriculture. This is mainly to give the farmers and experts a kind of help in identification of different types of weeds from the fields and also to give them the best way to remove the weeds from fields.
Crowdsourcing in cheating in bridge
"Boye Brogeland initiated a crowdsourcing investigation of cheating by top-level "bridge players which showed several players were guilty, which led to their suspension.
A number of motivations exist for businesses to use crowdsourcing to accomplish their tasks, find solutions for problems, or to gather information. These include the ability to offload peak demand, access cheap labor and information, generate better results, access a wider array of talent than might be present in one organization, and undertake problems that would have been too difficult to solve internally. Crowdsourcing allows businesses to submit problems on which contributors can work, on topics such as science, manufacturing, biotech, and medicine, with monetary rewards for successful solutions. Although crowdsourcing complicated tasks can be difficult, simple work tasks can be crowdsourced cheaply and effectively.
Crowdsourcing also has the potential to be a problem-solving mechanism for government and nonprofit use. Urban and transit planning are prime areas for crowdsourcing. One project to test crowdsourcing's public participation process for transit planning in Salt Lake City was carried out from 2008 to 2009, funded by a U.S. Federal Transit Administration grant. Another notable application of crowdsourcing to government "problem solving is the Peer to Patent Community Patent Review project for the U.S. Patent and Trademark Office.
Researchers have used crowdsourcing systems like the Mechanical Turk to aid their research projects by crowdsourcing some aspects of the research process, such as data collection, parsing, and evaluation. Notable examples include using the crowd to create speech and language databases, and using the crowd to conduct user studies. Crowdsourcing systems provide these researchers with the ability to gather large amount of data. Additionally, using crowdsourcing, researchers can collect data from populations and demographics they may not have had access to locally, but that improve the validity and value of their work.
Artists have also used crowdsourcing systems. In his project the Sheep Market, "Aaron Koblin used Mechanical Turk to collect 10,000 drawings of sheep from contributors around the world. "Sam Brown (artist) leverages the crowd by asking visitors of his website "explodingdog to send him sentences that he uses as inspirations for paintings. Art curator Andrea Grover argues that individuals tend to be more open in crowdsourced projects because they are not being physically judged or scrutinized. As with other crowdsourcers, artists use crowdsourcing systems to generate and collect data. The crowd also can be used to provide inspiration and to collect financial support for an artist's work.
Additionally, crowdsourcing from 100 million drivers is being used by "INRIX to collect users' driving times to provide better GPS routing and real-time traffic updates.
The crowd is an umbrella term for the people who contribute to crowdsourcing efforts. Though it is sometimes difficult to gather data about the "demographics of the crowd, a study by Ross et al. surveyed the demographics of a sample of the more than 400,000 registered crowdworkers using Amazon Mechanical Turk to complete tasks for pay. A previous study in 2008 by "Ipeirotis found that users at that time were primarily American, young, female, and well-educated, with 40% earning more than $40,000 per year. In November 2009, Ross found a very different Mechanical Turk population, 36% of which was Indian. Two-thirds of Indian workers were male, and 66% had at least a bachelor's degree. Two-thirds had annual incomes less than $10,000, with 27% sometimes or always depending on income from Mechanical Turk to make ends meet.
The average US user of Mechanical Turk earned $2.30 per hour for tasks in 2009, versus $1.58 for the average Indian worker.["citation needed] While the majority of users worked less than five hours per week, 18% worked 15 hours per week or more. This is less than "minimum wage in the United States (but not in India), which Ross suggests raises ethical questions for researchers who use crowdsourcing.
The demographics of Microworkers.com differ from Mechanical Turk in that the US and India together account for only 25% of workers; 197 countries are represented among users, with Indonesia (18%) and Bangladesh (17%) contributing the largest share. However, 28% of employers are from the US.
Another study of the demographics of the crowd at iStockphoto found a crowd that was largely white, middle- to upper-class, higher educated, worked in a so-called "white-collar job" and had a high-speed Internet connection at home. In a crowd-sourcing diary study of 30 days in Europe the participants were predominantly higher educated women.
Studies have also found that crowds are not simply collections of amateurs or hobbyists. Rather, crowds are often professionally trained in a discipline relevant to a given crowdsourcing task and sometimes hold advanced degrees and many years of experience in the profession. Claiming that crowds are amateurs, rather than professionals, is both factually untrue and may lead to marginalization of crowd labor rights.
G. D. Saxton et al. (2013) studied the role of community users, among other elements, during his content analysis of 103 crowdsourcing organizations. Saxton et al. developed a taxonomy of nine crowdsourcing models (intermediary model, citizen media production, collaborative software development, digital goods sales, product design, peer-to-peer social financing, consumer report model, knowledge base building model, and collaborative science project model) in which to categorize the roles of community users, such as researcher, engineer, programmer, journalist, graphic designer, etc., and the products and services developed.
Many scholars of crowdsourcing suggest that both "intrinsic and "extrinsic motivations cause people to contribute to crowdsourced tasks and these factors influence different types of contributors. For example, students and people employed full-time rate human capital advancement as less important than part-time workers do, while women rate social contact as more important than men do.
Intrinsic motivations are broken down into two categories: enjoyment-based and community-based motivations. Enjoyment-based motivations refer to motivations related to the fun and enjoyment that contributors experience through their participation. These motivations include: skill variety, task identity, task autonomy, direct feedback from the job, and pastime. Community-based motivations refer to motivations related to community participation, and include community identification and social contact. In crowdsourced journalism, the motivation factors are intrinsic: the crowd is driven by a possibility to make social impact, contribute to social change and help their peers.
Extrinsic motivations are broken down into three categories: immediate payoffs, delayed payoffs, and social motivations. Immediate payoffs, through monetary payment, are the immediately received compensations given to those who complete tasks. Delayed payoffs are benefits that can be used to generate future advantages, such as training skills and being noticed by potential employers. Social motivations are the rewards of behaving pro-socially, such as the altruistic motivations of "online volunteers. Chandler and Kapelner found that US users of the Amazon Mechanical Turk were more likely to complete a task when told they were going to “help researchers identify tumor cells,” than when they were not told the purpose of their task. However, of those who completed the task, quality of output did not depend on the framing of the task.
Motivation factors in crowdsourcing are often a mix of intrinsic and extrinsic factors. In a crowdsourced law-making project, the crowd was motivated by a mix of intrinsic and extrinsic factors. Intrinsic motivations included fulfilling civic duty, affecting the law for sociotropic reasons, to deliberate with and learn from peers. Extrinsic motivations included changing the law for financial gain or other benefits. Participation in crowdsourced policy-making was an act of grassroots advocacy, whether to pursue one’s own interest or more altruistic goals, such as protecting nature.
Another form of social motivation is prestige or status. The "International Children's Digital Library recruits volunteers to translate and review books. Because all translators receive public acknowledgment for their contributions, Kaufman and Schulz cite this as a reputation-based strategy to motivate individuals who want to be associated with institutions that have prestige. The Mechanical Turk uses reputation as a motivator in a different sense, as a form of quality control. Crowdworkers who frequently complete tasks in ways judged to be inadequate can be denied access to future tasks, providing motivation to produce high-quality work.
Using crowdsourcing through means such as Amazon Mechanical Turk can help provide researchers and requesters with an already established infrastructure for their projects, allowing them to easily use a crowd and access participants from a diverse culture background. Using crowdsourcing can also help complete the work for projects that would normally have geographical and population size limitations.
Participation in crowdsourcing
Despite the potential global reach of IT applications online, recent research illustrates that differences in location["which?] affect participation outcomes in IT-mediated crowds.
Limitations and controversies
At least five major topics cover the limitations and controversies about crowdsourcing:
- Impact of crowdsourcing on product quality
- Entrepreneurs contribute less capital themselves
- Increased number of funded ideas
- The value and impact of the work received from the crowd
- The ethical implications of low wages paid to crowdworkers
Impact of crowdsourcing on product quality
Crowdsourcing allows anyone to participate, allowing for many unqualified participants and resulting in large quantities of unusable contributions. Companies, or additional crowdworkers, then have to sort through all of these low-quality contributions. This task of sorting through crowdworkers’ contributions, along with the necessary job of managing the crowd, requires companies to hire actual employees, thereby increasing management overhead. For example, susceptibility to faulty results is caused by targeted, malicious work efforts. Since crowdworkers completing microtasks are paid per task, often a financial incentive causes workers to complete tasks quickly rather than well. Verifying responses is time-consuming, so requesters often depend on having multiple workers complete the same task to correct errors. However, having each task completed multiple times increases time and monetary costs.
Crowdsourcing quality is also impacted by task design. Lukyanenko et al. argue that, the prevailing practice of modeling crowdsourcing data collection tasks in terms of fixed classes (options), unnecessarily restricts quality. Results demonstrate that information accuracy depends on the classes used to model domains, with participants providing more accurate information when classifying phenomena at a more general level (which is typically less useful to sponsor organizations, hence less common). Further, greater overall accuracy is expected when participants could provide free-form data compared to tasks in which they select from constrained choices.
Just as limiting, oftentimes the scenario is that just not enough skills or expertise exist in the crowd to successfully accomplish the desired task. While this scenario does not affect "simple" tasks such as image labeling, it is particularly problematic for more complex tasks such as engineering design or product validation. In these cases, it may be difficult or even impossible to find the qualified people in the crowd, as their voices may be drowned out by consistent, but incorrect crowd members. However, if the difficulty of the task is even "intermediate" in its difficultly, estimating crowdworkers' skills and intentions and leveraging them for inferring true responses works well, albeit with an additional computation cost.
Crowdworkers are a nonrandom sample of the population. Many researchers use crowdsourcing to quickly and cheaply conduct studies with larger sample sizes than would be otherwise achievable. However, due to limited access to the Internet, participation in low developed countries is relatively low. Participation in highly developed countries is similarly low, largely because the low amount of pay is not a strong motivation for most users in these countries. These factors lead to a bias in the population pool towards users in medium developed countries, as deemed by the "human development index.
The likelihood that a crowdsourced project will fail due to lack of monetary motivation or too few participants increases over the course of the project. Crowdsourcing markets are not a first-in, first-out queue. Tasks that are not completed quickly may be forgotten, buried by filters and search procedures so that workers do not see them. This results in a long-tail power law distribution of completion times. Additionally, low-paying research studies online have higher rates of attrition, with participants not completing the study once started. Even when tasks are completed, crowdsourcing does not always produce quality results. When "Facebook began its localization program in 2008, it encountered some criticism for the low quality of its crowdsourced translations.
One of the problems of crowdsourcing products is the lack of interaction between the crowd and the client. Usually little information is known about the final desired product, and often very limited interaction with the final client occurs. This can decrease the quality of product because client interaction is a vital part of the design process.
An additional cause of the decrease in product quality that can result from crowdsourcing is the lack of collaboration tools. In a typical workplace, coworkers are organized in such a way that they can work together and build upon each other’s knowledge and ideas. Furthermore, the company often provides employees with the necessary information, procedures, and tools to fulfill their responsibilities. However, in crowdsourcing, crowdworkers are left to depend on their own knowledge and means to complete tasks.
A crowdsourced project is usually expected to be unbiased by incorporating a large population of participants with a diverse background. However, most of the crowdsourcing works are done by people who are paid or directly benefit from the outcome (e.g. most of "open source projects working on "Linux). In many other cases, the end product is the outcome of a single person's endeavour, who creates the majority of the product, while the crowd only participates in minor details.
Entrepreneurs contribute less capital themselves
To make an idea turn into a reality, the first thing needed is capital. Depending on the scope and complexity of the crowdsourced project, the amount of necessary capital can range from a few thousand dollars to hundreds of thousands. The capital-raising process can take days to months depending on different variables, including the entrepreneur’s network and the amount of initial self-generated capital.
The crowdsourcing process allows entrepreneurs to access to a wide range of investors who can take different stakes in the project. In effect, crowdsourcing simplifies the capital-raising process and allows entrepreneurs to spend more time on the project itself and reaching milestones rather than dedicating time to get it started. Overall, the simplified access to capital can save time to start projects and potentially increase efficiency of projects.
Opponents of this issue argue easier access to capital through a large number of smaller investors can hurt the project and its creators. With a simplified capital-raising process involving more investors with smaller stakes, investors are more risk-seeking because they can take on an investment size with which they are comfortable. This leads to entrepreneurs losing possible experience convincing investors who are wary of potential risks in investing because they do not depend on one single investor for the survival of their project. Instead of being forced to assess risks and convince large institutional investors why their project can be successful, wary investors can be replaced by others who are willing to take on the risk.
There are translation companies and several users of translations who pretend to use crowdsourcing as a means for drastically cutting costs, instead of hiring "professional translators. This situation has been systematically denounced by "IAPTI and other translator organizations.
Increased number of funded ideas
The raw number of ideas that get funded and the quality of the ideas is a large controversy over the issue of crowdsourcing.
Proponents argue crowdsourcing is beneficial because it allows niche ideas that would not survive venture capitalist or angel funding, many times the primary investors in startups, to be started. Many ideas are killed in their infancy due to insufficient support and lack of capital, but crowdsourcing allows these ideas to be started if an entrepreneur can find a community to take interest in the project.
Crowdsourcing allows those who would benefit from the project to fund and become a part of it, which is one way how small niche ideas get started. However, when the raw number of projects grows, the number of possible failures can also increase. Crowdsourcing assists niche and high-risk projects to start because of a perceived need from a select few who seek the product. With high risk and small target markets, the pool of crowdsourced projects faces a greater possible loss of capital, lower return, and lower levels of success.
Ethical concerns for crowdsourcers
Because crowdworkers are considered independent contractors rather than employees, they are not guaranteed "minimum wage. In practice, workers using the Amazon Mechanical Turk generally earn less than the minimum wage, with US users earning an average of $2.30 per hour for tasks in 2009, and users in India earning an average of $1.58 per hour, which is below minimum wage in the United States (but not in India). Some researchers who have considered using Mechanical Turk to get participants for research studies have argued that the wage conditions might be unethical. However, according to other research, workers on Amazon Mechanical Turk do not feel that they are exploited and are ready to participate in crowdsourcing activities in the future. When Facebook began its localization program in 2008, it received criticism for using free labor in crowdsourcing the translation of site guidelines.
Typically, no written contracts, nondisclosure agreements, or employee agreements are made with crowdworkers. For users of the Amazon Mechanical Turk, this means that requestors decide whether users' work is acceptable, and reserve the right to withhold pay if it does not meet their standards. Critics say that crowdsourcing arrangements exploit individuals in the crowd, and a call has been made for crowds to organize for their labor rights.
Collaboration between crowd members can also be difficult or even discouraged, especially in the context of competitive crowd sourcing. Crowdsourcing site InnoCentive allows organizations to solicit solutions to scientific and technological problems; only 10.6% of respondents report working in a team on their submission. Amazon Mechanical Turk workers collaborated with academics to create a platform, WeAreDynamo.org, that allows them to organize and create campaigns to better their work situation.
- "Citizen science
- "Collaborative innovation network
- "Collective consciousness
- "Collective intelligence
- "Commons-based peer production
- "Crowd computing
- "Crowdsourcing software development
- "Distributed thinking
- "Distributed Proofreaders
- "Flash mob
- "Government crowdsourcing
- "List of crowdsourcing projects
- "Open value network
- "Participatory democracy
- "Participatory monitoring
- "Smart mob
- "Social collaboration
- ""Stone Soup"
- "Virtual Collective Consciousness
- "Virtual volunteering
- "Wisdom of the crowd
- Safire, William (February 5, 2009). "On Language". New York Times Magazine. Retrieved May 19, 2013.
- Schenk, Eric; Guittard, Claude (2009). Crowdsourcing: What can be Outsourced to the Crowd, and Why ?
- Hirth,Matthias; Hoßfeld, Tobias; Tran-Gia, Phuoc. Anatomy of a Crowdsourcing Platform - Using the Example of Microworkers.com. 5th IEEE International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS 2011), June 2011, "doi:10.1109/IMIS.2011.89
- Estellés-Arolas, Enrique; González-Ladrón-de-Guevara, Fernando (2012), "Towards an Integrated Crowdsourcing Definition" (PDF), Journal of Information Science, 38 (2): 189–200, "doi:10.1177/0165551512437638
- Howe, Jeff (2006). "The Rise of Crowdsourcing". "Wired.
- Brabham, D. C. (2013). Crowdsourcing. Cambridge, Massachusetts; London, England: The MIT Press.
- Brabham, D. C. (2008). "Crowdsourcing as a Model for Problem Solving an Introduction and Cases". Convergence: The International Journal of Research into New Media Technologies. 14 (1): 75–90. "doi:10.1177/1354856507084420.
- Prpić, J., & Shukla, P. (2016). Crowd Science: Measurements, Models, and Methods. In Proceedings of the 49th Annual Hawaii International Conference on System Sciences, Kauai, Hawaii: IEEE Computer Society
- Prpić, John; Taeihagh, Araz; Melton, James (September 2015). "The Fundamentals of Policy Crowdsourcing". Policy & Internet. 7 (3): 340–361. "doi:10.1002/poi3.102.
- Schlagwein, Daniel; Bjørn-Andersen, Niels (2014), "Organizational Learning with Crowdsourcing: The Revelatory Case of LEGO" (PDF), Journal of the Association for Information Systems, 15 (11)
- Howe, Jeff (June 2, 2006). "Crowdsourcing: A Definition". Crowdsourcing Blog. Retrieved January 2, 2013.
- "Daren C. Brabham". USC Annenberg. University of Southern California. Retrieved 17 September 2014.
- Brabham, Daren (2008), "Crowdsourcing as a Model for Problem Solving: An Introduction and Cases" (PDF), Convergence: The International Journal of Research into New Media Technologies, 14 (1): 75–90, "doi:10.1177/1354856507084420, archived from the original (PDF) on 2012-04-25
- Afuah, A., & Tucci, C. L. (2012). Crowdsourcing as a Solution to Distant Search. Academy of Management Review, 37(3), 355–375.
- Vuković, M. (2009). Crowdsourcing for enterprises. In Services-I, 2009 World Conference on (pp. 686-692). IEEE.
- de Vreede, T., Nguyen, C., de Vreede, G. J., Boughzala, I., Oh, O., & Reiter-Palmon, R. (2013). A Theoretical Model of User Engagement in Crowdsourcing. In Collaboration and Technology (pp. 94-109). Springer Berlin Heidelberg
- Claypole, Maurice (February 14, 2012). "Learning through crowdsourcing is deaf to the language challenge". The Guardian. London.
- "A Brief History of Crowdsourcing [Infographic]". Crowdsourcing.org. 2012-03-18. Retrieved 2015-07-02.
- Hern , Chester G.(2002). Tracks in the Sea, p. 123 & 246. McGraw Hill. "ISBN 0-07-136826-4.
- "'C'était Paris en 1970'". Etudesphotographiques.revues.org. 1970-04-25. Retrieved 2015-07-02.
- "'The Big Picture a New Churning'". indianexpress.com. 2015-01-15. Retrieved 2015-08-19.
- "UNV Online Volunteering Service | History". Onlinevolunteering.org. Retrieved 2015-07-02.
- "Wired 14.06: The Rise of Crowdsourcing". Archive.wired.com. 2009-01-04. Retrieved 2015-07-02.
- Lih, Andrew (2009). The Wikipedia revolution : how a bunch of nobodies created the world's greatest encyclopedia (1st ed.). New York: Hyperion. "ISBN "1401303714.
-  Archived November 29, 2014, at the "Wayback Machine.
- "Antoine-Jean-Baptiste-Robert Auget, Baron de Montyon". New Advent. Retrieved February 25, 2012.
- "It Was All About Alkali". Chemistry Chronicles. Retrieved February 25, 2012.
- "Nicolas Appert". John Blamire. Retrieved February 25, 2012.
- "9 Examples of Crowdsourcing, Before 'Crowdsourcing' Existed". MemeBurn. Retrieved February 25, 2012.
- Pande, Shamni. "The People Know Best". "Business Today. India: Living Media India Limited.
- Vergano, Dan. "1833 Meteor Storm Started Citizen Science". National Geographic. StarStruck. Retrieved 18 September 2014.
- "Gateway to Astronaut Photography of Earth". "NASA.
- McLaughlin, Elliot. "Image Overload: Help us sort it all out, NASA requests". Cnn.com. CNN. Retrieved 18 September 2014.
- Després, Jacques; Hadjsaid, Nouredine; Criqui, Patrick; Noirot, Isabelle (1 February 2015). "Modelling the impacts of variable renewable sources on the power sector: reconsidering the typology of energy modelling tools". Energy. 80: 486–495. "doi:10.1016/j.energy.2014.12.005. "ISSN 0360-5442.
- "OpenEI — Energy Information, Data, and other Resources". OpenEI. Retrieved 2016-09-26.
- Garvin, Peggy (12 December 2009). "New Gateway: Open Energy Info". SLA Government Information Division. Dayton, OH, USA. Retrieved 2016-09-26.
- Brodt-Giles, Debbie (2012). WREF 2012: OpenEI — an open energy data and information exchange for international audiences (PDF). Golden, CO, USA: National Renewable Energy Laboratory (NREL). Retrieved 2016-09-24.
- Davis, Chris; Chmieliauskas, Alfredas; Dijkema, Gerard; Nikolic, Igor. "Enipedia". Delft, The Netherlands: Energy and Industry group, Faculty of Technology, Policy and Management, TU Delft. Retrieved 2016-10-07.
- Davis, Chris (2012). Making sense of open data: from raw data to actionable insight — PhD thesis (PDF). Delft, The Netherlands: Delft University of Technology. Retrieved 2016-07-21. Chapter 9 discusses in depth the initial development of Enipedia.
- "What Is the Four-Generation Program?". The Church of Jesus Christ of Latter-day Saints. Retrieved January 30, 2012.
- Bonney, R. and LaBranche, M. (2004). Citizen Science: Involving the Public in Research. ASTC Dimensions. May/June 2004, p. 13.
- Baretto, C.; Fastovsky, D.; Sheehan, P. (2003). "A Model for Integrating the Public into Scientific Research". Journal of Geoscience Education. 50 (1): 71–75.
- McCaffrey, R.E. (2005). "Using Citizen Science in Urban Bird Studies". Urban Habitats. 3 (1): 70–86.
- King, Turi E.; Jobling, Mark A. (2009). "What's in a name? Y chromosomes, surnames and the genetic genealogy revolution". Trends in Genetics. 25 (8): 351–60. "doi:10.1016/j.tig.2009.06.003. "PMID 19665817.
The International Society of Genetic Genealogy (www.isogg.org) advocates the use of genetics as a tool for genealogical research, and provides a support network for genetic genealogists. It hosts the ISOGG Y-haplogroup tree, which has the virtue of being regularly updated.
- Mendex, etc. al., Fernando (28 February 2013). "An African American Paternal Lineage Adds an Extremely Ancient Root to the Human Y Chromosome Phylogenetic Tree". The American Society of Human Genetics. Retrieved 10 July 2013. This is Volume 92, Issue 3, pp. 454–459.
- Wells, Spencer (2013). "The Genographic Project and the Rise of Citizen Science". Southern California Genealogical Society (SCGS). Archived from the original on 2013-07-10. Retrieved July 10, 2013.
- Aitamurto, Tanja (2015). "Motivation Factors in Crowdsourced Journalism: Social Impact, Social Change and Peer-Learning". International Journal of Communication. 9: 3523–3543.
- Aitamurto, Tanja (2016). "Crowdsourcing as a Knowledge-Search Method in Digital Journalism: Ruptured Ideals and Blended Responsibility". Digital Journalism. 4: 280–297. "doi:10.1080/21670811.2015.1034807.
- Aitamurto, Tanja. "Balancing between open and closed: co-creation in magazine journalism". Digital Journalism. 1 (2): 229–251. "doi:10.1080/21670811.2012.750150.
- Keuleers; et al. (Feb 2015). "Word knowledge in the crowd: Measuring vocabulary size and word prevalence in a massive online experiment". Quarterly journal of experimental psychology. 68: 1665–1692. "doi:10.1080/17470218.2015.1022560.
- "History of the Christmas Bird Count | Audubon". Birds.audubon.org. Retrieved 2015-07-02.
-  Archived August 24, 2014, at the "Wayback Machine.
- Aitamurto, Tanja (2012). Crowdsourcing for Democracy: New Era In Policy–Making. Committee for the Future, Parliament of Finland. pp. 10–30. "ISBN "978-951-53-3459-6.
- Prpić, J.; Taeihagh, A.; Melton, J. (2014). "Crowdsourcing the Policy Cycle. Collective Intelligence 2014, MIT Center for Collective Intelligence" (PDF). Humancomputation.com. Retrieved 2015-07-02.
- Prpić, J.; Taeihagh, A.; Melton, J. (2014). "A Framework for Policy Crowdsourcing. Oxford Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy" (PDF). Ipp.oxii.ox.ac.uk. Retrieved 2015-07-02.
- Prpić, J.; Taeihagh, A.; Melton, J. (2014). "Experiments on Crowdsourcing Policy Assessment. Oxford Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy" (PDF). Ipp.oii.ox.ac.uk. Retrieved 2015-07-02.
- Thapa, B.; Niehaves, B.; Seidel, C.; Plattfaut, R. (2015). "Citizen involvement in public sector innovation: Government and citizen perspectives". Information Polity. pp. 3–17. "doi:10.3233/IP-150351.
- Aitamurto and Landemore. "Five design principles for crowdsourced policymaking: Assessing the case of crowdsourced off-road traffic law reform in Finland". Journal of Social Media for Organizations (1): 1–19.
- Aitamurto, Landemore, Galli (2016). "Unmasking the Crowd: Participants' Motivation Factors, Profile and Expectations for Participation in Crowdsourced Policymaking". Information, Communication & Society – via Routledge.
- Aitamurto, Chen, Cherif, Galli and Santana (2016). "Making Sense of Crowdsourced Civic Data with Big Data Tools". ACM Digital Archive: Academic Mindtrek – via ACM Digital Archive.
- Aitamurto, Tanja. Crowdsourcing for Democracy: New Era in Policymaking. Committee for the Future, Parliament of Finland. "ISBN "978-951-53-3459-6.
- Andro, M., Saleh, I. (2017). "Digital Libraries and Crowdsourcing: A Review". pp. 135-162. In Collective Intelligence and Digital Archives: Towards Knowledge Ecosystems. Edited by Samuel Szoniecky and Nasreddine Bouhaï, Wiley / ISTE. "ISBN 9781786300607. 260 p.
- DeVun, Leah (November 19, 2009). "Looking at how crowds produce and present art.". Wired News. Archived from the original on 2012-10-24. Retrieved February 26, 2012.
- Ess, Henk van "Crowdsourcing: how to find a crowd", ARD ZDF Akademie 2010, Berlin, p. 99,
- Doan, A.; Ramarkrishnan, R.; Halevy, A. (2011), "Crowdsourcing Systems on the World Wide Web" (PDF), Communications of the ACM, 54 (4): 86–96, "doi:10.1145/1924421.1924442
- Brabham, Daren C. (2013), Crowdsourcing, MIT Press.["page needed]
- Howe, Jeff (2008), "Crowdsourcing: Why the Power of the Crowd is Driving the Future of Business" (PDF), The International Achievement Institute.
- Robson, John (February 24, 2012). "IEM Demonstrates the Political Wisdom of Crowds". Canoe.ca. Retrieved March 31, 2012.
- "4 Great Examples of Crowdsourcing through Social Media". digitalagencymarketing.com. 2012.
- Goldberg, Ken; Newsom, Gavin. "Let's amplify California's collective intelligence". Citris-uc.org. Retrieved 14 June 2014.
- Escoffier, N. and B. McKelvey (2014). "Using "Crowd-Wisdom Strategy" to Co-Create Market Value: Proof-of-Concept from the Movie Industry." in International Perspective on Business Innovation and Disruption in the Creative Industries: Film, Video, Photography, P. Wikstrom and R. DeFillippi, eds., UK: Edward Elgar Publishing Ltd, Chap. 11.
- Block, A. B. (2009). "How boxoffice trading could flop." The Hollywood Reporter, (April 22).
- Chen, A. and R. Panaligan (2013). "Quantifying movie magic with Google search." Google White Paper, Industry Perspectives+User Insights
- Cunard, C. (2010). "The Movie Research Experience gets audiences involved in filmmaking." The Daily Bruin, (July 19)
- "Compete To Create Your Dream Home". FastCoexist.com. June 4, 2013. Retrieved 2014-02-03.
- "Designers, clients forge ties on web". Boston Herald. June 11, 2012. Retrieved 2014-02-03.
- Stan Nussbaum. 2003. Proverbial perspectives on pluralism. Connections: the journal of the WEA Missions Committee October, pp. 30, 31.
- "Oromo dictionary project". OromoDictionary.com. Retrieved 2014-02-03.
- "Description of WeSay software and process" (PDF). Retrieved 2014-02-03.
- "Developing ASL vocabulary for science and math". Washington.edu. December 7, 2012. Retrieved 2014-02-03.
- "Pashto Proverb Collection project". AfghanProverbs.com. Retrieved 2014-02-03.
- "Comparing methods of collecting proverbs" (PDF). gial.edu.
- Edward Zellem. 2014. Mataluna: 151 Afghan Pashto Proverbs. Tampa, FL: Culture Direct.
- "Web 2.0-based crowdsourcing for high-quality gold standard development in clinical Natural Language Processing". Jmir.org. "doi:10.2196/jmir.2426. Retrieved 2014-02-03.
- Lombard, Amy (May 5, 2013). "Crowdfynd: The First Place to Look". TIME.com. Retrieved 2014-02-03.
- Prive, Tanya. "What Is Crowdfunding And How Does It Benefit The Economy". Forbes.com. Retrieved 2015-07-02.
- Barnett, Chance. "Crowdfunding Sites In 2014". Forbes.com. Retrieved 2015-07-02.
- Agrawal, Ajay, Christian Catalini, and Avi Goldfarb. "Some Simple Economics of Crowdfunding." National Bureau of Economic Research (2014): 63-97.
- "Mobile Crowdsourcing". Clickworker. Retrieved 10 December 2014.
- Thebault-Spieker, Terveen, & Hecht. Avoiding the South Side and the Suburbs: The Geography of Mobile Crowdsourcing Markets.
- Chatzimiloudis, Konstantinidis & Laoudias, Zeinalipour-Yazti. "Crowdsourcing with smartphones" (PDF).
- MIST: Fog-based Data Analytics Scheme with Cost-Efficient Resource Provisioning for IoT Crowdsensing Applications .
- Yang, J.; Adamic, L.; Ackerman, M. (2008), "Crowdsourcing and Knowledge Sharing: Strategic User Behavior on Taskcn" (PDF), Proceedings of the 9th ACM Conference on Electronic Commerce
- Gadiraju, U.; Kawase, R.; Dietze, S. (2014), "A Taxonomy of Microtasks on the Web" (PDF), Proceedings of the 25th ACM Conference on Hypertext and Social Media
- Leimeister, J.M.; Huber, M.; Bretschneider, U.; Krcmar, H. (2009), "Leveraging Crowdsourcing: Activation-Supporting Components for IT-Based Ideas Competition", Journal of Management Information Systems, 26 (1): 197–224, "doi:10.2753/mis0742-1222260108
- Ebner, W.; Leimeister, J.; Krcmar, H. (2009), "Community Engineering for Innovations: The Ideas Competition as a method to nurture a Virtual Community for Innovations", R&D Management, 39 (4): 342–356, "doi:10.1111/j.1467-9310.2009.00564.x
- "DARPA Network Challenge". DARPA Network Challenge. Archived from the original on August 11, 2011. Retrieved November 28, 2011.
- "Social media web snares 'criminals'". New Scientist. Retrieved April 4, 2012.
- "Beyond XPrize: The 10 Best Crowdsourcing Tools and Technologies". February 20, 2012. Retrieved March 30, 2012.
- Kittur, A.; Chi, E.H.; Sun, B. (2008), "Crowdsourcing user studies with Mechanical Turk" (PDF), CHI 2008
- van der Krieke; et al. (2015). "HowNutsAreTheDutch (HoeGekIsNL): A crowdsourcing study of mental symptoms and strengths". International Journal of Methods in Psychiatric Research. 25 (2): 123–144. "doi:10.1002/mpr.1495. "PMID 26395198.
- Prpić, J. (2015). "Health Care Crowds: Collective Intelligence in Public Health. Collective Intelligence 2015. Center for the Study of Complex Systems, University of Michigan.". Paoers.ssrn.com. "SSRN .
- van der Krieke, L; Blaauw, FJ; Emerencia, AC; Schenk, HM; Slaets, JP; Bos, EH; de Jonge, P; Jeronimus, BF (2016). "Temporal Dynamics of Health and Well-Being: A Crowdsourcing Approach to Momentary Assessments and Automated Generation of Personalized Feedback (2016)". Psychosomatic Medicine: 1. "doi:10.1097/PSY.0000000000000378. "PMID 27551988.
- Rahman, Mahbubur; Blackwell, Brenna; Banerjee, Nilanjan; Dharmendra, Saraswat (2015), "Smartphone-based hierarchical crowdsourcing for weed identification", Computers and Electronics in Agriculture: 14–23, retrieved 12 August 2015
- Primarily on the Bridge Winners website
- Noveck, Beth Simone (2009), Wiki Government: How Technology Can Make Government Better, Democracy Stronger, and Citizens More Powerful, Brookings Institution Press
- Sarasua, Cristina; Simperl, Elena; Noy, Natalya F. (2012), "Crowdsourcing Ontology Alignment with Microtasks" (PDF), Institute AIFB. Karlsruhe Institute of Technology: 2
- "Crowdfunding and Civic Society in Europe: A Profitable Partnership?". Open Citizenship Journal. Retrieved April 29, 2013.
- Federal Transit Administration Public Transportation Participation Pilot Program, U.S. Department of Transportation, archived from the original on January 7, 2009
- Peer-to-Patent Community Patent Review Project, Peer-to-Patent Community Patent Review Project
- Callison-Burch, C.; Dredze, M. (2010), "Creating Speech and Language Data With Amazon's Mechanical Turk" (PDF), Human Language Technologies Conference: 1–12
- McGraw, I.; Seneff, S. (2011), "Growing a Spoken Language Interface on Amazon Mechanical Turk" (PDF), Interspeech: 3057–3060
- Mason, W.; Suri, S. (2010), "Conducting Behavioral Research on Amazon's Mechanical Turk", Behavior Research Methods, "SSRN
- Koblin, A. (2008), "The sheep market", Creativity and Cognition
- "explodingdog 2015". Explodingdog.com. Retrieved 2015-07-02.
- Linver, D. (2010), Crowdsourcing and the Evolving Relationship between Art and Artist
- "Why". INRIX.com. 2014-09-13. Retrieved 2015-07-02.
- Ross, J.; Irani, L.; Silberman, M.S.; Zaldivar, A.; Tomlinson, B. (2010). "Who are the Crowdworkers? Shifting Demographics in Mechanical Turk" (PDF). CHI 2010. Archived from the original (PDF) on March 30, 2012.
- Hirth, M.; Hoßfeld, T.; Train-Gia, P. (2011), Human Cloud as Emerging Internet Application – Anatomy of the Microworkers Crowdsourcing Platform (PDF)
- Brabham, Daren C. (2008). "Moving the Crowd at iStockphoto: The Composition of the Crowd and Motivations for Participation in a Crowdsourcing Application". First Monday.
- Lakhani; et al. (2007). "The Value of Openness in Scientific Problem Solving" (PDF). Retrieved February 26, 2012.
- Brabham, Daren C. (2012). "Managing Unexpected Publics Online: The Challenge of Targeting Specific Groups with the Wide-Reaching Tool of the Internet". International Journal of Communication.
- Brabham, Daren C. (2010). "Moving the Crowd at Threadless: Motivations for Participation in a Crowdsourcing Application". Information, Communication & Society. 13: 1122–1145. "doi:10.1080/13691181003624090.
- Brabham, Daren C. (2012). "The Myth of Amateur Crowds: A Critical Discourse Analysis of Crowdsourcing Coverage". Information, Communication & Society. 15: 394–410. "doi:10.1080/1369118X.2011.641991.
- Saxton, Oh, & Kishore (2013). "Rules of Crowdsourcing: Models, Issues, and Systems of Control.". Information Systems Management. 30: 2–20. "doi:10.1080/10580530.2013.739883.
- Aitamurto, Tanja (2015). "Motivation Factors in Crowdsourced Journalism: Social Impact, Social Change, and Peer Learning". International Journal of Communication. 9: 3523–3543.
- Aitamurto, Landemore, Galli (2016). "Unmasking the Crowd: Participants' Motivation Factors, Profile and Expectations for Participation in Crowdsourced Policymaking". Information, Communication & Society.
- Kaufmann, N.; Schulze, T.; Viet, D. (2011). "More than fun and money. Worker Motivation in Crowdsourcing – A Study on Mechanical Turk" (PDF). Proceedings of the Seventeenth Americas Conference on Information Systems.
- Brabham, Daren C. (2012). "Motivations for Participation in a Crowdsourcing Application to Improve Public Engagement in Transit Planning". Journal of Applied Communication Research. 40: 307–328. "doi:10.1080/00909882.2012.693940.
- Lietsala, Katri; Joutsen, Atte (2007). "Hang-a-rounds and True Believers: A Case Analysis of the Roles and Motivational Factors of the Star Wreck Fans". MindTrek 2007 Conference Proceedings.
- "State of the World's Volunteerism Report 2011" (PDF). Unv.org. Retrieved 2015-07-01.
- Chandler, D.; Kapelner, A. (2010). "Breaking Monotony with Meaning: Motivation in Crowdsourcing Markets" (PDF).
- Aparicio, M.; Costa, C.; Braga, A. (2012). "Proposing a system to support crowdsourcing" (PDF). OSDOC '12 Proceedings of the Workshop on Open Source and Design of Communication.
- Aitamurto, Landemore, Galli (2016). "Unmasking the Crowd: Participants' Motivation Factors, Expectations, and Profile in a Crowdsourced Law Reform.". Information, Communication & Society.
- Quinn, Alexander J.; Bederson, Benjamin B. (2011). "Human Computation:A Survey and Taxonomy of a Growing Field, CHI 2011 [Computer Human Interaction conference], May 7–12, 2011, Vancouver, BC, Canada" (PDF). Retrieved 30 June 2015.
- Paolacci, G; Chandler, J; Ipeirotis, P.G. (2010). "Running experiments on Amazon Mechanical Turk". Judgment and Decision Making. 5 (5): 411–419.
- Prpić, J; Shukla, P.; Roth, Y.; Lemoine, J.F. (2015). "A Geography of Participation in IT-Mediated Crowds". Proceedings of the Hawaii International Conference on Systems Sciences 2015. "SSRN .
- Borst, Irma. "The Case For and Against Crowdsourcing: Part 2". Retrieved 2015-02-09.
- Ipeirotis; Provost; Wang (2010). "Quality Management on Amazon Mechanical Turk" (PDF).
- Lukyanenko, Roman; Parsons, Jeffrey; Wiersma, Yolanda (2014). "The IQ of the Crowd: Understanding and Improving Information Quality in Structured User-Generated Content". Information Systems Research. 25 (4): 669–689. "doi:10.1287/isre.2014.0537.
- Burnap, Alex; Ren, Alex J.; Papazoglou, Giannis; Gerth, Richard; Gonzalez, Richard; Papalambros, Panos. "When Crowdsourcing Fails: A Study of Expertise on Crowdsourced Design Evaluation" (PDF).
- Kurve, Aditya; Miller, David J.; Kesidis, George (30 May 2014). "Multicategory Crowdsourcing Accounting for Variable Task Difficulty, Worker Skill, and Worker Intention". IEEE KDE (99).
- Hirth; Hoßfeld; Tran-Gia (2011), Human Cloud as Emerging Internet Application - Anatomy of the Microworkers Crowdsourcing Platform (PDF)
- Ipeirotis (2010). "Analyzing the Amazon Mechanical Turk Marketplace". XRDS: Crossroads, The ACM Magazine for Students (PDF). ACM. 17 (2). "doi:10.1145/1870000/1869094. "SSRN .
- Hosaka, Tomoko A. (April 2008). "Facebook asks users to translate for free". "MSNBC.
- Britt, Darice. "Crowdsourcing: The Debate Roars On". Retrieved 2012-12-04.
- Woods, Dan (28 September 2009). "The Myth of Crowdsourcing". Forbes. Retrieved 2012-12-04.
- "The Promise of Idea Crowdsourcing: Benefits, Contexts, Limitations | Tanja Aitamurto". Academia.edu. 1970-01-01. Retrieved 2015-07-02.
- "International Translators Association Launched in Argentina". Latin American Herald Tribune. Retrieved 23 November 2016.
- Kleeman, Frank (2008). "Un(der)paid Innovators: The Commercial Utilization of Consumer Work through Crowdsourcing". Sti-studies.de. Retrieved 2015-07-02.
- Jason (2011). "Crowdsourcing: A Million Heads is Better Than One". Crowdsourcing.org. Retrieved 2015-07-02.
- Dupree, Steven (2014). "Crowdfunding 101: Pros and Cons". Gsb.stanford.edu. Retrieved 2015-07-02.
- "Fair Labor Standards Act Advisor". Retrieved 28 February 2012.
- Greg Norcie, 2011, "Ethical and practical considerations for compensation of crowdsourced research participants," CHI WS on Ethics Logs and VideoTape: Ethics in Large Scale Trials & User Generated Content, , accessed 30 June 2015.
- Busarovs, Aleksejs (2013). "Ethical Aspects of Crowdsourcing, or is it a Modern Form of Exploitation" (PDF). International Journal of Economics & Business Administration. 1 (1): 3–14. Retrieved 26 November 2014.
- The Crowdsourcing Scam (Dec. 2014), "The Baffler, No. 26
- Salehi; et al. (2015). "We Are Dynamo: Overcoming Stalling and Friction in Collective Action for Crowd Workers" (PDF). Retrieved June 16, 2015.