UOA09-01: The Zooniverse citizen science projects

Submitting Institution

University of Oxford

Unit of Assessment

Physics

Summary Impact Type

Societal

Research Subject Area(s)

Physical Sciences: Astronomical and Space Sciences


Download original

PDF

Summary of the impact

The Zooniverse citizen science projects, including Galaxy Zoo, have engaged over 856,000 members of the public from 100 countries with astronomy and other areas of research such as nature, health and the humanities. The impacts include increased public awareness and understanding of science and research methods, changes in the attitudes of school children and adults, and benefits to teaching and learning. The Zooniverse engages with large numbers of people through the internet; additional benefits are also delivered through adaptations of the projects for interactive museum exhibits and classroom education. Further impacts include benefits to Cancer Research UK and commercial uptake by Microsoft and the BBC.

Underpinning research

The original research aim that led to the Zooniverse was to investigate star formation in as wide a variety of galaxies as possible. Under Professor Joe Silk, postdoctoral researcher Dr Chris Lintott (appointed to Oxford in 2006) began investigations into the astrochemical properties of a small proportion of local elliptical galaxies that showed signs of recent star formation but he required a larger sample of such systems. Ground and space-based platforms such as the Sloan Digital Sky Survey and the Hubble Space Telescope have produced large numbers (typically millions) of images featuring galaxies and other astronomical objects of interest. Previous work [1] had demonstrated that such samples were best assembled through visual inspection, a PhD student at Oxford, Kevin Schawinski, having classified 50,000 galaxies by eye. To find a sustainable solution, the Oxford team developed software that could be scaled to handle the size of modern datasets to crowdsource the problem.

In 2008, using the newly developed software, Lintott demonstrated that it was possible to train members of the public to classify galaxies with sufficient accuracy that, when cross-referenced with each other, the data could be used in scientific research [2]. Gathering several independent classifications for each galaxy, and quantitative estimates of error in the classification, was critical to the system. Using the public as a resource for classification meant that vast data sets could be analysed. The public online interface with the classification software was named Galaxy Zoo and within its first year of operation was able to collect 50 million classifications. With multiple classifications used for each galaxy, this resulted in the first data release of morphological classifications for nearly 900,000 galaxies [3]. Galaxy Zoo is a collaboration between Oxford, Portsmouth and Nottingham universities. Portsmouth and Nottingham each provided science team members who assisted with the analysis of Galaxy Zoo data. The scientific direction, project development, and operation were led by Oxford.

Having demonstrated the effectiveness of this form of citizen science, the Oxford team developed the Zooniverse platform capable of supporting the widest possible range of projects. This new platform was first used to re-launch Galaxy Zoo and now supports 17 live projects in a range of subject areas, collectively known as the Zooniverse. In 2009, Lintott was appointed to a permanent position in the department.

The power of this platform, coupled with scientific insights into the kinds of problems that could be tackled, has enabled some remarkable discoveries in astrophysics that would not have been possible without effective analysis of large data sets. These include the discovery of a quasar-scale light-echo [4], the first planet in a four star system [5] and a sophisticated measurement of the dust distribution in the Earth's orbit [6].

References to the research

(Oxford authors, * denotes best indicators of quality)

[1] Schawinski K, Thomas D, Sarzi M, Maraston C, Kaviraj S, Joo S-J, Yi SK, Silk J, (2007), Observational evidence for AGN feedback in early-type galaxies, Monthly Notices of the Royal Astronomical Society, 382 (4), 1415-1431, doi: 10.1111/j.1365-2966.2007.12487.x, citations: 204 (WoS).

 
 
 
 

*[2] Lintott CJ, Schawinski K, Slosar A, Land K, Bamford S, Thomas D, Raddick MJ, Nichol RC, Szalay A, Andreescu D, Murray P and Vanderberg J, (2008), Galaxy Zoo: morphologies derived from visual inspection, Monthly Notices of the Royal Astronomical Society, 389 (3), 1179-1189. doi 10.1111/j.1365-2966.2008.13689.x, citations: 175 (WoS). This paper introduces the Galaxy Zoo project and finds that Galaxy Zoo results are comparable with classifications by professional astronomers.

 
 
 
 

*[3] Lintott CJ, Schawinski K, Bamford S, Slosar A, Land K, Thomas D, Edmondson E, Masters K, Nichol RC, Raddick MJ, Szalay A, Andreescu D, Murray P and Vanderberg J, (2011), Galaxy Zoo 1: data release of morphological classifications for nearly 900 000 galaxies, Monthly Notices of the Royal Astronomical Society, 410 (1), 166-178, doi: 10.1111/j.1365-2966.2010.17432.x, citations: 67 (WoS)

 
 
 
 

*[4] Lintott CJ, Schawinski K and 19 other co-authors, (2009), Hanny's Voorwerp, a quasar light echo, Monthly Notices of the Royal Astronomical Society, 399 (1), 129-140, doi: 10.1111/j.1365-2966.2009.15299.x, citations: 19 (WoS). This paper gives an example of a serendipitous discovery made possible using Galaxy Zoo.

 
 
 
 

[5] Schwamb ME, Orosz JA, Carter JA, Welsh WF, Fischer DA, Torres G, Howard AW, Crepp JR, Keel WC, Lintott CJ, Kaib NA, Terrell D, Gagliano R, Jek KJ, Parrish M, Smith AM, Lynn S, Simpson RJ, Giguere MJ, Schawinski K, (2013), Planet Hunters: A Transiting Circumbinary Planet in a Quadruple Star System, The Astrophysical Journal, 768, 21, doi: 10.1088/0004-637X/768/2/127, citations: 1 (WoS).

 
 
 
 

[6] Davis CJ, Davies JA, St Cyr OC, Campbell-Brown M, Skelt A, Kaiser M, Meyer-Vernet N, Crothers S, Lintott C, Smith A, Bamford S, Baeten EML, (2012), The distribution of interplanetary dust between 0.96 and 1.04 au as inferred from impacts on the STEREO spacecraft observed by the heliospheric imagers, Monthly Notices of the Royal Astronomical Society, 420, 1355, doi: 10.1111/j.1365-2966.2011.20125.x, citations: 4 (WoS).

 
 
 
 

Details of the impact

Here we detail the impact of the entire suite of 17 Zooniverse projects, all of which have been launched and sustained in the REF period. Many of these projects involve researchers and datasets from other institutions, but the underpinning research and expertise in citizen science as a scientific tool, along with the leadership of development and implementation, is an Oxford-led endeavour. The Zooniverse includes 7 astronomy projects (the first being Galaxy Zoo, launched 2009) and 9 projects beyond astronomy, for example in climate, nature, health and the humanities. In November 2012 the users of Zooniverse were surveyed to determine the nature, reach and significance of the impacts. The survey received over 2000 responses [A], primarily from users of astronomy projects Galaxy Zoo and Planet Hunters.

Impacts on the users of the Zooniverse: The Zooniverse is distinguished by its broad reach, with more than 856,000 people engaging directly as a result of signing up to one or more of the projects and taking part. Roughly one third of these volunteers are from the UK, one third are from the US and one third are from over 100 other countries. Translations into languages including Polish, German and Czech further widen the Zooniverse's reach. 85% of survey respondents were not already amateur astronomers prior to engaging with Zooniverse.

88% of respondents agreed that the Zooniverse had increased their understanding of how modern scientific research is carried out. In addition to citing specific research methods they have learned about, users say that working with real data has enhanced their understanding of the research process. Comments include: "working with real data [...] gives me a better feel for the connection between data scientists deal with and the conclusions they develop from it" and "by participating in the research, I have appreciated more what researchers have to check for, cross referencing their data, and analysing the results". Comments also indicate a better understanding of scientific consensus: "a thing isn't true just because one person says or believes it is, a thing is true because it can be shown to be by observations and measurements which are not dependent upon one's personal bias and/or belief structure."

85% agreed that the Zooniverse had increased their understanding of astronomy and physics. Again users list specific scientific concepts they now understand, for example gravitational lensing and morphological classification of galaxies. Comments include: "with every Zooniverse project I've participated in my knowledge of that subject has increased substantially." 78% of under-18s said they were more encouraged to study physics or astronomy at a higher level as a result of the Zooniverse. 39% of all respondents said they were more likely to take up a scientific career as a consequence of their experiences with the Zooniverse.

Over half of respondents have changed their astronomical observing behaviour as a result of the Zooniverse including 19% who observed the night sky for the first time. Many note that they have bought their own telescopes and now observe as a family activity. In all, 87% of respondents reported at least one increase in engagement with science as a result of the Zooniverse, including those who read more about science (68%), studied more formally (34%), carried out their own research (12%), attended lectures or events (19%), and/or visited museums and planetariums (33%).

The highly accessible nature of the Zooniverse is an important factor in enabling these impacts. Users comment that "these projects have allowed me to feel less removed from the daily application of science and more knowledgeable about astronomy, something I've always had an interest in but have been too intimidated to pursue seriously" and "what was once seemed [sic] distant, lofty, and inaccessible to many people is now right at their fingertips."

Teaching: Further reach is achieved through formal and informal teaching. Teachers use the Zooniverse site directly to support classroom learning and comments suggest that this "has opened their curiosity in a whole new way" and changed some students' preconception that "science was hard or boring." Another teacher comments that "the feedback from students suggests that they learn about physics/astronomy but also get a better understanding of what scientists actually do." In recognition that impact through teachers is an important pathway, the Zooniverse has produced resources for teachers directly. A series of workshops, using Galaxy Zoo data, were organised in Oxford and following their success the Zooteach tools were launched in 2011. These resources include 38 lesson-plans categorised by subject and age, and have received almost 14,000 page views between 1st January 2013 and 30th July 2013.

Many survey respondents note that they participate in Zooniverse projects with their families in an informal learning environment. A user said "the combination of tutorials and extensive community discussion about the data are an invaluable part of increasing mine and my family's scientific literacy." 47% of under-18s said that the Zooniverse had helped with their school work. Parents find the Zooniverse beneficial to support their children; for example one commented that "I have a better understanding of physics, so much so I can help my son in his school work."

Media: Many of the Zooniverse projects have enjoyed a high media profile, both on launch and during their operation. UK broadcast examples included BBC Radio 4's Today Programme (6 appearances) and PM (1 appearance), BBC Breakfast (1 appearance), Bang Goes the Theory (2 appearances). Lintott is co-presenter of Sky at Night (viewership 1 million) where Galaxy Zoo was featured and other projects mentioned. Stargazing Live (viewership 4 million) also featured two projects on episodes of the show. Galaxy Zoo was reviewed in the Guardian [B] which concluded that there was "no surer way to engage the public than to involve people in the research itself." Planet Hunters is showcased in the Economist [C].

Museums: Museums have also made use of the underlying Zooniverse software leading to a wider audience than just the primary users of the online projects. Zooniverse project Solar Stormwatch has been at the heart of programmes for schools and visitors run by the Royal Observatory Greenwich. This won `Best Innovative Site' at the 2010 `Museums and the Web' awards [D]. The Public Astronomer at the Royal Observatory Greenwich said, Solar Stormwatch has "certainly had a very positive impact on the content of our public programme, as well as the Observatory's online and media profile. We regularly run solar viewing sessions [...] and Solar Stormwatch has been the springboard for several of these" [E]. US museums, including the Adler Planetarium in Chicago (500,000 visitors per year), have also featured Zooniverse projects prominently in floor displays and in public programs. The President of the Adler Planetarium said: "Our partnership with Oxford University on the Zooniverse citizen science effort is a critical component of our success in inspiring the next generation of explorer. The Zooniverse permeates our operation, and allows us to offer all visitors meaningful opportunities to engage in frontier science" [F].

Charity: Cell Slider, a Zooniverse project launched in 2012 in collaboration with Cancer Research UK (CRUK), is the first biomedical citizen science project in the world; its purpose is to accelerate cures for cancers by using citizen scientists to classify tumour samples. So far Cell Slider has helped to reduce analysis time from 18 months to three months, and with accuracy that shows a high degree of agreement with expert pathologists. The Citizen Science Lead at CRUK said, "in addition to significantly reducing research timeframes, CRUK recognise Zooniverse's impacts on their work as a charity. The Zooniverse has given us access to a community of people outside of the typical CRUK supporter base. Cell Slider is the first non-fundraising product CRUK have launched and the first time that CRUK cancer research data has been made publicly available for analysis. The Zooniverse has made an essential contribution to these developments." [G]

Sustainability: There are many problems in science that cannot be dealt with by purely automated processes, and capability to crowdsource parts of the analysis is crucial. By pursuing these scientific problems through citizen science, the Zooniverse has created a virtuous circle where the scientific outcomes and the public both benefit. In only four years, this stream of citizen science has grown into a large activity measured by number of users and the diversity of projects: from January 2013 to July 2013, between 500 and 1000 new users signed up daily and 4 new Zooniverse projects were launched. On-going engagement is apparent through the Zooteach resources, discussion forums and special tools for advanced users.

Recognition: In 2011, Lintott won the Royal Society Kohn Award "for his excellent engagement with society in matters of science and its social dimension". Zooniverse also won the President's Prize in the Institute of Physics web awards. Zooniverse was the People's Choice winner as well as the overall winner by the judges, who described it as "a great site for non-professionals to take part in serious scientific discovery" (Paul Millar); "an engaging online experience that takes visitors beyond browsing and into genuine interaction" (Sumit Paul-Choudhury); and "a great way to harness collaboration, sense of participating and making a difference" (Maggie Philbin). The Old Weather project, a collaboration with the Met Office, won the 2012 Royal Meteorological Society award for "Meteorological innovation that matters" — the certificate states that the success of Old Weather "depended on the efforts of the Zooniverse team, who built the novel website interface which ultimately allowed the public to digitize the data with minimum effort" [H].

Commercial uptake: In 2009, Microsoft licensed the Zooniverse framework in their development for NASA of Be A Martian. Tiny Planets, an educational website, also implemented a version of the Zooniverse project Moon Zoo adapted for children aged 4-7, into their online educational virtual world. Scribe, a generic package for crowdsourced transcription, was developed by the Oxford team as open-source software. The first third-party implementation of Scribe was in What's the Score, a partnership between the Bodleian Library and Google to digitize a collection of music manuscripts.

Sources to corroborate the impact

[A] Zooniverse survey results (data held on file) confirming the nature and significance of impacts on members of the public.

[B] "Galaxy Zoo and the dawn of citizen science", The Guardian, 18th March 2012
http://www.guardian.co.uk/science/2012/mar/18/galaxy-zoo-crowdsourcing-citizen-scientists

[C] "A new world in your bedroom", The Economist, 1st October 2011
http://www.economist.com/node/21530947

[D] Solar Stormwatch winner of the Best Innovative Site at the 2010 Museums and the Web awards http://www.museumsandtheweb.com/nominee/solar_stormwatch

[E] Letter from the Public Astronomer at the Royal Observatory Greenwich (held on file) confirming impacts on the Royal Observatory and their visitors.

[F] Letter from President of Adler Planetarium, Chicago (held on file) confirming impacts on Adler Planetarium and their visitors.

[G] Letter from Citizen Science Lead at Cancer Research UK (held on file) confirms reduction of analysis time and impacts on CRUK's work.

[H] Old Weather winner of `Innovation that Matters' award from the Royal Meteorological Society 2012 http://oldweather.files.wordpress.com/2013/05/rmets_ibm_award_certificate.pdf