6,056
Views
36
CrossRef citations to date
0
Altmetric
Review Article

Robotic telescopes in education

&

Abstract

The power of robotic telescopes to transform science education has been voiced by multiple sources, since the 1980s. Since then, much technical progress has been made in robotic telescope provision to end users via a variety of different approaches. The educational transformation hoped for by the provision of this technology has, so far, yet to be achieved on a scale matching the technical advancements. In this paper, the history, definition, role and rationale of optical robotic telescopes with a focus on their use in education is provided. The current telescope access providers and educational projects and their broad uses in traditional schooling, undergraduate and outreach are then outlined. From this background, the current challenges to the field, which are numerous, are then presented. This review is concluded with a series of recommendations for current and future projects that are apparent and have emerged from the literature.

1. Introduction

Observations are the fundamental measurements of astronomy as a science. These are matched to data and theories produced by laboratory astrophysicists and other physical scientists to test provable predictions. Astronomers are in a unique position among scientists as they are unable to undertake experiments directly on the subjects of their studies. As astronomers we must wait for photons (and now other forms of non-electromagnetic radiation [Citation1]) to travel through the Universe, towards the Earth and its environment. Key to making discoveries is having an appropriate telescope in an appropriate place to witness these photons and the story they tell.

For most of human history, astronomical observations beyond that which can be seen with the naked eye or with small telescopes or binoculars have been inaccessible except to those involved with scientific research or the relatively few who have the large resources required to run a personal observatory. Even when a telescope may be available, the most suitable observing locations are not likely to be within a reasonable distance of the typical city-dweller. A variety of technologies, most notably CCD cameras, robotic mounts and more efficient, powerful and affordable computers in the latter half of the 20th Century have provided potential solutions to these issues [Citation2,Citation3] allowing access to a wider public.

From a keen astronomers’ perspective, this increasingly better access to higher quality data from better telescopes could in itself seem to be a boon for education. To those outside of the field, expenditure on such access, especially when sourced from public funds, needs to be provided with a motivation. The promise of robotic telescopes for education is usually couched in terms of its capacity to deal with certain local, national or international problems related to STEM. In particular, the distinct lack of interest of students in science as formal schooling goes on [Citation4] and the ‘leaky pipeline’ [Citation5] is seen as a problem that astronomy, with its aesthetic and general appeal, should be able to address.

In this paper, we will focus on the wide role of robotic telescopes in formal, informal and tertiary education, the challenges in using them, and their future potential. We endeavour to provide a relatively concise description of the history of the field and current state of the field and a discussion of the important issues that need to be addressed for the future.

1.1. Brief technical history

A brief technical history of robotic autonomous observatories is provided by CastroTirado [Citation6] from the earliest attempts in the late 1960s with the University of Wisconsin Telescope up through the emerging computer and technical revolution [Citation7,Citation8] until near the present day. An earlier paper by Baruch [Citation9] delves into more detail about the early development of robotic astronomy and the interaction between engineering realities and astronomical research.

Many modern observatories have ‘roboticised’ their observing away from electro-mechanical controls to providing software interfaces to drive the mechanical elements. This is not a trivial step. Retrofitting older observatories to become robotic is often prohibitively expensive, but once an observatory can be controlled by software, it paves the way for remote operation and a stronger possibility of using telescopes for education.

Since the early 1990s, students have been able to take advantage of remotely operated astronomical observatories. These included such early projects as the 14” Remote Access Astronomy Project (RAAP, Figure (L)) at UC Santa Barbara, the original 12” Bradford Robotic Telescope (BRT) [Citation10], five 6” telescopes at MicroObservatory [Citation3] and a variety of telescopes, including a 30” at UC Berkeley [Citation11], through the Hands-On Universe (HoU) project [Citation12]. The Telescopes in Education (TIE) project ([Citation13], Figure (R)) was among the first to bring observing with a professional observatory (in this case, the 24” Mount Wilson telescope) into the classroom.

Figure 1. Examples of early telescope education projects. Source: Left: Image Credit: Jatila Van Der Veen, UCSB. Right: Image credit: Lou Mayo, NASA.

Notes: The left-hand figure (L) shows the 14” RAAP telescope at UC Santa Barbara. The right-hand figure (R) shows the 24” telescope at Mt. Wilson used by the TIE project.
Figure 1. Examples of early telescope education projects. Source: Left: Image Credit: Jatila Van Der Veen, UCSB. Right: Image credit: Lou Mayo, NASA.

During a similar time period, commercially available, amateur-grade telescopes of 8”–16” apertures developed the ability to be remote controlled via a simple control pad. This control pad was readily replaced by computer, as standardised control software became available (e.g. ACP from DC-3 Dreams, The Sky from Software Bisque or MPO Connections from BDW Publishing) which provided off-the-shelf ways to roboticise existing equipment. The rise of the Internet of Things has made operating a physical device via the internet a regular, almost trivial, occurrence. Telescopes are no exception, with the majority of commercial, amateur telescopes being able to be remote controlled over great distances, via the internet. It became a logical step to replace the serial connection between telescope and computer with an internet connection for more flexibility. Many universities and schools invested in similar observatories, which needed minimal commissioning and maintenance, but suited their range of pedagogical activities.

1.2. Remote control vs autonomous control

For the purpose of this article we define robotic as, being remotely operable. We refer to instances where a telescope observes under direct human control as remote control and instances where a telescope observes without human intervention as autonomous control. Many robotic observatories incorporate elements of both remote control and autonomous control.

Remote Control has been used in two main situations. Having a telescope operator to manage the observing experience paired with a teacher who provides a motivating and educational experience to remote student users [Citation13Citation15]. The second is to facilitate access for research astronomers to access, typically, large aperture telescopes that require manual control at high altitude and distant locations [Citation16]. Both are dependent on the requirement for a fast data transfer system between the observatory and the user [Citation17].

Robotic observatories open up many more possibilities for educational use. They can be located in relatively hostile or unpleasant locations such as the Atacama desert, Antarctica [Citation18] or even in space, but their robotic nature means that their users can be located anywhere. This gives them a much broader appeal, where the focus can be on the science (and ultimately the education) and not the logistics of operating the telescope.

Networks of telescopes linked together over the internet available for education have been promised by many groups of astronomers over the past few decades [Citation19]. For a long time, there was little stable success with many networks existing for either short periods of time or not at all. Since the mid-late 2000s a variety of pro-amateur institutions (such as iTelescope, Slooh, Sierra Stars Observatory Network) have created and demonstrated medium-term stability in providing robotic telescopes which provide time for education use. In a similar time frame professional research observatories have come online which provide time for specifically education-related purposes (e.g. Las Cumbres Observatory (LCO), SkyNET).

1.3. Problems robotic telescopes solve

For the purposes of education, robotic telescopes solve a number of important problems. School children are at school during the day but most astronomical phenomena are visible during the night. There exist many logistical difficulties to getting school children to an observatory after the school day, as Percy [Citation20] states the problem: ‘the stars come out at night, the students don’t’.

Access to sites where the sky is not effected by light pollution is also a problem. A major issue facing optical astronomers is the increase in light pollution [Citation21], especially as old dimmer sodium lamps are being replaced by high power LEDs. Schools are generally located in the centre of population distributions which also are correlated with higher light pollution, as shown in Figure . Unless the school is in a rural or remote town, it is likely that most students will be located in a heavily light polluted location.

Figure 2. Estimates of the light pollution for three typical modern cities, Sao Paulo, Melbourne and Cardiff.

Notes: The light pollution is highly correlated to the local student population. This image was created using https://www.lightpollutionmap.info/.
Figure 2. Estimates of the light pollution for three typical modern cities, Sao Paulo, Melbourne and Cardiff.

Even if a suitable dark sky spot were available to a school and an observing night on a cloudless evening could be organised, the quality of the instrumentation available to a typical school would be limited. There are many cases of schools buying or being gifted 4”–16” equatorial telescopes (e.g. [Citation22]) which are either permanently housed on the school premises or available through the science department. For the non-amateur astronomer, setting up such a telescope is a challenge. Equatorial mounted telescopes are much more difficult to set up and align than Dobsonians and as a consequence are often underused.

Even in the highest GDP economies around the world, school budgets are typically very tight and have little room for purchase of such expensive equipment. Only the most well resourced, or philanthropically endowed, schools can afford such expenditure. By providing access to robotic and remote telescopes for free or very low cost, schools in less developed countries and/or in lower socio-economic areas have equal access to this instrumentation [Citation23]. Access to a telescope via computer also allows access to those students who, due to physical reasons, may not be able to access ladders or awkward positioned eyepieces. It also allows the visually impaired to use computer accessibility tools to be able to see images from a telescope that they may not be able to through the traditional eyepiece.

Even if a telescope can be configured, a dark sky and a clear night found, and children are able to use this telescope during the night, managing their expectations can be difficult. Viewing objects such as Saturn and the Moon can provide inspiring experiences, but some of the more interesting deep sky objects can be very faint, lacking in colour, and not matching students’ expectations particularly compared to images found online [Citation3].

To truly explore the night sky in colour, the eye is insufficient and a more sensitive detector, such as a DSLR camera, is needed. To allow for long exposures the costs increase significantly as adding a good quality tracking mount and high quality optical tube is necessary. Such an investment of time and money would only be available to a vanishingly small fraction of schools. There is no known systematic study of the usage of telescopes of this calibre in schools but informal conversations suggest most are largely unused in long-term storage.

1.4. The role of robotics telescopes

By having remote or robotic telescopes accurately and automatically aligned, all of the stress of setting up the telescope and pointing, which requires a lot of skill and practice, is removed from the user. These telescopes can be permanently located at a given spot, meaning that their initial set-up only needs to be undertaken once by a small group of professionals who only occasionally need to maintain the telescopes.

There are a variety of benefits to the telescope user. As the telescopes do not need to be transported, more effective mounts and larger apertures can be provided. Physically damaging the telescopes can be made next to impossible by design. There is no time expenditure to set up, pack up or maintain the instrument on the part of the user. The technical knowledge necessary for use can be minimised through a well-designed user interface. As they can be used constantly by a continual cycle of users, the much higher initial investment costs are warranted by this higher level of continued usage. The user can also potentially access either the Northern or Southern hemisphere, rather than the one where they are physically located, opening up more objects in the night sky to view.

Typically using these telescopes involves the use of either a request going into an online automated scheduler for a robotic telescope to return an image within a reasonable time (autonomous control, see Figure (L)), or through direct remote control of a telescope, located in a favourable time-zone (remote control, see Figure (R)).

Figure 3. Examples of robotic telescope user interfaces.

Notes: On the left (L) is the Las Cumbres Observatory robotic scheduler interface. On the right (R) is the itelescope remote interface.
Figure 3. Examples of robotic telescope user interfaces.

Robotic telescopes support new types of research that overcome human limitations. They can be set to monitor objects autonomously at every dark moment in remote locations repetitively and relatively cheaply over long periods of time, be driven by algorithms to maximise the efficiency of multiple observing programmes as well as respond rapidly to urgent requests [Citation24].

Remote control observing is quite inefficient, solid estimates are rare, but Baruch [Citation25] estimates that a robotic autonomous operator can work between 4 and 20 times faster than a human operator. A further step to make robotic observations more efficient, undertaken by the MicroObservatory telescopes [Citation26], is to only take a single image of a popular observation and send this one image out to multiple users, a method which is also employed by the Liverpool Telescope in their National Schools’ Observatory programme [Citation27]. Without sufficient context this could be perceived by the student audience as being something akin to a simple Google image search and not the product of their observation request.

2. A brief history of robotic telescopes in education

The earliest example of an automated telescope that ran over multiple nights was an 8” reflector telescope at the University of Wisconsin during the mid 1960s [Citation28]. There were numerous other attempts prior to 1990 but not many of these achieved a stable functioning state. Notable exceptions to these were: the MIT Automated Astrophysical Observatory [Citation29], Colgate’s 30” [Citation30], the Phoenix-10 at Fairborn Observatory in 1983 built by Boyd, Genet and Hall [Citation31], the Carlsberg Meridian Telescope which began operation in 1984 [Citation32], the 0.8 m Berkeley Automatic Imaging Telescopes [Citation33] and the 30” Leuschner Observatory Telescopes [Citation34]. These telescopes were largely focused on scientific research.

The RAAP [Citation35,Citation36], constructed as an undergraduate project between 1989 and 1992, used a 14” telescope with digital camera, on the roof of the UC Santa Barbara physics department which could be remotely driven. Teachers and students could access an image database, communicate and send observing requests to the telescopes by connecting to a bulletin board system via modem. Image Processing was undertaken through the custom-built software, IMAGINE-32 [Citation15].

The first research-grade instrument to be offered for educational use was the 24” telescopes at Mt Wilson, CA through the TIE project [Citation13]. This project began in 1993 with students being able to speak to an operator while controlling the telescope. Smith [Citation37] describes a London high school’s experience with TIE. Early experiences pre-internet involved direct dialling twice (once for voice, once for data) to the telescope which led to substantial cost in telephone calling charges. The tangible nature of hearing the telescope tracking added to the experience. The image itself would take 5–10 min to download.

During a similar time period, the BRT [Citation10], as shown in Figure , was developed. The telescope control computers were attached to the internet via phone line and were sent a crude list of targets for the night, which one of the computers fine-tuned. While the instrument was initially built as an engineering experiment, the demand from the education sector was quite significant and surprising. The original telescope ran up until 1998 when a lightning strike decimated the electronics of the telescope. The telescope was insured and eventually replaced, the replacement runs until this day as part of an astronomical facility on Mount Teide, Tenerife with operations taken over by The Open University in 2016. It provides time for free for education uses and runs a low cost service for amateur astronomers.

Figure 4. An image of the BRT, now the Autonomous Robotic Telescope, at its site on Teide, Tenerife. Source: Image credit: Gordon Chesterman, GC Media Tenerife.

Figure 4. An image of the BRT, now the Autonomous Robotic Telescope, at its site on Teide, Tenerife. Source: Image credit: Gordon Chesterman, GC Media Tenerife.

HoU [Citation12] was an early project beginning in the 1990s which did not necessarily centre around a particular telescope but rather tried to create a network of telescopes for participating teachers and students to use, as well as providing teacher training, materials and software [Citation38]. The Yerkes 24” was roboticised and used for HoU, as were the 30” automated telescope at Leuschner Observatory [Citation11], the (then) 17.5” NF/Observatory in New Mexico ([Citation39]) and a variety of telescopes in Japan, France and the USA ([Citation40]). Currently HoU functions underneath the larger umbrella of Global HoU. A related collaborative project of institutions based in Europe (EU-HOU, [Citation41]) also operates as part of the Global-HoU. Early projects involving deeper scientific investigations included Asteroid Search [Citation42] and Supernovae research [Citation43] with more recent projects looking at transits and binaries [Citation44].

MicroObservatory is a set of five 6” telescopes (see Figure (L)) that are located at Harvard College Observatory and the Whipple Observatory in New Mexico [Citation23]. People can submit targets from a pre-defined list to be observed and are notified via email when the telescope has observed the object and downloaded the image. The MicroObservatory telescopes are still available for use today through ‘Observing with NASA’.

The Charles Sturt University Remote Telescope Project [Citation45] began in 1999 in Bathurst, Australia. It originally focused on providing remote access to a 12” telescope (see Figure (R)) to primary school students in other timezones. This was quickly expanded to include middle and high school students [Citation46] through the usage of the Journey Through Space and Time materials [Citation47,Citation48]. Direct control of the telescope was achieved by students through the use of a Remote Desktop Protocol with an in-person presenter available for mentoring at all times. This project continues today as the OSS Remote Telescope Project utilising the same telescope as well as the SkyTitan telescopes in Wyoming and Texas.

Figure 5. On the left (L) is one of the 6” MicroObservatory telescopes. On the right (R) is the 12” telescope of the Charles Sturt University Remote Telescope Project. Source: Left: Image credit: Mary Dussault, MicroObservatory.

Figure 5. On the left (L) is one of the 6” MicroObservatory telescopes. On the right (R) is the 12” telescope of the Charles Sturt University Remote Telescope Project. Source: Left: Image credit: Mary Dussault, MicroObservatory.

The Global Network of Astronomical Telescopes was an early attempt at a larger distributed telescope network beginning in the early-mid 1990s [Citation49]. Telescope time and access was provided by membership and education was a prominent part of its mission [Citation50]. The network was still hard at work in the R&D phase in the mid-2000s [Citation51] and it seems to have been little active since 2009.

3. Current providers of telescope time

There have been a large variety of other attempts at small to medium size telescope networks. Quite a significant fraction of these networks do not reach stability over 3+ year timescales. Many of the endeavours mentioned in a 2010 survey [Citation52] of internet accessible telescopes are now, just over five years later, defunct or with uncertain status. Hence, our list is limited to those larger institutions who have shown relative stability, are currently functioning and provide time explicitly for education. We will also not discuss the education programmes of observatories which have education and outreach programmes which do not involve capturing data from their telescopes (e.g. Herschel Space Observatory, European Southern Observatory). Our list is intended to demonstrate the variety of programmes and resources which are available, and not to provide a complete list of all available programmes (see [Citation53] for a more complete list). Inevitably our sample also has a bias predominantly towards English-language projects, as there are practical limits to how far investigate language specific programs, which we acknowledge.

The Liverpool Telescope [Citation27] is a 2 m class telescope owned and operated by Liverpool John Moores University on La Palma. Five per cent of the time available on this telescope goes to UK schools through the National Schools Observatory [Citation54]. The Liverpool Telescope has two sister telescopes, the 2 m class telescope Faulkes Telescopes situated in Siding Spring Observatory in Australia and on Haleakala, Hawaii (Figure ). All three of these telescopes were designed and built by Telescope Technologies Ltd. (now a subsidiary of LCO).

Figure 6. The 2-m class telescopes.

Notes: On the Left (L) is the 2-m Faulkes Telescope South clamshell dome with two 1-m domes, owned by LCO. On the right (R) is the 2-m Liverpool Telescope clamshell opened to show the telescope itself. The Liverpool and Faulkes telescopes are very similar in original construction and design.
Figure 6. The 2-m class telescopes.

LCO [Citation55] is a global, homogeneous network currently consisting of the twin 2-m Faulkes telescopes, nine 1-m telescopes and seven 0.4 m telescopes situated at various locations (see Figure ) around the world (McDonald Observatory, Siding Spring, Cerro Tololo, Tenerife, South African Astronomical Observatory, and soon expanding to Ali Observatory in Tibet and Wise Observatory in Israel). Educational access to LCO is through a collaboration with different education partners around the world, each of whom manage their own education programmes using the LCO network. As well as being a service provider, LCO support a small number of informal education projects mirroring their research interests in time-domain astronomy.

Figure 7. Current observatory locations for the 18 telescopes in the LCO global telescope network.

Figure 7. Current observatory locations for the 18 telescopes in the LCO global telescope network.

SkyNet is a network of telescopes initially set up to observe gamma-ray bursts as six 16” PROMPT telescopes in Chile (see Figure ) in 2004 [Citation56] with four 17” PROMPT telescopes set up in Siding Spring Observatory in 2013 as well as a 24-inch ‘Morehead Telescope’ based on their home campus. They also provide access to a 20 m radio dish and a variety of telescopes owned by other institutions, such as the 24” Yerkes or the GORT telescope at Sonoma State University [Citation57]. SkyNet is also utilised in the Global Telescope Network (GTN) project [Citation58].

Figure 8. The Chilean site of SkyNet showing the six 16” PROMPT telescopes. Source: Image credit: by Oscar Saa.

Figure 8. The Chilean site of SkyNet showing the six 16” PROMPT telescopes. Source: Image credit: by Oscar Saa.

iTelescope.net (see Figure ) provides access to 19 robotic telescopes ranging from fairly small apertures up to 1 m apertures in New Mexico, Spain, Australia and California for a paying membership. This value changes with the quality of the night (e.g. a lower rate applies when the moon is present).

The Sierra Stars Observatory Network [Citation59] is a network of three roughly half-meter telescopes located in California, Arizona and New South Wales. They are designed to provide telescope time for education and research projects for a fee per hour. Further telescopes are intended to be added to the network over time [Citation60].

Figure 9. The wide range of small to medium aperture instruments available through iTelescope. Source: Image Credit: Peter Lake, iTelescope.

Note: This is from their Siding Spring Observatory site.
Figure 9. The wide range of small to medium aperture instruments available through iTelescope. Source: Image Credit: Peter Lake, iTelescope.

SLOOH is a commercial network of ground-based telescopes in three locations, Teide, Chile and Australia. It was the first system that allowed users to observe night-sky objects in near real-time as a public outreach facility as well as providing more traditional robotic telescope access [Citation61].

The American Association of Variable Star Observers (AAVSO) runs a network called aavsonet [Citation62] of ACP scheduled telescopes that accept proposals from their membership. It contains the two telescopes involved in APASS ([Citation63]) as well as four roughly half-meter telescopes and five small aperture telescopes for bright star use. These are located at various locations in SW USA, New Zealand and Chile.

MONET is a pair of 1.2 m telescopes operated by the Georg-August-Univesitat Gottingen [Citation64]. One is located at McDonald Observatory and one at the South African Astronomical Observatory. While the telescopes have been around for a decade, they have been plagued by continuing technical issues but have had some success in providing time to student researchers.

Western Australia has two publicly accessible telescopes, the 1 m Zadko Telescope [Citation65] which aims to provide time for student asteroid and supernovae searches and a pair of telescopes (35 and 43 cm), called the ‘SPIRIT’ telescopes hosted through ICRAR [Citation66] for general student use. Also in WA, there is a node of the Falcon Telescope Network, a currently growing network of 50-cm telescopes over 12 sites created by the US Airforce to track satellite and space debris positions. Some of the time available on the network will be provided to education users.

While most robotic telescopes deal with optical observations, there are also robotic radio telescopes available for use by education users. While radio observations lack the obvious aesthetic appeal of a crisp optical image, there are opportunities for students to undertake valuable scientific investigation using these telescopes. The Pulse@Parkes [Citation67] project uses the Parkes Radio Telescope in Parkes, NSW, Australia to directly observe pulsars with various school groups over the course of days and years. A similar project, without the direct control element, is the Pulsar Search Collaboratory [Citation68].

Small single-dish radio telescopes can be utilised for a variety of astronomical studies, such as brown dwarf variability, masers, gamma ray bursts, surveys and pulsars as well as a number of educational purposes [Citation69] The typical educational radio telescopes, such as the MIT Haystack design [Citation70], consists of an antenna a few metres in diameter tuned to the 21-cm line. The Haystack 37-m telescope was also available for education users via remote control at 22 and 43-Ghz.

The Pisgah Astronomical Research Institute has a 4.6 m radio telescope (called ‘Smiley’) which offers remote usage through its School of Galactic Radio Astronomy. Skynet has a radio 20 m dish at the National Radio Astronomy Observatory (NRAO) Green Bank site. The OpenScience Laboratory has a Radio Telescope called ARROW: ‘A Robotic Radio-telescope Over the Web’ available to use 21 cm observations to map the spiral structure of the Milky Way. European Hands-on Universe (EU-HoU) also has a variety of antennas intended to be used in schools distributed across Europe.

4. Current education projects

There are a diversity of programmes involving robotic telescopes, run by and with educational establishments across the globe. These programmes engage audiences from primary and pre-school level, through to university level courses and life-long learning. There are also a variety of uses in citizen science and public outreach. There are two broad uses of robotic telescopes for education in the various contexts, either engagement through simple astronomical imagery or providing access to collect research grade data, either astrometry, photometry or spectroscopy.

Colour Imaging is often used as a gateway into astronomy education using robotic telescopes. It has sufficient visual beauty to capture the attention of non-scientists [Citation71] while still using authentic tools, such as FITS Liberator and image processing packages such as GIMP or Photoshop [Citation72], to work with relatively raw data. Very powerful visualisation tools and techniques can be used to present and interpret astronomical imagery beyond a simple colour image [Citation73] which can lead to a deep, engaging, emotional response on the part of the viewer [Citation74].

While this is likely the case, and colour imaging is the core of many optical robotic telescope education projects, there has not been a great deal of research on the efficacy, in terms of knowledge gain or engagement, on the student. It is a commonly held belief that colour imaging has merit amongst most projects and groups and, while unlikely to be shown dramatically false, this assertion still needs to be validated.

Other activities generally include more scientific uses of the instrumentation, whether astrometric, photometric or spectroscopic. The variety of these approaches is nearly as varied as the number of approaches in typical mainstream astronomy, albeit with a generally more limited timescale and scope. The following sections outline approaches taken in the three broad domains in which robotic telescopes are used, Formal School Education, Undergraduate Education and Outreach & Public Engagement.

4.1. Formal K-12 school education

There are many reasons for including astronomy in the school curriculum, many of which were outlined by Percy [Citation75]. Some graduates will not have studied science beyond the upper high school level and this is typically the last moment the entire student body can be engaged, although the exact educational level varies from nation to nation. One of the major difficulties in providing experience to students at high school level is trying to fit an intentionally beneficial experience into the actual curriculum and syllabus. This becomes even more problematic when there is a mismatch between the intended spirit and wording of the curriculum, and the final curriculum documentation [Citation76].

Interaction with telescopes particularly helps to provide a different interpretation of the ‘scientific method’ involving observation, simulation and theory, than the typical experimental textbook approach commonly provided, and can provide a basis to improve an otherwise uninspiring school experience [Citation77]. Robotic telescopes also provide strong links with other sciences, particularly physics, utilising concepts to do with light, gravity and instrumentation. Providing students with access to a means of looking at the size and age of objects in the Universe provides a less abstract/theoretical basis for studying time, distance and size scales. The general understanding of astronomy when students begin higher level (e.g. high-school, undergraduate) courses is generally fairly low [Citation78,Citation79]. Students, at any level, typically also have very minimal knowledge of the night sky in terms of constellations and major stars [Citation80], and limited practical knowledge of what cannot be seen with the naked eye.

The ‘Build the Telescope and they will learn’ approach [Citation81] is common throughout the literature involving formal school use of robotic telescopes. There is much literature on how such telescopes will change science education but only a small amount (in comparison) has been reported about actual changes. It is not much of a leap to imagine that bringing such a new and alien technology into the everyday classroom is a significantly more complex and intimidating process than was originally imagined.

The last two decades have shown considerable success in terms of technical capacity but not in producing and supporting widespread inquiry-based astronomy education in formal education as was the usual intention [Citation53]. It has been noted in various publications (e.g. [Citation81Citation83]) that there has been a significant lack of deep research and understanding of how to translate this technology into the classroom.

4.1.1. Some examples of formal school projects

The BRT, currently in transition of ownership to the Open University, focuses on primary school levels providing access to its three cameras, which can be used to look at entire constellations (40), relatively large objects (4) and more deep sky objects (1/3). Teachers and their students autonomously control the BRT after a period of training, both through teacher workshops and in-school workshops. Then the teacher assumes the role of mentor to undertake astronomical investigations with their class. It was found that engaging primary school teachers in using the telescopes pushed the teachers to learn more about astronomy [Citation84]. BRT have claimed to have found a 30% jump in applications in the STEM-based subjects from 50 schools that fed Bradford University compared to the 80 who did not [Citation85] .

The original MicroObservatory telescopes [Citation26] continue to be operational, providing images (cumulatively totalling in the millions) via autonomous control. This enables students to undertake many simple investigations on astronomical images, the most popular being the Moon. A new approach to using MicroObservatory is being trialled called ‘Laboratory for the study of exoplanets’ [Citation86] (see Figure ). This involves students observing known predictable planetary transits and undertaking photometry and modelling to estimate the size of the planet.

Figure 10. A screenshot from the current MicroObservatory online exoplanet educational project.

Figure 10. A screenshot from the current MicroObservatory online exoplanet educational project.

The Faulkes Telescope Project (FTP) is a major education partner of LCO network. It provides access, education and support to education users in the UK and beyond using the LCO network. It was initially started by Dr Martin Faulkes who provided £10 m initial capital to create two 2-m class telescopes available to schoolchildren in the UK under the slogan ‘Real time, real science, real scientists’ [Citation87]. FTP has continued as an official education partner of LCO, now that the Faulkes Telescope North and South are owned and operated as part of the LCO network. Previously they provided remote control of the 2-m from the UK classrooms over the internet [Citation88], although some participants could participate in more extended research projects via autonomous control [Citation89]. Now the telescopes are accessed primarily under autonomous control, through network wide autonomous scheduling, to provide access to high-quality imagery as well as data for a variety of research projects including variable stars, open clusters [Citation90], a variety of related education programmes [Citation91] as well as recently, Gaia transient follow-up observations. Figure shows examples of students and teacher participants in a supernovae-based school project.

Figure 11. High School students and their teacher interact with LCO telescopes and analyse supernovae data through the Faulkes Telescope Project. Source: Image Credit: Faulkes Telescope Project.

Figure 11. High School students and their teacher interact with LCO telescopes and analyse supernovae data through the Faulkes Telescope Project. Source: Image Credit: Faulkes Telescope Project.

The International Astronomical Search Collaboration (IASC) is an educational project that provides pre-observed data from a variety of robotic telescopes around the world to students in their classrooms (see Figure ) to search for moving objects, primarily asteroids [Citation92]. Over 25 main belt asteroids have been discovered by students and thousands of measurements have been submitted to the Minor Planet Center.

Figure 12. An example of a class who participated in the IASC All-India Asteroid Search Campaign in 2016. Source: Image Credit: Patrick Miller, IASC.

Figure 12. An example of a class who participated in the IASC All-India Asteroid Search Campaign in 2016. Source: Image Credit: Patrick Miller, IASC.

Our Solar Siblings (OSS) is a project based in Australia focused at bringing telescope access into the high school classroom to model authentic research. It focuses on the Year 10 Australian Curriculum, the final stage where science is a mandatory subject and where students are expected to learn about the components of the Universe and the Big Bang. Interested Students can then undertake their own authentic research-grade independent research projects, usually on RR Lyraes or Open Clusters (see Figure ), mentored by project staff and professional astronomers. Early versions of the curriculum materials and general approach were also utilised by an earlier project primarily using the LCO 2-m telescopes [Citation93].

Figure 13. An example of a student constructed image of an open cluster and its colour-magnitude diagram from the Our Solar Siblings project.

Figure 13. An example of a student constructed image of an open cluster and its colour-magnitude diagram from the Our Solar Siblings project.

A variety of different projects in Hawai’i have utilised robotic telescopes for student research. From 1999 to 2004, the NSF funded a teacher enhancement workshop called ‘Towards Other Planetary Systems’ [Citation94] which reached 75 teachers over the five years, one-third of them returning for future workshops. Faulkes Telescope North, situated on Maui and operated by LCO beginning in 2005, continues to be used in a variety of contexts involving students and teachers (see Figure ) with both amateur and professional astronomers [Citation95]. The HISTAR programme, running since 2007, has provided students with astrometry and photometry skills to undertake authentic science projects using FTN, as well as a number of smaller robotic telescopes, to be presented at state fairs.

Figure 14. An instructor with students participating in the HISTAR programme in Hawaii. Source: Image Credit: JD Armstrong, University of Hawai’i.

Figure 14. An instructor with students participating in the HISTAR programme in Hawaii. Source: Image Credit: JD Armstrong, University of Hawai’i.

Project OBSERVE was a 5-year project (now completed) organised using the SkyNet telescopes with high schools (75 teachers, 5000 students) in the local area around the University of North Carolina. There are also programmes, such as Astronomy Live! run through UCLA or the long-running Summer Science Programme, that take high school students on workshops using robotic telescopes over the summer break.

LCO, runs its various formal education programme internationally largely by providing time for official education partners to use, such as FTP and OSS above, as well as the Institute for Astronomy at the University of Hawaii, Universe Awareness from the Netherlands, Universe in the Classroom in Wales, McDonald Observatory in Texas and Astronomers without Borders. This model differs from others because it places LCO as a service provider (of telescope data) and the education partners as the content deliverers.

4.2. Undergraduate education

In the United States, rough estimates are that 10% of all undergraduate students will take an introductory astronomy course typically to meet a general education requirement in their undergraduate degrees [Citation96]. In this particular country, this is a very significant proportion of the general population that would be touched by introductory astronomy, typically the last formal science these students will undertake [Citation97]. In other countries with differing tertiary education systems, this is typically not the case. For instance, in Australia, only a few thousand of the nation’s 1.5 m undergraduate students will undertake an introductory astronomy subject [Citation98].

While interest in using remote-control telescopes at the non-science major, high enrolment, ‘astro101’ subjects is large, where the telescopes would fit into such a subject is unclear and would require appropriate classroom-proven curriculum materials that are easy to implement [Citation99]. Usage of robotic telescopes in such undergraduate courses is very uncommon. The problem of how robotic telescopes with finite telescope time provision could be used in classes with enrolments in the hundreds or thousands, such as a typical astro101 course, has not, as yet, been solved. An exception to this is SkyNet, which through its host institution runs a variety of undergraduate programmes using the SkyNet telescopes to explore undergraduate content at an astro101 level.

Nevertheless, providing robotic telescope usage for undergraduates in non-astro101 contexts can provide a rich authentic experience. It can encourage creativity and discovery just at that point of their education career where the content can start to become quite dry and overwhelming [Citation33]. For those students who continue their astronomy careers throughout undergraduate, the robotic telescope provides an important exposure to telescopes, providing insight to observational data that may be taken at face value otherwise [Citation100] and also potentially to increase their interest in a postgraduate science career [Citation101].

In contrast to the high school projects and the major telescope institutions that serve them, undergraduate institutions have a much greater resource pool. This can sometimes lead to the existence of their own, more or less stable, remotely controlled observatory that they can use in their teaching programmes [Citation102]. These smaller facilities also allow exploration of more speculative or lower expected impact research programmes (e.g. [Citation103Citation105]). While it is likely that their, generally institution-bound, locations are do not provide high quality observatory sites, it does provide capacity for students to directly see the engineering and instrumentation side of telescopes.

Those students who may be continuing on towards higher level courses or even a scientific career may want to dig a little deeper into astronomical research during their undergraduate experience. Amongst the most notable and long-term series of undergraduate student research programmes is Percy’s work through the University of Toronto Research Opportunity programmes over many decades outlined in Percy [Citation106] with many examples of student publications over the years.

Beaky [Citation107] outlines a few broad principles for undergraduate astronomy research. These include that (1) the research must be sustainable, in the sense that accumulated experience is passed from one student to another before graduation, (2) that the technology must be reliable and relatively easy to use, (3) that the research must be designed to lead to publishable outcomes if it is to be truly called ‘research’ even if it does not succeed in publication and (4) that the undergraduate research needs to be integrated into the curriculum.

There are many examples of programmes within which single university-driven robotic telescopes can, and have, been utilised in an undergraduate context. A good example of this is the ‘Physics Innovations Robotic Astronomical Telescope Explorer’ or PIRATE [Citation108] which is a 17” telescope (see Figure ) run by the Open University. The original intention was to provide a hands-on experience to groups of 2–4 distance education students who collaborate via the internet remotely through the institution with limited remote supervision [Citation109,Citation110]. Targets selected by third-year observing groups largely involve periodic variables [Citation111], sometimes leading to scientific papers in the pro-am journal, Journal of the British Astronomical Association (JBAA) [Citation112,Citation113]. Second year students generally create colour magnitude diagrams of open clusters.

Figure 15. The 17” PIRATE Telescope run through The Open University, while located in Mallorca before moving to Tenerife in 2016. Source: Image Credit: Ulrich Kolb, The Open University.

Figure 15. The 17” PIRATE Telescope run through The Open University, while located in Mallorca before moving to Tenerife in 2016. Source: Image Credit: Ulrich Kolb, The Open University.

Another example is the work done through a variety of institutions including the Boyce Research Initiatives & Education Foundation, Concordia University in Irvine, Cuesta Community College, California Polytechnic University in San Luis Obispo and the Institute for Student Astronomical Research [Citation114]. These are one semester astronomical seminars at community colleges and undergraduate which also include high school students looking for future course credit. The topic is generally double star observations [Citation115] but has also included cepheids, asteroids and exoplanets. The goal of the seminar is for students to create a peer reviewed published article for the amateur/pro-am literature.

Other examples include the Keck Northeast Astronomy Consortium [Citation116] which has been running for nearly three decades providing astronomical research to eight small liberal arts colleges and universities in NE USA. The 0.51 m Iowa Robotic Observatory at Winer Observatory utilises their telescope in introductory, major-level and upper-level courses. A variety of projects are undertaken, for example, asteroid lightcurves [Citation117] and a search for exoplanets around white dwarves. The 20” Northwest Indiana Robotic Telescope provides time for undergraduate research and education at Purdue University, Calumet. Monitoring of exoplanets, blue stragglers in open clusters, quasar variability and asteroids are some topics that are explored.

There are other organisations that are not specifically astronomy which also provide some scope for student astronomical research with robotic telescopes. Two examples are Research Experiences for Undergraduates which provide research experience with projects run through the National Science Foundation or the Council of Undergraduate Research which has a number of projects and approaches to promote undergraduate student research. These two are examples from the United States, but there are likely similar national programmes in many other countries.

4.3. Outreach and public engagement

While formal astronomy education takes place within classrooms, there are many other places, such as planetaria, museums, astronomy groups, newspapers, television, radio, the internet, books, magazines, youth groups on hikes [Citation118] where informal astronomy education can take place. It is part of the ‘astronomers burden’ [Citation102] that astronomy is highly visible, compared to subjects like chemistry or pure mathematics, and of inherent interest to the public. The likelihood of students being interested in pursuing astronomy beyond high school is significantly correlated to their participation in these extracurricular astronomy or space science activities, such as observing stars or reading/watching science fiction [Citation119]. All outreach and engagement projects can have a lasting impact if they are also accompanied by educational resources and a dissemination plan.

By comparing the situation to that of a successful school sports league, Gelderman [Citation19] argues we need to provide out-of-school time astronomy students (1) open and easy entry level recreational opportunities, (2) a series of challenging activities with steadily increasing challenge and reward, (3) high-level competitive experiences in an astronomy club to help drive further participation in extracurricular astronomy. This can model similar approaches to those listed in the Formal Education or Undergraduate sections but to greater depth. SkyNet Junior Scholars, a good example of this approach, is run primarily for non-formal education such as youth clubs, after school programs, museums and camps. Professional learning about using the SkyNet telescopes is required for these group leaders who can guide youth explorations using the telescopes.

The field of public outreach and engagement using robotic telescopes employing a more direct interaction between robotic telescopes and the general public is less well developed. There have been some attempts at providing museum portal access to optical telescopes. The HoU project gained funding to attempt a museum exhibit to allow visitors to control two remote telescopes [Citation120]. SkyNet has also provided in the past a web-based museum portal where visitors can request an image that is taken later by the network and sent to their email address. There are many undocumented examples of robotic telescope groups introducing informal audiences at exhibitions and festivals, and the perception by the public is highly dependent on the individuals performing the demonstrations.

The telescopes provided by SLOOH and GLORIA [Citation61] have been used to live stream astronomical events, notably the 2012 Solar Eclipse, viewed through one of their remote telescopes to a wider non-specialist audience. These provide excellent opportunities for outreach as the phenomena themselves gain significant media attention in their own right.

During International Year of Astronomy 2009, European Southern Observatory hosted an ambitious event, ‘Around the World in 80 Telescopes’ [Citation121]. During a continuous, 24 h webcast, hosted by a team of 6 presenters in ESO headquarters in Garching, Germany, the audience were shown live video feeds from telescopes from across the globe. While all of the telescopes involved were robotic, the majority of them were remote controlled from the same site, with the video feeds coming from the control rooms. This event attracted an audience of 156,000 viewers over the 24 h period, with a maximum of 3600 simultaneous viewers. Although this audience did not play an active part in the outreach, it still had a large reach and hopefully a significant impact.

Twitter has been used by many different groups and individuals for astronomy outreach, virtually from its beginning. The idea of telescopes (and other scientific robots, such as Mars Curiosity rover and Planck Satellite) broadcasting their positions, targets and even developing ‘personalities’ was hugely appealing to the general public [Citation122]. Some even chose Twitter above more traditional media outlets to broadcast their status and discoveries, such as ESA Rosetta’s ‘Hello World’ Tweet, announcing it had successfully awoken from hibernation. The idea of using Twitter and robotic telescopes for outreach was taken further by LCO, where in 2011 they partnered with Irish comedian Dara Ó Briain, who live tweeted images and commentary from an observing session on one of their 2-m telescope, to his 2 m followers [Citation123], in an event called #ShowMeStars.

LCO Asteroid Tracker is a recent attempt to get the public to trigger their own observations of an asteroid which is be added to a data-set for analysis and a later video for exploration by the public with an attached story about the particular object. For the non-astronomically inclined this type of activity can be a meaningful contribution with an engaging story and requiring minimal technical knowledge.

5. Authentic astronomical research produced by education and citizen science users

While the cutting edge of extragalactic astronomy at large redshifts is dominated by the extremely large (8 m+) telescopes, there is much research that can be undertaken with smaller telescopes. There is some debate to the relative worth of small and large aperture telescopes with different studies coming to different conclusions from different metrics [Citation124] such as number of publications and citations [Citation125]. There is some research that is more suited to small-size (0.5–1 m) and middle-sized telescopes (1–3 m), in particular topics such as stellar variability, Gamma Ray Bursts, Near-Earth Objects, Supernovae and exoplanets [Citation17].

It is also noted that many recent major scientific studies, such as 2MASS or SDSS, have been undertaken on modest sized telescopes [Citation126]. The contribution non-professionals can make to astronomical research evolves over time as technology and techniques change. As most astronomers move to investment in larger aperture, highly competitive, instrumentation at the expense of smaller instruments and, as telescopes of modest aperture become increasingly available at a lower cost, pro-am organisations and individuals can step into contribute to the scientific endeavour [Citation127].

5.1. Citizen science

In astronomy the term Citizen Science is often used synonymously with the multi-project Zooniverse [Citation128], typified by the original project in this suite, Galaxy Zoo [Citation129]. Although the majority of Zooniverse projects use large, pre-existing data-sets in the field of astronomy there have been a few which were responsive to new data acquired by robotic telescopes. The projects, Supernova Zoo and Asteroid Zoo received data at regular intervals from Palomar Transient Factory and Catalina Sky Survey (respectively). While providing useful classification statistics, the interesting aspect of these projects is that the robotic telescope data was being used for a dual purpose of training a computer learning algorithm. The ultimate aim of the project was not to achieve a specified number of classifications but to eventually train the algorithm to accurately detect transient objects, eventually rendering the human interaction unnecessary.

While Zooniverse projects tap into and feed the motivations of the public to contribute to science and inspired some to dig deeper or to begin postgraduate research [Citation130Citation132], it is for the most part citizens volunteering to be basic interpreters of images rather than being more participatory in the larger process. Their methodology is to provide a large data-set to an audience without specialist skills and use the human brain’s innate ability to recognise patterns to produce a statistically significant classification of the data.

The authors of this paper note that the Zooniverse approach is not the definitive citizen science method. We broaden the definition saying that citizen science should be an activity through which the participants will grow their skills and knowledge of the science area by being involved in the citizen science project. This inevitably requires more education and thus blurs the line between what is considered education, citizen science, and authentic research. The education involved can be simple and built into the interface used for the analysis of the data.

Citizen Sky was a large project run by the AAVSO on epsilon Aurigae as a focused project for the International Year of Astronomy [Citation133]. The goal was to discover the cause of this binary’s eclipse. At the end of the project it was theorised to be an F-type star creating a disk shrouding another comparable mass star or star/s in the system [Citation134]. Typically most observations were in the V-band made by 26 observers around the world using a variety of tools, telescopes and techniques [Citation135]. These were largely with equipment owned by the observers, but is a good example of a potential collaborative project accessible to the public that could utilise the robotic telescopes coming on-board now. Projects, like IASC and Citizen Sky, that include active robotic telescope use require providing a different framework for the public to incorporate their original observations and deeper analysis.

5.2. Authentic research

Authentic astronomical research utilising high grade instrumentation can engage gifted or motivated students who otherwise may not be enthused by their typical everyday science lessons to consider the option of a potential STEM career [Citation136]. Many of these student research projects can be undertaken in the context of national schemes or competitions, extra-curricular astronomy and science clubs or external mentoring by a professional astronomer [Citation137]. For those undertaking authentic research projects, students who undertake research in high school are more likely to be employed in a science-related career than those whose first research is in undergraduate [Citation138].

Particularly in the United States, there are science fairs at district, state and national scales which have also provided an avenue for communication of science by students, although the historical observational non-experimental nature of astronomy can be an impediment in this context [Citation20]. Variable Stars, in particular, have been a popular topic for student research projects due to the relative simplicity of the measurements compared to other more abstract fields of research [Citation139].

Many projects over the last two decades have claimed that authentic, original research on behalf of the students have been a core motivation in their projects but not as much progress or success as was hoped occurred on this front [Citation53]. Part of this challenge is that the balance between authenticity, challenge and time within the curriculum is hard to achieve.

Despite this, some research that is undertaken within these projects can reach the level of publication in mainstream and pro-amateur scientific journals. While not intending to be an exhaustive list, we present a sample of some of the students who have published in astronomy journals involving use of remote telescopes in an educational context. We recognise that this sample will likely be biased to those publications in larger projects from a primarily English speaking background.

Two students at Oil City High School in Pennsylvania participating in the Hands-On-Universe project were involved in the observations of SN 1994I in M51 [Citation43,Citation140]. Students at Northfield Mount Hermon School, Massachusetts discovered the 72nd Kuiper Belt Object 1998FS144 [Citation141] with confirmation by students also from Oil City High School.

The MONET project produced a variety of papers with German Gymnasiums involving cataclysmic variables [Citation142,Citation143] and binary stars [Citation144]. Students involved with the Space To Grow project [Citation93] produced papers on a planetary nebula [Citation145], RR Lyraes [Citation146] (see Figure (R)) and on a neglected open cluster [Citation147]. Through the NITARP project (see Figure (L)), students were involved with observations of the Witch Head Nebula [Citation148], cataclysmic variables [Citation149], accretion discs [Citation150] and young stellar candidates [Citation151].

Figure 16. On the left (L), members of NITARP presenting their poster at the January 2017 AAS meeting. On the right (R), high school students present their results from their use of the LCO 2-m telescopes in the Space to Grow programme. Source: Left: Image Credit: Luisa Rebull, NITARP.

Figure 16. On the left (L), members of NITARP presenting their poster at the January 2017 AAS meeting. On the right (R), high school students present their results from their use of the LCO 2-m telescopes in the Space to Grow programme. Source: Left: Image Credit: Luisa Rebull, NITARP.

Some student research has ended up in the amateur literature, recording scientifically useful measurements and discoveries that may not warrant a full publication in the mainstream professional astronomy literature. The journal of the American Association of Variable Star Observers (jAAVSO) has published numerous articles based on the work of students, both undergraduate and high school, on variable stars over the years (e.g. [Citation106,Citation152]). Potential other places to consider for future publication of variable star related results include the professional Informational Bulletin on Variable Stars (IBVS).

Contributions of asteroid measurements to the Minor Planet Center by students are relatively common with many of these provided by the IASC project [Citation92]. The Minor Planet Bulletin contains much pro-am research surrounding asteroids, in particular asteroid rotation lightcurves. More generally the Society for the Astronomical Sciences publishes a yearly proceedings that includes astronomical results. The JBAA also publishes amateur/pro-am papers. The Research Based Science Education journal ran through the NOAO from 1999 to 2010 provided a place for scientific reviewed papers written by the high school teachers and students participating in that project. Results were from a variety of objects including Open Clusters, T Tauris, Variable Stars, Solar Observing, Galaxies and Nova.

A particularly accessible field to undergraduate students has been the field of Double Star Observations. A variety of publications has been published in the Journal of Double Star Observations [Citation153] which can lead to inclusion in the Observations Catalogue of the Washington Double Star Catalogue [Citation154] or the Circular of Commission 26 (Double and Multiple stars) of the IAU. Monitoring these stars provides measurements for future astronomers to estimate the masses and absolute positions from their orbital ellipses [Citation155].

For Undergraduates, there are a variety of specifically undergraduate focused journals, such as Reinvention, Journal of Undergraduate Research and Scholarly Excellence, the American Journal of Undergraduate Research and quite a number of journals sharing the name ‘The Journal of Undergraduate Research’. The various levels of astronomy journals are probably still a better choice for astronomical undergraduate research publication. The Council on Undergraduate Research also provides a significant amount of support for organising and driving undergraduate research programmes.

6. Challenges and opportunities

6.1. Quality of available supporting material for robotic telescope usage

Percy [Citation20] envisioned a robotic telescope farm facility, similar to the large networks available now, that had the potential to serve tens of thousands of students. He did stress that they need to be supported by a carefully-developed set of curriculum materials and approaches. This need for quality materials has also been expressed for other astronomy areas such as the Virtual Observatory [Citation156] and astronomy education in general [Citation157].

A typical student in an average classroom, while having seen spectacular images of the night sky perhaps on Google or on any form of media, tends not to have a great grasp of the types of objects out there in the universe. Placing a student in control of the telescope immediately without some support will not typically result in beneficial outcomes, they typically require some scaffolding [Citation81].

There is a large amount of material of widely variable quality available from a variety of projects and repositories. There is certainly a fairly strong case that there is a lot of reinventing the wheel occurring with a lot of overlap between the material for all of the different robotic telescope projects. There are numerous classroom sets and training manuals on variable stars, open clusters, asteroids and colour imaging amongst other topics available online. In the future, perhaps collaborative efforts can be made to take the best of what has been learned into a more centralised location for all robotic telescopes, perhaps through online repositories like NASA Wavelength [Citation158] or through online peer-reviewed repositories like astroEDU [Citation157].

6.2. Efficient use, reliability and scalability of telescope resources.

There are only a finite number of robotic telescopes in the world and many more teachers and even more students. Assuming an 8 h night, the absolute maximum a single telescope can provide is about 2100 h assuming 75% of the nights are available per year. Assuming a total exposure time per colour image for the full set, of 10 min on a 1-m telescope (for reasonable signal–noise ratio of an extended, deep sky source), and if the telescope was entirely dedicated to this usage, then 12,000 image sets could be collected per telescope per year. Assuming roughly 750,000 students in a single grade of high school in the United States. This would require around 60, 1-m class telescopes (or more of smaller aperture) fully dedicated to this usage so that each student could get one set of BVR images of their own at some point in their high school careers.

Just on these rough numbers, then about 1% of the necessary telescope time is available for such use. This is prior to including the vastly more lengthy exposure times for independent research projects to the tally. How are these limited robotic resources going to be distributed amongst this large set of users? Telescope time is a precious commodity, especially on research grade instrumentation.

Creative suggestions to overcome these time limitations early on included taking a single image per night, instead of taking a single image for every single request, and then distributing that single image to multiple users [Citation23]. This may be a good solution where ownership of the data is not core to the programme or for purely inspirational purposes, perhaps in a primary school or museum outreach context. It does, however, take away a large motivation of providing access to students for authentic research purposes. While this potentially maximises telescope time, it takes away from the sense of ownership that may be the most important part of imaging with such telescopes.

There is some concern that teachers and students will not trust that the images are actually their own rather than simply just images that were taken at a prior date [Citation159], this is a problem that can be overcome with remote real-time control telescopes where users can test this hypothesis directly [Citation160] although the current availability of such approaches is relatively small but growing.

6.3. Scalability of human resources

What may be more surprising is that the limitations preventing larger groups of users to collect their own images from telescopes is far from the technical one mentioned above. From formal and informal discussions with many education and technical projects, actual recruitment and retention of education users of robotic telescopes is known to be a very tricky, very drawn-out, process. A recruitment of a teacher in one year does not transform into an in-class user until at least the next year due to school planning cycles.

Designing efficient user-friendly portals to access the telescopes as well as scalable and enticing training, and using professional learning methods is far more important at this stage. Scalable large networks such as SkyNet, LCO, iTelescope and others, are now in the domain where providing more telescope time is largely a case of providing more money to the technical institution. Scalable educational support, training and retention needs are currently trailing significantly behind the scalability of the technical instrumentation. This is equally important where teachers facilitate learning, such as in self-directed or inquiry-based science education scenarios, were students direct their own learning.

For robotic telescope usage to really take off in the general teaching population, the robustness and reliability of the networks is the most important issue. For example, if a classroom teacher requests an image in a certain time-frame so that it is ready to present to a scheduled class then, barring weather and mechanical fault, that image needs to arrive in the requested time-frame. If it does not, the teacher is unlikely to utilise the robotic telescope in class again. The technical provision really does have to be bulletproof [Citation83].

6.4. Instructor barriers

Even early on, it was noted that there were significant issues with being able to match user needs and their interests to the growing availability of this technology and that robotic telescopes were not necessarily a good tool for educational good, just because they were new and available [Citation2]. Problems of user confidence in turning the classroom technology into an effective classroom tool saw some instructors struggling to provide it as an in-class tool, especially as it was not clear how to incorporate it. [Citation159]

Even those instructors who are identified as positively inclined or ‘alpha’ instructors, while being aware of online resources, rarely made common use of online data for authentic inquiry in the classroom. [Citation161]. These results suggested that instructors required training that translates research into classroom ideas and well designed data-driven inquiry products. Schools and universities typically also have limited resources and facilities that are not low monetary cost will likely not have a large uptake and that uptake will only be by those who can afford it, thereby largely negating the ‘equity of access’ benefit, as far as socioeconomic indicators are concerned.

There are a number of key barriers for instructors in the uptake of robotic telescopes [Citation162] and inquiry-based teaching [Citation163]. Primary school teachers largely have little to no astronomy background or even science at all and commonly hold just as many misconceptions as the students do [Citation46]. High school teachers are equally likely to have little astronomy background and, while generally required to have science as part of their undergraduate degrees in most countries, are usually biology or chemistry focussed with physics-related backgrounds being a much distant third (e.g. [Citation164]).

While it is easy to find those teachers who are already pre-disposed to astronomy, who probably already have a semi-amateur, amateur or even pro-amateur background, it is a very different story trying to recruit teachers for whom teaching astronomy and/or physics may be an uncomfortable period of time during their school year. This is a common problem with external science education programmes (in fact most innovations, e.g. [Citation165]) where early success is achieved with the early adopter populations but recruitment stalls when attempting to reach the less positively inclined majority population of instructors.

To deal with this, many more instructor concerns must be identified and addressed with the majority of instructors, not just those who are already very keen. These include, but are not limited to, the lack of preparation time available, the lack of high quality and easily accessible professional development, capacity to fail without repercussions, unrealistic expectations on behalf of project personnel, lack of administrative or supervisory support, a lack of available funds, impenetrable and unreliable information technology systems and the common mismatch between what is expected by the curriculum and what is asked by project personnel [Citation83].

Some approaches to dealing with instructors confidence is to provide authentic research experiences (e.g. [Citation166,Citation167]) to increase their understandings of the nature of science. Prior experience with research has been shown to have the strongest correlation to accurate knowledge of the nature of science and scientific inquiry on behalf of the instructor [Citation168].

6.5. Image and information technology issues for educational use

Images that come out of these robotic telescopes, if provided in authentic form, are generally Flexible Image Transport System ([Citation169]), or ‘FITS’, images. This is not a familiar file format to teachers or students. Most of the software developed to undertake authentic science grade manipulation of these files are written for the Linux operating system. In contrast, essentially all education users will be using Windows or Mac OS based operating systems. These users also will lack the command-line/terminal and editing skills necessary to drive a lot of this manipulation. SkyNet have attempted to overcome this issue by providing a web-access image reduction and analysis tool for their project called Afterglow run from a central server over the web. This is an approach also taken by Boyce Astro through the Boyce-Astro Research Computer.

Typically a raw image from the telescope needs to undergo a series of fairly standard image ‘reduction’ steps. The most fundamental of these are the bias, dark and flatfield subtraction. Thankfully, as these are heavily tied to the nature of the telescope and camera themselves, these steps are typically taken at the observatory before provision to the user.

While these basic reductions generally do take place, there are other image artefacts that need to be dealt with. Hot or cold pixels, column defects and cosmic rays need to be identified and removed. Unfortunately, there is no relatively user-friendly, accessible or free software that can remove these quickly and automatically. Fortunately, these issues can be very easily automated in Linux by the providers of the telescope access.

In recent years, placing the correct Right Ascension and Declination coordinates into the FITS file to accompany just the basic x, y pixel locations has become quite easy with the advent of astrometry.net software [Citation170]. This is another step than can easily be undertaken at the provider’s end.

For the most basic usages, such as examining the FITS file, stretching the image and making very simple measurements there are a variety of freely available software. FITS Liberator is the most useful piece of software for simple examination and advanced stretching in preparation for colour image processing. Subaru Makali’i Image Processor is a popular, very simple, very user-friendly Windows software that does basic stretching, blinking, photometry and astrometry.

SAOImage DS9 is a popular scientific viewer amongst professional astronomers which has native versions for Mac OS and Windows. The Windows version has not been updated since 2013. The original MicroObservatoryImage software is still available online, although it is a bit dated. SalsaJ [Citation171] was developed by and extensively used in the HoU and EU-HoU projects but as it is not under active development can suffer from software glitches as well as mildly inaccurate photometry results. It is based on the popular, cross-platform software, ImageJ [Citation172].

To undertake scientific grade astrometric, spectroscopic or photometric measurements, analysis should be undertaken with a professional grade tool. For astrometry, the most popular of these is Astrometrica which is shareware and has an extensive trial period. BdW Publishing’s Canopus is a mid-range option. For those who have monetary resources to expend, there are relatively high cost software packages such as DC-3 Pinpoint, TheSky/CCDSoft and Prism Pro that will undertake quality astrometric measurements.

For aperture photometry, the most robust freely available tool available is Aperture Photometry Tool. The interface can be daunting for first-time users, but it is heavily validated [Citation173,Citation174]) and has successfully been used in research that has been published in the mainstream and pro-am literature [Citation147,Citation151,Citation175,Citation177]. AstroImageJ [Citation178] is a more recently developed promising free software, like SalsaJ is based on ImageJ, which is capable of multi-object differential aperture photometry for high precision light-curves over a series of images.

The AAVSO provides access for members to an online aperture photometry tool called VPhot. C-Munipack is a very useful simple free tool for photometry and matching of multiple fits images for detecting new variable stars and constructing lightcurves. Canopus, a relatively low-cost application from BdW Publishing, has been used frequently for the study of asteroid lightcurves and other photometric measurements. For those with more resources, aperture photometry can also be undertaken with the commercial packages MaximDL, Mira Pro, TheSky/CCDSoft and Prism Pro.

Aperture photometry is relatively robust but is only acceptable for relatively bright stars which are far above the sky background level and for stars that are not embedded in a crowded field of stars or other objects, such as in nebulae, compact star clusters or along the galactic plane. To overcome these issues and measure faint and/or crowded fields, Point-Spread-Function photometry needs to be undertaken. All of the common trialed and tested methods that undertake this, such as DAOPhot [Citation179], DoPhot [Citation180] and PSFEx [Citation181] are Linux command line tools. These tools are all potentially automated and photometry could potentially be provided to the user along with the images.

For spectroscopy, there is STSci SpecView which allows examination of optical to infrared spectra with line-identifications and sample spectra. SPLAT-VO is also a very useful spectroscopy tool containing a lot of spectra examination, measurement and manipulation tools. RSpec is a commercial spectra software available for Windows.

A broader issue underpinning these software related issues is that a lot of the pro-am software is currently written by single authors and in a closed source environment. When the single author retires from astronomy software development, then the once-indispensible software is slowly rendered defunct as the requirements of operating systems change. This is perhaps the strongest argument in supporting open source collaboration for astronomy software projects, particularly for the pro-am and education audience.

Recent developments in web technology are on the brink of revolutionising image analysis, replacing analysis applications with analysis in web browsers. At present there are tools which would make this. A fully featured application on this is the AAVSO Vphot websiteFootnote1 (previously called ‘Photometrica’), which allows a range of photometric analysis to be performed on images inside a web browser. It is however, only available to AAVSO members. There have been several attempts at creating Javascript libraries for read FITS data (e.g. AstroView,Footnote2 jsFITS,Footnote3 fitsjsFootnote4). A present a limitation is the size of individual FITS files which need to be uploaded and rendered in a browser, and a coordinated approach to supporting and developing such a resource.

6.6. Lack of effective evaluation in the literature

Much of the modern research in the field of Astronomy Education Research has largely been focused on the improvement of non-science major ‘astro101’ undergraduate astronomy courses [Citation182]. Much evaluation has centred around the uses of concept inventories to probe student learning in large classes (e.g. [Citation183]) with more of a focus on broad knowledge rather than specific learning targets [Citation184Citation186] with less frequent studies of shifts in student motivation (e.g. [Citation187]) or student perceptions of the nature of science (e.g. [Citation188]).

Most robotic telescope education programmes do not appear to have published peer-reviewed evaluations of their approach in the academic literature. While there are some grey literature evaluations on the internet, these tend to be unreliable, suffer from methodological flaws or significant threats to validity and be non-peer reviewed. Furthermore, there typically are only short conference papers describing the project and approach, without further details. There are some exceptions, but lack of evaluation and/or reporting is rife. This makes it hard to appraise the effectiveness of either the field in general or individual projects by themselves. For those projects that do evaluate themselves, the evaluations are particularly heterogeneous and hence direct comparisons between each project cannot be made.

For those running education projects, there are a number of guides put out by various authors that can serve as a brief introduction. ‘Conducting astronomy education research: A primer’ by Bailey [Citation189] is a book aimed at astronomers turning to education research and evaluation for the first time. A similar guide with a more generic focus is ‘Discipline-Based Education Research: A scientist’s guide’ by Slater [Citation190]. A longer, more detailed guidebook, The around ’2010 User-Friendly Handbook for Project Evaluation’ [Citation191] is available for free from the NSF for those who may want to delve deeper. For those endeavouring to evaluate, it is highly recommended to find a mentor as some of the limitations, tripping hazards and complexities of this type of research are not immediately apparent to others coming from out of the field, and done well could be used for career appraisal [Citation192]. Making the transition from science to science education is not necessarily an easy one [Citation193].

One of the simplest direct evaluation techniques is the pre/post test with a concept knowledge questionnaire to see what students knew at the beginning and then be able to estimate what they learned throughout the process (e.g. [Citation187]) . A sample of the most relevant concept inventories to robotic telescopes is provided in Table . The results can also inform the instructor on what parts of the content the students are learning well or not learning from which the teaching approach can be adapted.

Table 1. Relevant concept inventories to robotic telescope projects.

Table 2. Relevant psychometric surveys to robotic telescope projects.

The pre/post test approach can give the appearance of rigour and accuracy as directly from the numbers, a gain [Citation199] can be estimated and a statistical significance calculated. This is comforting to astronomers whose common research experience is largely numerical, whether observational or theoretical. However, even if the gain achieved is great and statistical significance is powerful, it still only tells the evaluator that whatever happened between the pre and the post test seems to be correlated with successful learning as measured by a multiple choice test.

It is also possible to use pre/post tests to measure other constructs such as student attitude towards science or astronomy, their philosophical views of the nature of science, their attitudes towards learning science and their opinions of their classrooms amongst many others. A very small sample of five well-known and well-used tools that could potentially be used in the evaluation of such projects (if they helped answer the right question) is presented in Table . There are many more. More care must be taken with such surveys as, firstly, the surveys are usually designed to measure a few fairly specific constructs and sometimes need to be administered in a particular way so a careful reading of the original paper is absolutely necessary and, secondly, shifting anything to do with a student’s psychology rather than just simple comprehension is a slow and steady process such that change is unlikely to be seen on timescales as short as a semester or a school term.

While pre/post-testing doesn’t provide a great depth of knowledge or understanding by itself, a measurement of the content knowledge gain will let the instructor know whether it worked or it did not. Hence, the pre/post test is a necessary component of project evaluation and should be undertaken by any project that can allocate the necessary time and resources, but it is not sufficient by itself to tell the full story.

Most educational research questions cannot provide a nice simple number with nice statistical error bars. Other questions that could be answered are also limited by ethical considerations when involving human subjects in research [Citation205]. Questions that can be asked in these projects such as how teacher’s understandings and valuings of the scientific method are affected by research experiences [Citation206], what prevents teachers from undertaking inquiry in the classroom [Citation162] or how important is image ownership for robotic telescope users [Citation159] are simply not answerable with multiple choice quantitative tests. They require qualitative exploration with the same rigour as expected in quantitative explorations.

7. Advice when building an education programme

Finally, we present some suggestions for creating and managing education activities or programmes. These are based on findings throughout this review and from our own experiences. It is not intended as a definitive guide but rather as a collection of simple-to-implement ideas which can make a substantial difference to any programme.

7.1. Goals first

Many projects start with a robotic telescope and then try to fit a programme around it. With any educational project it is essential to outline the goals of your project before considering what tools you need to achieve those goals. You will not only be able to refer to these goals when you are creating the educational materials, software, and other items for a successful program, it will help your program to stay focused, making it easier to achieve and support. If your initial goals are successful or even too simplistic, you can always revise them after trialling your programme. The evaluation of your programme should reference these goals and how well they were achieved by the audience.

7.2. Who is the audience?

You might think your programme will appeal to everyone, and while the essence of the programme might have broad appeal, identifying the key group or groups who will (or should) benefit most from your programme is very useful. It will guide your choice of activities and help your programme to remain focused. In doing so, try not to overclaim and say that your participants will or can do things which are beyond the scope of the programme.

7.3. Does your project match the instrumentation?

Some telescopes are too big to image the moon, the planets or bright stars. Some telescopes are too small or track too poorly to image distant galaxy clusters and faint planetary nebula. Some telescope networks are not set up to easily periodically observe a variable star or asteroid. Some telescopes are not in optimal locations and can easily be rained out hampering attempts at direct control. Some telescopes do not have science grade filters available to do research-grade photometry. Most telescopes (so far) do not have spectroscopes. All telescopes are different and matching your intended observations to the capacity of the instrumentation or user interface is very important.

7.4. Simple user interface

If you run a robotic telescope for education your user interface will be the key component to the success of your programme. Your choice of goals and understanding of who your audience is will be critical in your choice of interface. There are many off-the-shelf interface solutions but almost all of them assume a working knowledge of aspects of astronomy that professionals and amateurs take for granted (e.g. catalogue names for astronomical objects are relatively unknown to teachers, a telescope’s field of view will be a mystifying concept to students). One of your goals may be educating your audience to a sufficient level to use the interface. Be wary of requiring the audience to acquire skills and knowledge which are too specific to your programme. It may work better for your programme to use a simplistic interface which encourages a larger audience to participate.

7.5. A document is never as good as an expert

Do not assume any of your users will read documentation. Only the keenest of your audience will hunt for information if it is not immediately obvious. Do not assume that teachers who have been trained in the activities of your programme will remember the full details. If you can provide in-person mentoring to your audience, it will dramatically improve not only their understanding of the programme but also their investment in it. You might also consider running regular webcasts/webinars. These should involve a way for the audience to interact (e.g. ask questions) and be archived for your audience to watch at their convenience.

7.6. Time is precious and short

People new to robotic telescopes and astronomical data can take a long time to understand the various concepts, tools and tasks. Education users, whether in a formal classroom or an informal outreach situation, are typically very time limited. Unless your project is focused on mentoring users through long projects, it is best to remove any approach or material that unnecessarily uses up the limited time of the user.

7.7. Sustaining resources are necessary

As noted in previous publications, e.g. [Citation53], one of the major failing points of any education project is a lack of funding. Sometimes very well meaning projects come into existence on the back of a successful traditional 3-year grant, only to go through a lifecycle of necessary development and to disappear as soon as the grant funding dries up. Sufficient thought about the longevity of resources needs to be taken into account in any approach as education, nearly by definition, is something that occurs over a longer, more sustained period. The failing point in most projects is usually due to lack of monetary resources, but resources such as the voluntary time of skilled people as well as in-kind telescope time provision must also be taken into account.

7.8. Good design and continual improvement

The first version of any materials or approach used in any project will not be perfect. It will likely have errors and will not quite fit the intended audience. This is inevitable, try to use known principles of instructional design and how people learn when creating your initial attempts. Where possible, observe your activity being used or delivered to the target audience, and see how it differs from your intended implementation and why. Some differences may be very obvious while some may (or can) only appear after analysing your evaluation results. In light of this information, revisit and reform your provided materials and approach. An ethos of continual evaluation and revision will improve the quality of your project over time.

8. Conclusion

In this review, we have provided the first systematic overview of the role of optical robotic telescopes in education. The combination of this remote observing technology with education has shown much promise and has inspired much effort from many people, over a period of decades. Unfortunately, it largely suffers from the same problem that many other education technologies have; only a small fraction of incredibly keen users have included it in their regular programmes but it is still waiting to be accepted by the majority of educators.

As noted by many authors cited throughout this review paper, careful and considered project design is a necessity for any of these educational projects to achieve success. Due to the significant lack of evaluation of most of these projects, what qualifies as relative success in an objective manner is hard to define. To help the field of robotic telescope education develop, it is incredibly important that more research is undertaken in the domain overlapping robotic telescopes and education. In particular, project evaluations using well-tested concept inventories, such as those in Table , and deep qualitative investigations, matched with detailed and thorough descriptions of theoretical framework and project approach will help this field develop effectively. In doing so, it is hoped that this will help boost our educational capacity to bring it more in line with the current technical capacity.

There is however much to be optimistic about. Of the known effective evaluations, project design descriptions and even anecdotal successes, many of these have been concentrated into the last five or so years. The burgeoning technical capacity from the variety of telescope time providers is facilitating ever increasing ease of access for diverse audiences. Some of the educational projects are now approaching, or are currently in, their second decade of operation giving some hope for the stability of the field.

We conclude this review by noting that technical capacity, while still in development, is currently outstripping educational capacity. Astronomy education would significantly benefit from simple, high-level, well thought-out and innovative approaches to using robotic telescopes.

Notes

References

  • LIGO Scientific Collaboration and Virgo Collaboration, Abbott BP, Abbott R, et al. Observation of gravitational waves from a binary black hole merger. Phys Rev Lett. 2016;116(6):061102-1-16. http://journals.aps.org/prl/abstract/10.1103/PhysRevLett.116.061102
  • Marschall LA, Safko J. Technology and astronomy education. In: Percy JA, editor. Astronomy education: current developments, future coordination. Proceedings of an ASP Symposium; 1994 Jun 24–25; College Park, MD. San Francisco (CA): Astronomical Society of the Pacific (ASP); 1996. p. 148.
  • Sadler PM, Gould R, Brecher K, et al. Astronomical experiences using internet-accessible remote instrumentation. In: Jacobson M, Kosma R, editors. Innovations in science and mathematics education: advanced designs for technologies of learning. Mahwah (NJ): Erlbaum; 2000. p. 259–280.
  • Osborne J, Simon S, Collins S. Attitudes towards science: a review of the literature and its implications. Int J Sci Edu. 2003;25(9):1049–1079.
  • Cannady MA, Greenwald E, Harris KN. Problematizing the STEM Pipeline metaphor: is the STEM pipeline metaphor serving our students and the STEM workforce? Sci Ed. 2014;98(3):443–460.
  • Castro-Tirado AJ. Robotic Autonomous observatories: a historical perspective. Adv Astron. 2010;2010:e570489.
  • Genet R. Real-time control with the TRS-80. Indianapolis (IN): Howard W. Sams; 1982.
  • Genet RM, Hayes DS, Epand H, et al. Robotic observatories: remote-access personal-computer astronomy. Mesa (AZ): Autoscope Corporation; 1989.
  • Baruch JEF. Robots in astronomy. Vistas Astron. 1992;35(4):399–438.
  • Baruch JEF. The future of robotic telescopes for education. Publ Astron Soc Aust. 2000;17:119–124.
  • Asbell-Clarke J, Pack H, Pennypacker C, et al. Hands-on universe: bringing astronomical explorations to the classroom. In: Percy JA, editor. Astronomy education: current developments, future coordination. Proceedings of an ASP Symposium; 1994 Jun 24--25; College Park, MD. San Francisco (CA): Astronomical Society of the Pacific; 1996. p. 158–160.
  • Pennypacker C. Hands-on universe and plans for large-scale internet-mediated teacher training. In: Okyudo M, et al, editors. Astronomical education with the internet, frontiers of science series no. 27. Tokyo: Universal Academic Press; 1998. p. 45–60.
  • Clark G. Telescopes in education (TIE): bringing live astronomy to the classroom utilizing remotely controlled telescopes. In: Okyudo M, et al. editors. Astronomical education with the internet, frontiers of science series no. 27. Tokyo: Universal Academic Press; 1998. p. 37–44.
  • McKinnon DH. The eye observatory remote telescope project: practical astronomy for years 7, 8 and 9. Australia: Charles Sturt University; 2005.
  • Lubin P, van der Veen J. The remote access astronomy project: an example of a university/high school cooperative effort. Edu Comput. 1992;8(1):79–82.
  • Zijlstra A, Wallander A, Kaper L, et al. Remote observing at the ESO NTT & CAT telescopes. Publ Astron Soc Pac. 1997;109(741):1256–1263.
  • Querci FR, Querci M. Robotic telescopes and networks: new tools for education and science. Astrophys Space Sci. 2000;273(1):257–272.
  • Ashley MCB, Burton MG, Lawrence JS, et al. Robotic telescopes on the Antarctic plateau. Astron Nachr. 2004;325(6–8):619–625.
  • Gelderman R. A global network of autonomous observatories dedicated to student research. In: Pasachoff JM, Ros RM, Pasachoff N, editors. Innovation in astronomy education. Cambridge University Press; 2008. p. 226–232.
  • Percy JR. Small telescopes in astronomy education. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Dordrecht: Springer; 2003. p. 113–123.
  • Kyba CCM, Tong KP, Bennie J, et al. Worldwide variations in artificial skyglow. Sci Rep. 2015;5:8409.
  • AG. Telescopes in schools for IYA2009. Astron Geophys. 2009;50:1.39
  • Sadler PM, Gould RR, Leiker PS, et al. Microobservatory net: a network of automated remote telescopes dedicated to educational use. J Sci Edu Technol. 2001;10(1):39–55.
  • Eaton JA, Henry GW, Fekel FC. Advantages of automated observing with small telescopes. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Springer; 2003. p. 489–507.
  • Baruch JEF, Hedges DG, Machell J, et al. A global network of autonomous observatories dedicated to student research. In: Pasachoff JM, Ros RM, Pasachoff N, editors. Innovation in astronomy education. Cambridge University Press; 2008. p. 122–127.
  • Gould R, Dussault M, Sadler P. What’s educational about online telescopes? Evaluating 10 years of microobservatory. Astron Edu Rev. 2006;5(2):127–145.
  • Steele IA. The liverpool telescope. Astron Nachr. 2004;325(6–8):519–521.
  • Code AD. The Wisconsin APT -- the first robotic telescope. In: Robotic telescopes in the 1990s. Proceedings of the Symposium of the 103rd Annual Meeting of the Astronomical Society of the Pacific; 1991 Jun 22--24; Laramie (WY): University of Wyoming; 1992. p. 3–8.
  • McCord TB, Snellen G, Paavola S. The MIT automated astrophysical observatory. Publ Astron Soc Pac. 1972;84(497):220–224.
  • Colgate SA, Moore EP, Carlson R. A fully automated digitally controlled 30-inch telescope. Publ Astron Soc Pac. 1975;87(518):565–575.
  • Boyd LJ, Genet RM, Hall DS. Automatic photoelectric telescope. Int Amateur-Prof Photoelectr Photometry Commun. 1984;15:20–32.
  • Helmer L, Morrison LV. Carlsberg automatic meridian circle. Vistas Astron. 1985;28(3):505–518.
  • Filippenko AV. The scientific potential of automatic CCD imaging telescopes. In: Robotic telescopes in the 1990s. Proceedings of the Symposium of the 103rd Annual Meeting of the Astronomical Society of the Pacific; 1991 Jun 22--24; Laramie (WY): University of Wyoming; 1992. p. 55–66.
  • Perlmutter S, Muller RA, Newberg HJM, et al. A doubly robotic telescope -- the Berkeley automated supernova search. In: Robotic telescopes in the 1990s. Proceedings of the Symposium of the 103rd Annual Meeting of the Astronomical Society of the Pacific; 1991 Jun 22--24; Laramie (WY): University of Wyoming; 1992. p. 55–66.
  • Lubin P, van der Veen J. The UCSB remote access astronomy project. In: Robotic telescopes in the 1990s. Proceedings of the Symposium of the 103rd Annual Meeting of the Astronomical Society of the Pacific; 1991 Jun 22--24; Laramie (WY): University of Wyoming; 1992. p. 253–260.
  • Lubin P. The personal observatory. 32-Bit PC image processing, photometry and computer control of a filter wheel CCD Camera and telescope. I.A.P.P.P. Commun. 1992;49:17–21.
  • Smith D, Penston M, Roche P. Beyond backyard astronomy: professional telescopes online for schools. Phys. Educ. 2001;3AG. Telescopes in schools for IYA2009. Astron Geophys. 2009;50:1.39.6(3):178
  • Pennypacker C, Barclay T. Building a global education and science system based on modest-aperture telescopes: the hands-on universe system. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Springer; 2003. p. 421–426.
  • Neely AW. The ARLT (Automatic Radio-Linked Telescope): An Imaging Observatory. Int Amateur-Prof Photoelectr Photometry Commun. 1995;58:51.
  • Bor M, Thibaut C, Pack H, et al. Hands-on universe: a global program for education and public outreach in astronomy. In: Harnden FR, Primini FA, Payne HE, editors. Astronomical data analysis software and systems X. ASP Conference Proceedings. Vol. 238, San Francisco (CA): Astronomical Society of the Paciffic; 2001. p. 103.
  • Ferlet R. Hands-on universe Europe (EU-HOU). In: Pasachoff JM, Ros RM, Pasachoff N, editors. Innovation in astronomy education. Cambridge University Press; 2008. p. 23–26.
  • Spuck T. Hands-on universe asteroid search. In: Okyudo M, et al, editors. Astronomical education with the internet, frontiers of science series no. 27. Tokyo: Universal Academic Press; 1998. p. 73–77.
  • Richmond MW, van Dyk SD, Ho W, et al. UBVRI photometry of the type IC SN 1994I in M51. Astron J. 1996;111(1):327.
  • Gould A. Transits, binaries, and hands-on universe. In: Barnes J, Smith DA, Gibbs MG, et al, editors. Science education and outreach: forging a path to the future. ASP Conference Series 431; 2009 Sep 12–16; Millbrae, CA. San Francisco (CA): Astronomical Society of the Pacific; 2010. p. 61–69.
  • McKinnon DH, Mainwaring A. The Charles Sturt university remote telescope project: astronomy for primary school students. Publ Astron Soc Aust. 2000;17(2):125–128.
  • Danaia LJ. Students’ experiences, perceptions and performance in junior secondary school science: an intervention study involving astronomy and a remote telescope [dissertation]. Bathurst (NSW): Charles Sturt University; 2006.
  • McKinnon DH, Geissinger H. Interactive astronomy in elementary schools. J Int Forum Edu Technol Soc. 2002;5(1):124–128.
  • Townsend A, McKinnon DH, Fitzgerald M, Lummis G, Morris J. Educative Curricula and PCK development driven by STEM professional learning in rural and remote schools: A longitudinal Type IV case study. Int J Innov Sci Math Edu: Going Rural Special Edition. 2016;24(4):1–17.
  • Crawford DL, Craine E. GNAT: A global network of small astronomical telescopes. In: Percy JA, editor. Astronomy education: current developments, future coordination. Proceedings of an ASP Symposium; 1994 Jun 24--25; College Park, MD. San Francisco (CA): Astronomical Society of the Pacific; 1996. p. 183.
  • Crawford D. GNAT: A global network of small telescopes as a resource for astronomical research and education. U N Program Space Appl. 1997;8:9094.
  • Crawford DL, Craine ER, Tucker RA. GNATA Global network of small astronomical telescopes. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Springer; 2003. p. 189–200.
  • Graves K, Mackie G. Internet telescopes: capabilities and benchmarks. In: Genet RM, Johnson JM, Wallen V, editors. Small telescopes and astronomical research. 3rd ed. Santa Margarita (CA): Collins Foundation Press; 2010. p. 81.
  • Fitzgerald MT, Hollow R, Rebull LM, et al. A review of high school level astronomy student research projects over the last two decades. Publ Astron Soc Aust. 2014;31(e037):1–23.
  • Newsam A, Carter D, Roche P. The Liverpool and Faulkes telescopes. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Springer; 2003. p. 391–410.
  • Brown TM, Baliber N, Bianco FB, et al. Las Cumbres Observatory global telescope network. Publ Astron Soc Pac. 2013;125(931):1031–1055.
  • Reichart D, Nysewander M, Moran J, et al. PROMPT: panchromatic robotic optical monitoring and polarimetry telescopes. Nuovo Cimento C Geophys Space Phys C. 2005;28(4):767.
  • McLin KM. Using robotic telescopes to teach STEM skills: undergraduate and high school students. In: Telescopes from Afar. Proceedings of the Conference; 2011 Feb 28--Mar 3; Waikoloa Beach, Hawai’i; 2011.
  • Cominsky L, McLin K, Simonnet A, et al. Fourteen years of education and public outreach for the swift gamma-ray burst explorer mission [Internet]. Available from: https://arxiv.org/abs/1405.2104v1
  • Williams RJ. Commercial remote astronomical observatories for education and research. In: Genet RM, Johnson JM, Wallen V, editors. Small telescopes and astronomical research. 3rd ed. Santa Margarita (CA): Collins Foundation Press; 2010. p. 95.
  • Williams R, Beshore E. Sierra stars observatory network: an accessible global network. In: Telescopes from Afar. Proceedings of the Conference; 2011 Feb 28--Mar 3; Waikoloa Beach, Hawai’i; 2011.
  • White V, Croft SK, Gould A, et al.. No Ph.D. Required: remote telescopes reaching a wider audience. In: Garmany C, Gibbs MG, Moody JW, editors. EPO and a changing world: creating linkages and expanding partnerships; 2007 Sep 5--7; Chicago, IL. San Francisco (CA): Astronomical Society of the Pacific; 2008. p. 231–238.
  • Henden AA. A scientific network of small telescopes. In: Telescopes from Afar. Proceedings of the Conference; 2011 Feb 28--Mar 3; Waikoloa Beach, Hawai’i; 2011.
  • Henden AA, Smith TC, Levine SE. 2012. The AAVSO photometric all-sky survey completes the sky. Am Astrono Soc Meet Abstr 220 [Internet]. Available from:https://www.aavso.org/files/henden_aas.pdf
  • Bischoff K, Hessman FV, Tuparev G, et al.. New robotic telescopes by Halfmann-Teleskoptechnik GmbH and Tuparev Technologies Inc.. In: Stepp LM, Gilmozzi R, editors. Ground-based and airborne telescopes II. Proc. SPIE 7012; 2008. p. 70122X.
  • Coward DM, Heary A, Venville G, et al. The Zadko telescope: a resource for science education enrichment. Adv Space Res. 2011;47(11):1922–1930.
  • Luckas P. The design, construction and use of an internet accessible, robotic optical telescope initiative for student research projects [master’s thesis]. Western Australia: The University of Western Australia; 2013.
  • Hobbs G, Hollow R, Champion D, et al. The PULSE@Parkes project: a new observing technique for long-term pulsar monitoring. Publ Astron Soc Aust. 2009;26(4):468–475.
  • Rosen R, Swiggum J, McLaughlin MA, et al. The pulsar search collaboratory: discovery and timing of five new pulsars. Astrophys J. 2013;768(1):1–10.
  • Castelaz MW, Cline JD, Osborne C, et al. Small radio telescopes. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Springer; 2003. p. 271–285.
  • Salah JE, Pratap P, Rogers AEE. The educational role of small telescopes in radio astronomy. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Springer; 2003. p. 623–636.
  • Bessell MS. Beauty and astrophysics. Publ Astron Soc Aust. 2000;17(2):179–184.
  • Lindberg-Christensen L. 2007. The hands-on guide for science communicators [Internet]. New York (NY): Springer New York. Available from: http://link.springer.com/10.1007/978-0-387-49960-4
  • Rector TA, Levay ZG, Frattare LM, et al. Image-processing techniques for the creation of presentation-quality astronomical images. Astron J. 2007;133(2):598–611.
  • Arcand KK, Watzke M, Rector T, et al. Processing color in astronomical imagery. Stud Media Commun. 2013;1(2):25–34.
  • Percy JR. Why astronomy is useful and should be included in the school curriculum. In: Pasachoff J, Percy JR, editors. Teaching and learning astronomy: effective strategies for educators worldwide. New York (NY): Cambridge University Press; 2009. p. 10–13.
  • Slater SJ, Slater TF. Questioning the fidelity of the next generation science standards for astronomy and space sciences education. J Astron Earth Sci Edu. 2015;2(1):51–64.
  • Danaia L, Fitzgerald M, McKinnon D. Students’ perceptions of high school science: what has changed over the last decade? Res Sci Educ. 2012;43(4):1501–1515.
  • Danaia L, McKinnon DH. Common alternative astronomical conceptions encountered in junior secondary science classes: why is this so? Astron Edu Rev. 2007;6(2):32–53.
  • Slater SJ, Price Schleigh S, Stork DJ. Analysis of individual test of astronomy standards (TOAST) item responses. J Astron Earth Sci Edu. 2015;2(2):89
  • Hintz EG, Hintz ML, Lawler MJ. Prior knowledge base of constellations and bright stars among non-science majoring undergraduates and 14–15 year old students. J Astron Earth Sci Edu. 2015;2(2):115.
  • Slater TF, Burrows AD, French DA. A proposed astronomy learning progression for remote telescope observation. J College Teaching & Learning. 2014;11(4):197–206.
  • Sergio Bretones P, Megid Neto J. An analysis of papers on astronomy education in proceedings of IAU meetings from 1988 to 2006. Astron Edu Rev. 2011;10(1):0101020101029.
  • Fitzgerald M, McKinnon DH, Danaia L. Inquiry-based educational design for large-scale high school astronomy projects using real telescopes. J Sci Educ Technol. 2015;24(6):747–760.
  • Baruch J. Final report to the primary (formerly AstraZeneca) science teaching trust. 2011.
  • Baruch J. A robotic telescope for science and education. Astron Geophys. 2015;56(2):18–2.21.
  • Gould RR, Sunbury S, Krumhansl R. Using online telescopes to explore exoplanets from the physics classroom. Am J Phys. 2012;80(5):445–451.
  • Beare R. Investigation into the potential of investigative projects involving powerful robotic telescopes to inspire interest in science. Int J Sci Edu. 2007;29(3):279–306.
  • Roche P, Szymanek N. The Faulkes telescope project. Commun Astron Public. 2005:384–386.
  • Beare R. Astronomy-related content and robotic telescopes in upper secondary physics courses. School Sci Rev. 2004;86(314):113–118.
  • Lewis F, Street R, Roche P, et al. Robotic astronomy with the Faulkes telescopes and Las Cumbres Observatory global telescope. Adv Astron. 2010;2010:e873059.
  • Roche P, Roberts S, Gomez E, et al. Education and public outreach programmes from the Faulkes telescope project. In: Simpson RJ, Ward-Thompson D, editors. Astronomy: networked astronomy and the new media. Bristol (UK): Canopus publishing; 2009. p. 95–107.
  • Miller JP, Davis JW, Holmes RE, et al. An international asteroid search campaign. Astron Edu Rev. 2008;7(1):57–83.
  • Danaia L, McKinnon D, Parker Q, et al. Space to grow: LCOGT.net and improving science engagement in schools. Astron Edu Rev. 2012;11(1):010106.
  • Kadooka MA, Meech KJ, Bedient J. TOPS telescope projects on variable stars and other objects. J Am Assoc Var Star Obs. 2002;31(1):39–47.
  • Kadooka MA, Bedient J, Hu S, Hemphill R, Meech KJ. US student astronomy research and remote observing projects. In: Pasachoff JM, Ros RM, Pasachoff N, editors. Innovation in astronomy education. Cambridge University Press; 2008. p. 218–225.
  • Partridge B, Greenstein G. Goals for astro 101: Report on workshops for department leaders. Astron Edu Rev. 2003;2(2):46–89.
  • Waller WH, Slater TF. Improving introductory astronomy education in American colleges and universities: a review of recent progress. J Geosci Edu. 2011;59(4):176–183.
  • Lazendic-Galloway J, Fitzgerald M, McKinnon D. Implementing studio-based flipped classroom approaches in 1st year astronomy. Int J Innov Sci Math Edu, Australian Sci Math Edu. Edition. 2016:24(5). p.35–47.
  • Slater T. Using remote-control telescopes in ASTR 101, a brief report from a break out discussion. Astronomical Society of the Pacific COSMOS in the classroom conference. Clarement, California, 2007.
  • Privon GC, Beaton RL, Whelan DG, et al. The importance of hands-on experience with telescopes for students. Astro 2010: the astronomy and astrophysics decadal survey, position papers 45. 2009. http://adsabs.harvard.edu/abs/2009astro2010P..45P
  • Russell SH, Hancock MP, McCullough J. Benefits of undergraduate research experiences. Science. 2007;316(5824):548–549.
  • Caton DB. Astronomy back east: The future of the university telescope. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Springer; 2003. p. 209–218
  • Im M, Choi C, Kim K. Lee Sang Gak telescope (LSGT): a remotely operated robotic telescope for education and research at Seoul National University. J Korean Astron Soc. 2015;48(4):207–212.
  • Dukes RJ Jr. The four-college consortium and the future of APT’s. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Springer; 2003. p. 155–179.
  • Eastwood KDG. The national undergraduate research observatory. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Springer; 2003. p. 181–187.
  • Percy JR. Variable star research experiences for high school students, undergraduates, and amateur astronomers. In: Gibbs MG, Barnes J, Manning JG, et al, editors. Preparing for the 2009 International Year of Astronomy: A Hands-on Symposium. ASP Conference Series 400; 2008 Jun 1--5; St. Louis, MO. San Francisco (CA): Astronomical Society of the Pacific; 2008. p. 363–367.
  • Beaky MM. Observational astronomy research at a primarily undergraduate instituition. In: Genet RM, Johnson JM, Wallen V, editors. Small telescopes and astronomical research. 3rd ed. Santa Margarita (CA): Collins Foundation Press; 2010. p. 213.
  • Holmes S, Kolb U, Haswell CA, et al. PIRATE: a remotely operable telescope facility for research and education. Publ Astron Soc Pac. 2011;123(908):1177–1187.
  • Kolb U. The PIRATE facility: at the crossroads of research and teaching. Rev Mex Astron Asteofs. 2014;45:16–19.
  • Brodeur M, Kolb U, Minocha S, et al. Teaching undergraduate astrophysics with PIRATE. Rev Mex Astron Asteofs. 2014;45:129–132.
  • Norton AJ, Wheatley PJ, West RG, et al. New periodic variable stars coincident with ROSAT sources discovered using SuperWASP. Astron Astrophys. 2007;467(2):785–905.
  • Pulley D, Faillace G, Owen C. Investigating the properties of the near-contact binary system TW CrB. J Br Astron Assoc. 2013;123(2):100.
  • Bruce A, Cruickshank S, Rodda T, et al. BAA journal 2013 August an investigation of GSC 02038–00293, a suspected RS CVn star, using CCD photometry. J Br Astron Assoc. 2013;123(4):221–226.
  • Genet RM, Johnson JM, Wallen V. One-semester astronomical research seminars. In: Genet RM, Johnson JM, Wallen V, editors. Small telescopes and astronomical research. 3rd ed. Santa Margarita (CA): Collins Foundation Press; 2010. p. 203.
  • Genet RM, Fulton BJ, Bianco FB, et al.. Observing double stars. Society for astronomical sciences annual symposium. In: Warner DB, Buchleim RK, Foote JL, et al., editors. The Society for Astronomical Sciences 31st Annual Symposium on Telescope Science; 2012 May 22--24; Big Bear Lake, CA. Rancho Cucamongo (CA): Society for Astronomical Sciences; 2012. p. 147–157.
  • Partridge B. The OTHER keck observatories. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Springer; 2003. p. 127–136.
  • Willis S. CCD observations and period determination of six minor planets. Minor Planet Bull. 2004;31(4):82–83.
  • Fraknoi A. The state of astronomy education in the US. In: Percy JA, editor. Astronomy education: current developments, future coordination Astronomical Society of the Pacific Conference Series; 1994 Jun 24--25; College Park, MD. San Francisco (CA): Astronomical Society of the Pacific; 1996. p. 9–25.
  • Bergstrom Z, Sadler P, Sonnert G. Evolution and persistence of students astronomy career interests: a gender study. J Astron Earth Sci Edu (JAESE). 2016;3(1):77–92.
  • Pennypacker C. The real astronomy experience: making the IVO effective for international planetaria and science centers. In: Quinn PJ, Grski KM, editors. Toward an international virtual observatory. Springer: Berlin Heidelberg; 2004. p. 238–241.
  • Pierce-Price D, Lowery S, Michaela E, et al. Around the world in 80 telescopes. CAP J. 2009;6:18–25.
  • Lowe SR. AstroTwitter. In: Simpson RJ, Ward-Thompson D, editors. Astronomy: networked astronomy and the new media. 2009. 10 p. Located at: https://arxiv.org/abs/0907.0193
  • Gomez E. Show me stars: engaging celebrities in astronomy outreach with their twitter followers. CAP J. 2014;14:15–16.
  • Sage LJ. Community perceptions of the relative worth of large and small telescopes. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Springer; 2003. p. 13–19.
  • Abt HA. The productivity of ground-based optical telescopes of various apertures. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Springer; 2003. p. 55–64.
  • Huchra J. Small telescopes in the New Millennium. In: Oswalt TD, editor. The future of small telescopes in the New Millennium. Springer; 2003. p. 1–5.
  • Feinberg RT, Stencel R. Educational opportunities in proam collaboration. In: Pasachoff JM, Ros RM, Pasachoff N, editors. Innovation in astronomy education. Cambridge University Press; 2008. p. 55–57.
  • Fortson L, Masters K, Nichol R, et al. Galaxy Zoo: morphological classification and citizen science. Adv Mach Learn Data Min Astron. 2012:213–236.
  • Lintott CJ, Schawinski K, Slosar A, et al. Galaxy Zoo: morphologies derived from visual inspection of galaxies from the sloan digital sky survey. Mon Not R Astron Soc. 2008;389(3):1179–1189.
  • Cox J, et al. Defining and measuring success in online citizen science: a case study of zooniverse projects. Comput Sci Eng. 2015;17(44):28–41.
  • Mankowski TA, Slater SJ, Slater TF. An interpretive study of meanings citizen scientists make when participating in Galaxy Zoo. Contemp Issues Edu Res. 2011;4(4):25–42.
  • Raddick MJ, Bracey G, Gay PL. Galaxy Zoo: exploring the motivations of citizen science volunteers. Astron Edu Rev. 2010;9(1):010103.
  • Price A, Turner R, Stencel RE, et al. The origins and future of the citizen sky project. J Am AssocVar Star Obs. 2012;40(2):614–617.
  • Stencel RE. e Aurigae - an overview of the 2009–2011 eclipse campaign results. J Am AssocVar Star Obs. 2012;40(2):618–632.
  • Hopkins JL. The international e Aurigae Campaign 2009 photometry report. J Am AssocVar Star Obs. 2012;40(2):633–646.
  • Hollow R. Engaging gifted science students through astronomy. In: Pasachoff J, Percy JR, editors. Teaching and learning astronomy: effective strategies for educators worldwide. New York (NY): Cambridge University Press; 2009. p. 27–33.
  • Hollow RP. The student as scientist: secondary student research projects in astronomy. Publ Astron Soc Aust. 2000;17(2):162–167.
  • Roberts LF, Wassersug RJ. Does doing scientific research in high school correlate with students staying in science? A half-century retrospective study. Res Sci Educ. 2008;39(2):251–256.
  • Percy JR. Variable star research projects for outstanding senior high school students. J Am AssocVar Star Obs. 2007;35(1):284–287.
  • Pennypacker C, Asbell-Clarke J. Hands-on astronomy for education. In: Percy JA, editor. Astronomy education: current developments, future coordination astronomical society of the pacific conference series; 1994 Jun 24--25; College Park, MD. San Francisco (CA): Astronomical Society of the Pacific; 1996. p. 61.
  • Pack H. The hands-on universe web-based asteroid school project and discovery of trans-neptunian object 1998 FS144. In: Percy JA, Wilson JB, editor. Amateur-professional partnerships in astronomy. ASP Conference Proceedings 220. San Francisco (CA): Astronomical Society of the Pacific; 2000. p. 303.
  • Beuermann K, Diese J, Paik S, et al. A long-term optical and X-ray ephemeris of the polar EK Ursae Majoris. Astron Astrophys. 2009;507(1):385–388.
  • Beuermann K, Buhlmann J, Diese J, et al. The giant planet orbiting the cataclysmic binary DP Leonis. Astron Astrophys. 2011;526:A53.
  • Backhaus U, Bauer S, Beuermann K, et al. The quest for companions to post-common envelope binaries: I. Searching a sample of stars from the CSS and SDSS. Astron Astrophys. 2012;538:A84.
  • Frew DJ, Stanger J, Fitzgerald M, et al. K 1–6: An asymmetric planetary Nebula with a binary central star. Publ Astron Soc Aust. 2011;28:83–94.
  • Fitzgerald MT, Criss J, Lukaszewicz T, et al. RR Lyrae stars in the globular cluster NGC 6101. Publ Astron Soc Aust. 2012;29(1):72–77.
  • Fitzgerald MT, Inwood L, McKinnon DH, et al. Photometric and proper motion study of the neglected open cluster NGC 2215. Astron J. 2015;149(6):190.
  • Guieu S, Rebull LM, Stauffer JR, et al. Spitzer observations of IC 2118. Astrophys J. 2010;720(1):46.
  • Howell SB, Brinkworth C, Hoard DW, et al. First Spitzer space telescope observations of magnetic cataclysmic variables: evidence of excess emission at 3–8 m. Astrophys J. 2006;646(1):L65–L68.
  • Howell SB, Hoard DW, Brinkworth C, et al. Dark matter in accretion disks. Astrophys J. 2008;685(1):418–427.
  • Rebull LM, Johnson CH, Hoette V, et al. New young star candidates in CG4 and Sa101. Astron J. 2011;142(1):25.
  • Percy JR, Favaro E, Glasheen J, et al. Period changes in pulsating red supergiant stars: a science and education project. J Am Assoc Var Star Obs. 2008;36(2):145–147.
  • Clark RK. All about the journal of double star observations. In: Genet RM, Johnson JM, Wallen V, editors. Small telescopes and astronomical research. 3rd ed. Santa Margarita (CA): Collins Foundation Press; 2010. p. 155.
  • Mason BD, Wycoff GL, Hartkopf WI, et al. The 2001 US Naval observatory double star CD-ROM. I. The Washington double star catalog. Astron J. 2001;122(6):3466–3471.
  • Argyle R. Observing and measuring visual double stars. London: Springer-Verlag; 2012.
  • White JC II. The virtual observatory and education: a view from the classrom. In: Brunner RJ, Djorgovski G, Szalay AS, editors. Virtual observatories of the future, ASP Conference Proceedings 225. San Francisco (CA): Astronomical Society of the Pacific; 2001. p. 159–164.
  • Russo P, Gomez E, Heenatigala T, et al. Peer-review platform for astronomy education activities. eLearn Pap. 2015;40:1–8.
  • Cobb WH, Buxner S, Schwerin T, et al. NASA wavelength: education and public outreach resources for scientists and engineers. Lunar and Planetary Science Conference [Internet]; 2015 Mar 16--20; The Woodlands, TX; 2015. p. 2706. Available from: http://adsabs.harvard.edu/abs/2015LPI..46.2706C
  • Gershun DC, Slater TF, Berryhill KJ. Mixed-methods study that examines nine science teachers perceptions of SLOOH robotic telescope for teaching astronomy. Rev Latino-Am Edu Astron - RELEA. 2014;17:7–37.
  • McKinnon DH, Danaia L. Remote telescopes in education: report of an Australian study. In: Pasachoff JM, Ros RM, Pasachoff N, editors. Innovation in astronomy education. Cambridge University Press; 2008. p. 232–242.
  • Slater SJ, Slater TF, Olsen JK. Survey of K-12 science teachers’ educational product needs from planetary scientists. Astron Edu Rev. 2009;8(1):010101.
  • Fitzgerald M, Danaia L, McKinnon D. Barriers inhibiting inquiry-based science teaching and potential solutions: perceptions of positively inclined early adopters. Res Sci Edu. Forthcoming 2017. Doi:10.1007/s11165-017-9623-5.
  • Marshall JC, Smart JB, Alston DM. Inquiry-based instruction: a possible solution to improving student learning of both science concepts and scientific practices. Int J of Sci and Math Educ. 2016;1–20. Doi:10.1007/s10763-016-9718-x.
  • McKenzie P, Kos J, Walker M, et al. Staff in Australias schools 2007. Canberra (ACT): Department of Education, Employment and Workplace Relations; 2008. (IBN:0 642 77711 X).
  • Rogers EM. Diffusion of innovations. 5th ed. New York (NY): Free Press; 2003.
  • Rebull LM, Gorjian V, Squires GK, et al. The NASA/IPAC teacher archive research program (NITARP). Poster session presented at: American Astronomical Society [Internet]. AAS Meeting 227, id.246.13. Available from: http://nitarp.ipac.caltech.edu/system/media_files/binaries/173/original/rebull2016.pdf?1450366040.
  • Dresner M, Worley E. Teacher research experiences, partnerships with scientists, and teacher networks sustaining factors from professional development. J Sci Teacher Educ. 2006;17(1):114.
  • Buxner SR. Exploring how research experiences for teachers changes their understandings of the nature of science and scientific inquiry. J Astron Earth Sci Edu. 2015;1(1):53–68.
  • Wells DC, Greisen EW, Harten RH. FITS - a flexible image transport system. Astron Astrophys Suppl Ser. 1981;44(3):363–370.
  • Lang D, Hogg DW, Mierle K, et al. Astrometry.net: blind astrometric calibration of arbitrary astronomical images. Astron J. 2010;139(5):1782–1800.
  • Doran R, Melchior A-L, Boudier T. Astrophysics datamining in the classroom: exploring real data with new software tools and robotic telescopes. 2012. 10 p. Located at: https://arxiv.org/abs/1202.2764v1
  • Schneider CA, Rasband WS, Eliceiri KW. NIH Image to ImageJ: 25 years of image analysis. Nat Method. 2012;9(7):671–675. PMID 22930834
  • Laher RR, Gorjian V, Rebull LM, et al. Aperture photometry tool. Publ Astron Soc Pac. 2012;124(917):737–763.
  • Laher RR, Rebull LM, Gorjian V, et al. Aperture photometry tool versus SExtractor for noncrowded fields. Publ Astron Soc Pac. 2012;124(917):764–781.
  • Hayes-Gehrke M, Benik J, Kovacs Z, et al. Lightcurves for 938 Chlosinde and 3408 Shalamov. Minor Planet Bull. 2011;38(2):75.
  • Souza SP, Beltz-Mohrmann G, Sami M. Two new cool variable stars in the field of NGC 659. J Am Assoc Var Star Obs. 2013;41(1):92–96.
  • Souza SP, Beltz-Mohrmann G, Sami M. The light curve and period of MT696. J Am Assoc Var Star Obs. 2014;42(1):154–160.
  • Collins KA, Kielkopf JF, Stassun KG, Hessman FV. AstroImageJ: image processing and photometric extraction for ultra-precise astronomical light curves. AJ 153(2):77. http://iopscience.iop.org/article/10.3847/1538-3881/153/2/77/meta
  • Stetson PB. DAOPHOT -- a computer program for crowded-field stellar photometry. Publ Astron Soc Pac. 1987;99:191–222.
  • Schechter PL, Mateo M, Saha A. DoPHOT, A CCD photometry program: description and tests. Publ Astron Soc Pac. 1993;105(693):1342–1353.
  • Bertin E. Automated morphometry with SExtractor and PSFEx. In: Evans IN, Accomazzi A, Mink DJ, et al., editors. Astronomical data analysis software and systems XX.ASP Conference Proceedings 442; 2010 Nov 7--11; Boston, MA. San Francisco (CA): Astronomical Society of the Pacific; 2011. p. 435.
  • Bailey JM, Lombardi D. Blazing the trail for astronomy education research. J Astron Earth Sci Edu. 2015;2(2):77–88.
  • Prather EE, Rudolph AL, Brissenden G, et al. A national study assessing the teaching and learning of introductory astronomy. Part I: The effect of interactive instruction. Am J Phys. 2009;77(4):320–330.
  • Slater SJ, Tatge CB, Bretones PS, et al. iSTAR first light: characterising astronomy education research dissertations in the iSTAR Database. J Astron Earth Sci Edu. 2016;3(2):125.
  • Lelliott A, Rollnick M. Big Ideas: a review of astronomy education research 1974–2008. Int J Sci Edu. 32(13):1771.
  • Bretones PS, Jafelice LC, Horvath JE. Ten years of Latin-American journal of astronomy education RELEA: achievements and challenges for international astronomy education development. J Astron Earth Sci Edu. 3(2):111.
  • Fitzgerald M, McKinnon DH, Danaia L, et al. A large-scale inquiry-based astronomy intervention project: impact on students content knowledge performance and views of their high school science classroom. Res Sci Educ. 2016;46(6):901–916.
  • Wallace CS, Prather EE, Mendelsohn BM. Astro 101 students perceptions of science: results from the thinking about science survey instrument. Astron Edu Rev. 2013;12(1):010101.
  • Bailey JM, Slater SJ, Slater TF. Astronomy education research: a primer. 1st ed. New York (NY): W. H. Freeman; 2010.
  • Slater SJ, Slater TF, Bailey JM. Discipline-based science education research: a scientists guide. 1st ed. New York (NY): W. H. Freeman; 2011.
  • Frechtling J, Mark MM, Rog DJ, et al. The 2010 user-friendly handbook for project evaluation. Nat Sci Found. 2010. Located at: https://apps-spisu.sws.iastate.edu/resources/view/id/50
  • Borrow J, Russo P. A blueprint for public engagement appraisal: supporting research careers. arXiv:1510.02017 [physics.soc-ph]. 2015.
  • Buxner SR, Sharma M, Hsu B, et al.. Hands-on universe: bringing astronomical explorations to the classroom. In: Jensen JB, Manning JG, Gibbs MG, et al., editors. Connecting people to science: a national conference on science education and public outreach. ASP Conference Series 457; 2012 Jul 3--Aug 3; Baltimore, MD. San Francisco (CA): Astronomical Society of the Pacific; 2012. p. 81.
  • Slater SJ. The development and validation of the test of astronomy standards (TOAST). J Astron Earth Sci Edu. 2015;1(1):1–22.
  • Hufnagel B, Slater T, Deming G, et al. Pre-course results from the astronomy diagnostic test. Publ Astron Soc Aust. 2000;17(2):152–155.
  • Bailey JM, Bruce J, Prather EE, et al. Development and validation of the star properties concept inventory. Int J Sci Edu. 2012;13(14):2257–2286.
  • Bardar EM, Prather EE, Brecher K, et al. The need for a light and spectroscopy concept inventory for assessing innovations in introductory astronomy survey courses. Astron Edu Rev. 2005;4(2):20–27.
  • Sadler PM, Coyle H, Miller JL, et al. The astronomy and space science concept inventory: development and validation of assessment instruments aligned with the K-12 national science standards. Astron Edu Rev. 2009;8(1):p. 010111.
  • Hake RR. Interactive-engagement versus traditional methods: a six-thousand-student survey of mechanics test data for introductory physics courses. Am J Phys. 1998;66(1):64–74.
  • Kind P, Jones K, Barmby P. Developing attitudes towards science measures. Int J Sci Edu. 29(7):871–893.
  • Adams WK, Perkins KK, Podolefsky NS. New instrument for measuring student beliefs about physics and learning physics: the Colorado learning attitudes about science survey. Phys Rev ST-PER. 2006;2:010101.
  • Lederman NG, Abd-El-Khalick F, Bell RL, et al. Views of nature of science questionnaire: toward valid and meaningful assessment of learners’ conceptions of nature of science. J Res Sci Teach. 2002;39:497–521.
  • Zeilik M, Schau C, Mattern N. Conceptual astronomy. II. Replicating conceptual gains, probing attitude changes across three semesters. Am J Phys. 67(10):923.
  • Taylor PC, Fraser BJ. CLES: an instrument for assessing constructivist learning environments. Paper presented at the Annual Meeting of the National Assocation for Research in Science Teaching (NARST). The Abbey, Fontane, Apr 1991 ; Wisconsin.
  • Brogt E, Dokter E, Antonellis J, et al. Regulations and ethical considerations for astronomy education research II: resources and worked examples. Astron Edu Rev. 2007;6(2):99–110.
  • Buxner SR. Exploring the impact of science research experiences for teachers: stories of growth and identity [dissertation]. Tuscon (AZ): The University of Arizona; 2010.