A group of 12 researchers gathered at MSI to discuss issues surrounding the critical but challenging area of how to measure the long-term effects or impacts of ISE experiences, chaired by Dr. John Falk, Oregon State University and Institute for Learning Innovation, and hosted by Aaron Price, Museum of Science & Industry, Chicago, (MSI) on July 18, 2018. All the invitees had expertise and experience in this area, resulting in a rich conversation based equally in theory and practice. The goal of the discussion was to build on the collective experience of the group to identify and address key
The connections between technology applications of all sorts and human users that are ubiquitous in informal learning and assume a great deal about how the technology is used and how learning takes place. Much of the research in this area has been focused on game design and interaction. This project will examine this interaction involving the use of gestures that represent how individuals work with systems and large data sets that represent complex systems like the oceans, to understand how basic elements of a project with a 3-D type of design might enhance the user experience and increase the utility and learning that takes place by understanding the cognitive elements of these game like interactions in specific STEM related settings like museums.
This exploratory pathways project will investigate the use of interactive, gesture-enabled, multi-touch spheres for teaching about ocean systems in science centers and museums. The gesture-enabled aspect of the project will improve on interactive table-top installations which can frustrate users who use unexpected gestures and receive no response leading to brief interaction and abandonment without significant interaction or learning. The project will investigate ways in which unsupported gestures would still produce a system response which would encourage the user to remain at the installation and continue to investigate. The effect of multiple gestures will be supported by using natural mappings between gestures and interactions with the on-sphere data.
The project investigates theories of embodied cognition that support the notion that by engaging with global-scale datasets on a spherical display more effectively models the earth in a non-distorted manner and therefore will be more natural and allow users to develop a more accurate conceptual model of how data relates to itself and the globe. In this way, the project shares some aspects of understanding about learning through game play. The sphere will not be a fully developed game but will share characteristics of game play.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project takes an ethnographic and design-based approach to understanding how and what people learn from participation in makerspaces and explores the features of those environments that can be leveraged to better promote learning. Makerspaces are physical locations where people (often families) get together to make things. Some participants learn substantial amounts of STEM content and practices as they design, build, and iteratively refine working devices. Others, however, simply take a trial and error approach. Research explores the affordances are of these spaces for promoting learning and how to integrate technology into these spaces so that they are transformed from being makerspaces where learning happens, but inconsistently, into environments where learning is a consistent outcome of participation. One aim is to learn how to effectively design such spaces so that participants are encouraged and helped to become intentional, reflective makers rather than simply tinkerers. Research will also advance what is known about effective studio teaching and learning and advance understanding of how to support youth to help them become competent, creative, and reflective producers with technology(s). The project builds on the Studio Thinking Framework and what is known about development of meta-representational competence. The foundations of these frameworks are in Lave and Wengers communities of practice and Rogoff's, Stevens et al.'s, and Jenkins et al.'s further work on participatory cultures for social networks that revolve around production. A sociocultural approach is taken that seeks to understand the relationships between space, participants, and technologies as participants set and work toward achieving goals. Engaging more of our young population in scientific and technological thinking and learning and broadening participation in the STEM workplace are national imperatives. One way to address these imperatives is to engage the passions of young people, helping them recognize the roles STEM content and practices play in achieving their own personal goals. Maker spaces are neighborhood spaces that are arising in many urban areas that allow and promote tinkering, designing, and construction using real materials, sometimes quite sophisticated ones. Participating in designing and successfully building working devices in such spaces can promote STEM learning, confidence and competence in one's ability to solve problems, and positive attitudes towards engineering, science, and math (among other things). The goal in this project is to learn how to design these spaces and integrate learning technologies so that learning happens more consistently (along with tinkering and making) and especially so that they are accessible and inviting to those who might not normally participate in these spaces. The work of this project is happening in an urban setting and with at-risk children, and a special effort is being made to accommodate making and learning with peers. As with Computer Clubhouses, maker spaces hold potential for their participants to identify what is interesting to them at the same time their participation gives them the opportunity to express themselves, learn STEM content, and put it to use.
Through a comparative case study, Sheridan and colleagues explore how makerspaces may function as learning environments. Drawing on field observations, interviews, and analysis of artifacts, videos, and other documents, the authors describe features of three makerspaces and how participants learn and develop through complex design and making practices. They describe how the makerspaces help individuals identify problems, build models, learn and apply skills, revise ideas, and share new knowledge with others. The authors conclude with a discussion of the implications of their findings for this
In this essay, Erica Halverson and Kimberly Sheridan provide the context for research on the maker movement as they consider the emerging role of making in education. The authors describe the theoretical roots of the movement and draw connections to related research on formal and informal education. They present points of tension between making and formal education practices as they come into contact with one another, exploring whether the newness attributed to the maker movement is really all that new and reflecting on its potential pedagogical impacts on teaching and learning.
Planet Earth Decision Theater (PEDT) is a NOAA-funded project for Science on a Sphere (SOS) about the impact that humans have on the planet (grant #NA10SEC0080021). Survey data for this evaluation was collected at three live performances of PEDT on December 31, 2011. Overall, Planet Earth Decision Theater was well received and the visualizations were apprehensible and interesting to visitors.
To better help museum visitors make sense of large data sets, also called “Big Data”, this study focused on the types of visual representations visitors recognize, and how they make meaning (or not) of various visuals. Individual adults and youths were shown five different data visualizations (one from each of five categories), one at a time, and asked if the visualization looked familiar and how it was read. This study found that Context and previous experience matters. Participants of all ages are familiar with a wide variety of visual displays of data. If a participant encounters a visual
To better help museum visitors make sense of large data sets, also called “big data”, this study focuses on what museum visitors felt individual layers of a visual (alone and in combination with other layers) were communicating to them as the visual was constructed or deconstructed layer by layer. A second, smaller study, collected data to better understand how adult visitors would construct large data visualizations. This study was concerned with how people make sense of “big data” in their daily lives and how they engage with reference systems. The primary study used four different “big data
To better understand how audiences in public spaces, in this case those in a museum setting, relate to and make sense of the phrases “Big Data” and “Data Visualizations”, this study investigated visitors understanding of these terms. This formative study used intercepts; approaching adult visitors and inviting them to participate in a very brief interview. If the person agreed, they were asked additional questions. The first question asked about awareness of the phrase, “Big Data” or for a very small comparison group, “Data Visualization.” Visitors were then asked “How would you explain “Big
To better help museum visitors make sense of large data sets, also called “big data”, this study investigated if there were generalizable ways in which visitors engage with and then make meaning of such data sets. This front-end study was designed to explore if there were different, distinct, and repeatable patterns intuited by individuals as they work with large data sets. This was a descriptive, process method using a complex card sort with an interview. Each card had the name of one food item written on it. Food items were diverse, including eggs, crackers, lasagna, apples, tofu and almonds
The Cyberlearning Resource Center (CRC) has responsibility for promoting integrative collaboration among cyberlearning grantees (across NSF programs); synthesis and national dissemination of cyberlearning findings, technologies, models, materials, and best practices; creating a national presence for Cyberlearning; helping the disparate Cyberlearning research and development communities coordinate efforts to build capacity; and providing infrastructure (technological and social) for supporting these efforts. Monitored through the Cyberlearning: Transforming Education program, the CRC serves as a resource for all NSF grantees and programs with cyberlearning components, helping to promote synergy and integrate projects across NSF's cyberlearning investments. Among society's central challenges are amplifying, expanding, and transforming opportunities people have for learning and more effectively drawing in, motivating, and engaging young learners. Engaging actively as a citizen and productively in the workforce requires understanding a broad variety of concepts and possessing the ability to collaborate, learn, solve problems, and make decisions. Whether learning is facilitated in school or out of school, and whether learners are youngsters or adults, to develop such knowledge and capabilities, learners must be motivated to learn, actively engage over the long term in learning activities, and put forth sustained cognitive and social effort. Consistent with NSF's mission and strategic plan, a variety of programs at NSF invest in research aimed towards achieving these goals. In support of this important thematic thrust, the Cyberlearning Resource Center works with researchers and NSF program officers to identify and disseminate findings from across programs and projects; develop ways to broker productive partnerships and collaborations; convene meetings for purposes of envisioning the future, integrating findings, and building capacity,; and monitor the cyberlearning portfolio and its influences and impacts.
EvalFest (Evaluation Use, Value, and Learning through Festivals of Science and Technology) will test innovative evaluation methods in science festivals that are being held across the country and assess in what ways and how effectively they are used. Morehead Planetarium and Science Center (at the University of North Carolina-Chapel Hill) and the University of California, San Francisco, in collaboration with over twenty science festivals, will (1) investigate whether a multisite evaluation approach is an effective model for creating common metrics for informal STEM education, (2) develop common methods to measure the effects of Festivals, (3) create a query-able database of 50,000 Festival attendees to share with the informal STEM learning field, and (4) document whether these efforts also result in new knowledge related to informal STEM education. The project will develop the Enterprise Feedback Management (EFM) system and query-able database for the festival community. EFMs are systems, including processes and software, that enable groups (such as the festival network) to collect, organize, analyze and share data. The EFM system will be designed to integrate data across sites and to allow users to extract data of interest. The project will refine evaluation tools currently used within the Science Festival Alliance that assess self-reported festival learning, and the effects of festival attendance, motivation, and future science participation. It will collect economic impact data and longitudinal festival attendee data. The project will also develop some new evaluation tools such as secret shopper observational protocols. Data from festival attendees will be collected onsite at participating festivals.