This Pathways project focuses on research that explores diverse family visitors' engagement with and thinking about science as they experience exhibits at the Museum of Science, Boston. The research team will work closely with museum staff on the implementation of three studies during which they will systematically investigate the arc of visitors' engagement (cognitive, emotional, and physical) as the visitors experience a range of exhibits. The team will also describe how visitors' engagement relates to their thinking about science concepts. The project team uses a mix of data collection and analysis methods, including self-report measures and physiological data along with the tracking of visitor behavior to understand and articulate engagement, along with information on learners' thinking about scientific concepts and demographic information. This project will advance the ISE field by offering findings about engagement that account for the applied and complex nature of the museum setting. The research team will be able to help the ISE field move forward in terms of building theoretical understanding about engagement and offering potential lines of inquiry for future research. The results can also be used to inform exhibit and programmatic design as well as how family learning in museums is evaluated.
DATE:
-
TEAM MEMBERS:
Gabrielle Rappolt-SchlictmannChristine ReichSamantha Daley
Many communities across the country are developing "maker spaces," environments that combine physical fabrication equipment, social communities of people working together, and educational activities for learning how to design and create works. Increasingly, maker spaces and maker technologies provide extended learning opportunities for school-aged young people. In such environments participants engage in many forms of communication where individuals and groups of people are focused on different projects simultaneously. The research conducted in this project will address an important need of those engaged in the making movement: evidence leading to a better understanding of how participants in maker spaces engage with science, technology, engineering and mathematics (STEM) as they create and produce physical products of personal and social value. Specifically, this research will generate new knowledge regarding how participants: pose and solve problems; identify, organize and integrate information from different sources; integrate information of different kinds (visual, quantitative, and verbal); and share ideas, knowledge and work with others. To understand and support STEM literacies involved in making, the investigators will study a number of different informal learning sites that self-identify as maker spaces and serve different-aged participants. The project will use ethnographic and design research techniques in three cycles of qualitative research. In Cycle One, the researchers will investigate two adult-oriented maker spaces in order to generate case studies and develop theories about how more experienced adult makers use the spaces and to create case studies of adult maker spaces, and to develop methodological techniques for understanding literacy in maker spaces. In Cycle Two, the study will expand into two out-of-school time youth-oriented maker spaces, building two new case studies and initiating design-based research activities. In Cycle Three, the team will further apply their developing theories and findings, through rapid iterative design-based research, to interventions that support participants' science literacy and making practices in two maker spaces that exist in schools. Through peer-reviewed publications, briefs, conference presentations, presence on websites of local and national maker organizations, project findings will be widely shared with organizations and individuals that are engaged in broadening the base of U.S. science and mathematics professionals for an innovation economy.
The Exploratorium, in collaboration with the Boys and Girls Club Columbia Park (BGC) in the Mission District of San Francisco, is implementing a two-year exploratory project designed to support informal education in science, technology, engineering, and mathematics (STEM) within underserved Latino communities. Building off of and expanding on non-STEM-related efforts in a few major U.S. cities and Europe, the Exploratorium, BGC, and residents of the District will engage in a STEM exhibit and program co-development process that will physically convert metered parking spaces in front of the Club into transformative public places called "parklets." The BGC parklet will feature interactive, bilingual science and technology exhibits, programs and events targeting audiences including youth ages 8 - 17 and intergenerational families and groups primarily in the Mission District and users of the BGC. Parklet exhibits and programs will focus on STEM content related to "Observing the Urban Environment," with a focus on community sustainability. The project explores one approach to working with and engaging the public in their everyday environment with relevant STEM learning experiences. The development and evaluation processes are being positioned as a model for possible expansion throughout the city and to other cities.
A growing body of research suggests that many types of institutions and experiences contribute to science and technology learning by the public. These include the formal education system, libraries, science centers, citizen science, after school programs, television programs, film and video, newspapers, radio, books and magazines, the internet, community and health organizations, environmental organizations, and conversations with friends and family. It is also important that research about who learns and how they learn from these institutions and experiences is informed by and discussed within the communities themselves. This project focuses specifically on STEM learning in interactive science centers. It invites science center professionals from around the country to contribute to and share findings from an on-going research study designed to better understand the influence that interactive science centers have on youth and adult's long-term understanding, interest and engagement with science and technology. The pair of workshops supported by this grant will engage science center administrators, educators, exhibition and program designers, evaluators and researchers in two sets of tasks. The first workshop, held prior to the start of the larger research project, will examine and focus the research's overall goals and help frame a set of specific research questions. Although no research study can answer all important issues, the goal of the workshop is to ensure that the planned investigation attempts to address the issues and outcomes considered most critical to the broader science center community. The second workshop will occur after completion of all data collection and initial data analysis. It will engage a broad cross-section of the science center community in discussing findings, brainstormind implications and usage, and developing dissemination strategies to insure that the findings of the research reach the broader science center and policy communities. The goal of these workshops is to use the collective wisdom of dozens of active professionals from across the country to develop a suite of strategies for grounding research in practice, incorporating research results into practice as well as bringing important research findings to a broader national audience.
This Michigan State University and University of Texas-Austin project will focus on making science communication more scientific. It will primarily use interview and survey research to improve societal understanding of how those involved in science communication, particularly scientists, think about science communication. The goal is to use this knowledge to help improve science communication training and recruiting with a focus on increasing the likelihood that scientists will adopt evidence-based communication strategies to increase public interest, engagement, and identification with science, technology, engineering, and math (STEM). A central underlying reason for the study is a mismatch between scientists' motivations and goals when interacting with public audiences and what research suggests would be the most positive and productive with public audiences. This study is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project will be conducted in three phases. The first is interviews with a wide range of science communication experts to assess priority research questions. These interviews will be followed by surveys with U.S.-based members of up to 10 different scientific societies representing a broad range of academic fields as well as a survey of science communication researchers. The survey will focus on three different public engagement modes, including face-to-face engagement, online engagement, and engagement via the news media. Consistent with the Theory of Planned Behavior, the surveys will assess scientists' attitudes about public engagement and specific public engagement goals, as well as perceptions of social norms (both descriptive and injunctive) and efficacy beliefs (both internal and external). These will be used as predictors of general and goal-specific engagement willingness, as well as reported past behavior, using multigroup modeling. Potential communication goals of interest include transferring knowledge, developing interest and excitement, building trust in scientists, demonstrating openness and a willingness to listen, shaping how people think about subjects (i.e. framing), and/or defending science. The final phase of the project will explore the potential to design experiments aimed at testing the impact that mention of specific goals has on communication training recruitment as well as the degree to which online content about various goals is attractive to scientists interested in developing their communication skills. The research is the most targeted and largest attempt to date to understand how scientists' views about the public and communication processes may shape science communication behavior.
Project TRUE (Teens Researching Urban Ecology) was a summer research experience for New York City youth that focused on strengthening their STEM interest, skills, and ultimately, increasing diversity in STEM fields. Through a partnership between an informal science institution (the Wildlife Conservation Society) and a university (Fordham University), 200 high school students conducted urban ecology research at one of four zoos in New York City under the guidance of STEM mentors. A unique feature of Project TRUE was its near-peer mentorship model, in which university professors mentored graduate urban ecology students, who mentored undergraduate students, who mentored high school students Science research projects focused on urban ecology topics, with high school students identifying their own research questions that were nested within the undergraduate mentor’s larger research question, thereby establishing a sense of ownership. Youth collected and analyzed their own data and the experience culminated in the creation of research posters, with teams presenting their posters to the public at a student science symposium.
This project was funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. We studied the impacts of two key parts of the program – conducting authentic science research and near-peer mentorship – on the STEM trajectories of almost 200 high school students who participated in the program from 2015 to 2018. The research explored short-term outcomes immediately after the program and followed up with students multiple years after participation to understand the medium-term impacts of the experience during and after the transition from high school to college.
EvalFest (Evaluation Use, Value, and Learning through Festivals of Science and Technology) will test innovative evaluation methods in science festivals that are being held across the country and assess in what ways and how effectively they are used. Morehead Planetarium and Science Center (at the University of North Carolina-Chapel Hill) and the University of California, San Francisco, in collaboration with over twenty science festivals, will (1) investigate whether a multisite evaluation approach is an effective model for creating common metrics for informal STEM education, (2) develop common methods to measure the effects of Festivals, (3) create a query-able database of 50,000 Festival attendees to share with the informal STEM learning field, and (4) document whether these efforts also result in new knowledge related to informal STEM education. The project will develop the Enterprise Feedback Management (EFM) system and query-able database for the festival community. EFMs are systems, including processes and software, that enable groups (such as the festival network) to collect, organize, analyze and share data. The EFM system will be designed to integrate data across sites and to allow users to extract data of interest. The project will refine evaluation tools currently used within the Science Festival Alliance that assess self-reported festival learning, and the effects of festival attendance, motivation, and future science participation. It will collect economic impact data and longitudinal festival attendee data. The project will also develop some new evaluation tools such as secret shopper observational protocols. Data from festival attendees will be collected onsite at participating festivals.
This project will bring STEM education to rural communities through local public libraries. Museum quality exhibits labelled as "Discover Earth", "Discover Technology", and "Discover Space" will spend 3 months at a series of locations around the Nation. Twenty four medium sized libraries will be chosen for the large exhibits and forty small libraries will be chosen for scaled down versions. The project's intent is to provide exhibits in every state and to reach as many under-represented individuals as possible. The significance of this project is that rural areas of this country are underserved regarding STEM education and since this segment of society is represented by 50-60 million residents, it is important to reach out to them. There is a significant segment of the Nation's population (50-60 million) that is underserved by out-of-school learning venues such as museums and science centers. An earlier phase 1 project demonstrated at 18 sites that rural libraries and librarians could provide STEM education to community members ranging in age from adults to children using these hands-on exhibits. Each exhibit (earth, space or technology) includes information about the topic and technologically enabled models to provide interesting and fun discovery mechanisms. They use common layman friendly language that highlights the most recent discoveries in each area. Each exhibit will be placed in the selected library for 3 months during which the library will organize events to feature and advertise the STEM learning opportunities. Another feature of this project will be to determine the models of learning in library settings and as a function of the demographics. The partners in this project that bring the necessary expertise are the American Library Association, the Afterschool Alliance, the Association of Rural and Small Libraries, the University of Colorado Museum, Datum Advisors, LLC, Evaluation and Research Associates, the Lunar and Planetary Institute, the American Geophysical Union, and the Space Science Institute.
This early-stage design and development, integrated media and research project will contribute important new understandings to the informal science learning literature by exploring science engagement on social media when integrated with broadcast television. It will help answer questions including: What does such engagement look like? Who participates? How and why does it happen? and What is the degree or depth of engagement? The project builds on the previous successful work by WGBH nationally distributing the television series NOVA scienceNOW and the research expertise of EDC. WGBH's NOVA scienceNOW program will collaborate with EDC to develop new metrics to understand how and why learners engage with science on social media. Deliverables will include six one-hour episodes of NOVA scienceNOW, short online videos, moderated online discussion events, and an online film festival. A new social Media Initiative will develop six live broadcast microblogging events, six post-broadcast online discussion events, daily social media updates, and an online film festival that will feature user generated videos. A range of STEM content in the videos and online posts will be framed around big science and engineering questions such as animal communication and survival systems, the biology of sleep, climate change, new technologies, energy, genetics, and natural disasters. The continued innovations and expansion of social media channels provides significant new opportunities for providing learner's access to high quality science content, researchers, and opportunities to participate in science. In the first phase of this work to deepen the evidence based understanding of how social media supports informal science engagement, NOVA and EDC will collaborate to develop new measurement instruments: (1) a Network Profile to quantitatively represent the size and activity of NOVA's social media network; (2) an Informal Science Engagement (ISE) index to measure the degree of engagement by coding and analyzing conversations and posts; (3) a Follower Profile to assess the degree of activity and the nature of the engagement; and (4) a Science Social Media Engagement survey instrument. They will then use these measures and data collection protocols to explore whether and how the initiative might influence science engagement. External expert reviewers with content and methodological expertise will review all aspects of the project at critical junctures. This project will contribute important new knowledge and research instruments and methods to better understand how the learning opportunities of social media channels can be realized most effectively. This has significant potential for broad and lasting benefits to society as well as advancing the informal science learning field.
For over two decades NSF has been investing in the development and evaluation of giant screen films for viewing by audiences in science centers and museums. These have been highly successful in terms of audiences reached and project evaluations that indicate their impact on learning. Less well understood is how the unique attributes of giant screen films (e.g., "immersion" and "presence") affect learners in ways that differ from other film formats. This integrated research and media project will contribute to that knowledge base. Project deliverables will include a giant screen film that tells the story of the discovery of biological mimicry (the critical proof for natural selection and in turn, evolution) through the life story of Henry Bates and his travels through the Amazon rainforest more than 150 years ago; 2D dome, and 2D flat format versions; live interactive science demonstrations and educational resources; and workshops for ISE professionals. The film and the related outreach via science centers, social media, and the web are expected to reach large public audiences; workshops and web resources will reach ISE professionals nationally. A strategy for reaching underrepresented audiences through science museums and partnerships with educational societies is a part of the broadening participation effort. Building on results of an NSF-funded workshop in which researchers, evaluators, and filmmakers began to develop a research agenda to provide evidence about giant screen attributes and their impacts on learning, the research component of this project will focus on the differences in learner knowledge among the various film formats, their unique attributes, and whether format plays a role in science interest and science identity. A baseline study will be conducted to begin gathering evidence on how each of these formats affects learning. Data on audience knowledge gains, interest, and science identity will be collected using a novel tablet-based game-like assessment pre-film viewing, immediately post viewing, and in a later follow-up. These baseline data will inform follow-on research that, over time, can better explain the unique impacts on learning of the giant screen format. Project partners include the Pacific Science Center, SK Films, Howard Hughes Medical Institute, Rutgers University, and Arizona State University.
This is the Front End Evaluation report for the NSF-AISL-funded Pushing the Limits: Building Capacity to Enhance Public Understanding of Math and Science through Rural Libraries (Limits) project. A national survey of rural librarians and their patrons was carried out between February and April 2011. Key guiding questions were: 1) How interested/motivated are rural librarians in: a. Providing science and technology related programming at their libraries; b. Participating in professional development for running public programs; c. Personally learning about science and technology topics. 2) How
DATE:
TEAM MEMBERS:
Dartmouth CollegeJohn H FalkJennifer BachmanMichael Liu
This project is intended to develop a model for STEM education through local libraries. There are several unique features in this endeavor. The model is being aimed at rural libraries and adult residents that are geographically remote from typical venues such as museums, zoos, and science centers. According to the 2000 census, there are 50 million individuals in this designation and the size of the group is increasing and becoming more diverse. Efforts to impact diverse audiences who are economically disadvantaged will be part of the plan. In many rural locations there are few community venues, but libraries are often present. The American Library Association and the Association Rural and Small Libraries have begun the reinvention of these libraries so they can become more attuned to the communities in which they are apart. Thus, this project is an effort to find new ways of communicating STEM concepts to a reasonably large underserved group. The design is to derive a "unit of knowledge enhancement" (some portion of Climate Change, for example) through a hybrid combination of book-club and scientific cafe further augmented with videos and web materials. Another part of the design is to enhance the base STEM knowledge of library staff and to associate the knowledge unit with an individual who has the specific STEM topic knowledge for a specific unit. Considerable effort shall be expended in developing the models for staff knowledge enhancement with a progressive number of librarians in training from 8 to 20 to 135. To build the content library model, five units of knowledge will be devised and circulated to participating libraries. Evaluation of the project includes front end, formative and summative by the Goodman Research Group. In addition to the "units of knowledge enhancement," the major results will be the model on how best to relate and educate citizens in rural environments and how to educate the library staff.