For over 60 years annual Science Fairs and Engineering competitions have been held in schools and communities throughout the country, engaging large numbers of middle school students and culminating in national and international events. Science fairs are at the intersection of formal learning in school and informal science learning in other settings including science centers, after-school programs, and clubs. However, in spite of their wide implementation and long history, there are few empirical studies that have examined the relationship between student participation in these fairs and their learning and interest in science. Additionally, there have been no studies to understand the real cost of these programs relative to the student benefits. This educational research project will fill that gap in understanding. It will systematically document and describe science fair models; measure their impact on learning; and provide evidence about the costs of various models and related benefits. The findings from this study will inform a wide range of stakeholders (including teachers, science fair leaders, volunteers, parents, and businesses) about these models and how they impact students' mastery of science and engineering practices. This four-year study in all regions of the country will be conducted in two phases: Phase 1 will be a survey of 3800 middle school science teachers will define the characteristics of science fair models; Phase 2 will use those understandings to conduct case studies in 20 schools. Deliverables include handbooks for teachers and the science fair community, articles in journals summarizing findings, the Science and Engineering Practice and Interest Inventory, and a suite of data collection instruments for scoring rubrics to describe science fairs and measure their impact. Research questions will include: (1) What are the basic models of middle school science fairs? (2) To what extent does participation in a particular model enhance students' mastery of science and engineering practices and/or their interest in science? (3) What student-teacher and school-level factors contribute to or inhibit students' mastery? (4) What resources, human and financial, are required to implement an effective middle school science fair? and (5) What are the most cost-effective aspects of the science fair experience, and how can they be applied or adapted by science fair leaders and teachers to strengthen students' mastery of science and engineering practices? Findings from this study will have the potential to improve current practices in the design and implementation of science fairs and their impact on student learning; they will be widely disseminated to the various stakeholders through publications, conference presentations, and educational association channels.
This media and research project will develop and study the use of new media, broadcast television, and social networks to introduce Citizen Science to a national audience, and motivate their direct involvement and participation. Project deliverables will include: four nationally-distributed public TV programs hosted by Waleed Abdalati, Director of CIREs at the University of Boulder and former NASA Chief Scientist; online videos for training and outreach of citizen science partners; digital engagement via social media; and a custom-designed application ('2nd screen app') that enables users to obtain additional informational content, share information, and connect with other viewers. The evaluation and research study will build new knowledge on how these deliverables can motivate the public to become citizen science participants. The investigators estimate the four television programs will reach approximately 80% of U.S. television households. In addition, videos and other content will be distributed through channels such as iTunes, Hulu, Netflix, and social media. Target audiences will include the general public, citizen science activists, and professional scientists. Underrepresented groups will be reached through special Google Hangouts, and professional societies such as SACNAS and AGU. The research components of the project will provide evidence on how traditional researchers respond to citizen science, and explore the deliverables' use as recruitment tools for citizen science projects and impacts on viewers' attitudes, behaviors, and skills related to citizen science. Data will be collected from multiple sources, including online surveys, in-person focus groups, and analyses of users' online postings. Retrospective surveys will be administered to explore changes in behavior regarding whether respondents have increased their interaction with professional scientists, or participated in citizen science initiatives. A quasi-experimental study will be conducted to assess the value added by the 2nd screen app.
During middle school, many young people disengage from and consequently do not achieve in school-based STEM subjects. This phenomenon is more pronounced among young people in low-income communities than elsewhere. Many summer, out-of-school STEM programs are designed to offer young people opportunities to engage in hands-on, inquiry-based learning that promote interest and engagement in STEM. Research on the effect of these types of programs is limited, however. This research project seeks to fill this gap by identifying and studying practices that promote interest and engagement in STEM-related topics. The central goal of the summer STEM Interest and Engagement Study is to identify instructional practices associated with cultivating and sustaining young people's interest and engagement in out-of-school STEM summer learning programs for middle school youth. The project is based on a model of change developed from existing theory and empirical research on the cultivation of youths' interest and engagement in STEM. The project is a descriptive study that will apply multiple data collection and analytic methods, including the Experience Sampling Method (ESM), to determine instructional practices and the resulting interest, engagement, and perceptions of youth as they participate in STEM activities. In addition, survey data provided by program participants will allow the researchers to account for individual differences in preexisting interest and background factors, such as gender and ethnicity, and to measure changes in dispositions toward STEM. By better understanding these connections, practitioners can better understand how the design of their programs may influence the outcome of the participants' experience, including their education and career decisions.
DATE:
-
TEAM MEMBERS:
Deborah MoroneyNeil NaftzgerLee ShumowJennifer Schmidt
Many communities across the country are developing "maker spaces," environments that combine physical fabrication equipment, social communities of people working together, and educational activities for learning how to design and create works. Increasingly, maker spaces and maker technologies provide extended learning opportunities for school-aged young people. In such environments participants engage in many forms of communication where individuals and groups of people are focused on different projects simultaneously. The research conducted in this project will address an important need of those engaged in the making movement: evidence leading to a better understanding of how participants in maker spaces engage with science, technology, engineering and mathematics (STEM) as they create and produce physical products of personal and social value. Specifically, this research will generate new knowledge regarding how participants: pose and solve problems; identify, organize and integrate information from different sources; integrate information of different kinds (visual, quantitative, and verbal); and share ideas, knowledge and work with others. To understand and support STEM literacies involved in making, the investigators will study a number of different informal learning sites that self-identify as maker spaces and serve different-aged participants. The project will use ethnographic and design research techniques in three cycles of qualitative research. In Cycle One, the researchers will investigate two adult-oriented maker spaces in order to generate case studies and develop theories about how more experienced adult makers use the spaces and to create case studies of adult maker spaces, and to develop methodological techniques for understanding literacy in maker spaces. In Cycle Two, the study will expand into two out-of-school time youth-oriented maker spaces, building two new case studies and initiating design-based research activities. In Cycle Three, the team will further apply their developing theories and findings, through rapid iterative design-based research, to interventions that support participants' science literacy and making practices in two maker spaces that exist in schools. Through peer-reviewed publications, briefs, conference presentations, presence on websites of local and national maker organizations, project findings will be widely shared with organizations and individuals that are engaged in broadening the base of U.S. science and mathematics professionals for an innovation economy.
This project will bring STEM content knowledge to visitors to Cuyahoga Valley National Park via mobile device applications. Visitors will be able to use their mobile phones to access details about Park features (such as where they are in the park, what they are looking at, and where are related features), supporting just-in-time STEM learning. Cuyahoga Valley National Park receives around 2.5 million visitors every year and experiences multitudes of inquiries. Until this project, visitors were subjected to less than optimum signage for information and background about a given feature that may or may not be of interest to them. In this project, knowledge building information will be selected by the visitors and delivered to them with convenience and speed. The data base supporting this effort will provide the visitor with identification and the history of park features as well as more in depth knowledge building information while they are in the park and after the leave, providing a more holistic experience than is currently available. The investigators will build the system in parts, testing the feasibility at each stage and evaluating affective and cognitive outcomes of each portion. Research questions that will be addressed in the course of this project include: (1) What outcomes associated with use of this GPS-base system could inform future development and implementation? and (2) What contributions do these GPS-based mobile learning applications have on informal science learning as understood within the Six Strands of Informal Science Learning? It is expected knowledge generated in this project will stimulate additional programing for increasing efficacy and use in other widely ranging venues. If successful, it is easy to imagine how this STEM knowledge-building application could be extended for use in other venues across the country.
DATE:
-
TEAM MEMBERS:
Richard FerdigRuoming JinPatrick LorchAnnette Kratcoski
This project is making novel use of familiar technology (smartphones and tablets) to address the immediate and pressing challenge of affordable, ongoing, large-scale museum evaluation, while encouraging museum visitors to engage deeply with museum content. Using a smartphone app, museum visitors pose questions to a 'virtual scientist' called Dr. Discovery (Dr. D). Dr. D provides answers and the chance to complete fun mini-challenges. The questions visitors ask are gathered in a large database. An analytics system analyzes these data and a password-protected website provides continuous, accessible evaluation data to museum staff, helping them make just-in-time tweaks (or longer term changes) to exhibit-related content (such as multimedia, lecture topics, docent training, experience carts, etc.) as current events and visitors' needs and interests change. The intellectual merit of this project is that it is building evaluation capacity among informal educators, advancing the fields of visitor studies, museum evaluation, informal science learning, and situated engagement, and is contributing to the development of novel evaluation techniques in museums. This project has many broader impacts: The Ask Dr. Discovery system is available to any venue that wishes to use or adapt it to their context. By enhancing the visitor experience and improving museum access to data for evaluation and data-driven decision making across the country, Ask Dr. Discovery has both a direct and indirect impact on museums and visitors of all types. This project is also training the next generation of STEM and education innovators by employing a diverse team of undergraduate students.
Project TRUE (Teens Researching Urban Ecology) was a summer research experience for New York City youth that focused on strengthening their STEM interest, skills, and ultimately, increasing diversity in STEM fields. Through a partnership between an informal science institution (the Wildlife Conservation Society) and a university (Fordham University), 200 high school students conducted urban ecology research at one of four zoos in New York City under the guidance of STEM mentors. A unique feature of Project TRUE was its near-peer mentorship model, in which university professors mentored graduate urban ecology students, who mentored undergraduate students, who mentored high school students Science research projects focused on urban ecology topics, with high school students identifying their own research questions that were nested within the undergraduate mentor’s larger research question, thereby establishing a sense of ownership. Youth collected and analyzed their own data and the experience culminated in the creation of research posters, with teams presenting their posters to the public at a student science symposium.
This project was funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. We studied the impacts of two key parts of the program – conducting authentic science research and near-peer mentorship – on the STEM trajectories of almost 200 high school students who participated in the program from 2015 to 2018. The research explored short-term outcomes immediately after the program and followed up with students multiple years after participation to understand the medium-term impacts of the experience during and after the transition from high school to college.
EvalFest (Evaluation Use, Value, and Learning through Festivals of Science and Technology) will test innovative evaluation methods in science festivals that are being held across the country and assess in what ways and how effectively they are used. Morehead Planetarium and Science Center (at the University of North Carolina-Chapel Hill) and the University of California, San Francisco, in collaboration with over twenty science festivals, will (1) investigate whether a multisite evaluation approach is an effective model for creating common metrics for informal STEM education, (2) develop common methods to measure the effects of Festivals, (3) create a query-able database of 50,000 Festival attendees to share with the informal STEM learning field, and (4) document whether these efforts also result in new knowledge related to informal STEM education. The project will develop the Enterprise Feedback Management (EFM) system and query-able database for the festival community. EFMs are systems, including processes and software, that enable groups (such as the festival network) to collect, organize, analyze and share data. The EFM system will be designed to integrate data across sites and to allow users to extract data of interest. The project will refine evaluation tools currently used within the Science Festival Alliance that assess self-reported festival learning, and the effects of festival attendance, motivation, and future science participation. It will collect economic impact data and longitudinal festival attendee data. The project will also develop some new evaluation tools such as secret shopper observational protocols. Data from festival attendees will be collected onsite at participating festivals.
This project will bring STEM education to rural communities through local public libraries. Museum quality exhibits labelled as "Discover Earth", "Discover Technology", and "Discover Space" will spend 3 months at a series of locations around the Nation. Twenty four medium sized libraries will be chosen for the large exhibits and forty small libraries will be chosen for scaled down versions. The project's intent is to provide exhibits in every state and to reach as many under-represented individuals as possible. The significance of this project is that rural areas of this country are underserved regarding STEM education and since this segment of society is represented by 50-60 million residents, it is important to reach out to them. There is a significant segment of the Nation's population (50-60 million) that is underserved by out-of-school learning venues such as museums and science centers. An earlier phase 1 project demonstrated at 18 sites that rural libraries and librarians could provide STEM education to community members ranging in age from adults to children using these hands-on exhibits. Each exhibit (earth, space or technology) includes information about the topic and technologically enabled models to provide interesting and fun discovery mechanisms. They use common layman friendly language that highlights the most recent discoveries in each area. Each exhibit will be placed in the selected library for 3 months during which the library will organize events to feature and advertise the STEM learning opportunities. Another feature of this project will be to determine the models of learning in library settings and as a function of the demographics. The partners in this project that bring the necessary expertise are the American Library Association, the Afterschool Alliance, the Association of Rural and Small Libraries, the University of Colorado Museum, Datum Advisors, LLC, Evaluation and Research Associates, the Lunar and Planetary Institute, the American Geophysical Union, and the Space Science Institute.
This early-stage design and development, integrated media and research project will contribute important new understandings to the informal science learning literature by exploring science engagement on social media when integrated with broadcast television. It will help answer questions including: What does such engagement look like? Who participates? How and why does it happen? and What is the degree or depth of engagement? The project builds on the previous successful work by WGBH nationally distributing the television series NOVA scienceNOW and the research expertise of EDC. WGBH's NOVA scienceNOW program will collaborate with EDC to develop new metrics to understand how and why learners engage with science on social media. Deliverables will include six one-hour episodes of NOVA scienceNOW, short online videos, moderated online discussion events, and an online film festival. A new social Media Initiative will develop six live broadcast microblogging events, six post-broadcast online discussion events, daily social media updates, and an online film festival that will feature user generated videos. A range of STEM content in the videos and online posts will be framed around big science and engineering questions such as animal communication and survival systems, the biology of sleep, climate change, new technologies, energy, genetics, and natural disasters. The continued innovations and expansion of social media channels provides significant new opportunities for providing learner's access to high quality science content, researchers, and opportunities to participate in science. In the first phase of this work to deepen the evidence based understanding of how social media supports informal science engagement, NOVA and EDC will collaborate to develop new measurement instruments: (1) a Network Profile to quantitatively represent the size and activity of NOVA's social media network; (2) an Informal Science Engagement (ISE) index to measure the degree of engagement by coding and analyzing conversations and posts; (3) a Follower Profile to assess the degree of activity and the nature of the engagement; and (4) a Science Social Media Engagement survey instrument. They will then use these measures and data collection protocols to explore whether and how the initiative might influence science engagement. External expert reviewers with content and methodological expertise will review all aspects of the project at critical junctures. This project will contribute important new knowledge and research instruments and methods to better understand how the learning opportunities of social media channels can be realized most effectively. This has significant potential for broad and lasting benefits to society as well as advancing the informal science learning field.
For over two decades NSF has been investing in the development and evaluation of giant screen films for viewing by audiences in science centers and museums. These have been highly successful in terms of audiences reached and project evaluations that indicate their impact on learning. Less well understood is how the unique attributes of giant screen films (e.g., "immersion" and "presence") affect learners in ways that differ from other film formats. This integrated research and media project will contribute to that knowledge base. Project deliverables will include a giant screen film that tells the story of the discovery of biological mimicry (the critical proof for natural selection and in turn, evolution) through the life story of Henry Bates and his travels through the Amazon rainforest more than 150 years ago; 2D dome, and 2D flat format versions; live interactive science demonstrations and educational resources; and workshops for ISE professionals. The film and the related outreach via science centers, social media, and the web are expected to reach large public audiences; workshops and web resources will reach ISE professionals nationally. A strategy for reaching underrepresented audiences through science museums and partnerships with educational societies is a part of the broadening participation effort. Building on results of an NSF-funded workshop in which researchers, evaluators, and filmmakers began to develop a research agenda to provide evidence about giant screen attributes and their impacts on learning, the research component of this project will focus on the differences in learner knowledge among the various film formats, their unique attributes, and whether format plays a role in science interest and science identity. A baseline study will be conducted to begin gathering evidence on how each of these formats affects learning. Data on audience knowledge gains, interest, and science identity will be collected using a novel tablet-based game-like assessment pre-film viewing, immediately post viewing, and in a later follow-up. These baseline data will inform follow-on research that, over time, can better explain the unique impacts on learning of the giant screen format. Project partners include the Pacific Science Center, SK Films, Howard Hughes Medical Institute, Rutgers University, and Arizona State University.
The mission of the New Mexico Informal Science Education Network (NM ISE Net) is to provide opportunities and resources for informal educators to work together to impact science teaching, science learning, and science awareness throughout the state of New Mexico. The NM Museum of Natural History and Science leads NM ISE Net with support from NM EPSCoR.
DATE:
-
TEAM MEMBERS:
New Mexico Museum of Natural HistorySelena ConnealyCharlie Walter