As part of the public impacts evaluation work conducted for the Explore Science: Earth & Space activity toolkits developed and created through the NASA-funded Space and Earth Informal STEM education (SEISE) project, this summative evaluation study of the toolkits was designed to address and answer questions regarding the number and range of audiences reached by the project, visitor engagement, relevance, science identity, and their understanding around NASA’s Science Mission Directorate (SMD) content areas (astrophysics, planetary science, heliophysics, Earth science). The results are based on
Supported by the National Science Foundation, the Global Soundscapes! Big Data, Big Screens, Open Ears project employs a variety of informal learning experiences to present the physics of sound and the new science of soundscape ecology. The interdisciplinary science of soundscape ecology analyzes sounds over time in different ecosystems around the world. The major components of the Global Soundscapes project are an educator-led interactive giant-screen theater show, group activities, and websites. All components are designed with both sighted and visually impaired students in mind. Multimedia
The Space and Earth Informal STEM Education (SEISE) project, led by the Arizona State University with partners Science Museum of Minnesota, Museum of Science, Boston, and the University of California Berkeley’s Lawrence Hall of Science and Space Sciences Laboratory, is raising the capacity of museums and informal science educators to engage the public in Heliophysics, Earth Science, Planetary Science, and Astrophysics, and their social dimensions through the National Informal STEM Education Network (NISE Net). SEISE will also partner on a network-to-network basis with other existing coalitions and professional associations dedicated to informal and lifelong STEM learning, including the Afterschool Alliance, National Girls Collaborative Project, NASA Museum Alliance, STAR_Net, and members of the Association of Children’s Museums and Association of Science-Technology Centers. The goals for this project include engaging multiple and diverse public audiences in STEM, improving the knowledge and skills of informal educators, and encouraging local partnerships.
In collaboration with the NASA Science Mission Directorate (SMD), SEISE is leveraging NASA subject matter experts (SMEs), SMD assets and data, and existing educational products and online portals to create compelling learning experiences that will be widely use to share the story, science, and adventure of NASA’s scientific explorations of planet Earth, our solar system, and the universe beyond. Collaborative goals include enabling STEM education, improving U.S. scientific literacy, advancing national educational goals, and leveraging science activities through partnerships. Efforts will focus on providing opportunities for learners explore and build skills in the core science and engineering content, skills, and processes related to Earth and space sciences. SEISE is creating hands-on activity toolkits (250-350 toolkits per year over four years), small footprint exhibitions (50 identical copies), and professional development opportunities (including online workshops).
Evaluation for the project will include front-end and formative data to inform the development of products and help with project decision gates, as well as summative data that will allow stakeholders to understand the project’s reach and outcomes.
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
The idea to link European citizenship and science education is surely new and uncommon in Poland, but we think, as SEDEC project, that can enrich both the panorama of science popularization outside and inside school system. I checked carefully curricula for every stage of school education looking for the topics concerning the developing of the European citizenship. I found that they are usually connected to the history, geography and some activities developing of the knowledge about generally defined citizenship. The spare topics connected directly to the science are present especially in
Bathgate, Schunn, and Correnti investigate students’ motivation toward science across three dimensions: the context or setting, the way in which students interact with science materials or ideas, and the activity topic. Findings point to the importance of understanding children’s perceptions of specific science topics, not just science in general.
Engineering Enabling Science - A NASA GSFC Informal Education Environment Collaborative is a collaborative relationship between and among NASA Goddard Education Office, Greenbelt and Wallops Visitor Centers, Port Discovery Children’s Museum of Baltimore, The Maryland Science Center, and Prince George’s County Public Schools Owens Science Center to leverage current and past NASA Goddard Office of Education and Science Mission Directorate and Engineering investments in Earth Sciences, Astrophysics, Heliophysics, and Planetary Science and NASA Missions. The goal of GSFC’s collaborative is to interface with a number of organizations to provide leveraging, expand their activities and to utilize NASA-related activities in a broader context than that of the individual organization thereby reducing redundancy of effort and services. Specifically, the Office of Education-GSFC Visitor Centers (Greenbelt and Wallops) will develop an integrated model for sharing and delivering high quality education services and activities based on NASA unique capabilities within a network of organizations and institutions serving the general public. The common thread across all proposed activities will be NASA-unique content that flows from the science and technology work of NASA’s Mission Directorates and its Engineering directorate, thereby demonstrating that engineering truly enables science by applying the engineering cycle to the four science themes of Earth Science, Astrophysics, Planetary Science, and Heliophysics. The products of these activities will directly relate to the Educator Professional Development (EPD) and STEM Engagement (SE) lines of business established by NASA educators, as well as showing the interactions and shared STEM learning opportunities between informal and formal education communities rather than viewing informal and formal education as stovepipes.
A partnership between Carthage College and the Appalachian Mountain Club has delivered a successful public education and outreach program that merges natural environment topics and astronomy. Over the four years of activity, over 25,000 people have received programming. The effort has trained nature educators, permanent and seasonal AMC staff, and undergraduate physics and astronomy students to integrate diverse topical material and deliver high quality programming to the lay public. Unique to the program is the holistic nature of the material delivered - an 'atypical' astronomy program. Linking observable characteristics of the natural world with astronomical history and phenomena, and emphasizing the unique sequence of events that have led to human life on Earth, the program has changed attitudes and behaviors among the public participants. Successful interventions have included hands-on observing programs (day and night) that link nature content to the observed objects; table-talk presentations on nature/astronomy topics; dark skies preservation workshops; and hands-on activities developed for younger audiences, including schools, camps, and family groups. An extensive evaluation and assessment effort managed by a leading sociologist has demonstrated the effectiveness of the approach, and contributed to continuous improvement in the program content and methods.
Quest, produced by KQED, is a multimedia initiative designed to raise the profile of STEM issues throughout the Northern California region and activate citizens to discuss and investigate them. Led by KQED, Quest is created and maintained by an active consortium of 16 participating informal science education organizations. Based on the successful Quest model, KQED will build on its prior collaborative work to develop regional partnerships with other public broadcasting stations and community-based organizations around the country, making possible a new and innovative partnership in science media production and informal science education. This grant will support a) a growing collaborative of science centers, museums, research institutes, and community-based organizations for editorial development, education outreach, and content creation; b) the production of at least 10 hours of television, weekly radio science news reports, and a dynamic online website that supports and extends the broadcast material; and c) educational resources and professional development workshops. STEM content will encompass research drawn from the physical sciences, life sciences, and earth sciences. Most of the stories will also incorporate content about the technology and engineering used to support scientific endeavors. The KQED Educational Network (EdNet) will administer the community and educational outreach initiatives, including creating viewer/listener guides, developing and delivering workshops, and providing information built around Quest media. Project collaborators include the Bay Institute, California Academy of Sciences, Chabot Space and Science Center, East Bay Regional Park District, Exploratorium, Girl Scouts, Lawrence Berkeley National Laboratory, Lawrence Hall of Science, Museum of Paleontology, Oakland Zoo, and The Tech Museum of Innovation. In expanding the model to regional hubs, Quest will also involve the Coalition for Public Understanding of Science (COPUS), the Encyclopedia of Life, and an array of peer public broadcasting organizations. This project offers a useful and exciting model for public television and radio stations nationally in building community collaborations that advance informal science education. The detailed and informed ways in which the team works with its community partners via multiple platforms are innovative. This proposal builds on prior work in Northern California to explore additional regional partnerships with other public broadcasting stations and community-based organizations, making possible a unique partnership in science media production and informal science education. This project extends reach by developing up to ten regional "hubs" across the country. Evaluation will be conducted by Rockman et al.
This Broad Implementation media project (building upon prior NSF award 0639001) will address science literacy among Latinos via mass media, increasing the amount of Spanish-language science content available in the U.S., increasing the representation of Latino scientists in mainstream media, and expanding the knowledge base about Latino's interest and engagement in science. The STEM content will be based on the research conducted by the Hispanic scientists being interviewed and therefore includes a wide range of topics including astronomy, biology, physics, earth sciences, and engineering. The criteria for selecting the Hispanic researchers and the content is based on the importance of the research, how it is immediately relevant to a Latino audience, and how it draws on the indigenous knowledge system or ethnic pride for U.S. Latinos. Project deliverables include 150 audio-video interviews with Hispanic scientists distributed on both commercial Hispanic radio and TV stations, as well as public broadcasting and online. In addition to the broadcasts, social media tools such as Facebook and Twitter will be used to reach out and engage Hispanics. It is estimated that 300 Spanish-language radio stations will air the programs, resulting in 3 million radio impressions for each daily 60-second broadcast. Television broadcasts are estimated to result in another 2 million impressions per program. Project partners include the Society for the Advancement of Chicanos and Native Americans in Science (SACNAS); V-Me, a national Hispanic educational channel; KLRN, the San Antonio, Texas public television station that will provide the national PBS distribution; and DaGama Web Studio that will develop and implement the social media marketing plan to attract and engage Latinos online. Comprehensive evaluations of project deliverables and impact will be conducted by Informal Learning Solutions (video-audio formative evaluations), and Knight-Williams Research (summative evaluation of project impact). The Summative Evaluation Plan will focus on the programs\' overall appeal, clarity, and effectiveness in meeting the two key audience objectives in the proposal: (1) increasing familiarity with and understanding of science concepts among U.S. Latinos, and (2) demonstrating engagement activities such as talking with friends/family about the presented topics, and/or seeking out additional information. It will furthermore assess the extent to which listeners and viewers find the Hispanic researchers featured in the programs to be effective communicators and the importance they assign to hearing from Hispanic researchers themselves. It will look at whether and how the programs are effective selecting topics with immediate relevance to listeners'/viewers' everyday lives. Finally, the evaluation will gather information about listeners'/viewers' demographic and background characteristics, including their country of origin, degree of fluency in Spanish, reasons for preferring Spanish media, number of generations in the U.S., reasons for tuning into the programming, efforts to recommend the programs to others, and the likelihood of continuing to listen to or view the programs in the future.
In partnership with the University of Pennsylvania's Graduate School of Education, The Franklin Institute Science Museum will develop, test, and pilot an exportable and replicable cyberlearning exhibit using two cutting edge technologies: Augmented Reality (AR) and Virtual Reality (VR). The exhibit's conceptualization is anchored in the learning research vision of the NSF-funded workshop Cyberinfrastructure for Education and Learning for the Future (Computing Research Association, 2005). The incorporation of VR and AR technologies into the Franklin Institute's electricity and Earth science exhibits is an innovation of traditional approaches to hands-on learning and will improve the quality of the learning experience for the primary audience of families with children and elementary school groups. The project has implications for future exhibit development and more broadly, will provide new research on learning on how to incorporate cyberlearning efforts into traditional exhibits. Fifteen participating exhibit developers across the ISE field will assist in the evaluation of the new exhibit; receive training on the design and development of VR and AR exhibits for their institutions; and receive full access to the exhibit's new software for implementation at their informal learning sites. The technology applications will be developed by Carnegie Mellon University's Entertainment Technology Center--leaders in the field in Virtual Reality design and development. Front-end and formative evaluation will be overseen internally by the Franklin Institute. The Institute for Learning Innovation will conduct the summative evaluation. Research will be conducted by the University of Pennsylvania's Graduate School of Education on the effects of AR and VR technologies on exhibit learning.
This Advancing Informal Science Learning Pathways project, Using Technology to Research After Class (UTRAC), explores whether a combination of technology (e.g., iPad-enabled sensors, web-based inquiry-focused portal) and facilitated visits improves learning outcomes for rural and Native American elementary-age youth in after school programs. Expected outcomes include improved engagement, knowledge, skills, and attitudes toward science, technology, engineering, and math (STEM). Project goals include promoting STEM learning through science inquiry activities keyed to specific Next Generation Science Standards as well as improving how technology can be used to enhance learning outcomes in afterschool programs. The experimental design of this project - testing the effects of physical or virtual facilitation visits on learning outcomes - will lead to improvements in STEM learning outcomes among rural and underrepresented students. This project will employ several innovations in utilizing technology to teach STEM topics including: (i) hands-on, real-time, crowd sourced data collected by participants in their schoolyards; (ii) a pedagogic emphasis on communication of schoolyard data among and between participants; (iii) testing of motivational incentives; and (iv) partnerships between after school providers, preservice teachers, and university researchers as facilitators. The entire process will be modularized so that it can be modified in terms of place, STEM topic or student cohort. The topic focus of the project -- Life Under Snow -- is relevant to participating students, as Montana school playgrounds lie blanketed under snow for the majority of the school year; it includes elements of snow science, carbon cycle science, and a combination at the intersection of three recent literacy initiatives (e.g., Earth Science, Climate, or Energy). UTRAC will pilot and evaluate facilitated snow science/carbon cycle science activities that couple real-time schoolyard data with tools patterned after those available through WISE (Web-based Inquiry Science Environment; wise.berkeley.edu). Participants will collect and compare data with other youth participants, and researchers will use formative assessments to define interventions with potential to maximize student engagement and learning improvements among underserved youth. The project will advance understanding of informal education's potential to improve STEM engagement, knowledge, skills and attitudes by quantifying how - and to what extent - youth engage with emerging technologies iPad-enabled sensors, and crowdsourcing and visualization tools. The deliverables include a quantifying metric for learning outcomes, a training model for the iPad sensors and web application, an orientation kit, a social media portal, and database for the measurements.