The National Museum of the American Indian, NY (NMAI-NY) contracted RK&A to conduct a two-phase formative evaluation of the museum’s upcoming Native New York exhibition. The study’s objectives for walk-in visitors and teachers were to understand their baseline knowledge, what piques their interest, potential barriers (confusion or misunderstanding), strategies to help make personal connections, and how/if they understand exhibition outcomes (such as appreciate who Native Americans are today and understand that Native peoples have powerfully shaped and defined New York’s geography, economy, and
One way to encourage youth to pursue training in the STEM fields and enter the STEM workforce is to foster interest and engagement in STEM during adolescence. Informal STEM Learning Sites (ISLS) provide opportunities for building interest and engagement in the STEM fields through a multitude of avenues, including the programming that they provide for youth, particularly teens. Frequently, ISLS provide opportunities to participate in volunteer programs, internships or work, which allow teens both to learn relevant STEM knowledge as well as to share that knowledge with others through opportunities to serve as youth educators. While youth educator programs provide rich contexts for teens to engage as both learners and teachers in these informal STEM environments, research to date has not yet identified the relationship between serving as youth educators and STEM engagement. Thus, the goal of this project is to document the impact of youth educators on visitor learning in ISLS and to identify best practices for implementing youth educator programs. The project studies STEM interests and engagement in the youth participants and the visitors that they interact with at six different ISLS in the US and UK. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences.
This project examines youth educator experiences related to STEM identity, educational aspirations, and motivation. The project also identifies outcomes that the youth educators have on visitors to ISLS in terms of knowledge, interest, and engagement in STEM. The specific aims are: 1) Outcomes for Teens - To measure the longitudinal impact of participation in an extended youth educator experience in an ISLS; 2) Outcomes for Visitors - To compare visitor engagement with and learning from exhibits in ISLS when they interact with a youth educator, relative to outcomes of interacting with an adult educator or no educator; and 3) Outcomes Across Demographics and STEM Sites - To examine differences in visitor engagement based on participant characteristics such as socio-economic status (SES), age, gender, and ethnicity and to compare outcomes of youth educator experiences across different types of ISLS. This research, which draws on expectancy value theory and social cognitive theory, will follow youth participants longitudinally over the course of 5 years and use latent variable analyses to understand the impact on the youth educators as well as the visitors with whom they interact. Importantly, the results of this research will be used to develop best practices for implementing youth educator programs in ISLS and the results will be disseminated to both academic and practice-based communities.
This project has clear and measurable broader impacts in a variety of ways. First, the project provides guidance to improve programming for youth in ISLS, including both the sites involved directly in the research and to the larger community of ISLS through evaluation, development, and dissemination of best practices. Additionally, this project provides rigorous, research-based evidence to identify and describe the outcomes of youth educator programs. This study directly benefits the participants of the research, both the visiting public and the youth educators, through opportunities to engage with science. The findings speak to issues of access and inclusivity in ISLS, providing insight into how to design environments that are welcoming and accessible for diverse groups of learners. Finally, this project provides evidence for best practices for ISLS in developing programs for youth that will lead to interest in and pursuit of STEM careers by members of underrepresented groups.
DATE:
-
TEAM MEMBERS:
Adam Hartstone-RoseMatthew IrvinKelly Lynn MulveyElizabeth ClemensLauren ShenfeldAdam RutlandMark WinterbottomFrances BalkwillPeter McOwanKatie ChambersStephanie TylerLisa Stallard
Produced by the Climate Change Education Partnership (CCEP) Alliance, the "Climate Change Education: Effective Practices for Working with Educators, Scientists, Decision Makers and the Public" guide provides recommendations for effective education and communication practices when working with different types of audiences. While effective education has been traditionally defined as the acquisition of knowledge, Alliance programs maintain a broader definition of “effective” to include the acquisition and use of climate change knowledge to inform decision-making.
The CCEP Alliance is supported
The Oregon Museum of Science and Industry (OMSI), located in Portland, is a hands-on science museum. In 2013, OMSI received funding from the National Science Foundation for the project Researching the Value of Educator Actions for Learning (REVEAL) to study how museum educators can better help families learn math while interacting with museum exhibits. Through REVEAL, OMSI was able to partner with Adelante Mujeres, a non-profit community organization located in Forest Grove that educates and empowers Latina women and their families. Here we share some of the lessons learned from the
Ciencia Pública is a National Science Foundation (NSF) -funded initiative in which the Exploratorium, in collaboration with the Boys and Girls Club of San Francisco (BGCSF), developed a parklet to engage Latino families in STEM content. The Parklet is located in San Francisco’s Mission District (the Mission), a historically Latino neighborhood. Buena Vista Horace Mann School (BVHM) is an additional project partner and hosts the Parklet on its site. Garibay Group conducted a summative evaluation of the project outcomes. This report discusses evaluation findings.
Utah Valley University (UVU) with partners Weber State University (WSU) and American Indian Services (AIS) are implementing UTAH PREP (PREParation for STEM Careers) to address the need for early preparation in mathematics to strengthen and invigorate the secondary-to-postsecondary-to-career STEM pipeline. As the preliminary groundwork for UTAH PREP, each partner currently hosts a PREP program (UVU PREP, WSU PREP, and AIS PREP) that identifies low-income, under-represented minority, first-generation, and female students entering seventh grade who have interest and aptitude in math and science, and involves them in a seven-week, three-year summer intensive program integrating STEM courses and activities. The course content blends skill-building academics with engaging experiences that promote a clear understanding of how mathematical concepts and procedures are applied in various fields of science and engineering. Courses are enhanced through special projects, field trips, college campus visits, and the annual Sci-Tech EXPO. The purpose of the program is to motivate and prepare participants from diverse backgrounds to complete a rigorous program of mathematics in high school so that they can successfully pursue STEM studies and careers, which are vital to advancing the regional and national welfare.
UTAH PREP is based on the TexPREP program that originated at the University of Texas at San Antonio and which was named as one of the Bright Spots in Hispanic Education by the White House Initiative on Educational Excellence for Hispanics in 2015. TexPREP was adapted by UVU for use in Utah for non-minority serving institutions and in regions with lower minority populations, but with great academic and college participation disparity. With NSF funding for a two-year pilot program, the project partners are building UTAH PREP through a networked improvement community, collective impact approach that, if demonstrably successful, has the ability to scale to a national level. This pilot program's objectives include: 1) creating a UTAH PREP collaboration with commitments to a common set of objectives and common set of plans to achieve them; 2) strengthening existing PREP programs and initiating UTAH PREP at two or three other institutions of higher education in Utah, each building a sustainable local support network; 3) developing a shared measurement system to assess the impact of UTAH PREP programs, adaptations, and mutually reinforcing activities on students, including those from groups that are underrepresented in STEM disciplines; and 4) initiating a backbone organization that will support future scaling of the program's impact.
DATE:
-
TEAM MEMBERS:
Daniel HornsAndrew StoneVioleta Vasilevska
This study was a longitudinal summative evaluation of repeat visitors’ experiences in four Math Moves! exhibitions that were developed as part of a large collaborative exhibition development project called Math Core for Museums, and mounted at four museums around the country: Museum of Science (Boston); Museum of Life & Science (Durham, NC); Explora (Albuquerque); and Science Museum of Minnesota (St. Paul). The summative evaluation purposively selected four family groups at each institution and collected naturalistic data as the 16 groups engaged with the exhibits from 4-6 times over a two
This project had three objectives to build knowledge with respect to advancing Informal STEM Education:
Plan, prototype, fabricate, and document a game-linked design-and-play STEM exhibit for multi-generational adult-child interaction utilizing an iterative exhibit design approach based on research and best practices in the field;
Develop and disseminate resources and models for collaborative play-based exhibits to the informal STEM learning community of practice of small and mid-size museums including an interactive, tangible tabletop design-and-play game and a related tablet-based game app for skateboarding science and technology design practice;
Conduct research on linkages between adult-child interactions and game-connected play with models in informal STEM learning environments.
Linked to these objectives were three project goals:
Develop tools to enable children ages 5-8 to collaboratively refine and test their own theories about motion by exploring fundamental science concepts in linked game and physical-object design challenge which integrates science (Newton’s Laws of Motion) with engineering (iterative design and testing), technology (computational models), and mathematics (predictions and comparisons of speed, distance, and height). [Linked to Objectives 1 & 3]
Advance the informal STEM education field’s understanding of design frameworks that integrate game environments and physical exhibit elements using tangibles and playful computational modeling and build upon the “Dimensions of Success” established STEM evaluation models. [Linked to Objectives 1 & 2]
Examine methods to strengthen collaborative learning within diverse families through opportunities to engage in STEM problem-based inquiry and examine how advance training for parents influences the extent of STEM content in conversations and the quality of interactions between caregivers and children in the museum setting. [Linked to Objectives 1 & 3]
The exhibit designed and created as a result of this grant project integrates skateboarding and STEM in an engaging context for youth ages 5 to 8 to learn about Newton’s Laws of Motion and connect traditionally underserved youth from rural and minority areas through comprehensive outreach. The exhibit design process drew upon research in the learning sciences and game design, science inquiry and exhibit design, and child development scholarship on engagement and interaction in adult-child dyads.
Overall, the project "Understanding Physics through Collaborative Design and Play: Integrating Skateboarding with STEM in a Digital and Physical Game-Based Children’s Museum Exhibit" accomplished three primary goals. First, we planned, prototyped, fabricated, and evaluated a game-linked design-and-play STEM gallery presented as a skatepark with related exhibits for adult-child interaction in a Children's Museum.
Second, we engaged in a range of community outreach and engagement activities for children traditionally underserved in Museums. We developed and disseminated resources for children to learn about the physics of the skatepark exhibit without visiting the Museum physically. For example, balance board activities were made portable, the skatepark video game was produced in app and web access formats, and ramps were created from block sets brought to off-site locations.
Third, we conducted a range of research to better understand adult-child interactions in the skatepark exhibit in the Children's Museum and to explore learning of physics concepts during physical and digital play. Our research findings collectively provide a new model for Children's Museum exhibit developers and the informal STEM education community to intentionally design, evaluate, and revise exhibit set-up, materials, and outcomes using a tool called "Dimensions of Success (DOS) for Children's Museum Exhibits." Research also produced a tool for monitoring the movement of children and families in Museum exhibit space, including time on task with exhibits, group constellation, transition time, and time in gallery. Several studies about adult-child interactions during digital STEM and traditional pretend play in the Museum produced findings about social positioning, interaction style, role, and affect during play.
DATE:
-
TEAM MEMBERS:
Deb DunkhaseKristen MissallBenjamin DeVane
resourceevaluationProfessional Development, Conferences, and Networks
The Summative Study of the Nano Mini-exhibition took place during the spring and summer of 2012. After being observed during their Mini-exhibition experience, 455 visitors across six different partner institutions participated in surveys and interviews with NISE Net evaluation team members. This report begins by describing the key findings of the study in detail, with additional information about study methods, instruments, and two exploratory sub-studies found in the Appendices.
The National Institutes of Health (NIH) awarded OMSI funding during the spring of 2011 to create a 2,000 sq. ft. bilingual (English/Spanish) traveling exhibition exploring current research on the human microbiome and the impact of our resident microorganisms on our health. The exhibition was developed with the support of the J. Craig Venter Institute and other national experts in microbiome research. More information about the exhibition can be found at http://omsi.edu/exhibitions/zoo-in-you/. The Zoo in You Project Goals are to (1) Educate museum visitors and program participants about what
The exploratory phase of a project to bring a new humanities initiative at the John Carter Brown Library to a much broader public than has traditionally been the case for the Library’s exhibitions and scholarly projects. “Exploring the Four Elements: Toward a Digital Environmental History of the Americas” takes a simple concept -- the cultural significance of earth, air, fire, and water to the diverse populations of the Americas, from the continent’s earliest indigenous inhabitants to the last waves of European scientific explorers at the end of the colonial period -- and examines the ramifications of human engagement with these elements as a window onto changing ecological relationships throughout the pre-contact and early modern periods in the early Americas.
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. Native Universe (NU) was designed to build institutional capacity in leadership and practice among scientific museums, in order to increase public understanding of environmental change and the human relationship to nature from Indigenous perspectives, while also providing access to science as practiced in the established scientific community.