This report details the formative evaluation study conducted through collaboration with the National Science Teachers Association (NSTA) and the Association of Science-Technology Centers (ASTC) to inform the iterative development and piloting of the Connected Science Learning: Connecting In-School and Out-of-School STEM Learning journal. The journal was the result of an Early Concept Grant for Exploratory Research (EAGER) project funded by the National Science Foundation (NSF) to develop, disseminate and evaluate a new resource for connecting STEM education practitioners across settings and to
The CADRE Early Career Guide offers advice from experienced DR K-12 awardees on becoming a successful researcher in the field of STEM education. The guide also profiles a support program, the CADRE Fellows, for doctoral students in STEM education research.
DATE:
TEAM MEMBERS:
Jennifer StilesCatherine McCullochCommunity for Advancing Discovery Research in Education (CADRE)
resourceresearchProfessional Development, Conferences, and Networks
If your project, large or small, needs an external review panel or evaluation advisory committee to help oversee the extent to which project impacts were achieved, one option is to create an Evaluation Committee of Visitors (COV). A COV is commonly used when a project team wants to ensure a consistent outsider lens and broader perspective. As an external group, the COV reviews work and provides recommendations to improve project performance. In this example from the NISE Network, a COV was designated for evaluation efforts. Depending on how the evaluation activities are situated in your
DATE:
TEAM MEMBERS:
Oregon Museum of Science and Industry
The project team is developing and testing a prototype of Thinkzone, a blended learning portal intended for Kindergarten through Grade 8 teachers to host existing education learning games across core subject areas. The prototype will host games, and include a learning system to train educators to integrate games to replace or supplement instructional practice. In the Phase I pilot study will include 10 teachers and 200 students. The researchers will examine if the prototype functions as planned, if teachers are able to implement it with small groups of students, and whether students are engaged across the various games.
This White Paper is based on proceedings from the National Living Laboratory Workshop: High School Research Experiences in Living Laboratory - a convening of professionals who wished to share resources and explore opportunities to involve high school students in the Living Laboratory model.
Students in the U.S. educational system are increasingly diverse, and this diversity is reflected in science, technology, engineering, and mathematics (STEM) fields. Diversity in education encompasses students from many races, genders, and socioeconomic backgrounds; students who speak a variety of languages; and students from many cultures. For instance, ethnic diversity increased by 5% across primary and secondary public schools from 2000 to 2007 (Aud, Fox, & KewalRamani, 2010). Diversity is also evident in the socioeconomic make-up of students, with almost half of 4th graders in public
To explore the role and impact of The Innovation Lab at Youth Radio, Rockman et al, an independent research and evaluation organization, conducted an external evaluation of the project. With funding from the National Science Foundation’s Advancing Informal STEM Learning (AISL) program, the Innovation Lab sought to develop and research a scalable, evidence-informed theory of action to engage underrepresented youth in Science, Technology, Engineering, and Mathematics (STEM) learning through the collaborative creation and dissemination of original journalistic media, technology, and curriculum
Researching the Value of Educator Actions for Learning (REVEAL) is an NSF-funded research project, led by the Oregon Museum of Science and Industry (OMSI) in collaboration with TERC and Oregon State University (OSU), which studied the impact of science center staff facilitation strategies at math exhibits. Building on and using exhibits from Design Zone—an interactive math exhibition which engaged visitors in exploring algebraic relationships and functions—the study was designed to add to the scant existing literature about the impact of staff facilitation on visitors. The study also aimed to
Co-led by the University of Washington and Science Gallery Dublin, this project aims to drive and transform the next generation of broadening participation efforts targeting teen-aged youth from communities historically underrepresented in STEM fields. This project investigates how out-of-school time (OST) programs that integrate epistemic practices of the arts, sciences, computer science, and other disciplines, in the context of consequential activities (such as creating radio segments, designing museum exhibitions, or building online games), can more broadly appeal to and engage youth who do not already identify as STEM learners. STEM-related skills and capacities (such as computational thinking, design, data visualizations, and digital storytelling) are key to productive and creative participation in many future civic and workplace activities, and are driving the 30 fastest-growing occupations in the US. But many new jobs will entail a hybrid blend of skills, such as programming and design skills that many students who have disengaged with academic STEM pathways may already have and would be eager to develop further. There is not currently a strong foundation of research-based evidence to guide the design, implementation, and evaluation transdisciplinary programs - in which STEM skills are embedded as tools for meaningful participation - or how such approaches relate to long-term outcomes. Hypothesizing that OST programs which effectively engage youth during their high-leverage teenage years can significantly impact youths' longer-term STEM learning trajectories, this project will involve: 1) Five 3-year studies documenting learning in different technology-rich contexts: Making Afterschool, Media Production, Museum Exhibition Design, Digital Arts Programs, and Pop-Up/Street Science Programs; 2) A 4-year longitudinal study, involving 100 youth from the above programs; 3) The creation of a number of practical measurement tools that can be used to monitor how programs are leveraging the intersections of the arts and sciences to support student engagement and learning; and 4) A Professional Development program conducted at informal science education conferences in the EU and US to engage the informal STEM field with emerging findings. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences to better understand, strengthen, and coordinate STEM engagement and learning. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments.
Transdisciplinary, equity-oriented OST programs can provide supportive social contexts in which STEM concepts and practices are taken up as the means for meaningful participation in valued activities, building students' STEM skills in ways that can propel their future academic, career, and lifelong learning choices. This project will build the knowledge base about these emerging 21st century transdisciplinary approaches to broadening participation investigating: 1) The epistemic intersections across a range of disciplines (art, science, computation, design) that operate to broaden appeal and meaningful participation for underrepresented youth; 2) How transdisciplinary activities undertaken in the context of consequential learning (e.g., producing a radio segment, designing an exhibition for the general public) can illuminate the relevance of STEM to young people's lives, concerns, and futures; and 3) How participation in such programs can propel students' longer-term life choices and STEM learning trajectories. The project is a collaboration of the University of Washington, Science Gallery Dublin, Indiana University, Youth Radio in Oakland California, Guerilla Science in New York and London, and the London School of Economics.
Science researchers and practitioners are often challenged by how best to assess the effectiveness of science activities on young children whose language skills are still emerging. Yet, research has demonstrated the critical importance of early learning on individual potential. Building on evidence that movement is tightly intertwined with thinking, this project will investigate how thought and movement link as embodied learning to accelerate science understanding. Research will be conducted in the United States (US) and the United Kingdom (UK) with the aim to gather evidence for embodied interactions during science learning and articulate design principles about how museum exhibits can most effectively encourage cognitive and physical engagement with science. Such guidelines are largely absent in the field of informal STEM learning, and so this project seeks transformational change in how learning is understood and recognizes that changes in knowledge can be developed and revealed through body-based movements as well as verbally. Such a view is critically important given that many early learners communicate understanding through nonverbal channels before verbal. Research will be conducted with a diverse population of children and will explore the application of embodied learning to communities that are underrepresented in STEM. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences. During a 3-year period, researcher-practitioner teams across six museum sites will collaboratively investigate the links between movement and learning outcomes at selected science exhibits designed for young learners. Research activities will involve iteration and refinement of new instruments and protocols, through analysis of observed and automated capture of interaction data, and synthesis and interpretation of data. A design-based research methodology will be applied to address three key questions: 1) What elements of sensory and action experiences are key to informing the design of exhibits that aim to exploit embodied interactions for learning; 2) What is the role of bodily enactment /gestures in assessing children's understanding of science concepts; and 3) What cultural differences in kinds of embodied engagement emerge across diverse museum settings? Video and audio data of 400 children's exhibit interactions will be collected. Pre/post semi-structured interviews will be conducted with a subset of these participants and will focus on children's understanding of relevant science concepts as well as personal reflections on their physical and emotional experience engaging with the exhibit. This project would raise awareness of embodied approaches to learning as well as build stronger collaborations between informal STEM educators and cognitive researchers. Utilization of informal and formal dissemination networks will support wide diffusion of project outcomes. This is critically important given strong evidence pointing to the impact of preschool education in underserved populations, and ongoing national efforts by the US and UK to improve the quality of STEM learning in preschool contexts.
Project partners supported by NSF funding include The Phillip and Patricia Frost Museum of Science, University of Illinois Urbana Champaign, The Children's Museum of Indianapolis, andSciencenter (Ithaca).
Partners supported by the Wellcome Trust include University of Edinburgh, University College London, Glasgow Science Centre, Science Museum London, and Learning through Landscapes.
This 4-year project addresses fundamental equity issues in informal Science, Technology, Engineering and Mathematics (STEM) learning. Access to, and opportunities within informal STEM learning (ISL) remain limited for youth from historically underrepresented backgrounds in both the United States and the United Kingdom. However, there is evidence that ISL experiences can expand opportunities for youth learning and development in STEM, for instance, increase positive attitudes towards educational aspirations and future careers/pursuits, improve grades and test scores in school settings, and decrease disciplinary action and dropout rates. Through research and development, this project brings together researchers and practitioners to focus on the experiences, practices and tools that will support equitable youth pathways into STEM. Working across conceptual frameworks and ISL settings (e.g. science centers, community groups, zoos) and universities in four urban contexts in two different nations, the partnership will produce a coherent knowledge base that strengthens and expands research plus practice partnerships, builds capacity towards transformative research and development, and develops new models and tools in support of equitable pathways into STEM at a global level. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences. This Equity Pathways project responds to three challenges at the intersections of ISL research and practice in the United States and the United Kingdom: 1) lack of shared understanding of how youth from historically underrepresented backgrounds perceive and experience ISL opportunities across national contexts, and the practices and tools needed to support empowered movement through ISL; 2) limited shared understanding and evidence of core high-leverage practices that support such youth in progressing within and across ISL, and 3) limited understanding of how ISL might be equitable and transformative for such youth seeking to develop their own pathways into STEM. The major goal of this Partnership is for practitioners and researchers, working with youth through design-based implementation research, survey and critical ethnography, to develop new understandings of how and under what conditions they participate in ISL over time and across settings, and how they may connect these experiences towards pathways into STEM. The project will result in: 1) New understandings of ISL pathways that are equitable and transformative for youth from historically underrepresented backgrounds; 2) A set of high leverage practices and tools that support equitable and transformative informal science learning pathways (and the agency youth need to make their way through them); and 3) Strengthened and increased professional capacity to broaden participation among youth from historically underrepresented backgrounds in STEM through informal science learning. The project will be carried out by research + practice partnerships in 4 cities: London & Bristol, UK and Lansing, MI & Portland, OR, US, involving university researchers (University College London, Michigan State University, Oregon State University/Institute for Learning Innovation) practitioners in science museums (@Bristol Science Centre, Brent Lodge Park Animal Centre, Impressions 5, Oregon Museum of Science & Industry) and community-based centers (STEMettes, Knowle West Media Centre, Boys & Girls Clubs of Lansing, and Girls, Inc. of the Pacific Northwest).
The National Science Foundation (NSF) Climate Change Education Partnership Alliance (CCEPA) is a consortium made up of the six Phase II Climate Change Education Partnership (CCEP-II) program awardees funded in FY 2012. Collectively, the CCEPA is establishing a coordinated network devoted to increasing the adoption of effective, high quality educational programs and resources related to the science of climate change and its potential impacts. The establishment of a CCEPA Coordination Office addresses the need for a coordinating body that leverages and builds upon the CCEPA projects' individual initiatives. The CCEPA Coordination Office facilitates interactions to leverage a successful network of CCEP-II projects and individuals engaged in increasing climate science literacy. The efforts of the Coordination Office advance knowledge and understanding of how to effectively network related, but different, projects into a cohesive enterprise. The goal is to coordinate a functional network, where the whole is greater than the sum of the parts.
The CCEPA Coordination Office at the University of Rhode Island is helping to move the CCEPA network forward on a number of key initiatives that strengthen it, reduce duplication, and enhance its overall impact. An important role of the Coordination Office is the facilitation of the transfer of best practices between projects. An effective network forges collaborations and establishes communities of practice through network working groups, building intellectual capital network-wide. The CCEPA Coordination Office has a key role in assisting the CCEPA project PIs and staff to disseminate the results of their work. Partnerships with other relevant societies and organizations assist the Coordination Office in identifying opportunities and synergies for sharing, disseminating, and leveraging network products as well as best practices that emerge as Earth system science education models and tools are evaluated. This endeavor broadens the collective impact of the individual projects across the country.