The Robert R. McCormick Foundation contracted RK&A to conduct a formative evaluation of the Freedom Express mobile museum program to assess the degree to which the program supports students toward the achievement of stated civic engagement-related outcomes. How did we approach this study? The evaluation was designed to explore the extent to which students demonstrate desired outcomes after experiencing the Freedom Express program and to identify the extent to which teachers value and recognize the benefits of the program. To capture diverse perspectives and produce reliable data, RK&A utilized
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Randi Korn
The Young Developers program is an after school program conceptualised and run by The P-STEM Foundation. It introduces computer programming and design concepts to high school age students from South African historically disadvantaged communities, where the majority of students have had little or no interaction with computers. Young Developers uses Self Organised Learning Methodology and involves introducing a series of increasingly complex challenges / questions that the participants have to collaboratively solve. The first module is run in Scratch with the final objective being the creation of a racing car game. The second module is run in Python using Turtle graphics with an objective of creating an animation. This program runs as pods in each of the communities that the P-STEM foundation works in. Each pod has up to 30 teens from the age of 10 to 18. Each pod is peer led and peer driven, and the pace of learning is determined by the participants. In 2015, we would also like to introduce national competitions which pods participate in against other pods.
This is a Science Learning+ planning project that will develop a plan for how to conduct a longitudinal study using existing data sources that can link participation in science-focused programming in out-of-school settings with long-range outcomes. The data for this project will ultimately come from "mining" existing data sets routinely collected by out-of-school programs in both the US and UK. 4H is the initial out-of-school provider that will participate in the project, but the project will ideally expand to include other youth-based programs, such as Girls Inc. and YMCA. During the planning grant period, the project will develop a plan for a longitudinal research study by examining informal science-related factors and outcomes including: (a) range of educational outcomes, (b) diversity and structure of learning activities, (c) links to formal education experiences and achievement measures, and (d) structure of existing informal science program data collection infrastructure. The planning period will not involve actual mining of existing data sets, but will explore the logistics regarding data collection across different informal science program, including potential metadata sets and instruments that will: (a) identify and examine data collection challenges, (b) explore the implementation of a common data management system, (c) identify informal science programs that are potential candidates for this study, (d) compare and contrast data available from the different programs and groups, and (e) optimize database management.
Young people's participation in informal STEM learning activities can contribute to their academic and career achievements, but these connections are infrequently explicitly recognized or cultivated. More systemic approaches to STEM education could allow for students' experiences of formal and informal STEM learning to be aligned, coordinated, and supported across learning contexts. This Science Learning+ planning project brings together stakeholders in two digital badge systems--one in the US and one in the UK--to plan for a study to identify the specific structural features of the systems that may allow for the alignment of learning objectives across institutions. Digital badge systems may offer an inventive solution to the challenge of connecting and building on youth's STEM-related experiences in multiple learning contexts. When part of a defined system, badges could be used to represent and communicate evidence of individual learning, as well as provide youth and educators with evidence-supported indicators for other activities in the system that might be interesting or valuable. Properly designed and supported badge systems could transmit critical information within a network of informal STEM programs and schools that (1) recognize context-dependent, interest-driven learning and (2) provide opportunities to explore those interests across multiple settings. This project advances the field of informal STEM learning in two ways. First, the project documents and analyzes the processes by which two small groups of informal science education organizations and schools negotiate the meaning and value of badges, as proxies for learning objectives, and how they decide to recognize badges awarded by other institutions. This process builds capacity within the target systems while also beginning to identify the institutional, cultural, and material capacity issues that facilitate or constrain the alignment process. Second, the project conducts a pilot study with a small number of youth in the US and UK to investigate factors associated with an individual youth's likelihood of: a) identifying badges of interest; b) connecting the activities of various badge systems to each other and to non-badging institutions, such as school or industry; c) determining which badges to pursue; and d) persisting in a particular badge pathway. Findings from this pilot study will help identify institution- and individual-level factors that might be associated with advancing student interest and progression in STEM fields. Deepening and validating the understanding of those factors and their relative impact on student experiences and outcomes will be the focus of investigations in future studies.
DATE:
-
TEAM MEMBERS:
James DiamondNew York City Hive Learning NetworkMOUSEDigitalMeKatherine McMillan
This Science Learning+ project will develop a Youth Access & Equity Research & Practice Agenda, focusing on addressing equity issues for youth, ages 11-14, primarily from non-dominant backgrounds. The project will involve researchers and practitioners from three ISL settings/contexts, (1) Designed spaces, e.g., museums; (2) Community-based, e.g., afterschool clubs; and (3) Everyday science, e.g., science media. The goal of the agenda will be to advance scholarly understanding of equity issues in relation to these three contexts. Taking an ecological view of STEM learning as a sociocultural process of participation and transformation, the project will employ a Complex Adaptive System lens to document multiple pathways youth take (or not) within/across ISL settings over time, the impact these pathways have on learning and development, and their influence on ISL organizations themselves. These lenses will help us identify aspects of learning environments which shape youth access and development, and the value and impact of the equity ideas, tools and practices.
Relatively little is known about how Natural History Museums (NHMs) and schools can complement one another to maximize learning among school-age learners. Nor do we fully understand the long-term benefits to learning and engagement with science that NHMs have. In this Science Learning+ project researchers in UK and US universities will work with practitioners in NHMs and school teachers in the UK and the US to address these questions. The project will (a) undertake a critical review of the published and grey literature to examine the contributions to learning and engagement that NHMs have made; (b) develop improved instruments that are common across schools, NHMs and other out-of-school settings to determine the efficacy of learning experiences; devise protocols to explore the possibility of data obtained from museum evaluations being matched with national databases, thus improving our understanding of the consequences of such experiences; (c) map the areas of science curricula (using the latest version of the science National Curriculum in England and the Common Core Standards in the US) that NHMs might most valuably address; d) through researcher-practitioner collaboration review current pedagogical approaches employed by schools and NHMs, with a view to developing and studying new practice models in Phase 2. The project will devise validated instruments (of the sort that are increasingly used in large-scale social psychology studies) and explore whether data obtained from museum visitors can be matched, both in the UK and in the US, onto external datasets (e.g. the National Pupil Database in the UK; Elementary/Secondary Information System in the US).
This Science Learning+ project will develop research-and-practice activities to explore how an integrated art, STEM, and society (what we refer to as STEAM) approach can expand science engagement and learning of youth aged 15-19, from low-income and non-dominant cultural communities. The project will review current knowledge, practice, and trends related to underrepresented youth, STEAM, and science engagement. The review will be used to develop: (1) A cross-setting research framework for investigating the relationship between informal STEAM learning experiences and young people's developing engagement with science. (2) Design principles for out-of-school STEAM programs that have proven effective in cultivating youth engagement with science and making relevant cross-setting connections. (3) Practitioner-friendly program evaluation tools that integrate findings from current research and practice related to cross-setting science learning of young adults especially non-dominant youth as it relates to STEAM learning experiences.
From intimate science cafes to massive science festivals, the public science events sector encompasses an enormous diversity of activity involving a wide range of practitioners and target audiences. As unique as each instance of an event can be, public science events are all live, in-person programs designed to engage the public with science in a social context. This activity is already taking place on a grand scale in both the US and UK, and initial evaluations of some of these event forms have begun to demonstrate distinct beneficial impacts. Despite some significant leaps forward, there are several issues that this Science Learning+ project seeks to address: (1) insufficient connectivity and communications between many event organizers; (2) little overall tracking of event activity; (3) few comparative evaluations across different event forms; and (4) lack of shared terminology, key facts, and a coherent narrative for the role live events play in the science learning ecosystem. A landscape study, organized into a single document and simple website, is the main deliverable. This will summarize existing activity and findings related to events, and provide an overview of potentially fruitful areas for future investigation.
President Obama announced in April 2013 that the Corporation for National and Community Service (CNCS) would launch a STEM AmeriCorps initiative to build student interest in STEM. A RFA is currently being prepared to be released in the late fall of 2013. This project will engage in quick response research to identify an evaluation and research agenda that can begin to inform the program launch. Thus, the timeframe for informing the initial stages of STEM AmeriCorps is relatively short, and the creation of an evaluation and research agenda is very timely. The products from the RAPID proposal are: (1) a review of the evaluation and research literature on the use of volunteers and/or mentors to build students' interest in STEM; (2) to convene a workshop to identify evaluation and research priorities to guide the initiative; and (3) a summary evaluation agenda that identifies promising directions along with the strength of evidence around key issues.
Native Americans exert sovereignty over vast amounts of United States land and water resources, yet are underrepresented in the disciplines that train our nation's future land and water resource managers. Native American resource managers must walk in two worlds, accommodating both traditional and modern methods that may come into conflict. Building on an existing, NSF-funded Manoomin Science Camp, the Walking Two Worlds (W2W) project will employ a systems view of resource management in considering a broad range of resource management issues affecting the region (including its lakes and wetlands, fisheries, forestry, wildlife, and air quality), with the goal of engaging the entire community in environmental and resource management issues of immediate relevance to the community. W2W will incorporate both Western science concerning the physical, chemical, and biological worlds, and traditional environmental knowledge, culture, language, and the judgment of elders. This holistic approach will not only facilitate effective resource management for the community, it will also serve as a 'hook' for engaging students and the community in STEM. A partnership of the Fond du Lac Band (of Lake Superior Chippewa) and the University of Minnesota (UMN) planned collaboratively with the community, W2W will focus on community-inspired, participatory science research projects related to resource management and environmental science. W2W will be facilitated by local teachers, with former participants as mentors, researchers and resource manages as mentors, and UMN faculty as lecturers. W2W recognizes the critical importance of strong STEM education for natural resource management. Using a mixed-methods approach to external evaluation, the project will build knowledge on the contributions of the W2W holistic, systemic approach and theme of community resource management. This will provide the foundation for a future development project that builds a community of place-based learning and community-inspired research projects.
This project supports the development of technological fluency and understanding of STEM concepts through the implementation of design collaboratives that use eCrafting Collabs as the medium within which to work with middle and high school students, parents and the community. The researchers from the University of Pennsylvania and the Franklin Institute combine expertise in learning sciences, digital media design, computer science and informal science education to examine how youth at ages 10-16 and families in schools, clubs, museums and community groups learn together how to create e-textile artifacts that incorporate embedded computers, sensors and actuators. The project investigates the feasibility of implementing these collaboratives using eCrafting via three models of participation, individual, structured group and cross-generational community groups. They are designing a portal through which the collaborative can engage in critique and sharing of their designs as part of their efforts to build a model process by which scientific and engineered product design and analysis can be made available to multiple audiences. The project engages participants through middle and high school elective classes and through the workshops conducted by a number of different organizations including the Franklin Institute, Techgirlz, the Hacktory and schools in Philadelphia. Participants can engage in the eCrafting Collabs through individual, collective and community design challenges that are established by the project. Participants learn about e-textile design and about circuitry and programming using either ModKit or the text-based Arduino. The designs are shared through the eCrafting Collab portal and participants are required to provide feedback and critique. Researchers are collecting data on learner identity in relation to STEM and computing, individual and collective participation in design and student understanding of circuitry and programming. The project is an example of a scalable intervention to engage students, families and communities in developing technological flexibility. This research and development project provides a resource that engages students in middle and high schools in technology rich collaborative environments that are alternatives to other sorts of science fairs and robotic competitions. The resources developed during the project will inform how such an informal/formal blend of student engagement might be scaled to expand the experiences of populations of underserved groups, including girls. The study is conducting an examination of the new types of learning activities that are multiplying across the country with a special focus on cross-generational learning.
The Exploratorium, in collaboration with the Boys and Girls Club Columbia Park (BGC) in the Mission District of San Francisco, is implementing a two-year exploratory project designed to support informal education in science, technology, engineering, and mathematics (STEM) within underserved Latino communities. Building off of and expanding on non-STEM-related efforts in a few major U.S. cities and Europe, the Exploratorium, BGC, and residents of the District will engage in a STEM exhibit and program co-development process that will physically convert metered parking spaces in front of the Club into transformative public places called "parklets." The BGC parklet will feature interactive, bilingual science and technology exhibits, programs and events targeting audiences including youth ages 8 - 17 and intergenerational families and groups primarily in the Mission District and users of the BGC. Parklet exhibits and programs will focus on STEM content related to "Observing the Urban Environment," with a focus on community sustainability. The project explores one approach to working with and engaging the public in their everyday environment with relevant STEM learning experiences. The development and evaluation processes are being positioned as a model for possible expansion throughout the city and to other cities.