This report summarizes the evaluation findings of the first year of the Science Beyond the Boundaries Early Learners Collaborative (ELC). The three-year project, funded through the Institute of Museum and Library Services (IMLS), connects science centers and children’s museums to enhance early learner programming. In Year One, the ELC brought together five institutions to collaborate directly through regularly scheduled conference call discussions. During these discussions they shared their program experience, ideas on early childhood programs, and their thoughts on current early learner
Learning to design and deliver research information customized for particular audiences is one major goal of the Museum of Science’s Research Communication Laboratory (RCL). Judging of short research presentations by an independent judge revealed that graduate students from MIT’s Center for Excitonics who participated in RCL demonstrated significantly better spoken and graphic communication skills compared with graduate students who did not experience RCL instruction. The judge rated RCL students as significantly better than non-RCL students with respect to three criteria: 1) presentation
The Museum of Science partnered with the Center for High-rate Nanomanufacturing to create a sequence of professional development experiences in science communication and hands-on learning for graduate students and post-docs. The Sharing Science Workshops were intended to help graduate students who work with the CHN program to improve their abilities to present their research to a variety of scientific and nonscientific audiences. The sequence included a half-day "Sharing Science" workshop, a half-day guided "Practicum" with museum visitors, and optional participation in NanoDays events at MOS
Funded by the National Science Foundation (NSF), the Center for High-rate Nanomanufacturing (CHN) brings together three universities with unique strengths in nanoscience and nanomanufacturing: the University of Massachusetts, Lowell (UML); Northeastern University, Boston (NEU); and the University of New Hampshire, Durham (UNH). The University of Massachusetts Donahue Institute (UMDI) is conducting the five-year evaluation of CHN's education and outreach activities. The evaluation uses multiple sources of evidence to analyze project processes and outcomes. Using quantitative and qualitative
DATE:
TEAM MEMBERS:
Center for High-rate NanomanufacturingCarol Lynn AlpertCarol Barry
resourceevaluationProfessional Development, Conferences, and Networks
Funded by the National Science Foundation (NSF), the Center for High-rate Nanomanufacturing (CHN) brings together three universities with unique strengths in nanoscience and nanomanufacturing: the University of Massachusetts, Lowell (UML); Northeastern University, Boston (NEU); and the University of New Hampshire, Durham (UNH). The University of Massachusetts Donahue Institute (UMDI) is conducting the five-year evaluation of CHN's education and outreach activities. The evaluation uses multiple sources of evidence to analyze project processes and outcomes. Using quantitative and qualitative
DATE:
TEAM MEMBERS:
Center for High-rate NanomanufacturingCarol Lynn AlpertCarol BarryUMass Donahue Institute Research and Evaluation Group
To conserve species, we must first identify them. Field researchers, land managers, educators, and citizen scientists need up-to-date and accessible tools to identify organisms, organize data, and share observations. Emerging technologies complement traditional, book-form field guides by providing users with a wealth of multimedia data. We review technical innovations of next-generation field guides, including Web-based and stand-alone applications, interactive multiple-access keys, visual-recognition software adapted to identify organisms, species checklists that can be customized to
DATE:
TEAM MEMBERS:
New England Wild Flower SocietyElizabeth FarnsworthMiyoko ChuW. John KressJason BestJohn PickeringRobert StevensonGregory CourtneyJohn VanDyckAaron Ellison
The Community STEM Outreach Project at the Saint Louis Science Center (SLSC) received funding from the United States Office of Naval Research (ONR) from October 2010 through September 2013. Klein Consulting, with support from Tisdal Consulting, conducted the evaluation of the three-year project. The original proposal from the SLSC to ONR laid the foundation for the Community STEM Outreach Project by describing the institution and its youth program, the Youth Exploring Science (YES) Program. Plans were underway to reach out to existing and new national partners to document and disseminate a
The Badges for College Credit project designs and researches: (1) a digital badge system that leads to college credit as the context for investigating how to integrate badges with learning programs; (2) how to assess learning associated with badges; and (3) how badges facilitate learning pathways and contribute to science identity formation. The project is one of the first efforts to develop a system to associate informal science learning with college credit. The project will partner with three regional informal science institutions, the Pacific Science Center, the Future of Flight, and the Seattle of Aquarium, that will facilitate activities for participants that are linked to informal science learning and earning badges. The project uses the iRemix platform, a social learning platform, as a delivery system to direct participants to materials, resources, and activities that support the learning goals of the project. Badges earned within the system can be exported to the Mozilla Open Badges platform. Participants can earn three types of badges, automatic (based on participation), community (based on contributions to building the online community), and skill (based on mastery of science and communication) badges. Using a learning ecologies framework, the project will investigate multiple influences on how and why youth participate in science learning and making decisions. Project research uses a qualitative and quantitative approach, including observations, interviews, case studies, surveys, and learning analytics data, and data analytics. Project evaluation will focus on the nature and function of the collaboration, and on the scale-up aspects of the innovation and expansion, by: (1) analyzing and documenting effective procedures,and optimal contexts for the dissemination of the model and (2) by analyzing the collaboration between informal science organizations and higher education.
DATE:
-
TEAM MEMBERS:
Carrie TzouKaren LennonAmanda GoertzGray Kochlar-Lindgren
This research and development project explores the mechanisms that initiate and support innovation in early childhood education, especially in combining informal learning via public media and technology with teacher and family interactions to maximize children's math learning. Deliverables include 27 episodes of Peg+Cat, an animated math adventure series on PBS, 8 related online games and apps, summer math institutes and school-year training for preschool/Head Start teachers, and complementary activities and resources to support parent's knowledge and practice and student's engagement, interest, and learning of foundational math concepts. The research agenda will test several hypotheses regarding the strategies to extend teacher's math content knowledge and pedagogy and parent/ caregiver's understanding and valuing of math. A key question will focus on how coupled learning opportunities (professional development for teachers, transmedia, and support for families) enable and sustain children's engagement and learning in math. Formative evaluation of the media components will use focus groups of 3-5 year olds to assure develerables are engaging and accessible. The summative evaluation by Rockman et al will focus on how well the project met its overall goals including the project implementation, and impacts on Head Start teachers, parents/caregivers, and preschoolers. The project's transmedia deliverables will reach millions of preschoolers through daily PBS broadcasts and online games and apps. Fifty Head Start teachers will participate in the two-year professional development program and will be using new content knowledge and pedagogy to teach 550 Head Start children in southwest Pennsylvania and engage their parents/caregivers. The Head Start infrastructure will provide further dissemination of the project's findings and resources.
The Chicago Zoological Society (CZS) in collaboration with Eden Place Nature Center, the Fuller Park Community Corporation, and the University of Illinois at Chicago (UIC) will implement the SCIENCES Program, Supporting a Community's Informal Education Needs: Confidence and Empowerment in STEM. The primary goals of this Full Scale Development project are to broaden access to and participation in environmental science, strengthen partnerships between CZS, Eden Place, and UIC, and gain insights into the 'ecosystemic' learning model which promotes scientific literacy and agency in the community. The project targets a low-resource community with a minority audience while the secondary audience is informal science learning organizations and researchers who will advance research in informal learning. The theoretical framework for the project design draws on conservation psychology, informal science learning, civic ecology education, and urban science education to create an ecosystematic, geographically centered approach. The deliverables include research, curriculum, and engaging hands-on programs for youth, families, adults, and teachers, reaching both in-school and out-of-school audiences, in addition to the SCIENCES Implementation Network. Three potential curriculum themes to be explored are water conservation and protection, pollinators for healthy ecosystems, and community resilience to climate change. The SCIENCES project offers a comprehensive suite of engaging programs for community audiences. For example, the year-long Zoo Adventure Passport (ZAP) program for families includes hands-on experiments and field trips, while project-based learning experiences enable teens to create wetlands, design interpretive signage, and develop associated public programming. School-based programs include professional development for teachers on the Great Lakes ecosystem and invasive species. Existing programs that have been previously evaluated and demonstrated to show learning impacts will be adapted and modified to meet the goals of the ecosystemic learning model by providing multiple learning opportunities. New learning resources will also be created to support the content themes and provide continuity. The result will be a comprehensive approach that ensures deep community engagement by individuals, families, and organizations, with cohesiveness provided by the overarching content themes which broaden access to STEM learning resources and leverages partnerships. The project includes both a research and evaluation plan. The primary research question to be addressed is: How does a large informal science learning institution work with a community-based organization to support environmental scientific literacy and agency at all levels of the community? A sociocultural framework will be used for this mixed-methods case study research. Study participants include community leaders, youth, parents, teachers, and staff from Eden Place. The case study sample will include 20 focal individuals drawn from the participant groups and approximately 300 survey participants. Case study data will be triangulated with evaluation data and analyzed using a grounded theory approach. By examining changes from the baseline following the implementation of the community programs, the findings may provide insight on agency and science literacy among community members. The comprehensive, mixed-methods evaluation plan employs a quasi-experimental design and incorporates front-end, formative, and summative evaluation components. The evaluation questions address the quality of the processes and products, access to environmental science learning opportunities, environmental science literacy, sustainability, and barriers to implementation. An extensive dissemination plan is proposed with a dual emphasis on meeting stakeholders' needs at multiple levels. The evaluation and research teams will emphasize publication in peer reviewed journals and presentations at conferences for informal science education professionals. Findings will be shared with the Fuller Park community stakeholders using creative methods such as one-page research briefs written in layperson's language, videos, and recorded interviews with participants. The local project Advisory Board will also be actively involved in the dissemination of findings to community constituents. The SCIENCES National Amplification Network will be created and work collaboratively with the American Association of Zoos and Aquariums and the Metropolitan Green Spaces Alliance to disseminate the model. Collectively, the activities and deliverables outlined in this proposal will advance the discovery of sustainable models of community-based learning while the research will advance the understanding of informal learning support for science literacy and agency.
Techbridge has proposed a broad implementation project that will scale up a tested multi-faceted model that increases girls' interest in STEM careers. The objectives of this project are to increase girls' engineering, technology, and science skills and career interests; build STEM capacity and sustainability across communities; enhance STEM and career exploration for underrepresented girls and their families; and advance research on the scale-up, sustainability, and impact of the model with career exploration. The Techbridge approach is grounded in Eccles' expectancy value model, and helps bridge critical junctures as girls transition from elementary to middle school and middle school to high school, immersing participants in a network of peers and supportive adults. Techbridge targets girls in grades 5-12 with a model that includes five components: a previously tested and evaluated curriculum, career exploration, professional development for staff and teachers, family engagement, and dissemination. The inquiry-based curriculum introduces electrical engineering and computer science through engaging, hands-on units on Cars and Engines, Green Design, and Electrical Engineering. The Techbridge model will be enhanced to include a central repository for curriculum and support materials, electronic girl-driven career exploration resources, an online learning community and video tools for staff, and customized family guides. Project deliverables include the dissemination of the enhanced model to three cities, 24 school sites and teachers, 2,000 girls, and over 600 role models. A supplementary research component will study the broad implementation of the Techbridge model by examining the fidelity of implementation and the program's impact on girls' STEM engagement and learning. The research questions are as follows: (1) To what extent and how do new program sites demonstrate adherence to the Techbridge program model? (2) Do new sites experience similar or increased participant responsiveness to Techbridge programming with regard to scientific learning outcomes, career awareness, attitude and interest in engineering? (3)How are changes experienced by girls sustained over time, if at all? (4) To what extent and how do new sites balance instilling the Techbridge essentials, those critical components Techbridge identifies as essential for success, with the need for local adaptation and ownership of the program? and (5) Given the potential for customization in local communities, do new sites maintain programmatic quality of delivery experienced at the original site? If so, what are elements essential to success regarding quality delivery? The mixed-methods study will include document analysis, embedded assessments, participant survey scales, and observations. Qualitative data methods include interviews with teachers, role models, staff and focus groups with girls. A project evaluation will also be conducted which investigates project outcomes for participants (girls, teachers, role models, and families) and fidelity of the implementation and enhancements at expansion sites, using a quasi-experimental approach. Career and learning outcomes for girls will be determined using embedded assessments, portfolios, surveys, school data, and previously validated instruments such as the Career Interest Questionnaire and the Modified Attitudes towards Science Inventory. The Managing Complex Change model is used as a framework for the project evaluation for the purpose of examining factors related to the effectiveness of scaling. The dissemination of research and evaluation findings will be achieved through the use of publications, blogs, social media, and conferences. It is anticipated that this project will broaden the participation of Hispanic, African-American, and English language learner girls, build capacity for STEM programming and sustainability at the dissemination sites, and disseminate findings to over 1 million educators, researchers, and community members. Broader impacts include contributing to the field's understanding of how virtual role models and field trips can engage young women, increase corporate advocacy, and engage participants in research and dissemination efforts.
Using STEM America (USA) is a two-year Pathways project designed to examine the feasibility of using informal STEM learning opportunities to improve science literacy among English Language Learner (ELL) students in Imperial County, California. Project partners include the Rueben H. Fleet Science Center and the University of California, San Diego (UCSD). The project's goals are to support teachers in the development of informal science education opportunities for English learners, partner with students in grades 7-12 to create activities and exhibits, deliver student-produced products to community members, and sustain and disseminate the activities through the development of web-based teacher tools. The teachers will work with informal science education experts, STEM professionals, and undergraduate students to develop and implement the program lessons with their 7-12 grade students. The activities and exhibits designed for community audiences will be used in the Imperial Valley Discovery Zone, slated for completion in fall 2013. Special emphasis will be placed on understanding English scientific word frames and science content specific vocabulary to help ELL students express complex scientific concepts in English. The project deliverables in this pilot project include a comprehensive teacher professional development strategy, student-developed informal science activities and exhibits, a project website, and multiple teacher resources (lesson plans, how-to guides, training materials, and social networking tools). Teachers will receive 45 hours of professional development during the summer with an additional 20 hours of support provided during the school year. UCSD's Jacob's School of Engineering will provide training on solar energy micro-grids using a micro-grid observatory to be located in Imperial Valley. English language development training will be provided by the University of California's Professional Development Institute (UCPDI) and address the role of language objectives in scientific conceptual knowledge and language development; using science and language to improve classroom questioning/discussion; and teaching academic language to English learners. The informal science education component of the training provided by the Fleet Science Center will address topics such as questioning strategies, scientific reasoning frameworks, communicating science to public audiences, and learning "high level" science content using hands-on approaches. The project design builds on research which supports an active learning approach that mirrors scientific practice and is one of the strengths of informal science learning environments. The question to be addressed by the USA Project is: "Can informal STEM activities with embedded English Language development strategies assist English learner students to increase their English language competency and their interest in STEM subjects?" The PI seeks to identify the impact that teachers have on guiding students in inquiry-based informal STEM education, evaluate the academic outcomes for students, and measure changes in community interest, understanding, and attitudes towards STEM and STEM occupations. The USA Project is designed to reach approximately 200 underserved students and will promote the participation of at least 400 additional students, parents, and other rural community members. It is anticipated that this project will result in the development of a model for teacher-led informal STEM education, increased STEM learning opportunities for the community, and the development of a network of educational institutions that helps to bridge formal and informal STEM learning and learning environments.