Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
A partnership between Carthage College and the Appalachian Mountain Club has delivered a successful public education and outreach program that merges natural environment topics and astronomy. Over the four years of activity, over 25,000 people have received programming. The effort has trained nature educators, permanent and seasonal AMC staff, and undergraduate physics and astronomy students to integrate diverse topical material and deliver high quality programming to the lay public. Unique to the program is the holistic nature of the material delivered - an 'atypical' astronomy program. Linking observable characteristics of the natural world with astronomical history and phenomena, and emphasizing the unique sequence of events that have led to human life on Earth, the program has changed attitudes and behaviors among the public participants. Successful interventions have included hands-on observing programs (day and night) that link nature content to the observed objects; table-talk presentations on nature/astronomy topics; dark skies preservation workshops; and hands-on activities developed for younger audiences, including schools, camps, and family groups. An extensive evaluation and assessment effort managed by a leading sociologist has demonstrated the effectiveness of the approach, and contributed to continuous improvement in the program content and methods.
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
This project supports the development of technological fluency and understanding of STEM concepts through the implementation of design collaboratives that use eCrafting Collabs as the medium within which to work with middle and high school students, parents and the community. The researchers from the University of Pennsylvania and the Franklin Institute combine expertise in learning sciences, digital media design, computer science and informal science education to examine how youth at ages 10-16 and families in schools, clubs, museums and community groups learn together how to create e-textile artifacts that incorporate embedded computers, sensors and actuators. The project investigates the feasibility of implementing these collaboratives using eCrafting via three models of participation, individual, structured group and cross-generational community groups. They are designing a portal through which the collaborative can engage in critique and sharing of their designs as part of their efforts to build a model process by which scientific and engineered product design and analysis can be made available to multiple audiences. The project engages participants through middle and high school elective classes and through the workshops conducted by a number of different organizations including the Franklin Institute, Techgirlz, the Hacktory and schools in Philadelphia. Participants can engage in the eCrafting Collabs through individual, collective and community design challenges that are established by the project. Participants learn about e-textile design and about circuitry and programming using either ModKit or the text-based Arduino. The designs are shared through the eCrafting Collab portal and participants are required to provide feedback and critique. Researchers are collecting data on learner identity in relation to STEM and computing, individual and collective participation in design and student understanding of circuitry and programming. The project is an example of a scalable intervention to engage students, families and communities in developing technological flexibility. This research and development project provides a resource that engages students in middle and high schools in technology rich collaborative environments that are alternatives to other sorts of science fairs and robotic competitions. The resources developed during the project will inform how such an informal/formal blend of student engagement might be scaled to expand the experiences of populations of underserved groups, including girls. The study is conducting an examination of the new types of learning activities that are multiplying across the country with a special focus on cross-generational learning.
The Museum of Aviation: STEM-ulating Georgia's Future Workforce Through Outreach project will build partnerships between the Museum of Aviation, STARBASE, six Georgia school districts, NASA, and volunteer mentors that promote STEM literacy, awareness of NASA's mission, and encourage the pursuit of STEM careers. This goal will be achieved through meeting the following objectives: -Promote lifelong learning by students, educators, and families, using NASA-themed STEM and missions via six outreach programs serving 10,750 participants (including 9,000 students, 1,600 parents, and 150 teachers). -Improve the understanding of NASA's missions, contributions to STEM disciplines and careers by students and faculty in grades pre K-8 by at least 35%. To accomplish the objectives, 6 STEM-based outreach programs will be provided to 12 school districts and will serve students, parents, and teachers. -ACE on the Go - STEM Modules use hands-on interactive activities for 2nd-5th graders -Family STEM Night - provides 2nd-5th graders and their families an opportunity to partake in 15 or more hands-on, interactive experiments that demonstrate STEM principles. -Aviation Outreach - introduces 6th-8th graders to aviation, and to STEM related careers. -STEM Afterschool - 6th-8th graders will learn about forces and motion and how forces make flight possible. -STARBASE 2.0 Afterschool STEM Mentoring Club consists of two components - a STEM Academy and a STEM Mentoring Afterschool Program both for underserved and at-risk youth in grades 6-8. -Teacher Training – STEM Workshops for teachers through the Georgia NASA RERC. This project will help to strengthen Georgia's future workforce by targeting students traditionally underserved and underrepresented in communities and in STEM fields. It will help attract and retain students in STEM disciplines by engaging students in STEM education and exposing them to STEM careers, and connect students, teachers, and families to NASA's mission by building strategic partnerships with formal education providers. The project will also help to strengthen the nation's and NASA's future workforce, attract and retain students in STEM disciplines, and engage Americans in NASA's mission.
The Dynamic Earth: You Have To See it To Believe It is a public exhibition and suite of programming designed to educate and excite K-8 students, teachers, and families about weather and climate science, plate tectonics, erosion, and stream formation. The Dynamic Earth program draws attention to the importance of large-scale earth processes and the human impacts on these processes, utilizing real artifacts, hands-on models, and NASA earth imagery and data. The program includes the exhibition, student workshops, family workshops, annual professional development opportunities for classroom teachers, innovative theater shows, lectures for adults by visiting scientists, and interpretive activities. The Montshire Museum of Science has partnered with Chabot Space and Science Center (CA) and the US Army Corps of Engineers Cold Regions Research and Engineering Laboratory (NH) on various components. The project has broadened our internal capacity for providing quality earth science programming by greatly expanding our program titles and allowing us to create hands-on materials for use by our educators and to loan to schools in our Partnership Initiative. Programming developed during the grant period continues to reach thousands of students and teachers each year, both on-site and as part of our rural outreach efforts.
The Children’s Museum developed From the Blue Planet to the Red Planet: Exploring Planetary Science to provide opportunities for students in grades 4 through 8, teachers, and families to learn about Mars exploration. The Museum partnered with the Connecticut Center for Advanced Technology (CCAT) on four teacher professional development modules related to aspects of planetary science: soil and plant study, air pressure, robotic exploration, and the comparison of Mars and Earth. Teachers who attended free workshops could bring students to the Museum for classroom and planetarium experiences. The Museum received support from Central Connecticut State University and technical advice from Phoenix Project scientists at JPL. The Museum created a timeline of Mars exploration history with video clips of milestones and an accompanying quiz kiosk. CCAT created virtual Mars drive-through experiences with which visitors could explore the planet. The Travelers ScienceDome Planetarium staff wrote, directed, and animated a full-dome planetarium program about the future study of Mars that was finished in December 2012. For over two years the Museum has sponsored free, monthly Mars Madness programs during which the general public can visit the exhibit, see a Mars-related planetarium program, and test out some of the hands-on activities developed for the school groups. The Museum hoped to reach a diverse audience, especially, those people who might otherwise not afford admission. We have produced four teacher professional development guides with hands-on activities, an exhibit for our facility, a dedicated website, and a planetarium program.
Curious Scientific Investigators (CSI): Flight Adventures immerses children and families in science, technology, engineering, and math (STEM) disciplines. Launched in February 2012, the project supports NASA’s Aeronautics Research Mission Directorate (ARMD), focusing on “innovative ideas to convey the fundamentals of flight, flight technology, and NASA’s role in aeronautics.” The project’s audience includes youth ages 6-18 and the Museum’s more than 1 million annual visitors of all ages. The project’s lead agency, The Children’s Museum of Indianapolis (Museum), developed and implemented the project in Indianapolis in partnership with the Academy of Model Aeronautics and NASA Dryden Flight Research Center. The project’s goals focus on inspiring children and families to develop an interest in STEM concepts and learn about NASA’s role in science and aeronautics research and the evolution of flight, and on engaging and educating them through inquiry-based programs that facilitate understanding of STEM concepts and knowledge and NASA’s contributions to flight. Centered on an original Multimedia Planetarium Show on flight, Flight Adventures, the Museum designed several components, all of which complement the show and the messages it conveys. Among these components are an exhibit area composed of a movable wind tunnel, a display of models, low- and high-tech interactives; a Unit of Study; a TV show, Wings Over Indiana; a website; and a variety of educational and family programs.
DATE:
-
TEAM MEMBERS:
Jennifer Pace-RobinsonGordon Schimmel
Families and school-aged constituents at 30 urban, inner-city neighborhood community-based organizations and teachers and students in earth science classes in 40 middle schools. Intent: This project will prepare neighborhood and community leaders in Philadelphia to use simple but effective observation tools and NASA’s educational web content to help their inner-city Philadelphia neighbors learn about space science and technology – and about their city and themselves – by knowledgably exploring the sky. Project Goals: 1. Create multiple opportunities for inner-city children, adults and families to observe and learn about the solar system through neighborhood and city-wide events. 2. Equip CBO’s with the knowledge, skills and materials they need to make space science-related events and activities a sustained part of programming for their constituents. 3. Stimulate interest and engagement in NASA’s missions and resources among residents of traditionally underserved, inner-city neighborhoods through astronomy experiences and NASA’s websites. 4. Create and strengthen collaborative ties between The Franklin Institute, CBO’s, city residents, and local amateur astronomers. Programs/Products produced: 1. Repeatable ‘Galileoscope’ workshops and activities in 30 CBO’s 2. Solar observing activities for 30 CBO’s and 40 middle schools. 3. School assembly-type audience interactive program about observational astronomy for use in schools and community organizations. 4. Recurring neighborhood star parties facilitated through on-going partnerships with local amateur astronomy clubs. 5. Participation in city-wide star party as part of the annual Philadelphia Science Festival.
The Chicago Zoological Society (CZS) in collaboration with Eden Place Nature Center, the Fuller Park Community Corporation, and the University of Illinois at Chicago (UIC) will implement the SCIENCES Program, Supporting a Community's Informal Education Needs: Confidence and Empowerment in STEM. The primary goals of this Full Scale Development project are to broaden access to and participation in environmental science, strengthen partnerships between CZS, Eden Place, and UIC, and gain insights into the 'ecosystemic' learning model which promotes scientific literacy and agency in the community. The project targets a low-resource community with a minority audience while the secondary audience is informal science learning organizations and researchers who will advance research in informal learning. The theoretical framework for the project design draws on conservation psychology, informal science learning, civic ecology education, and urban science education to create an ecosystematic, geographically centered approach. The deliverables include research, curriculum, and engaging hands-on programs for youth, families, adults, and teachers, reaching both in-school and out-of-school audiences, in addition to the SCIENCES Implementation Network. Three potential curriculum themes to be explored are water conservation and protection, pollinators for healthy ecosystems, and community resilience to climate change. The SCIENCES project offers a comprehensive suite of engaging programs for community audiences. For example, the year-long Zoo Adventure Passport (ZAP) program for families includes hands-on experiments and field trips, while project-based learning experiences enable teens to create wetlands, design interpretive signage, and develop associated public programming. School-based programs include professional development for teachers on the Great Lakes ecosystem and invasive species. Existing programs that have been previously evaluated and demonstrated to show learning impacts will be adapted and modified to meet the goals of the ecosystemic learning model by providing multiple learning opportunities. New learning resources will also be created to support the content themes and provide continuity. The result will be a comprehensive approach that ensures deep community engagement by individuals, families, and organizations, with cohesiveness provided by the overarching content themes which broaden access to STEM learning resources and leverages partnerships. The project includes both a research and evaluation plan. The primary research question to be addressed is: How does a large informal science learning institution work with a community-based organization to support environmental scientific literacy and agency at all levels of the community? A sociocultural framework will be used for this mixed-methods case study research. Study participants include community leaders, youth, parents, teachers, and staff from Eden Place. The case study sample will include 20 focal individuals drawn from the participant groups and approximately 300 survey participants. Case study data will be triangulated with evaluation data and analyzed using a grounded theory approach. By examining changes from the baseline following the implementation of the community programs, the findings may provide insight on agency and science literacy among community members. The comprehensive, mixed-methods evaluation plan employs a quasi-experimental design and incorporates front-end, formative, and summative evaluation components. The evaluation questions address the quality of the processes and products, access to environmental science learning opportunities, environmental science literacy, sustainability, and barriers to implementation. An extensive dissemination plan is proposed with a dual emphasis on meeting stakeholders' needs at multiple levels. The evaluation and research teams will emphasize publication in peer reviewed journals and presentations at conferences for informal science education professionals. Findings will be shared with the Fuller Park community stakeholders using creative methods such as one-page research briefs written in layperson's language, videos, and recorded interviews with participants. The local project Advisory Board will also be actively involved in the dissemination of findings to community constituents. The SCIENCES National Amplification Network will be created and work collaboratively with the American Association of Zoos and Aquariums and the Metropolitan Green Spaces Alliance to disseminate the model. Collectively, the activities and deliverables outlined in this proposal will advance the discovery of sustainable models of community-based learning while the research will advance the understanding of informal learning support for science literacy and agency.
Techbridge has proposed a broad implementation project that will scale up a tested multi-faceted model that increases girls' interest in STEM careers. The objectives of this project are to increase girls' engineering, technology, and science skills and career interests; build STEM capacity and sustainability across communities; enhance STEM and career exploration for underrepresented girls and their families; and advance research on the scale-up, sustainability, and impact of the model with career exploration. The Techbridge approach is grounded in Eccles' expectancy value model, and helps bridge critical junctures as girls transition from elementary to middle school and middle school to high school, immersing participants in a network of peers and supportive adults. Techbridge targets girls in grades 5-12 with a model that includes five components: a previously tested and evaluated curriculum, career exploration, professional development for staff and teachers, family engagement, and dissemination. The inquiry-based curriculum introduces electrical engineering and computer science through engaging, hands-on units on Cars and Engines, Green Design, and Electrical Engineering. The Techbridge model will be enhanced to include a central repository for curriculum and support materials, electronic girl-driven career exploration resources, an online learning community and video tools for staff, and customized family guides. Project deliverables include the dissemination of the enhanced model to three cities, 24 school sites and teachers, 2,000 girls, and over 600 role models. A supplementary research component will study the broad implementation of the Techbridge model by examining the fidelity of implementation and the program's impact on girls' STEM engagement and learning. The research questions are as follows: (1) To what extent and how do new program sites demonstrate adherence to the Techbridge program model? (2) Do new sites experience similar or increased participant responsiveness to Techbridge programming with regard to scientific learning outcomes, career awareness, attitude and interest in engineering? (3)How are changes experienced by girls sustained over time, if at all? (4) To what extent and how do new sites balance instilling the Techbridge essentials, those critical components Techbridge identifies as essential for success, with the need for local adaptation and ownership of the program? and (5) Given the potential for customization in local communities, do new sites maintain programmatic quality of delivery experienced at the original site? If so, what are elements essential to success regarding quality delivery? The mixed-methods study will include document analysis, embedded assessments, participant survey scales, and observations. Qualitative data methods include interviews with teachers, role models, staff and focus groups with girls. A project evaluation will also be conducted which investigates project outcomes for participants (girls, teachers, role models, and families) and fidelity of the implementation and enhancements at expansion sites, using a quasi-experimental approach. Career and learning outcomes for girls will be determined using embedded assessments, portfolios, surveys, school data, and previously validated instruments such as the Career Interest Questionnaire and the Modified Attitudes towards Science Inventory. The Managing Complex Change model is used as a framework for the project evaluation for the purpose of examining factors related to the effectiveness of scaling. The dissemination of research and evaluation findings will be achieved through the use of publications, blogs, social media, and conferences. It is anticipated that this project will broaden the participation of Hispanic, African-American, and English language learner girls, build capacity for STEM programming and sustainability at the dissemination sites, and disseminate findings to over 1 million educators, researchers, and community members. Broader impacts include contributing to the field's understanding of how virtual role models and field trips can engage young women, increase corporate advocacy, and engage participants in research and dissemination efforts.
In October 2009, the Tennessee Aquarium began an ambitious program, Connecting Tennessee to the World Ocean (CTWO), funded by a grant from the National Oceanic and Atmospheric Administration. CTWO consists of several individual projects, all intended to increase the ocean literacy of Aquarium audiences and to promote their adoption of an ocean stewardship ethic. This evaluation report summarizes the extent to which the Aquarium accomplished these goals over the 3-year project period. The five project components and their key associated evaluation findings follow. 1. Classroom-based activities