Beginning in autumn 2011, Education Development Center’s Center for Children and Technology (EDC|CCT) worked closely with Iridescent to evaluate the impact of its Family Science after-school program on its participants and partners.1 Between September 2011 and April 2015, Iridescent held six series of five-week programs in New York and Los Angeles at nine different school and museum sites. The program activities centered on “design challenges” that introduced families to the engineering design process and supported the development of curiosity, creativity, and persistence. These five-week
The Center for Children and Technology (CCT) at Education Development Center, Inc., an international nonprofit research and development organization (cct.edc.org), conducted the formative evaluation of the fourth year of the Be A Scientist! (BAS) project. This project, managed by Iridescent—a nonprofit afterschool science, technology, engineering, and mathematics (STEM) program (www.iridescentlearning.org), has the goal of providing high-quality afterschool science and engineering courses to underserved families in New York City and Los Angeles. The project aims to enable participants to
The Center for Advancement of Informal Science Education (CAISE), a cooperative agreement with the National Science Foundation Advancing Informal STEM Learning (AISL) program, is a partnership of the Association of Science-Technology Centers with faculty and professionals from the University of Pittsburgh Center for Learning in Out-of-School Environments (UPCLOSE), Oregon State University (OSU), the Great Lakes Science Center, KQED Public Media, advisors and other collaborators. CAISE works to support and resource ongoing improvement of, and NSF investments in, the national infrastructure for informal Science Technology Engineering and Mathematics (STEM) education. CAISE's roles are to build capacity and support continued professionalization for the field by fostering a community that bridges the many varied forms in which informal STEM learning experiences are developed and delivered for learners of all ages. To that end, CAISE activities also include: creating field-driven evidence databases about the impacts of informal STEM education; facilitating federated searches of those databases; furthering dialogue and knowledge transfer between learning research and practice; working to enhance the quality and diversity of evaluation knowledge and processes; and helping STEM researchers improve their efforts in informal STEM education, outreach and communication. For Principal Investigators (PIs) and potential PIs, CAISE provides resources that can assist in the development of evidence-based proposals. It also facilitates and strengthens networks through PI meetings, communications, and other methods that encourage sharing of deliverables, practices, outcomes and findings across projects. For the AISL Program at NSF, CAISE is assisting program officers in understanding the portfolio of awards, identifying the portfolio's impacts in key areas, and integrating the program's investments in education infrastructure.
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
Currently, many museums present histories of science and technology, but very few are integrating scientific activity--observation, measurement, experimentation-with the time- and place-specific narratives that characterize history-learning experiences. For the Prairie Science project, Conner Prairie is combining proven science center-style activities, developed by the Science Museum of Minnesota, with family-engagement strategies developed through extensive research and testing with audiences in historical settings. The goal of this integration is to create guest experiences that are rich in both STEM and historical content and encourage family learning. One key deliverable of this project is the Create.Connect gallery, which is currently installed at Conner Prairie. Create.Connect allows the project team to evaluate and research hands-on activities, facilitation strategies and historic settings to understand how these elements combine to encourage family conversations and learning around historical narratives and STEM content. For example, in one exhibit area families can experiment with creating their own efficient wind turbine designs while learning about the innovations of the Flint & Walling windmill manufacturing company from Indiana. The activity is facilitated by a historic interpreter portraying a windmill salesman from 1900. The interpreter not only guides the family though the process of scientific inquiry, but shares his historic perspective on wind power as well. Two other exhibit areas invite hands-on exploration of electrical circuits and forces in motion as they connect to stories from Indiana history. Evaluation and research findings from the Create.Connect exhibit will be used to develop a model that can guide other history institutions that want to incorporate STEM content and thinking into their exhibits and interpretation. By partnering with the Science Museum of Minnesota, we will combine the experience of science center professionals and history museum professionals to find the best practices for incorporating science activities into historic settings. To ensure that this dissemination model is informed from many perspectives, Conner Prairie has invited the participation of four history museums: The Museum of America and the Sea, Mystic, Connecticut; the California State Railroad Museum, Sacramento, California; the Wabash County Historical Society, Wabash, Indiana; and the Oliver H. Kelley Farm, Elk River, Minnesota. Each of the four participants will install history-STEM exhibit components which will be connected to location-specific historic narratives. Drawing on the staff experience and talents of participant museums, this project will develop realistic solutions to an array of anticipated barriers. These issues and the resulting approaches will become part of a stronger, more adaptable dissemination model that will support history museums in creating STEM-based guest experiences.
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
The Virginia Institute of Marine Science (VIMS) and The Watermen's Museum, Yorktown, VA, will produce an underwater robotics research and discovery education program in conjunction with time-sensitive, underwater archeological research exploring recently discovered shipwrecks of General Cornwallis's lost fleet in the York River. The urgency of the scientific research is based upon the dynamic environment of the York River with its strong tidal currents, low visibility, and seasonal hypoxia that can rapidly deteriorate the ships, which have been underwater since 1781. Geophysical experts believe that further erosion is likely once the wrecks are exposed. Given the unknown deterioration rate of the shipwrecks coupled with the constraints of implementing the project during the 2011-2012 school-year, any delays would put the scientific research back at least 18 months - a potentially devastating delay for documenting the ships. The monitoring and studying of the historic ships will be conducted by elementary through high school-aged participants and their teachers who will collect the data underwater through robotic missions using VideoRay Remotely Operated Vehicles (ROVs) and a Fetch Automated Underwater Vehicle (AUV) from a command station at The Watermen's Museum. Students and teachers will be introduced to the science, mathematics, and integrated technologies associated with robotic underwater research and will experience events that occur on a real expedition, including mission planning, execution, monitoring, and data analysis. Robotic missions will be conducted within the unique, underwater setting of the historical shipwrecks. Such research experiences and professional development are intended to serve as a key to stimulating student interest in underwater archeological research, the marine environment and ocean science, advanced research using new technologies, and the array of opportunities presented for scientific and creative problem solving associated with underwater research. A comprehensive, outcomes-based formative and summative, external evaluation of the project will be conducted by Dr. L. Art Safer, Loyola University. The evaluation will inform the project's implementation efforts and investigate the project's impact. The newly formed partnership between the Waterman's Museum and VIMS will expand the ISE Program's objectives to forge new partnerships among informal venues, and to expand the use of advanced technologies for informal STEM learning. Extensive public dissemination during and after the project duration, includes but is not limited to, hosting an "Expedition to the Wrecks" web portal on the VIMS BRIDGE site for K-12 educators providing real-time results of the project and live webcasts. The website will be linked to the education portal at the Association for Unmanned Vehicle Systems International, the world's largest organization devoted to promoting unmanned systems and to the FIRST Robotics community through the Virginia portal. The website will be promoted through scientific societies, the National Marine Educators Association, National Science Teachers Association, and ASTC. Links will be provided to the Center for Archeological Research at the College of William and Mary and the Immersion Presents web portal--consultants to Dr. Bob Ballard's K-12 projects and JASON explorations. The NPS Colonial National Historic Park and the Riverwalk Landing will create public exhibits about the shipwreck's archeological and scientific significance, and will provide live observation of the research and the exploration technologies employed in this effort.
Quest, produced by KQED, is a multimedia initiative designed to raise the profile of STEM issues throughout the Northern California region and activate citizens to discuss and investigate them. Led by KQED, Quest is created and maintained by an active consortium of 16 participating informal science education organizations. Based on the successful Quest model, KQED will build on its prior collaborative work to develop regional partnerships with other public broadcasting stations and community-based organizations around the country, making possible a new and innovative partnership in science media production and informal science education. This grant will support a) a growing collaborative of science centers, museums, research institutes, and community-based organizations for editorial development, education outreach, and content creation; b) the production of at least 10 hours of television, weekly radio science news reports, and a dynamic online website that supports and extends the broadcast material; and c) educational resources and professional development workshops. STEM content will encompass research drawn from the physical sciences, life sciences, and earth sciences. Most of the stories will also incorporate content about the technology and engineering used to support scientific endeavors. The KQED Educational Network (EdNet) will administer the community and educational outreach initiatives, including creating viewer/listener guides, developing and delivering workshops, and providing information built around Quest media. Project collaborators include the Bay Institute, California Academy of Sciences, Chabot Space and Science Center, East Bay Regional Park District, Exploratorium, Girl Scouts, Lawrence Berkeley National Laboratory, Lawrence Hall of Science, Museum of Paleontology, Oakland Zoo, and The Tech Museum of Innovation. In expanding the model to regional hubs, Quest will also involve the Coalition for Public Understanding of Science (COPUS), the Encyclopedia of Life, and an array of peer public broadcasting organizations. This project offers a useful and exciting model for public television and radio stations nationally in building community collaborations that advance informal science education. The detailed and informed ways in which the team works with its community partners via multiple platforms are innovative. This proposal builds on prior work in Northern California to explore additional regional partnerships with other public broadcasting stations and community-based organizations, making possible a unique partnership in science media production and informal science education. This project extends reach by developing up to ten regional "hubs" across the country. Evaluation will be conducted by Rockman et al.
Through the Scientists for Tomorrow pathways project, The Science Institute at Columbia College in Chicago will test a model for preparing non-science major, pre-service elementary school teachers to deliver three ten-week informal science education modules to youth in after school programs. The initiative will bring engineering concepts, environmental science, and technology to approximately 240 urban Chicago youth (ages 10-14 years old) and their families. The Science Institute will partner with eight minority serving community based organizations and the Museum of Science and Industry, the Field Museum, and the Garfield Park Conservatory Alliance to develop and implement all aspects of the program. The goals of the program are two-fold. First, the project will develop and implement a high-quality STEM based afterschool program for under-represented youth in STEM. Second, the professional development and experience implementing the curriculum with youth in the local communities and within informal science education (ISE) institutions will extend and enrich the pre-service teachers\' STEM content and pedagogical knowledge base and better prepare them to teach science in formal and informal settings. Thirty teachers will receive specialized professional development through a seminar, course, and other support mechanisms in order to best support the implementation of the modules, while building their STEM content expertise, confidence, and pedagogical knowledge. Each module has a different STEM content focus: alternative energy (fall), the physics and mathematics of sound and music (winter), and environmental science (spring). At the end of each module, a culminating youth-led presentation will be held at one of the partnering Chicago museums. Youth will be encouraged to participate in all three modules. The formative evaluation will be conducted by the Co-Principal Investigators. Pre and post assessments, artifact reviews, and interviews will be used for the summative evaluation, which will be conducted by an external evaluator at the Illinois Institute of Technology. The project deliverables include: (a) a teacher training program, (b) an after school curriculum, and (c) media tools - DVDs, website. Over the grant period, the project intends to reach 120 youth each year, over 100 family and community members, and 30 teachers. The larger impact of this project will be the development of a scalable model for bringing relevant STEM content and experiences to youth, their families, and non-science major pre-service teachers. As a result of this project, a cadre of pre-service teachers will have: (a) increased their STEM content knowledge, (b) gained experience presenting STEM content in informal settings, (c) learned effective approaches to deliver hands-on STEM content, and (d) learned to use museum and other ISE resources in their teaching. In fact, after the grant period nearly half of the teachers will continue to work at the centers as part-time instructors, fully supported by the partnering community centers.
This Broad Implementation media project (building upon prior NSF award 0639001) will address science literacy among Latinos via mass media, increasing the amount of Spanish-language science content available in the U.S., increasing the representation of Latino scientists in mainstream media, and expanding the knowledge base about Latino's interest and engagement in science. The STEM content will be based on the research conducted by the Hispanic scientists being interviewed and therefore includes a wide range of topics including astronomy, biology, physics, earth sciences, and engineering. The criteria for selecting the Hispanic researchers and the content is based on the importance of the research, how it is immediately relevant to a Latino audience, and how it draws on the indigenous knowledge system or ethnic pride for U.S. Latinos. Project deliverables include 150 audio-video interviews with Hispanic scientists distributed on both commercial Hispanic radio and TV stations, as well as public broadcasting and online. In addition to the broadcasts, social media tools such as Facebook and Twitter will be used to reach out and engage Hispanics. It is estimated that 300 Spanish-language radio stations will air the programs, resulting in 3 million radio impressions for each daily 60-second broadcast. Television broadcasts are estimated to result in another 2 million impressions per program. Project partners include the Society for the Advancement of Chicanos and Native Americans in Science (SACNAS); V-Me, a national Hispanic educational channel; KLRN, the San Antonio, Texas public television station that will provide the national PBS distribution; and DaGama Web Studio that will develop and implement the social media marketing plan to attract and engage Latinos online. Comprehensive evaluations of project deliverables and impact will be conducted by Informal Learning Solutions (video-audio formative evaluations), and Knight-Williams Research (summative evaluation of project impact). The Summative Evaluation Plan will focus on the programs\' overall appeal, clarity, and effectiveness in meeting the two key audience objectives in the proposal: (1) increasing familiarity with and understanding of science concepts among U.S. Latinos, and (2) demonstrating engagement activities such as talking with friends/family about the presented topics, and/or seeking out additional information. It will furthermore assess the extent to which listeners and viewers find the Hispanic researchers featured in the programs to be effective communicators and the importance they assign to hearing from Hispanic researchers themselves. It will look at whether and how the programs are effective selecting topics with immediate relevance to listeners'/viewers' everyday lives. Finally, the evaluation will gather information about listeners'/viewers' demographic and background characteristics, including their country of origin, degree of fluency in Spanish, reasons for preferring Spanish media, number of generations in the U.S., reasons for tuning into the programming, efforts to recommend the programs to others, and the likelihood of continuing to listen to or view the programs in the future.
The Balboa Park Cultural Partnership, in collaboration with several informal science education and other cultural and business organizations in San Diego, Chicago, and Worcester, MA are implementing a research and development project that investigates a range of possible approaches for stimulating the development of 21st Century creativity skills and innovative processes at the interface between informal STEM learning and methods for creative thinking. The goal of the research is to advance understanding of the potential impacts of creative thinking methods on the public's understanding of and engagement with STEM, with a focus on 21st Century workforce skills of teens and adults. The goal of the project's development activities is to experiment with a variety of "innovation incubator" models in cities around the country. Modeled on business "incubators" or "accelerators" that are designed to foster and accelerate innovation and creativity, these STEM incubators generate collaborations of different professionals and the public around STEM education and other STEM-related topics of local interest that can be explored with the help of creative learning methodologies such as innovative methods to generate creative ideas, ideas for transforming one STEM idea to others, drawing on visual and graphical ideas, improvisation, narrative writing, and the process of using innovative visual displays of information for creating visual roadmaps. Hosting the project's incubators are the Balboa Park Cultural Partnership (San Diego), the Museum of Science and Industry (Chicago) and the EcoTarium (Worcester, MA). National partners are the Association of Science-Technology Centers, the American Association for the Advancement of Science, and the Americans for the Arts. Activities will include: the formation and collaborative processes of three incubator sites, a research study, the development of a creative thinking curriculum infused into science education, professional development based on the curriculum, public engagement events and exhibits, a project website and tools for social networking, and project evaluation. A national advisory council includes professionals in education, science, creativity, and business.