Goodman Research Group, Inc. (GRG), a research firm in Cambridge, Massachusetts specializing in program evaluation, has been conducting external evaluation of ZOOM for WGBH-TV Boston since 1998. GRG's Season VI evaluation comprised a pilot test to investigate the effectiveness of the new online ZOOMSCITM TRAINING: LEARN TO LEAD SCIENCE ACTIVITIES (ZOOMsci Training), a self-directed, online tutorial designed to help afterschool educators learn how to lead hands-on science activities with kids ages 8 to 11. The goal of the training is to motivate leaders, help them develop science-teaching
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
'Be a Scientist!' is a full-scale development project that examines the impact of a scalable, STEM afterschool program which trains engineers to develop and teach inquiry-based Family Science Workshops (FSWs) in underserved communities. This project builds on three years of FSWs which demonstrate improvements in participants' science interest, knowledge, and self-efficacy and tests the model for scale, breadth, and depth. The project partners include the Viterbi School of Engineering at the University of Southern California, the Albert Nerken Engineering Department at the Cooper Union, the Los Angeles Museum of Natural History, and the New York Hall of Science. The content emphasis is physics and engineering and includes topics such as aerodynamics, animal locomotion, automotive engineering, biomechanics, computer architecture, optics, sensors, and transformers. The project targets underserved youth in grades 1-5 in Los Angeles and New York, their parents, and engineering professionals. The design is grounded in motivation theory and is intended to foster participants' intrinsic motivation and self-direction while the comprehensive design takes into account the cultural, social, and intellectual needs of diverse families. The science activities are provided in a series of Family Science Workshops which take place in afterschool programs in eight partner schools in Los Angeles and at the New York Hall of Science in New York City. The FSWs are taught by undergraduate and graduate engineering students with support from practicing engineers who serve as mentors. The primary project deliverable is a five-year longitudinal evaluation designed to assess (1) the impact of intensive training for engineering professionals who deliver family science activities in community settings and (2) families' interest in and understanding of science. Additional project deliverables include a 16-week training program for engineering professionals, 20 physics-based workshops and lesson plans, Family Science Workshops (40 in LA and 5 in NY), a Parent Leadership Program and social networking site, and 5 science training videos. This project will reach nearly one thousand students, parents, and student engineers. The multi-method evaluation will be conducted by the Center for Children and Technology at the Education Development Center. The evaluation questions are as follows: Are activities such as recruitment, training, and FSWs aligned with the project's goals? What is the impact on families' interest in and understanding of science? What is the impact on engineers' communication skills and perspectives about their work? Is the project scalable and able to produce effective technology tools and develop long-term partnerships with schools? Stage 1 begins with the creation of a logic model by stakeholders and the collection of baseline data on families' STEM experiences and knowledge. Stage 2 includes the collection of formative evaluation data over four years on recruitment, training, co-teaching by informal educators, curriculum development, FSWs, and Parent Leadership Program implementation. Finally, a summative evaluation addresses how well the project met the goals associated with improving families' understanding of science, family involvement, social networking, longitudinal impact, and scalability. A comprehensive dissemination plan extends the project's broader impacts in the museum, engineering, evaluation, and education professional communities through publications, conference presentations, as well as web 2.0 tools such as blogs, YouTube, an online social networking forum for parents, and websites. 'Be a Scientist!' advances the field through the development and evaluation of a model for sustained STEM learning experiences that helps informal science education organizations broaden participation, foster collaborations between universities and informal science education organizations, increase STEM-based social capital in underserved communities, identify factors that develop sustained interest in STEM, and empower parents to co-invest and sustain a STEM program in their communities.
The STAR Library Education Network: a hands-on learning program for libraries and their communities, (STAR_Net for short) is led by the National Center for Interactive Learning (NCIL) at the Space Science Institute (PI: Paul Dusenbery). STAR stands for Science-Technology, Activities and Resources. Team members include NCIL staff, the American Library Association (ALA), Lunar and Planetary Institute (LPI), and the National Girls Collaborative Project (NGCP). STAR_Net is developing two comprehensive, informal education programs: Discover Earth and Discover Tech. The project also includes a comprehensive evaluation plan and a research component that explores how public libraries can serve as a STEM learning center in rural, underserved communities. STAR_Net is supported through a grant from the National Science Foundation. The STAR_Net project includes two traveling library exhibits: Discover Earth: A Century of Change and Discover Tech: Engineers Make a World of Difference. The Discover Earth exhibition features interactive, multimedia displays that allow exhibit visitors to interact with digital information in a dynamic way, encouraging new perspectives on our planet. Discover Tech introduces the many extraordinary ways that engineers solve problems to help people and societies around the world. Similar to a science center experience, visitors and families will be able to explore and tinker with their own engineering solutions. A number of STEM activities and resources will be developed by project staff and by other organizations to help librarians and community partners offer a wide variety of programs for their patrons. Besides the traveling exhibits and programs, STAR_Net also includes library staff training (online and in-person) and a Community of Practice (CoP) for librarians (including non-host librarians) to interact and partner with STEM professionals and organizations. NCI's Kate Haley Goldman and staff from Evaluation and Research Associates are conducting the project's evaluation.
The National Science Festival Network project, also operating as the Science Festival Alliance, is designed to create a sustainable national network of science festivals that engages all facets of the general public in science learning. Science Festivals, clearly distinct from "science fairs", are community-wide activities engaging professional scientists and informal and K-12 educators targeting underrepresented segments of local communities historically underserved by formal or informal STEM educational activities. The initiative builds on previous work in other parts of the world (e.g. Europe, Australasia) and on recent efforts in the U.S. to create science festivals. The target audiences are families, children and youth ages 5-18, adults, professional scientists and educators in K-12 and informal science institutions, and underserved and underrepresented communities. Project partners include the MIT Museum in Cambridge, UC San Diego, UC San Francisco, and the Franklin Institute in Philadelphia. The deliverables include annual science festivals in these four cities supported by year-round related activities for K-12 and informal audiences, a partnership network, a web portal, and two national conferences. Ten science festivals will be convened in total over the 3 years of the project, each reaching 15,000 to 60,000 participants per year. STEM content includes earth and space science, oceanography, biological/biomedical science, bioinformatics, and computer, behavioral, aeronautical, nanotechnology, environmental, and nuclear science. An independent evaluator will systematically assess audience participation and perceptions, level/types of science interest stimulated in target groups, growth of partnering support at individual sites, and increasing interactions between ISE and formal K-12 education. A variety of qualitative and quantitative assessments will be designed and utilized. The project has the potential to transform public communication and understanding of science and increase the numbers of youth interested in pursuing science.
DATE:
-
TEAM MEMBERS:
Loren ThompsonJeremy BabendureBen Wiehe
The Louisiana State Museum and Tulane University/Xavier University Center for Bioenvironmental Research and the University of Rhode Island Graduate School of Oceanography, along with several other research collaborators, designers, evaluators, and the Times-Picayune newspaper are partnering to develop a multi-pronged approach on educating the general public, school children, teachers and public officials on the STEM-related aspects of Hurricane Katrina and its implications for the future of New Orleans and other parts of the country. The major products will be an 8,500 square-foot semi-permanent exhibit, smaller exhibits for Louisiana regional libraries, a comprehensive Web site on hurricanes, a set of studies on informal learning, a case study for public officials about the relevance of science research to policy and planning, teacher workshops, and a workshop for interested exhibit designers from around the country. This project advances the field of informal science education by exploring how museums, universities, and their communities can work together to provide meaningful learning experiences on STEM topics that are critical to solving important community and national issues.
Math off the Shelf (MotS) was designed to help those who work in public libraries put math into what they do with grades K-6 children and their families. Public libraries exist in virtually every community in the nation, and increasingly, families rely on them as a free, safe place for children to spend time in the absence of other care. As such, they are an ideal venue for reaching a large and diverse population with math. MotS has: (1) developed research-based English/Spanish materials for informal educators working in public libraries, available for free online (2) supported implementation and institutionalization at libraries across the nation (3) engaged informal educators working in libraries in conducting outreach via state and national library association meetings, webinars, and community and youth agencies (4) conducted evaluation on project impact, as described in the summative evaluation report attached. Dissemination to professional communities will constitute the remaining project work. External evaluation, conducted by Char Associates, identified dramatic changes in attitudes about math and its role in the library, in the amount of math that librarians offer to children and families, and in librarians' communication about math with patrons and peers. Development partners include the library systems of Queens NY, San Jose CA, St Louis MO, Westchester County NY, and dozens of libraries in AZ, CT, FL, and MA.
Collaboration efforts between educator preparation programs and children's science museums are important in assisting elementary pre-service teachers connect the theory they have learned in their classrooms with the actual practice of teaching. Elementary pre-service teachers must not only learn the science content, but how to effectively deliver that science content to a group of students. One university provided their elementary pre-service teachers with the opportunity to prepare and deliver science lessons to students in a children's science museum in south Texas.
This evaluation reports on the Mission: Solar System project, a 2-year project funded by NASA. The goal of the Mission: Solar System was to create a collection of resources that integrates digital media with hands-on science and engineering activities to support kids’ exploration in formal and informal education settings. Our goal in creating the resources were: For youth: (1) Provide opportunities to use science, technology, engineering, and math to solve challenges related to exploring our solar system, (2) Build and hone critical thinking, problem-solving, and design process skills, (3)
This article describes discussions about the relationship between afterschool programs and the Common Core Standards at a networking meeting sponsored by the Robert Bowne Foundation for out-of-school time (OST) providers in New York City in the fall of 2013. The meeting was entitled "Introducing the Common Core Learning Standards: What Are They? What Do We Need to Know?"
DATE:
TEAM MEMBERS:
Suzanne MartenSara HillAnne Lawrence
What would it be like to increase the number of youth-serving volunteers who can competently lead science, technology, engineering, and math (STEM) activities? This question guided the Inquiry in the Community project, launched in 2008. Along with Girl Scout staff colleagues and volunteers, the project created a system for embedding inquiry-based science into a youth development organization.
Grounded in literature on best practices in science education, this article describes a systematic and intentional approach to developing out-of-school time (OST) science curricula and professional development models. Examples from the California 4-H Science, Engineering, and Technology Initiative demonstrate promising practices in action.