The Garfield Park Conservatory Alliance is developing Sugar from the Sun, a project consisting of a 5,400-square-foot exhibition intended to help children and their families explore photosynthesis. This immersive exhibition will use real plants to delve into the process that plants use to manufacture sugar (food energy) from the sun (light energy). Selinda Research Associates (SRA) conducted a front-end evaluation as part of the exhibit development process. The first phase examined what was known in the research literature about the public's understanding of photosynthesis and also about
DATE:
TEAM MEMBERS:
Cecilia GaribayJane SchaeferBeth ChangGarfield Park Conservatory
Goodman Research Group, Inc. (GRG), a research firm in Cambridge, Massachusetts specializing in program evaluation, has been conducting external evaluation of ZOOM for WGBH-TV Boston since 1998. GRG's Season VI evaluation comprised a pilot test to investigate the effectiveness of the new online ZOOMSCITM TRAINING: LEARN TO LEAD SCIENCE ACTIVITIES (ZOOMsci Training), a self-directed, online tutorial designed to help afterschool educators learn how to lead hands-on science activities with kids ages 8 to 11. The goal of the training is to motivate leaders, help them develop science-teaching
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
This pathways project would refine and test a game based on the Kinect technology gaming tool to teach seismology concepts in an informal education setting and how they apply to phenomenon in other STEM fields. The game will be developed as a companion tool to the "Quake Catcher Network" a low-cost network of seismic sensors in schools, homes and offices world-wide and tie-ins with seismology programs such as the great California ShakeOut with a participant base of 8.6 million. The project design would select three new learning modules, chosen by a group of scientists and educators, to incorporate into the game and evaluate player experience and knowledge gain. The activities will be conducted at a partner test site, an aquarium, frequented by area youth 8 - 12 years old. The focus of the effort is to add to the knowledge of how gaming can be used effectively in informal learning environments The game places the player as a scientist, allowing the player to make decisions about seismic station deployment strategies following an earthquake, installing the sensors and monitoring incoming data. The game has levels of difficulty and players accrue points by acting swiftly and correctly. Learning goals for the project include making abstract math concepts understandable; involve participants in data collection and the process of scientific investigation, plus demonstrate how scientists and mathematicians use tools of their fields to address real-world issues.
The Virginia Institute of Marine Science (VIMS) and The Watermen's Museum, Yorktown, VA, will produce an underwater robotics research and discovery education program in conjunction with time-sensitive, underwater archeological research exploring recently discovered shipwrecks of General Cornwallis's lost fleet in the York River. The urgency of the scientific research is based upon the dynamic environment of the York River with its strong tidal currents, low visibility, and seasonal hypoxia that can rapidly deteriorate the ships, which have been underwater since 1781. Geophysical experts believe that further erosion is likely once the wrecks are exposed. Given the unknown deterioration rate of the shipwrecks coupled with the constraints of implementing the project during the 2011-2012 school-year, any delays would put the scientific research back at least 18 months - a potentially devastating delay for documenting the ships. The monitoring and studying of the historic ships will be conducted by elementary through high school-aged participants and their teachers who will collect the data underwater through robotic missions using VideoRay Remotely Operated Vehicles (ROVs) and a Fetch Automated Underwater Vehicle (AUV) from a command station at The Watermen's Museum. Students and teachers will be introduced to the science, mathematics, and integrated technologies associated with robotic underwater research and will experience events that occur on a real expedition, including mission planning, execution, monitoring, and data analysis. Robotic missions will be conducted within the unique, underwater setting of the historical shipwrecks. Such research experiences and professional development are intended to serve as a key to stimulating student interest in underwater archeological research, the marine environment and ocean science, advanced research using new technologies, and the array of opportunities presented for scientific and creative problem solving associated with underwater research. A comprehensive, outcomes-based formative and summative, external evaluation of the project will be conducted by Dr. L. Art Safer, Loyola University. The evaluation will inform the project's implementation efforts and investigate the project's impact. The newly formed partnership between the Waterman's Museum and VIMS will expand the ISE Program's objectives to forge new partnerships among informal venues, and to expand the use of advanced technologies for informal STEM learning. Extensive public dissemination during and after the project duration, includes but is not limited to, hosting an "Expedition to the Wrecks" web portal on the VIMS BRIDGE site for K-12 educators providing real-time results of the project and live webcasts. The website will be linked to the education portal at the Association for Unmanned Vehicle Systems International, the world's largest organization devoted to promoting unmanned systems and to the FIRST Robotics community through the Virginia portal. The website will be promoted through scientific societies, the National Marine Educators Association, National Science Teachers Association, and ASTC. Links will be provided to the Center for Archeological Research at the College of William and Mary and the Immersion Presents web portal--consultants to Dr. Bob Ballard's K-12 projects and JASON explorations. The NPS Colonial National Historic Park and the Riverwalk Landing will create public exhibits about the shipwreck's archeological and scientific significance, and will provide live observation of the research and the exploration technologies employed in this effort.
'Be a Scientist!' is a full-scale development project that examines the impact of a scalable, STEM afterschool program which trains engineers to develop and teach inquiry-based Family Science Workshops (FSWs) in underserved communities. This project builds on three years of FSWs which demonstrate improvements in participants' science interest, knowledge, and self-efficacy and tests the model for scale, breadth, and depth. The project partners include the Viterbi School of Engineering at the University of Southern California, the Albert Nerken Engineering Department at the Cooper Union, the Los Angeles Museum of Natural History, and the New York Hall of Science. The content emphasis is physics and engineering and includes topics such as aerodynamics, animal locomotion, automotive engineering, biomechanics, computer architecture, optics, sensors, and transformers. The project targets underserved youth in grades 1-5 in Los Angeles and New York, their parents, and engineering professionals. The design is grounded in motivation theory and is intended to foster participants' intrinsic motivation and self-direction while the comprehensive design takes into account the cultural, social, and intellectual needs of diverse families. The science activities are provided in a series of Family Science Workshops which take place in afterschool programs in eight partner schools in Los Angeles and at the New York Hall of Science in New York City. The FSWs are taught by undergraduate and graduate engineering students with support from practicing engineers who serve as mentors. The primary project deliverable is a five-year longitudinal evaluation designed to assess (1) the impact of intensive training for engineering professionals who deliver family science activities in community settings and (2) families' interest in and understanding of science. Additional project deliverables include a 16-week training program for engineering professionals, 20 physics-based workshops and lesson plans, Family Science Workshops (40 in LA and 5 in NY), a Parent Leadership Program and social networking site, and 5 science training videos. This project will reach nearly one thousand students, parents, and student engineers. The multi-method evaluation will be conducted by the Center for Children and Technology at the Education Development Center. The evaluation questions are as follows: Are activities such as recruitment, training, and FSWs aligned with the project's goals? What is the impact on families' interest in and understanding of science? What is the impact on engineers' communication skills and perspectives about their work? Is the project scalable and able to produce effective technology tools and develop long-term partnerships with schools? Stage 1 begins with the creation of a logic model by stakeholders and the collection of baseline data on families' STEM experiences and knowledge. Stage 2 includes the collection of formative evaluation data over four years on recruitment, training, co-teaching by informal educators, curriculum development, FSWs, and Parent Leadership Program implementation. Finally, a summative evaluation addresses how well the project met the goals associated with improving families' understanding of science, family involvement, social networking, longitudinal impact, and scalability. A comprehensive dissemination plan extends the project's broader impacts in the museum, engineering, evaluation, and education professional communities through publications, conference presentations, as well as web 2.0 tools such as blogs, YouTube, an online social networking forum for parents, and websites. 'Be a Scientist!' advances the field through the development and evaluation of a model for sustained STEM learning experiences that helps informal science education organizations broaden participation, foster collaborations between universities and informal science education organizations, increase STEM-based social capital in underserved communities, identify factors that develop sustained interest in STEM, and empower parents to co-invest and sustain a STEM program in their communities.
Researchers at the American Association of Variable Star Observers, the Living Laboratory at the Boston Museum of Science, and the Adler Planetarium are studying stereoscopic (three-dimensional or 3D) visualizations so that this emerging viewing technology has an empirical basis upon which educators can build more effective informal learning experiences that promote learning and interest in science by the public. The project's research questions are: How do viewers perceive 3D visualizations compared to 2D visualizations? What do viewers learn about highly spatial scientific concepts embedded in 3D compared to 2D visualizations? How are viewers\' perceptions and learning associated with individual characteristics such as age, gender, and spatial cognition ability? Project personnel are conducting randomized, experimental mixed-methods research studies on 400 children and 1,000 adults in museum settings to compare their cognitive processing and learning after viewing two-dimensional and three-dimensional static and dynamic images of astronomical objects such as colliding galaxies. An independent evaluator is (1) collecting data on museum workers' and visitors' perceived value of 3D viewing technology within museums and planetariums and (2) establishing a preliminary collection of best practices for using 3D viewing technology based on input from museum staff and visitors, and technology creators. Spatial thinking is important for learning many domains of science. The findings produced by the Two Eyes, 3D project will researchers' understanding about the advantages and disadvantages of using stereoscopic technology to promote learning of highly spatial science concepts. The findings will help educators teach science in stereoscopic ways that mitigate problems associated with using traditional 2D materials for teaching spatial concepts and processes in a variety of educational settings and science content areas, including astronomy.
The adoption of the Next Generation Science Standards means that many educators who adhere to model-based reasoning styles of science will have to adapt their programs and curricula. In addition, all practitioners will have to teach modeling, and model-based reasoning is a useful way to do so. This brief offers perspectives drawn from Lehrer and Schauble, two early theorists in model-based reasoning.
This report includes six separate formative evaluations conducted to inform the design and development of the deliverables for the 3D Visualization Tools for Enhancing Awareness, Understanding and Stewardship of Freshwater Ecosystems project. Deliverables were tested with both students and general visitor groups, with a focus on groups including late elementary and middle school children. Many different components were tested, including prototype versions of 3D visualizations, high-tech interactive experiences, apps on tablets and phones, and table top exhibits. Results are reported in each of
Magnolia Consulting, LLC conducted a formative and summative evaluation to examine public perceptions of the utility and quality of two labs/exhibits within the North Carolina Museum of Natural Sciences Natural World Investigate Lab, Biofuels and Science of Scent. Appendix includes survey.
DATE:
TEAM MEMBERS:
North Carolina State Museum of Natural ScienceMary Styers
The purposes of the STUDIO 3D evaluation were to collect information about the impact upon student learning as a result of participating in the STUDIO 3D Project, as well as to elicit information for program improvement. Areas of inquiry include recruiting and retention, impact on project participants, tracking student impacts, and the project as a whole.
The formative evaluation of Season 2 of Design Squad was performed in two parts. Part 1 included a field test conducted by American Institutes for Research in spring 2008. Part 2, conducted by Veridian inSight, included follow-up interviews with teachers whose classrooms participated in the field test. The teacher interviews were conducted in fall of 2008. This document is the Design Squad, Season 2 final evaluation report. It contains the following sections: Section 1: Highlights from the teacher interviews conducted in fall of 2008 by Veridian inSight. Section 2: Findings from the field test
DATE:
TEAM MEMBERS:
Veridian inSight, LLCAmerican Institutes for Research