In support of a summative evaluation of SciGirls Season Three, Multimedia Research developed a scale to assess preteen girls’ interest in nature and science. The work was sponsored by Twin Cities PBS under NSF Grant No. 1323713. Multimedia Research developed, piloted, validated and implemented the GINSS: A nine statement Likert scale constructed to reveal girls’ strength of interest in nature and science activities. Researchers and evaluators are encouraged to use this scale to extend its application. Please email if you eventually use the scale in your research or evaluation: Flagg
Naturalists act as our link between scientific knowledge and the public’s understanding of natural history and conservation efforts. In order for them to succeed, they need access to reference materials as well as up-to-date information (Mankin, Warner, & Anderson, 1999). Incorporating mobile technology (i.e. tablets) into naturalists’ endeavors in natural history and environmental education can be used as supportive and educational tools. My project investigated how newly trained naturalists used tablet technology while leading groups of children on nature hikes. I investigated naturalists’
DATE:
TEAM MEMBERS:
Abuin Marishka Radzewich St. ClairKristy Daniel (Halverson)
Goodman Research Group, Inc. (GRG), a research firm in Cambridge, Massachusetts specializing in program evaluation, has been conducting external evaluation of ZOOM for WGBH-TV Boston since 1998. GRG's Season VI evaluation comprised a pilot test to investigate the effectiveness of the new online ZOOMSCITM TRAINING: LEARN TO LEAD SCIENCE ACTIVITIES (ZOOMsci Training), a self-directed, online tutorial designed to help afterschool educators learn how to lead hands-on science activities with kids ages 8 to 11. The goal of the training is to motivate leaders, help them develop science-teaching
The University of Chicago's Yerkes Observatory, the National Radio Astronomy Observatory, the University of North Carolina, the Astronomical Society of the Pacific, and 4-H are collaborating to provide professional development to 180 4-H leaders and other informal science educators, and engage 1,400 middle school youth in using research-grade robotic telescopes and data analysis tools to explore the Universe. Youth participating in 4H-based out-of-school programs in Wisconsin, West Virginia and North Carolina are learning about the universe and preparing for STEM careers by conducting authentic astronomy research, completing astronomy-related hands-on modeling activities, interacting with astronomers and other professionals who are part of the Skynet Robotic Telescope Network, and interacting with other youth who part of the Skynet Junior Scholars virtual community. The project is innovative because it is providing a diverse community of 4-H youth (including sight- and hearing-challenged youth and those from underrepresented groups) with opportunities to use high-quality, remotely located, Internet-controlled telescopes to explore the heavens by surveying galaxies, tracking asteroids, monitoring variable stars, and learn about the nature and methods of science. Deliverables include (1) online access to optical and radio telescopes, data analysis tools, and professional astronomers, (2) an age-appropriate web-based interface for controlling remote telescopes, (3) inquiry-based standards-aligned instructional modules, (4) face-to-face and online professional development for 4-H leaders and informal science educators, (5) programming for youth in out-of-school clubs and clubs, (6) evaluation findings on the impacts of program activities on participants, and (7) research findings on how web-based interactions between youth and scientists can promote student interest in and preparedness for STEM careers. The evaluation plan is measuring the effectiveness of program activities in (1) increasing youths' knowledge, skills, interest, self-efficacy, and identity in science, including youth who are sight- and hearing-impaired, (2) increasing educators' competency in implementing inquiry-based instruction and their ability to interact with scientists, and (3) increasing the number of Skynet scientists who are involved in education and public outreach.
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
The Virginia Institute of Marine Science (VIMS) and The Watermen's Museum, Yorktown, VA, will produce an underwater robotics research and discovery education program in conjunction with time-sensitive, underwater archeological research exploring recently discovered shipwrecks of General Cornwallis's lost fleet in the York River. The urgency of the scientific research is based upon the dynamic environment of the York River with its strong tidal currents, low visibility, and seasonal hypoxia that can rapidly deteriorate the ships, which have been underwater since 1781. Geophysical experts believe that further erosion is likely once the wrecks are exposed. Given the unknown deterioration rate of the shipwrecks coupled with the constraints of implementing the project during the 2011-2012 school-year, any delays would put the scientific research back at least 18 months - a potentially devastating delay for documenting the ships. The monitoring and studying of the historic ships will be conducted by elementary through high school-aged participants and their teachers who will collect the data underwater through robotic missions using VideoRay Remotely Operated Vehicles (ROVs) and a Fetch Automated Underwater Vehicle (AUV) from a command station at The Watermen's Museum. Students and teachers will be introduced to the science, mathematics, and integrated technologies associated with robotic underwater research and will experience events that occur on a real expedition, including mission planning, execution, monitoring, and data analysis. Robotic missions will be conducted within the unique, underwater setting of the historical shipwrecks. Such research experiences and professional development are intended to serve as a key to stimulating student interest in underwater archeological research, the marine environment and ocean science, advanced research using new technologies, and the array of opportunities presented for scientific and creative problem solving associated with underwater research. A comprehensive, outcomes-based formative and summative, external evaluation of the project will be conducted by Dr. L. Art Safer, Loyola University. The evaluation will inform the project's implementation efforts and investigate the project's impact. The newly formed partnership between the Waterman's Museum and VIMS will expand the ISE Program's objectives to forge new partnerships among informal venues, and to expand the use of advanced technologies for informal STEM learning. Extensive public dissemination during and after the project duration, includes but is not limited to, hosting an "Expedition to the Wrecks" web portal on the VIMS BRIDGE site for K-12 educators providing real-time results of the project and live webcasts. The website will be linked to the education portal at the Association for Unmanned Vehicle Systems International, the world's largest organization devoted to promoting unmanned systems and to the FIRST Robotics community through the Virginia portal. The website will be promoted through scientific societies, the National Marine Educators Association, National Science Teachers Association, and ASTC. Links will be provided to the Center for Archeological Research at the College of William and Mary and the Immersion Presents web portal--consultants to Dr. Bob Ballard's K-12 projects and JASON explorations. The NPS Colonial National Historic Park and the Riverwalk Landing will create public exhibits about the shipwreck's archeological and scientific significance, and will provide live observation of the research and the exploration technologies employed in this effort.
This CRPA project will develop a game for mobile devices called the "RapidGuppy". It provides users (students 12-21 years of age) with an interesting and fun way to learn details about biological adaptation and genetic change. The game teaches users about the environmental factors that lead to adaptation. More than 30 years of research on the Trinidadian Guppy that "rapidly" evolves (over 3-5 years) is the basis for the game. The research, databases, and mini-documentaries that support the "RapidGuppy" game are linked to allow users to easily delve deeper into these materials. An extensive social media campaign will be used to market the game and the public facing website. Partners in this endeavor include: University of California-Riverside, Habitat Seven, Magmic Inc., and Edu, Inc. In this project, the mobile device game will be backed by a sophisticated website that contains detailed research results from the field and mini-documentaries showing real fish and the actual research processes as well as researchers and scientists to promote role model development. Interested individuals may also directly access the videos and research results via the website. The target audiences are youth who are prone to play electronic games and the general public. The comprehensive evaluation plan will assess the learning outcomes resulting from the mini-documentaries, in-game content, and website, as well as the playability of the game and website functionality. Impacts resulting from the social media campaign and outreach to underserved audiences will also be measured. Because of the major social media campaign, this project may increase the level of interest in the science of evolution and genetic change, and raise awareness of STEM careers. If the user groups become excited about the game and the inherent messages, it is anticipated that the public will gain a better understanding of the factors responsible for genetic change.
The Louisiana State Museum and Tulane University/Xavier University Center for Bioenvironmental Research and the University of Rhode Island Graduate School of Oceanography, along with several other research collaborators, designers, evaluators, and the Times-Picayune newspaper are partnering to develop a multi-pronged approach on educating the general public, school children, teachers and public officials on the STEM-related aspects of Hurricane Katrina and its implications for the future of New Orleans and other parts of the country. The major products will be an 8,500 square-foot semi-permanent exhibit, smaller exhibits for Louisiana regional libraries, a comprehensive Web site on hurricanes, a set of studies on informal learning, a case study for public officials about the relevance of science research to policy and planning, teacher workshops, and a workshop for interested exhibit designers from around the country. This project advances the field of informal science education by exploring how museums, universities, and their communities can work together to provide meaningful learning experiences on STEM topics that are critical to solving important community and national issues.
This evaluation reports on the Mission: Solar System project, a 2-year project funded by NASA. The goal of the Mission: Solar System was to create a collection of resources that integrates digital media with hands-on science and engineering activities to support kids’ exploration in formal and informal education settings. Our goal in creating the resources were: For youth: (1) Provide opportunities to use science, technology, engineering, and math to solve challenges related to exploring our solar system, (2) Build and hone critical thinking, problem-solving, and design process skills, (3)
The University of Massachusetts Lowell and Machine Science Inc. propose to develop and to design an on-line learning system that enables schools and community centers to support IT-intensive engineering design programs for students in grades 7 to 12. The Internet Community of Design Engineers (iCODE) incorporates step-by-step design plans for IT-intensive, computer-controlled projects, on-line tools for programming microcontrollers, resources to facilitate on-line mentoring by university students and IT professionals, forums for sharing project ideas and engaging in collaborative troubleshooting, and tools for creating web-based project portfolios. The iCODE system will serve more than 175 students from Boston and Lowell over a three-year period. Each participating student attends 25 weekly after-school sessions, two career events, two design exhibitions/competitions, and a week-long summer camp on a University of Massachusetts campus in Boston or Lowell. Throughout the year, students have opportunities to engage in IT-intensive, hands-on activities, using microcontroller kits that have been developed and classroom-tested by University of Massachusetts-Lowell and Machine Science, Inc. About one-third of the participants stay involved for two years, with a small group returning for all three years. One main component for this project is the Handy Cricket which is a microcontroller kit that can be used for sensing, control, data collection, and automation. Programmed in Logo, the Handy Cricket provides an introduction to microcontroller-based projects, suitable for students in grades 7 to 9. Machine Science offers more advanced kits, where students build electronic circuits from their basic components and then write microcontroller code in the C programming language. Machine Science offers more advanced kits, which challenge students to build electronic circuits from their basic components and then write microcontroller code in the C programming language. Machine Science's kits are intended for students in grades 9 to 12. Microcontroller technology is an unseen but pervasive part of everyday life, integrated into virtually all automobiles, home appliances, and electronic devices. Since microcontroller projects result in physical creations, they provide an engaging context for students to develop design and programming skills. Moreover, these projects foster abilities that are critical for success in IT careers, requiring creativity, analytical thinking, and teamwork-not just basic IT skills.
DATE:
-
TEAM MEMBERS:
Fred MartinDouglas PrimeMichelle Scribner-MacLeanSamuel Christy
Internet Community of Design Engineers (iCODE) program, which took an innovative approach to structuring self-directed learning – using a collaborative on-line environment to facilitate hands-on activities, was a three year program led by the University of Massachusetts Lowell and Machine Science Inc., Cambridge. The overall objective of this program, which involved after-school and summer sessions and was funded by NSF’s Innovative Technology Experiences for Students and Teachers (ITEST) Program, was to increase the likelihood that participating middle school and high school students will
DATE:
TEAM MEMBERS:
Rucha LondheColleen ManningRachel SchechterLaura HousemanIrene Goodman
This report includes six separate formative evaluations conducted to inform the design and development of the deliverables for the 3D Visualization Tools for Enhancing Awareness, Understanding and Stewardship of Freshwater Ecosystems project. Deliverables were tested with both students and general visitor groups, with a focus on groups including late elementary and middle school children. Many different components were tested, including prototype versions of 3D visualizations, high-tech interactive experiences, apps on tablets and phones, and table top exhibits. Results are reported in each of