This report describes an evaluation of two educational programs that Iridescent offered with a grant from the National Science Foundation. These two programs were developed for youth and their families and were organized around open-ended Engineering Design Challenges. These are hands-on problem-solving activities supported by a web-based platform known as the Curiosity Machine. The Curiosity Machine and the Design Challenges were designed to work together to engage learners in fundamental physics and engineering concepts in fun and open-ended ways, while enhancing their curiosity, creativity
In support of a summative evaluation of SciGirls Season Three, Multimedia Research developed a scale to assess preteen girls’ interest in nature and science. The work was sponsored by Twin Cities PBS under NSF Grant No. 1323713. Multimedia Research developed, piloted, validated and implemented the GINSS: A nine statement Likert scale constructed to reveal girls’ strength of interest in nature and science activities. Researchers and evaluators are encouraged to use this scale to extend its application. Please email if you eventually use the scale in your research or evaluation: Flagg
Goodman Research Group, Inc. (GRG), a research firm in Cambridge, Massachusetts specializing in program evaluation, has been conducting external evaluation of ZOOM for WGBH-TV Boston since 1998. GRG's Season VI evaluation comprised a pilot test to investigate the effectiveness of the new online ZOOMSCITM TRAINING: LEARN TO LEAD SCIENCE ACTIVITIES (ZOOMsci Training), a self-directed, online tutorial designed to help afterschool educators learn how to lead hands-on science activities with kids ages 8 to 11. The goal of the training is to motivate leaders, help them develop science-teaching
This Pathways project will develop and evaluate a new model for a STEM career exploration program for at-risk Hispanic youth and their families in New Mexico where 46% of the population is Hispanic. The target audience includes Hispanic youth incarcerated in juvenile detention centers. The Hispanic Communications Network will partner with the Juvenile Justice Division of the New Mexico Children, Youth, and Families Department, Youth Development Inc.; and Youth Works in Santa Fe. STEM professionals from Los Alamos and Sandia labs and private sector companies in New Mexico will participate as role models. The evaluation findings will add to the knowledge base about strategies to increase interest and engagement in pursuing STEM careers among hard-to-reach Hispanic audiences including low income families, gang members and incarcerated youth. The project design includes using two main strategies: family evenings with STEM role models; and a social media and Facebook contest focusing on Green Jobs of the Future. The evaluation will use a mixed-methods approach for gathering data including brief questionnaires after the family evenings, pre-and past-activity surveys, observations, and telephone and online surveys. The evaluation will provide ongoing feedback to the project team on how well the strategies are working. The project will hold 8 family nights, involve approximately 16 STEM professionals (role models), and projects about 16 edited media submissions by the youth teams. Toward the end of the project the evaluation will comment on the viability, efficacy and potential transferability of this model to other communities.
DATE:
-
TEAM MEMBERS:
Carlos AlcazarTrinity TreatAlliyah NoorLynn Dierking
WGBH Educational Foundation will create PEEP'S WORLD/EL MUNDO DE PEEP, a Web-based "Digital Hub," in both English and Spanish, to significantly increase the impact of the extensive collection of proven preschool science and math assets from the Emmy Award-winning TV show PEEP AND THE BIG WIDE WORLD®. This project will: (1) redesign the PEEP Web site, creating interactive media experiences that will contextualize existing content and take advantage of new Web design; (2) provide professional development for preschool educators; and (3) reach a new audience of family childcare educators, one that is woefully underserved when it comes to educational resources about science. Dissemination through a network of national organizations, including National Association of Family Child Care, National Association of Child Care Resource and Referral Agencies, National Head Start Association, National Education Association, AVANCE, and Committee for Hispanic Children and Families, will help engage the maximum number of educators and parents in the project. PEEP'S WORLD/EL MUNDO DE PEEP will provide resources for targeted audiences. Specifically these resources will provide: Children with multiple ways to engage with science or math content areas, including interactive games, animated stories, and live-action videos; Parents with guided experiences to facilitate their child's math and science play; Center-based preschool educators with a media-rich, year long science curriculum and professional development materials; and Family childcare educators with curriculum modules, integrated with media, focused on six science content areas, and professional development materials for home-care settings in English and in Spanish. The University of Massachusetts's Donahue Institute will conduct a formative evaluation of the family childcare educator resources: 200 Spanish-speaking and 200 English-speaking educators will pilot the curriculum modules and professional development videos. Concord Evaluation Group, Inc. will conduct a summative evaluation, consisting of a Family Web Site Experiment and a National Observational Study, to assess the extent to which the project is successful at achieving its intended impacts. A multifaceted national dissemination plan will include a robust social media strategy, implemented by a Spanish-speaking online community manager, to reach parents, and collaborations with early childhood education statewide systems to reach educators. The projects intended impacts are to: (1) help English- and Spanish-speaking preschoolers effectively apply science and mathematical inquiry and process skills; (2) empower English- and Spanish-speaking parents to feel more equipped and inclined to facilitate science and math exploration with their preschoolers; and, (3) provide center-based and family childcare educators with resources for incorporating math and science into their curricula and boosting their confidence in teaching these subjects. While many parents know how to read to their children, they do not typically know how to approach science or math investigations with their pre-schoolers. After parents, preschool educators are the most important promoters of a young child\'s learning. Yet, center-based and family childcare educators do not receive significant training in science, and thus lack confidence when conducting preschool science activities. By providing parents and educators resources for approaching preschool science and math, which meet their specific needs, PEEP will help alleviate these challenges.
Kinetic City After School is a project supported by a prior NSF award that has produced over 80 activities in areas typical of after school activities such as computer games/simulations, hands-on activities, active play, and art and writing. This pathways project, KC Empower, will redesign and test five activities of the 80 activities currently developed by Kinetic City using a new approach to increase the representation of children and youth with disabilities in informal science settings. The project will test how universal design principles can be integrated with new technologies, not available when most after school STEM content was created, to address the needs of students with disabilities. The technologies used in the redesign include advanced mobile platforms and applications; search engines that sift through audio, image and video files; gaming input devices that respond to body movements; and information restructuring that allows multiple representations of content. The project will test how universal design guidelines will work with new technologies, in the short-term providing hands-on activities more accessible to students with disabilities, while increasing access for all students. The project is expected to lead to a full scale development project that will update all modules in Kinetic City After School. The target audience is 3rd - 5th grade students. The hypothesis of the project is that designing for disability can strengthen activities designed to increase science knowledge. Rather than making accommodations for persons with disabilities, it is the environment and design that are disabled, and it is better educational practice to rethink the activity from the point of view of all learners, including those with disabilities. Thus the use of universal design will address how best to present material for all users while influenced by the challenges presented by disabled users. The project includes the Coalition for Science After School, the Center for Applied Special Technology and the Afterschool Alliance.
Iridescent is a not-for-profit company that develops and implements informal science and engineering experiences for students by facilitating the translation of the work that scientists and engineers do in a way that makes that work accessible to families. The proposal expands the Iridescent outreach activities funded by the Office of Naval Research, to provide a blended combination of in-person and online support to the families of underrepresented populations. The project is producing twenty videos of scientists and engineers presenting their research that are closely aligned with one hundred scientific inquiry and engineering design-based experiments and lesson plans. These digital resources, collectively called the Curiosity Machine, provide opportunities for parents and children to engage in scientific inquiry and engineering design in multiple face-to-face and online environments, including mobile technologies. The evaluation findings from this project provide a model of how to engage STEM education practitioners, teachers and online communities, to substantively connect underserved communities, in both informal and more formal learning environments to develop experiences with engineering design and to improve students' perspectives about and motivations to prepare for STEM careers. The Curiosity Machine portal is designed to present scientists and engineers explaining the work that they do in a way that makes it accessible to parents and students. Iridescent is working at three sites across the country in South Los Angeles, the South Bronx in New York City, and San Francisco. Students and their families have multiple access points to the science and engineering videos and materials through after school activities, Family Science Nights and summer camps. The project is piloting the use of electronic badges, similar to those offered in the Boy and Girl Scouts as a mechanism to enhance the engagement and persistence of students in the online activities. The project is developing ways to evaluate student engagement and performance through the analysis of the products that students submit online in response to particular science and engineering challenges. Students can also gain extra credit at school for their participation in the Curiosity Machine activities. The materials that the Curiosity Machine activities and challenges use are those that are commonly available to families, and the project provides access to mobile technology to facilitate participation by families. Student access to out of school science and engineering experiences is limited by the resources in terms of time and availability science centers have available. This project develops the resources and tools to bridge the in-school and out of school activities for students through the use of videos and online participation in ways that expand the opportunity of students from underserved populations to continue to engage in substantive science and engineering experiences beyond what they might get during an intermittent visit to a science center. The research and evaluation that is part of this study provides information about how new forms of extrinsic motivation might be used to support student engagement and persistence in learning about science and engineering.
The ScienceMakers: African Americans and Scientific Innovation is a three-year project designed to increase awareness of the contributions of African American scientists, raise awareness of STEM careers, and increase understanding of STEM concepts through the creation of education, media, and career resources. The project team is supplemented with an extensive advisory board of STEM education, museum, and community professionals, as well as representatives from partnering science centers. Project partners include the St. Louis Science Center, Liberty Science Center, New York Hall of Science, Pacific Science Center, Franklin Institute, COSI Columbus, Lawrence Hall of Science, SciWorks, Detroit Science Center, and MOSI Chicago. Additional collaborators include middle and high schools with high minority populations. Project deliverables include a fully accessible multi-media archive of video oral histories of 180 African American scientists and web resources and contests utilizing Web 2.0 and 3.0 applications such as social networking tools that foster engagement and build community around the ScienceMakers. Public programs for youth and adults at science museums, after-school programs, and community organizations highlight African American contributors, and encourage interest in science and science careers and the ScienceMakers DVD Toolkit expand the reach of this innovative project. Intended impacts for youth and adults consist of increased awareness of STEM concepts and career options, exposure to African American scientists, awareness of the contributions of minority scientists, and 21st century skills. Intended impacts on professional audiences include increased awareness and understanding of STEM careers and workforce diversity, 21st century skills, and STEM career options. The project evaluation, conducted by Knight-Williams Research Communications, utilizes a mixed-methods approach. The evaluation assesses the impact of the oral history archive, public programs, and other deliverables on public and professional audiences' knowledge, interest, and awareness of the contributions of African American scientists, STEM concepts, and STEM careers. The evaluation also includes an ethnography which examines factors that contribute to success in STEM careers by African-American scientists. The ScienceMakers significantly expands the world\'s largest searchable oral history archive and may have an enduring impact on research and practice in the field of informal science education. The project has the potential to enrich programs and exhibits, while raising awareness of the contributions of African-American scientists among informal science education professionals and the general public.
This evaluation reports on the Mission: Solar System project, a 2-year project funded by NASA. The goal of the Mission: Solar System was to create a collection of resources that integrates digital media with hands-on science and engineering activities to support kids’ exploration in formal and informal education settings. Our goal in creating the resources were: For youth: (1) Provide opportunities to use science, technology, engineering, and math to solve challenges related to exploring our solar system, (2) Build and hone critical thinking, problem-solving, and design process skills, (3)
Rockman et al (REA), a San Francisco-based research and evaluation firm, conducted the external evaluation for Youth Radio's DO IT! program, which was funded by the National Science Foundation. Building upon Youth Radio's previous Science and Technology Program, the DO IT! initiative consisted of three primary components that promoted STEM (science, technology, engineering, and mathematics) learning by training underserved youth in cutting-edge digital technologies: (1) Brains and Beakers: Young people hosted a line-up of investigators and inventors for demo-dialogues at Youth Radio's studios
DATE:
TEAM MEMBERS:
Rockman et al | Youth RadioKristin BassJulia Hazer
In 2010 EarthSky Communications Inc. was awarded a broad implementation grant from the National Science Foundation (NSF) entitled Proyecto de Implementacion Amplia EarthSky en Español (EarthSky in Spanish Broad Implementation Project). In partnership with the Spanish media company Univision Communications Inc. and a national Advisory Committee of Hispanic scientists, educators, and media experts, EarthSky proposed to present science information and scientist interviews to Spanish-preferring U.S. Hispanics via short video programs distributed on television and the Internet. Under the Broad
DATE:
TEAM MEMBERS:
Knight Williams Inc.Valerie Knight-WilliamsDeborah ByrdRachel TeelDivan WilliamsRoxana HernandezEric AndersonGabriel SimmonsSauleh Rahbari
This Science Learning+ Planning Project will develop a prototype assessment tool (based on a mobile technology platform) to map STEM learning experiences across different learning ecologies (e.g. science centers, mass media, home environment) and to develop research questions and designs for a Phase 2 Science Learning+ proposal. The tool will focus on the impact of the learning ecologies on knowledge, interest, identity and reasoning rather than emphasize learning in a specific content area. The proposing team will develop and conduct a small scale usability study during the planning period, which will inform what is proposed in the Phase 2 research. A key focus of the planning period will be to identify and develop the theoretical constructs (i.e., outcomes) to be measured by the prototype App. As a starting point, the project will start with four of the six strands identified in Learning Science in Informal Environments (National Research Council, Bell et al., 2009): (1) interest triggered by a STEM experience; (2) understanding scientific knowledge; (3) engaging in scientific reasoning; and (4) identifying with the scientific enterprise. Discussion among the project partners during the planning process will revolve around how these strands should be measured in the Phase 2 research across ecologies. The measurement tool will assess the goal(s) that people set as they engage in STEM learning within each ecology and will measure the individuals' duration and level of engagement. The project will strive to utilize measures that: (1) are nonobtrusive; (2) are embedded in STEM experiences; (3) can be used across ecologies; (4) can be scaled for other ecologies than the ones examined in Phase 2 research; and (5) will be easy to use by researchers and practitioners.
DATE:
-
TEAM MEMBERS:
Bradley MorrisJohn DunloskyGreat Lakes Science CenterUniversity of LimerickIdeaStream (UK)Irish Independent newspaper