The summative evaluation of the Farming for Fuels classroom program and family event was conducted over two years. Two interim reports were delivered with preliminary results about specific areas of focus. This final report described the overall evaluation study methods and results, and made recommendations for potential revisions and improvements to the program. The evaluator worked with the program team at the Creative Discovery Museum to generate a list of questions to guide the evaluation study. The questions covered each of the major audiences for the program: museum educators, teachers
What Teachers and Districts Most Need from Research and Researchers: In this presentation from a workshop on research and practice at the NARST annual conference, Dan Gallagher of Seattle Public Schools and Tana Peterman of University of Washington discuss examples of what practitioners need from the education research community.
Since August of 2011, Project iLASER (Investigations with Light And Sustainable Energy Resources) has engaged children, youth and adults in public science education and hands-on activities across the entire length of the U.S.-Mexico border, from the Pacific Ocean to the Gulf of Mexico. The two main themes of Project iLASER activities focus on sustainable energy and materials science. More than 1,000 children have been engaged in the hands-on activities developed through Project iLASER at 20+ sites, primarily in after-school settings in Boys & Girls Clubs. Sites include Boys & Girls Clubs in California (Chula Vista, Imperial Beach, El Centro and Brawley); Arizona (Nogales); New Mexico (Las Cruces); and Texas (El Paso, Midland-Odessa, Edinburg and Corpus Christi). The project was co-funded between the NSF Division of Chemistry (CHE) and the Division of Research on Learning in Formal and Informal Settings (DRL).
DATE:
-
TEAM MEMBERS:
Southwestern CollegeDavid BrownDavid Hecht
The Chicago Zoological Society (CZS) in collaboration with Eden Place Nature Center, the Fuller Park Community Corporation, and the University of Illinois at Chicago (UIC) will implement the SCIENCES Program, Supporting a Community's Informal Education Needs: Confidence and Empowerment in STEM. The primary goals of this Full Scale Development project are to broaden access to and participation in environmental science, strengthen partnerships between CZS, Eden Place, and UIC, and gain insights into the 'ecosystemic' learning model which promotes scientific literacy and agency in the community. The project targets a low-resource community with a minority audience while the secondary audience is informal science learning organizations and researchers who will advance research in informal learning. The theoretical framework for the project design draws on conservation psychology, informal science learning, civic ecology education, and urban science education to create an ecosystematic, geographically centered approach. The deliverables include research, curriculum, and engaging hands-on programs for youth, families, adults, and teachers, reaching both in-school and out-of-school audiences, in addition to the SCIENCES Implementation Network. Three potential curriculum themes to be explored are water conservation and protection, pollinators for healthy ecosystems, and community resilience to climate change. The SCIENCES project offers a comprehensive suite of engaging programs for community audiences. For example, the year-long Zoo Adventure Passport (ZAP) program for families includes hands-on experiments and field trips, while project-based learning experiences enable teens to create wetlands, design interpretive signage, and develop associated public programming. School-based programs include professional development for teachers on the Great Lakes ecosystem and invasive species. Existing programs that have been previously evaluated and demonstrated to show learning impacts will be adapted and modified to meet the goals of the ecosystemic learning model by providing multiple learning opportunities. New learning resources will also be created to support the content themes and provide continuity. The result will be a comprehensive approach that ensures deep community engagement by individuals, families, and organizations, with cohesiveness provided by the overarching content themes which broaden access to STEM learning resources and leverages partnerships. The project includes both a research and evaluation plan. The primary research question to be addressed is: How does a large informal science learning institution work with a community-based organization to support environmental scientific literacy and agency at all levels of the community? A sociocultural framework will be used for this mixed-methods case study research. Study participants include community leaders, youth, parents, teachers, and staff from Eden Place. The case study sample will include 20 focal individuals drawn from the participant groups and approximately 300 survey participants. Case study data will be triangulated with evaluation data and analyzed using a grounded theory approach. By examining changes from the baseline following the implementation of the community programs, the findings may provide insight on agency and science literacy among community members. The comprehensive, mixed-methods evaluation plan employs a quasi-experimental design and incorporates front-end, formative, and summative evaluation components. The evaluation questions address the quality of the processes and products, access to environmental science learning opportunities, environmental science literacy, sustainability, and barriers to implementation. An extensive dissemination plan is proposed with a dual emphasis on meeting stakeholders' needs at multiple levels. The evaluation and research teams will emphasize publication in peer reviewed journals and presentations at conferences for informal science education professionals. Findings will be shared with the Fuller Park community stakeholders using creative methods such as one-page research briefs written in layperson's language, videos, and recorded interviews with participants. The local project Advisory Board will also be actively involved in the dissemination of findings to community constituents. The SCIENCES National Amplification Network will be created and work collaboratively with the American Association of Zoos and Aquariums and the Metropolitan Green Spaces Alliance to disseminate the model. Collectively, the activities and deliverables outlined in this proposal will advance the discovery of sustainable models of community-based learning while the research will advance the understanding of informal learning support for science literacy and agency.
Techbridge has proposed a broad implementation project that will scale up a tested multi-faceted model that increases girls' interest in STEM careers. The objectives of this project are to increase girls' engineering, technology, and science skills and career interests; build STEM capacity and sustainability across communities; enhance STEM and career exploration for underrepresented girls and their families; and advance research on the scale-up, sustainability, and impact of the model with career exploration. The Techbridge approach is grounded in Eccles' expectancy value model, and helps bridge critical junctures as girls transition from elementary to middle school and middle school to high school, immersing participants in a network of peers and supportive adults. Techbridge targets girls in grades 5-12 with a model that includes five components: a previously tested and evaluated curriculum, career exploration, professional development for staff and teachers, family engagement, and dissemination. The inquiry-based curriculum introduces electrical engineering and computer science through engaging, hands-on units on Cars and Engines, Green Design, and Electrical Engineering. The Techbridge model will be enhanced to include a central repository for curriculum and support materials, electronic girl-driven career exploration resources, an online learning community and video tools for staff, and customized family guides. Project deliverables include the dissemination of the enhanced model to three cities, 24 school sites and teachers, 2,000 girls, and over 600 role models. A supplementary research component will study the broad implementation of the Techbridge model by examining the fidelity of implementation and the program's impact on girls' STEM engagement and learning. The research questions are as follows: (1) To what extent and how do new program sites demonstrate adherence to the Techbridge program model? (2) Do new sites experience similar or increased participant responsiveness to Techbridge programming with regard to scientific learning outcomes, career awareness, attitude and interest in engineering? (3)How are changes experienced by girls sustained over time, if at all? (4) To what extent and how do new sites balance instilling the Techbridge essentials, those critical components Techbridge identifies as essential for success, with the need for local adaptation and ownership of the program? and (5) Given the potential for customization in local communities, do new sites maintain programmatic quality of delivery experienced at the original site? If so, what are elements essential to success regarding quality delivery? The mixed-methods study will include document analysis, embedded assessments, participant survey scales, and observations. Qualitative data methods include interviews with teachers, role models, staff and focus groups with girls. A project evaluation will also be conducted which investigates project outcomes for participants (girls, teachers, role models, and families) and fidelity of the implementation and enhancements at expansion sites, using a quasi-experimental approach. Career and learning outcomes for girls will be determined using embedded assessments, portfolios, surveys, school data, and previously validated instruments such as the Career Interest Questionnaire and the Modified Attitudes towards Science Inventory. The Managing Complex Change model is used as a framework for the project evaluation for the purpose of examining factors related to the effectiveness of scaling. The dissemination of research and evaluation findings will be achieved through the use of publications, blogs, social media, and conferences. It is anticipated that this project will broaden the participation of Hispanic, African-American, and English language learner girls, build capacity for STEM programming and sustainability at the dissemination sites, and disseminate findings to over 1 million educators, researchers, and community members. Broader impacts include contributing to the field's understanding of how virtual role models and field trips can engage young women, increase corporate advocacy, and engage participants in research and dissemination efforts.
Using STEM America (USA) is a two-year Pathways project designed to examine the feasibility of using informal STEM learning opportunities to improve science literacy among English Language Learner (ELL) students in Imperial County, California. Project partners include the Rueben H. Fleet Science Center and the University of California, San Diego (UCSD). The project's goals are to support teachers in the development of informal science education opportunities for English learners, partner with students in grades 7-12 to create activities and exhibits, deliver student-produced products to community members, and sustain and disseminate the activities through the development of web-based teacher tools. The teachers will work with informal science education experts, STEM professionals, and undergraduate students to develop and implement the program lessons with their 7-12 grade students. The activities and exhibits designed for community audiences will be used in the Imperial Valley Discovery Zone, slated for completion in fall 2013. Special emphasis will be placed on understanding English scientific word frames and science content specific vocabulary to help ELL students express complex scientific concepts in English. The project deliverables in this pilot project include a comprehensive teacher professional development strategy, student-developed informal science activities and exhibits, a project website, and multiple teacher resources (lesson plans, how-to guides, training materials, and social networking tools). Teachers will receive 45 hours of professional development during the summer with an additional 20 hours of support provided during the school year. UCSD's Jacob's School of Engineering will provide training on solar energy micro-grids using a micro-grid observatory to be located in Imperial Valley. English language development training will be provided by the University of California's Professional Development Institute (UCPDI) and address the role of language objectives in scientific conceptual knowledge and language development; using science and language to improve classroom questioning/discussion; and teaching academic language to English learners. The informal science education component of the training provided by the Fleet Science Center will address topics such as questioning strategies, scientific reasoning frameworks, communicating science to public audiences, and learning "high level" science content using hands-on approaches. The project design builds on research which supports an active learning approach that mirrors scientific practice and is one of the strengths of informal science learning environments. The question to be addressed by the USA Project is: "Can informal STEM activities with embedded English Language development strategies assist English learner students to increase their English language competency and their interest in STEM subjects?" The PI seeks to identify the impact that teachers have on guiding students in inquiry-based informal STEM education, evaluate the academic outcomes for students, and measure changes in community interest, understanding, and attitudes towards STEM and STEM occupations. The USA Project is designed to reach approximately 200 underserved students and will promote the participation of at least 400 additional students, parents, and other rural community members. It is anticipated that this project will result in the development of a model for teacher-led informal STEM education, increased STEM learning opportunities for the community, and the development of a network of educational institutions that helps to bridge formal and informal STEM learning and learning environments.
The National Girls Collaborative Project (NGCP) seeks to maximize access to shared resources within projects and with public and private sector organizations and institutions interested in expanding girls’ participation in science, technology, engineering, and mathematics (STEM). Funded primarily by the National Science Foundation, the NGCP is a robust national network of more than 3,000 girl-serving STEM organizations. Currently, 31 Collaboratives, serving 40 states, facilitate collaboration between more than 12,800 organizations who serve more than 7.7 million girls and 4.4 million boys. The NGCP occupies a unique role in the STEM community because it facilitates collaboration with all stakeholders who benefit from increasing diversity and engagement of women in STEM. These stakeholders form Regional Collaboratives, who are connected to local girl-serving STEM programs. Regional Collaboratives are led by leadership teams and advisory boards with representatives from K-12 education, higher education, community-based organizations, professional organizations, and industry. NGCP strengthens the capacity of girl-serving STEM projects by facilitating collaboration among programs and organizations and by sharing promising practice research, program models, and products through webinars, collaboration training, and institutes. This is accomplished through a tested comprehensive program of change that uses collaboration to expand and strengthen STEM-related opportunities for girls and women. In each replication state, the NGCP model creates a network of professionals, researchers, and practitioners, facilitating collaboration within this network, and delivering high-quality research-based professional development. Participating programs can also receive mini-grant funding to develop collaborative STEM-focused projects. To date, over 27,000 participants have been served in 241 mini-grant projects, and over 17,000 practitioners have been served through in-person events and webinars. The NGCP’s collaborative model changes the way practitioners and educators work to advance girls’ participation in STEM. It facilitates the development of practitioners in their knowledge of good gender equitable educational practices, awareness of the role of K-12 education in STEM workforce development, and mutual support of peers locally and across the United States.
The National Federation of the Blind (NFB), with six science centers across the U.S., will develop, implement, and evaluate the National Center for Blind Youth in Science (NCBYS), a three-year full-scale development project to increase informal learning opportunities for blind youth in STEM. Through partnerships and companion research, the NCBYS will lead to greater capacity to engage the blind in informal STEM learning. The NCBYS confronts a critical area of need in STEM education, and a priority for the AISL program: the underrepresentation of people with disabilities in STEM. Educators are often unaware of methods to deliver STEM concepts to blind students, and students do not have the experience with which to advocate for accommodations. Many parents of blind students are ill-equipped to provide support or request accessible STEM adaptations. The NCBYS will expose blind youth to non-visual methods that facilitate their involvement in STEM; introduce science centers to additional non-visual methods that facilitate the involvement of the blind in their exhibits; educate parents as to their students' ability to be independent both inside and outside the STEM classroom; provide preservice teachers of blind students with hands-on experience with blind students in STEM; and conduct research to inform a field that is lacking in published material. The NCBYS will a) conduct six regional, two-day science programs for a total of 180 blind youth, one day taking place at a local science center; b) conduct concurrent onsite parent training sessions; c) incorporate preservice teachers of blind students in hands-on activities; and d) perform separate, week-long, advanced-study residential programs for 60 blind high school juniors and seniors focused on the design process and preparation for post-secondary STEM education. The NCBYS will advance knowledge and understanding in informal settings, particularly as they pertain to the underrepresented disability demographic; but it is also expected that benefits realized from the program will translate to formal arenas. The proposed team represents the varied fields that the project seeks to inform, and holds expertise in blindness education, STEM education, museum education, parent outreach, teacher training, disability research, and project management. The initiative is a unique opportunity for science centers and the disability population to collaborate for mutual benefit, with lasting implications in informal STEM delivery, parent engagement, and teacher training. It is also an innovative approach to inspiring problem-solving skills in blind high school students through the design process. A panel of experts in various STEM fields will inform content development. NCBYS advances the discovery and understanding of STEM learning for blind students by integrating significant research alongside interactive programs. The audience includes students and those responsible for delivering STEM content and educational services to blind students. For students, the program will demonstrate their ability to interface with science center activities. Students will also gain mentoring experience through activities paired with younger blind students. Parents and teachers of blind students, as well as science center personnel, will gain understanding in the experiences of the blind in STEM, and steps to facilitate their complete involvement. Older students will pursue design inquiries into STEM at a more advanced level, processes that would be explored in post-secondary pursuits. By engaging these groups, the NCBYS will build infrastructure in the informal and formal arenas. Society benefits from the inclusion of new scientific minds, resulting in a diverse workforce. The possibility for advanced study and eventual employment for blind students also reduces the possibility that they would be dependent upon society for daily care in the future. The results of the proposed project will be disseminated and published broadly through Web sites; e-mail lists; social media; student-developed e-portfolios of the design program; an audio-described video; and presentations at workshops for STEM educators, teachers of blind students, blind consumer groups, researchers in disability education, and museum personnel.
SciGirls CONNECT is a broad national outreach effort to encourage educators, both formal and informal, to adopt new, research-based strategies to engage girls in STEM. SciGirls (pbskids.org/scigirls) is an Emmy award-winning television program and outreach program that draws on cutting-edge research about what engages girls in science, technology, engineering and math (STEM) learning and careers. The PBS television show, kids' website, and educational outreach program have reached over 14 million girls, educators, and families, making it the most widely accessed girls' STEM program available nationally. SciGirls' videos, interactive website and hands-on activities work together to address a singular but powerful goal: to inspire, enable, and maximize STEM learning and participation for all girls, with an eye toward future STEM careers. The goal of SciGirls is to change how millions of girls think about STEM. SciGirls CONNECT (scigirlsconnect.org) includes 60 partner organizations located in schools, museums, community organizations and universities who host SciGirls clubs, camps and afterschool programs for girls. This number is intended grow to over 100 by the end of the project in 2016. SciGirls CONNECT provides mini-grants, leader training and educational resources to partner organizations. Each partner training session involves educators from a score of regional educational institutions. To date, over 700 educators have received training from over 250 affiliated organizations. The SciGirls CONNECT network is a supportive community of dedicated educators who provide the spark, the excitement and the promise of a new generation of women in STEM careers. Through our partner, the National Girls Collaborative Project, we have networked educational organizations hosting SciGirls programs with dozens of female role models from a variety of STEM fields. The SciGirls CONNECT website hosts monthly webinars, a quarterly newsletter, gender equity resources, SciGirls videos and hands-on activities. SciGirls also promotes the television, website and outreach program to thousands of elementary and middle school girls and their teachers both locally and nationally at various events.
The Westside Science Club (WSSC) is an out-of-school time opportunity that brings participant-directed STEM activities to under-resourced late-elementary and middle school students in low-income housing units in Los Angeles. WSSC and CCI Solar began a collaboration in 2012 with funding from the NSF to connect research scientists from Caltech with the underserved youth in the club. Another community partner, Wildwood School, provided high school students to act as near-peer mentors for the club members. CCI Solar's research on the efficient and economical conversion of solar energy into stored chemical fuel provides an entry point for informal science education activities designed to introduce pre-high school participants to basic chemistry and related STEM concepts such as physics and plant biology. Activities were largely student driven, though lessons were developed by the team of facilitators including the club's founder Ben Dickow, Wildwood teacher Levi Simons, and students, post-docs, and staff from Caltech. Each lesson was tied to CCI Solar's research through a mind-map of related chemistry concepts. The activities were mostly intended to be "maker-type" experiences that allowed the club members to follow their own interests and questions. Caltech students and postdocs from CCI Solar helped deliver activities while honing their science communication skills with the young WSSC audience. The team is currently adapting the model of this successful collaboration to develop another science club in a different Los Angeles community. Two-years of lessons developed from this project, an evaluation of the project by Kimberly Burtnyk of Science for Society, and a model on how to replicate such a program are available in the project final report below. This was a two-year pilot program that was completed in July 2014.
The proposed CAREER study uses a comprehensive mixed-methods design to develop measures of motivational beliefs and family supports for Spanish and English speaking Mexican-origin youth in high school physical science. The research examines a three-part model which may provide a deeper understanding of how Mexican families support youth through their general education strategies, beliefs about physical science, and science specific behaviors. This approach incorporates motivation and ecodevelopmental theories while pursuing an innovative line of research that examines how the contributions of older siblings and relatives complement or supplement parental support. The study has four aims which are to (1) to develop reliable, valid measures of Mexican-origin adolescent motivational beliefs and family supports in relation to high school chemistry and physics, (2) to test whether family supports predict motivational beliefs and course enrollment, (3) to test how indicators in Aim 2 vary based on gender, culture, English language skills and relationship quality, and (4) to examine how family supports strengthen or weaken the relationship between school-based interactions (teachers and peer support) and the pursuit of physical science studies. Spanish and English-speaking Mexican-origin youth will participate in focus groups to inform the development of a survey instrument which will be used in a statistical measurement equivalence study of 300 high school students in fulfillment of Aim 1. One hundred and fifty Mexican high school students and their families will participate in a longitudinal study while students progress through grades 9-12 to examine Aims 2- 4. Data to be collected includes information on science coursework, adolescent motivational beliefs, supports by mothers and older youth in the family, and family interactions. All materials will be in English and Spanish. The educational and research integration plan uses a three pronged approach which includes mentoring of doctoral students, teacher outreach, and the evaluation of the ASU Biodesign high school summer internship program using measures resulting from the research. It is anticipated that the study findings will provide research-based solutions to some of the specific behaviors that influence youth motivation in physical sciences. Specifically, the study will identify youth that might be most affected by an intervention and the age of maximum benefit, as well as valid, reliable measures of youths' motivation that can used in interventions to measure outcomes. The study will also identify family behaviors that may be influenced, including education strategies for school preparation, beliefs about physical science, and sciece-specific strategies such as engaging in science activities outside school. The findings will be broadly disseminated to science teachers, scholars, and families of Mexican-origin youth. This multi-tiered approach will advance current scholarship and practice concerning Mexican-origin adolescents' pursuit of physical science.
The Exploratorium and the Museum of Life and Science will develop, evaluate and implement Science of Sharing, a three-year full-scale development project designed to bring the scientific study of human social behavior to a broad public audience. Science of Sharing will create new ways for visitors to experiment with social psychology and will generate important information for informal science institutions committed to involving visitors in discussions of personal, societal, and scientific responses to real-world challenges. Science of Sharing addresses a critical ISE issue: creating ways for visitors to experiment with inquiry based exhibits and activities that heighten public knowledge of the study of human social behavior. Based on research in social psychology and game theory, the project (a) fosters public engagement in activities exploring collaborative behavior and resource sharing; (b) promotes awareness of connections between these experiences and STEM-related research in psychology and economics; and (c) links individual behaviors to real-world issues of resource depletion and group conflict. The primary audience is youth and youth-adult museum visitors, with particular focus on underrepresented communities with limited access to communication technologies. The secondary audience is ISE professionals with interest in new kinds of interactive experience and visualization tools focusing on social behavior and techniques for fostering social interaction and public discussion of science. The project will (1) conduct front end evaluation to assess visitor attitudes and knowledge about issues of cooperation and resource use; (2) design, prototype, and evaluate 15 inquiry-based exhibits and 4 Experimonths (public events with web, museum, and community-based components on social-psychological topics); (3) conduct design-based research to investigate aspects of these exhibits and activities that prompt self-reflection and build metacognitive skills; and (4) work with local school districts to adapt exhibits for classroom use.