King et al. [2015] argue that ‘emphasis on impact is obfuscating the valuable role of evaluation’ in informal science learning and public engagement (p. 1). The article touches on a number of important issues pertaining to the role of evaluation, informal learning, science communication and public engagement practice. In this critical response essay, I highlight the article’s tendency to construct a straw man version of ‘impact evaluation’ that is impossible to achieve, while exaggerating the value of simple forms of feedback-based evaluation exemplified in the article. I also identify a
The Ocean Science project integrates the Ocean Literacy Essential Principles and Fundamental Concepts into a Western Washington region-wide, coordinated program of formal and informal education consisting of: 1. Teacher professional development in the ocean sciences to integrate the Ocean Literacy Essential Principles and Fundamental Concepts into inquiry-based marine science education and instruction; 2. Evaluation and re-alignment of existing Sound Science ecosystems curricula into Ocean Science, incorporating NOAA data and promoting the Ocean Literacy Essential Principles and Fundamental Concepts; 3. Classroom programs, beach field investigations, and on-site programs at the Seattle Aquarium of the Olympic Coast national Marine Sanctuary's Olympic Coast Discovery Center for grades 4-5 students, their parents and teachers; 4. Parent training in ocean science content, the Ocean Literacy Essential Principles and Fundamental Concepts, and inquiry-based methods for supporting their children's science education; 5. Informal education for the general public via an interactive learning station linked to the Window on Washington Waters exhibit and designed to innovatively use NOAA data and information (videos, computer simulations and other creative media) to increase and evaluate ocean literacy in adults and children. Window on Washington Waters displays the outer coast marine environments and sea life of the Olympic Coast National Marine Sanctuary.
During the school year of 2016-2017, Fairchild Tropical Botanic Garden (Fairchild) implemented the first year of a four-year project entitled: Growing Beyond Earth (GBE). NASA is providing funding support for project implementation as well as an external project evaluation.
The evaluation activities conducted this year were focused on understanding project implementation and exploring project outcomes using data collected between September 2016 and May 2017. This report’s findings and accompanying recommendations inform next year’s project implementation and evaluation activities.
DATE:
TEAM MEMBERS:
Catherine RaymondAmy RubinsonCarl LewisMarion LitzingerAmy Padolf
This project, conducted by the University of Pittsburgh and the University of California, Berkeley, seeks to discover what makes middle school students engaged in science, technology, engineering, and mathematics (STEM). The researchers have developed a concept known as science learning activation, including dispositions, practices, and knowledge leading to successful STEM learning and engagement. The project is intended to develop and validate a method of measuring science learning activation.
The first stage of the project involves developing the questions to measure science activation, with up to 300 8th graders participating. The second stage is a 16-month longitudinal study of approximately 500 6th and 8th graders, examining how science learning activation changes over time. The key question is what are the influencers on science activation, e.g., student background, classroom activities, and outside activities.
This project addresses important past research showing that middle school interest in STEM is predictive of actually completing a STEM degree, suggesting that experiences in middle school and even earlier may be crucial to developing interest in STEM. This research goes beyond past work to find out what are the factors leading to STEM interest in middle school.
This work helps the Education and Human Resources directorate, and the Division of Research on Learning, pursue the mission of supporting STEM education research. In particular, this project focuses on improving STEM learning, as well as broadening participation in STEM education and ultimately the STEM workforce.
The trend of utilising open learning environments and informal learning sources has a clear link to outdoor education, which bridges the gap between formal education and informal learning. According to the findings related to informal learning and its relevance to early professional development, the crucial era seems to be the first 3 years as an inexperienced teacher. Despite the long history, outdoor education needs new research methods. In Finland, the new National Curriculum 2016 underlines teaching of this “phenomenon” besides the traditional subject orientated teaching. This challenges
DATE:
TEAM MEMBERS:
Hannu SalmiArja KaasinenLiisa Suomela
In the project entitled "The GLOBE Program 2010: Collaborative Environmental Research at Local to Global Scales," the University Corporation for Atmospheric Research (UCAR) will improve the functionality of the GLOBE Program by providing: (1) new methods, tools, and services to enhance GLOBE Partner and teacher abilities to facilitate inquiry-based learning and student research, (2) initial pilot testing and assessment of student and teacher learning activities and events related to Climate Science research, (3) improvements in GLOBE's technology infrastructure and data systems (e.g. database, social networking, information management) to support collaborations between students, scientists, and teachers, and (4) development of a robust evaluation plan. In addition, the UCAR will continue to provide support to the worldwide GLOBE community, as well as program management and timely communication with program sponsors.
Science educators in the United States are adapting to a new vision of how students learn science. Children are natural explorers and their observations and intuitions about the world around them are the foundation for science learning. Unfortunately, the way science has been taught in the United States has not always taken advantage of those attributes. Some students who successfully complete their K–12 science classes have not really had the chance to “do” science for themselves in ways that harness their natural curiosity and understanding of the world around them.
The introduction of
DATE:
TEAM MEMBERS:
National Academies of Sciences, Engineering, and Medicine
It’s important to communicate the excitement and value of NSF-funded research. This tool (formatted as a Prezi presentation) helps you do that with assistance from NSF public affairs experts, exploring options for communicating your research and broader impacts.
Students in the U.S. educational system are increasingly diverse, and this diversity is reflected in science, technology, engineering, and mathematics (STEM) fields. Diversity in education encompasses students from many races, genders, and socioeconomic backgrounds; students who speak a variety of languages; and students from many cultures. For instance, ethnic diversity increased by 5% across primary and secondary public schools from 2000 to 2007 (Aud, Fox, & KewalRamani, 2010). Diversity is also evident in the socioeconomic make-up of students, with almost half of 4th graders in public
This project will develop standardized, exportable and comparable assessment instruments and models for Women In Engineering (WIE) programs nationwide, thus allowing them to assess their program's activities and ultimately provide data for making well-informed evaluations.
To accomplish this goal, the principal investigators at the University of Missouri and Penn State University will work over a three-year period with their institutions' WIE programs and three cooperating programs at Rensselaer Polytechnic Institute, Georgia Tech, and University of Texas at Austin. With these five programs that collectively represent a variety of private and public, years of experience for WIE directors and student body characteristics, the investigators will pilot, revise, implement, conduct preliminary data analysis and disseminate easy-to-access, reliable and valid assessment instruments. The principles of formative evaluation will be applied to all instruments and products. All institutions will use the same set of instruments, thus allowing them to have access to powerful benchmarking data in addition to the data from each of their respective institutions.
A prior project, the Women's Experience in College Engineering Project (WECE) sought to characterize the factors that influence women students' experiences and decisions by studying college environments, events and support programs that affect women's satisfaction with their engineering major, and their decisions to persist or leave these majors. In contrast to WECE's macro-level and student focus, this proposal's target audience is WIE directors, with a focus on WIE programs, not students.
Women in Engineering programs around the United States are a crucial part of our country's response to the need for more women in engineering professions. There are about 50 WIE programs nationwide. Half have expressed interest in this effort. WIE directors will benefit by having ready-made assessment tools that will allow them to collect data on programs, evaluate these programs, and make decisions on how to revise programs and / or redistribute limited resources to maximize overall program effectiveness. Data from these instruments will also provide substantiated evidence for administrators, advisory boards and potential funding agencies. Finally, because these instruments will be available nationwide, programs will have the opportunity to take advantage of powerful benchmarking data for their decision-making processes.
This project provides the next logical step in the national movement to recruit and retain women in engineering.