Frontier Scientists is comprised of a website and portfolio of videos created for distribution web-wide and through television broadcast. The goal of this program is to excite the general public about ongoing science in Alaska and the Arctic. This is the summary evaluation of a three-year National Science Foundation grant received by Frontier Scientists. Frontier Scientists contracted PEER Associates to conduct the evaluation. Over the course of the three years, the evaluation was focused on both formative (intended to inform and improve programming) and summative (what has the program
The Northwest Passage Project (NPP) is a collaborative effort between the University of Rhode Island (URI), Inner Space Center (ISC), Graduate School of Oceanography (GSO), the film company David Clark Inc., and several other partners, including six Minority Serving Institutions (MSIs) and three informal science education institutions. The project centers on a research expedition into the Arctic's Northwest Passage, which will engage intergenerational cohorts of high school, undergraduate, and graduate students in hands-on research aboard the U.S. tall ship SSV Oliver Hazard Perry (OHP). During the expedition, a professional film crew will produce a two-hour documentary focused on the NPP's innovative model of interdisciplinary informal STEM (science, technology, engineering, and mathematics) learning and highlight the expedition's research, participants, and the sociological issues related to the changing Arctic environment. Because the Canadian Arctic is remote and costly to access, the project will maximize NSF's investment by giving broad audiences access to the science and excitement of the expedition through the documentary. In addition, this informal science learning opportunity will not only engage students with scientists in authentic research, but also train the students to deliver daily live broadcasts from sea to three well-established U.S. informal science education institutions: the Smithsonian National Museum of Natural History (NMNH), the Exploratorium, and the Alaska Sea Life Center (ASLC). The daily broadcasts will also reach the public in real time via the project's interactive website, providing the opportunity for people to post questions to the scientists and students onboard the ship. The NPP has great potential to benefit society by enhancing awareness of the changing Arctic's ecosystems and increasing science literacy. The hands-on research experiences will enhance the college readiness of the participating high school students and encourage the undergraduate students from the six partner MSIs to consider a graduate course of study and/or pursue STEM careers. The graduate students will also be more career-ready, as they gain public communication and leadership skills necessary for 21st century scientists. The Northwest Passage Project is designed to advance knowledge and understanding within the practice of informal science education, as well as in the field of Arctic science. The project goals include: increasing public awareness and understanding of the changing Arctic ecosystem; increase public understanding about Arctic research and the scientific process; increase the Informal Science Education (ISE) field's understanding of the public's learning process when engaged in live interactions with scientists and student 'science communicators'; increase the ISE field's understanding of the value of immersive science experiences and impact on students from underserved and underrepresented populations; and to build or extend the capacity of ISE institutions to make connections between polar scientists, students, journalists and the public. The NPP is creative in that it combines the engagement of students in field-based scientific research, live broadcasts from sea to ISE institutions, and the production of a full-scale documentary for public audiences. A potentially transformative component to the ISE activities involves six Minority Serving Institution partners--Florida International University; University of Illinois, Chicago; California State University, Channel Islands; Texas State University; Virginia Commonwealth University and City College of New York--whose students will have the opportunity for a life-changing experience that may tip the scale toward their interest in STEM careers. Each of these students will develop news stories, host screenings of the film at their respective campuses, and share their experiences with peers, providing visual role models for other underrepresented students, who may never have thought themselves capable of becoming a scientist or science communicator. An additional project goal is to enhance the capacity and infrastructure of the three ISE partner institutions so that they may receive live broadcasts from the Inner Space Center in the future, beyond the funding period of the project. People, Places & Design Research will conduct the project's front-end and formative evaluation; MEM & Associates will conduct the summative evaluation. Some of the key evaluation questions will be: * Have ISE and MSI institution public visitors, who view either the live broadcasts or the documentary film (or both), become more aware of the changing Arctic ecosystem and the importance of scientific research in the Arctic? * What is the relative impact of the live broadcasts compared to the finished documentary, and the strengths and weakness of the respective media in translating the on-board experience? * Does a real environmental and social context for scientific evidence stimulate audiences to become more interested in the role of science/STEM? * Have students gained leadership skills and the ability to communicate science to their peers? * Have students increased their motivation and interest in pursuing STEM careers? This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
Gail ScowcroftDavid ClarkBrice LooseDwight Coleman
resourceprojectProfessional Development, Conferences, and Networks
Most experimental studies in the behavioral sciences rely on college students as participants for reasons of convenience, and most take place in North America and Europe. As a result, studies are only sampling from a narrow range of human experiences. The results of these studies have limited generalizability, failing to reflect the full range of mental and behavioral phenomena across diverse cultures and backgrounds. However sampling from broader populations is challenging, due to limited opportunities and access, heightened cost, and the need for specific knowledge about how to adapt research protocols to different communities. The goal of this workshop is to develop some tools and guidelines to help researchers overcome barriers to broader sampling, and to incentivize doing so through better institutional support.
The goal of this workshop is to develop tools to support and encourage increased robustness and generalizability in the experimental behavioral sciences. The meeting is dedicated to identifying and developing potential solutions to the so-called "WEIRD people" problem: the fact that most experimental behavioral science research is conducted with members of WEIRD populations (Western, Educated, Industrialized, Rich Democracies). The discovery that much of this research fails to generalize to broader populations and fails to capture the range of human patterned variation in thought and behavior creates a pressing need for research approaches to be more inclusive. Although there are researchers throughout the world who have developed effective models for overcoming these limitations, there are significant barriers to achieving robust and generalizable experimental behavioral research for most researchers. This workshop will bring together scholars from a range of disciplines whose research represents positive case studies of how to overcome these barriers. The participants aspire to accomplish three goals: 1) develop tools and training materials to help researchers enhance diversity in their research populations, 2) develop infrastructure solutions for connecting researchers across diverse contexts and populations, and 3) develop a set of recommendations for institutional changes to support enhancing diversity in experimental behavioral science through manuscript, grant, and tenure review.
DATE:
-
TEAM MEMBERS:
Douglas MedinDaniel HruschkaLera BoroditskyCristine Legare
In late 2012, Providence Children’s Museum began a major three-year research project in collaboration with The Causality and Mind Lab at Brown University, funded by a grant from the National Science Foundation (1223777). Researchers at Brown examined how children develop scientific thinking skills and understand their own learning processes. The Museum examined what caregivers and informal educators understand about learning through play in its exhibits and how to support children’s metacognition – the ability to notice and reflect on their own thinking – and adults’ awareness and appreciation of kids’ thinking and learning through play. Drawing from fields like developmental psychology, informal education and museum visitor studies, the Museum’s exhibits team looked for indicators of children’s learning through play and interviewed parents and caregivers about what they noticed children doing in the exhibits, asking them to reflect on their children’s thinking. Based on the findings, the research team developed and tested new tools and activities to encourage caregivers to notice and appreciate the learning that takes place through play.
SciGirls' (Season'Three) is a multimedia project that presents videos and games designed to engage and educate millions of children about citizen science. Multimedia Research, an independent evaluation group, implemented a summative evaluation that assessed a model of citizen science engagement and education that examined the contribution of SciGirls multimedia to preteen girls' experience of citizen science.
Throughout the five year SciGirls CONNECT grant the independent evaluation firm Knight Williams assisted Twin Cities PBS (TPT) in a wide range of program evaluation activities. Given the project’s emphasis on a Train-the-Trainer model, the evaluation prioritized two goals: (i) assessing the various levels of CONNECT trainings from different vantage and time points, and (ii) capturing information on the implementation of SciGirls programs led by those who completed a training. This evaluation approach allowed the team to collect ongoing data over the course of the grant and share this
SciGirls Reflect: Leveraging Multiple Communities and Networks to Expand Understanding of Professional Development for Informal STEM Educators in Gender Equitable Teaching Strategies was a one-day event that brought together 25 SciGirls Trainers, Educators, and Partner Organization representatives to reflect on their experiences with SciGirls. Data was collected throughout the day via panel presentations, small group discussions, and partner interviews. Nineteen of these participants also conducted follow-up Broadening the Discussion interviews with SciGirls Trainers and Educators to gather
This is an efficacy study through which the Denver Museum of Nature and Science, the Denver Zoo, the Denver Botanic Gardens, and three of Denver's urban school districts join efforts to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The Metropolitan Denver Urban Advantage (UA Denver) program is used for this purpose. This program consists of three design elements: (a) student-driven investigations, (b) STEM-related content, and (c) alignment of schools and informal science education institutions; and six major components: (a) professional development for teachers, (b) classroom materials and resources, (c) access to science-rich organizations, (d) outreach to families, (e) capacity building and sustainability, and (e) program assessment and student learning. Three research questions guide the study: (1) How does the participation in the program affect students' science knowledge, skills, and attitudes toward science relative to comparison groups of students? (2) How does the participation in the program affect teachers' science knowledge, skills, and abilities relative to comparison groups of teachers? and (3) How do families' participation in the program affect their engagement in and support for their children's science learning and aspirations relative to comparison families?
The study's guiding hypothesis is that the UA Denver program should improve science literacy in urban middle school students measured by (a) students' increased understanding of science, as reflected in their science investigations or "exit projects"; (b) teachers' increased understanding of science and their ability to support students in their exit projects, as documented by classroom observations, observations of professional development activities, and surveys; and (c) school groups' and families' increased visits to participating science-based institutions, through surveys. The study employs an experimental research design. Schools are randomly assigned to either intervention or comparison groups and classrooms will be the units of analysis. Power analysis recommended a sample of 18 intervention and 18 comparison middle schools, with approximately 72 seventh grade science teachers, over 5,000 students, and 12,000 individual parents in order to detect differences among intervention and comparison groups. To answer the three research questions, data gathering strategies include: (a) students' standardized test scores from the Colorado Student Assessment Program, (b) students' pre-post science learning assessment using the Northwest Evaluation Association's Measures for Academic Progress (science), (c) students' pre-post science aspirations and goals using the Modified Attitude Toward Science Inventory, (d) teachers' fidelity of implementation using the Teaching Science as Inquiry instrument, and (e) classroom interactions using the Science Teacher Inquiry Rubric, and the Reformed Teaching Observation protocol. To interpret the main three levels of data (students, nested in teachers, nested within schools), hierarchical linear modeling (HLM), including HLM6 application, are utilized. An advisory board, including experts in research methodologies, science, informal science education, assessment, and measurement oversees the progress of the study and provides guidance to the research team. An external evaluator assesses both formative and summative aspects of the evaluation component of the scope of work.
The key outcome of the study is a research-informed and field-tested intervention implemented under specific conditions for enhancing middle school science learning and teaching, and supported by partnerships between formal and informal organizations.
Over the past ten years, investments in infrastructure for informal STEM education and science communication have resulted in significant growth in the number and variety of resources and depth of expertise available to members of the STEM research community wishing to develop outreach, engagement and broader impacts activities. This report/white paper recounts some of the developments that led to the existing synergy between Informal STEM Education (ISE), science communication, and STEM research, provides examples of infrastructure and resources that support this work, and identifies areas of
This report summarizes findings from a research-practice partnership investigating STEM-rich making in afterschool programs serving young people from communities historically under-represented in STEM. The three-year study identified key dimensions related to (1) How STEM-Rich Making advances afterschool programmatic goals related to socio-emotional and intellectual growth for youth; (2) Key characteristics of programs that effectively engage youth historically marginalized in STEM fields; and (3) Staff development needs to support equity-oriented STEM-Rich Making programs.
These blog posts were written by researcher Andee Rubin in 2013 & 2014 as a way to provide technical assistance to investigators planning to carry out research in informal settings. The first post provides a history of human subjects protection as it emerged from medical research and thoughts about the application of these principles to informal settings. The second discusses the set of federally-mandated rules that Institutional Review Boards (IRBs) use to protect human subjects and describes how and when researchers need to seek IRB approval for their work. The third describes techniques for
Talk of the Nation: Science Friday is a weekly two-hour listener call-in talk show devoted to the understanding of complex scientific topics and methods. The series is hosted by science correspondent Ira Flatow. With support from the National Science Foundation, Multimedia Research presents the second study of a two-part summative evaluation on the impact of Science Friday on public radio listeners, focusing on the series’ increased emphasis on public understanding of basic research. The evaluation assessed what demographic or background characteristics relate to whether or not one listens to