Throughout the five year SciGirls CONNECT grant the independent evaluation firm Knight Williams assisted Twin Cities PBS (TPT) in a wide range of program evaluation activities. Given the project’s emphasis on a Train-the-Trainer model, the evaluation prioritized two goals: (i) assessing the various levels of CONNECT trainings from different vantage and time points, and (ii) capturing information on the implementation of SciGirls programs led by those who completed a training. This evaluation approach allowed the team to collect ongoing data over the course of the grant and share this
SciGirls Reflect: Leveraging Multiple Communities and Networks to Expand Understanding of Professional Development for Informal STEM Educators in Gender Equitable Teaching Strategies was a one-day event that brought together 25 SciGirls Trainers, Educators, and Partner Organization representatives to reflect on their experiences with SciGirls. Data was collected throughout the day via panel presentations, small group discussions, and partner interviews. Nineteen of these participants also conducted follow-up Broadening the Discussion interviews with SciGirls Trainers and Educators to gather
The independent evaluation firm Multimedia Research conducted an evaluation of the television component of SciGirls Season Two, including an experimental study of the impact of the TV series on girls' abilities to take part in science and engineering projects.2 During the same period, the independent evaluation team from Knight Williams Inc. conducted an evaluation of the implementation of the outreach activities among the member institutions of the National Girls Collaborative Project (NGCP) network.
Different stakeholders in research-practice partnerships often come from various institutions with distinct vocabulary, communication structures, and professional practices. To ensure that partnerships are mutually beneficial and equitable for educators and researchers alike, partners Jean Ryoo, Michelle Choi, and Emily McLeod from the California Tinkering Afterschool Network co-developed this resource for building equitable research-practice partnerships. This resource describes what equitable collaborations look like and offers guiding questions for group members to ask themselves in order
Puppet interviews can be helpful for getting feedback from young children in informal learning environments like libraries, museums, or afterschool programs. While puppets are a standby for interviewing children in clinical settings and are being used more frequently in some areas of qualitative research, they tend to be under-utilized in informal learning environments - natural settings for puppets because of their connections with play (Epstein et al., 2008). Our team developed a puppet interview protocol for the Gradient research project (Gender Research on Adult-child Discussion in
In this article, we invite you to expand your vision of what it means to work at the intersections of formal and informal science and literacy education by describing how educators have collaborated to create programs that blend science and literacy in schools, in museums, and across these two spaces. In 2012, K–12 teachers from the National Writing Project (NWP) began working with the Association of Science-Technology Centers (ASTC) and science museum educators in the National Science Foundation–funded Intersections project, which is being evaluated by Inverness Research. NWP is a network
This is an efficacy study through which the Denver Museum of Nature and Science, the Denver Zoo, the Denver Botanic Gardens, and three of Denver's urban school districts join efforts to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The Metropolitan Denver Urban Advantage (UA Denver) program is used for this purpose. This program consists of three design elements: (a) student-driven investigations, (b) STEM-related content, and (c) alignment of schools and informal science education institutions; and six major components: (a) professional development for teachers, (b) classroom materials and resources, (c) access to science-rich organizations, (d) outreach to families, (e) capacity building and sustainability, and (e) program assessment and student learning. Three research questions guide the study: (1) How does the participation in the program affect students' science knowledge, skills, and attitudes toward science relative to comparison groups of students? (2) How does the participation in the program affect teachers' science knowledge, skills, and abilities relative to comparison groups of teachers? and (3) How do families' participation in the program affect their engagement in and support for their children's science learning and aspirations relative to comparison families?
The study's guiding hypothesis is that the UA Denver program should improve science literacy in urban middle school students measured by (a) students' increased understanding of science, as reflected in their science investigations or "exit projects"; (b) teachers' increased understanding of science and their ability to support students in their exit projects, as documented by classroom observations, observations of professional development activities, and surveys; and (c) school groups' and families' increased visits to participating science-based institutions, through surveys. The study employs an experimental research design. Schools are randomly assigned to either intervention or comparison groups and classrooms will be the units of analysis. Power analysis recommended a sample of 18 intervention and 18 comparison middle schools, with approximately 72 seventh grade science teachers, over 5,000 students, and 12,000 individual parents in order to detect differences among intervention and comparison groups. To answer the three research questions, data gathering strategies include: (a) students' standardized test scores from the Colorado Student Assessment Program, (b) students' pre-post science learning assessment using the Northwest Evaluation Association's Measures for Academic Progress (science), (c) students' pre-post science aspirations and goals using the Modified Attitude Toward Science Inventory, (d) teachers' fidelity of implementation using the Teaching Science as Inquiry instrument, and (e) classroom interactions using the Science Teacher Inquiry Rubric, and the Reformed Teaching Observation protocol. To interpret the main three levels of data (students, nested in teachers, nested within schools), hierarchical linear modeling (HLM), including HLM6 application, are utilized. An advisory board, including experts in research methodologies, science, informal science education, assessment, and measurement oversees the progress of the study and provides guidance to the research team. An external evaluator assesses both formative and summative aspects of the evaluation component of the scope of work.
The key outcome of the study is a research-informed and field-tested intervention implemented under specific conditions for enhancing middle school science learning and teaching, and supported by partnerships between formal and informal organizations.
"Local Investigations of Natural Science (LIONS)" engages grade 5-8 students from University City schools, Missouri in structured out-of-school programs that provide depth and context for their regular classroom studies. The programs are led by district teachers. A balanced set of investigations engage students in environmental research, computer modeling, and advanced applications of mathematics. Throughout, the artificial boundary between classroom and community is bridged as students use the community for their studies and resources from local organizations are brought into school. Through these projects, students build interest and awareness of STEM-related career opportunities and the academic preparation needed for success.
DATE:
-
TEAM MEMBERS:
Robert CoulterEric KlopferJere Confrey
Over the past ten years, investments in infrastructure for informal STEM education and science communication have resulted in significant growth in the number and variety of resources and depth of expertise available to members of the STEM research community wishing to develop outreach, engagement and broader impacts activities. This report/white paper recounts some of the developments that led to the existing synergy between Informal STEM Education (ISE), science communication, and STEM research, provides examples of infrastructure and resources that support this work, and identifies areas of
Head Start on Engineering (HSE) is a collaborative, NSF-funded research and practice project designed to develop and refine a theoretical model of early childhood, engineering-related interest development. The project focuses on Head Start families with four-year-old children from low-income communities and is being carried out collaboratively by researchers, science center educators, and a regional Head Start program. In this paper, we outline a preliminary conceptual framework for describing early childhood STEM interest development, which will be used to guide data collection and program
In this paper, the authors synthesize three types of research-practice partnerships (RPPs) for informal learning. The article includes descriptions of example partnerships between local researchers and informal educators from the Hive NYC Learning Network, Community Practice Research Collaboration, and California Tinkering Afterschool Network. The synthesis paper concludes with a review of characteristics commonly found in partnerships in informal science education.
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. Through a unique university-zoo partnership, Project TRUE engages New York City high school students in authentic urban ecology field research in the surrounding metropolitan area. Central to the project design is a tiered mentorship model, in which Fordham University professors mentor undergraduate and graduate ecology students, who in turn mentor high school students from communities underrepresented in STEM fields. Project TRUE also pairs the university