The independent evaluation firm Knight Williams, Inc. administered an online survey to educators from 16 SciGirls CONNECT2 partner organizations to gather information about their anticipated use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each partner organization – specifically the program leader and one educator who was familiar with the original SciGirls Seven strategies – to complete the survey about the draft updated strategies after they were shared by TPT in March 2018 via an online webinar and a
The independent evaluation firm, Knight Williams, Inc., administered an online survey and conducted follow-up interviews with educators from 14 SciGirls CONNECT2 partner organizations to gather information about their use of, reflections on, and recommendations relating to the SciGirls Seven strategies. The evaluation aimed for two educators from each partner organization – specifically the program leader and one educator who was familiar with the SciGirls Seven – to share reflections on the strategies after they completed their Year 1 programs. In all, 24 educators from 13 partners completed
The independent evaluators at Knight Williams Inc. developed a front-end survey to gather background and baseline information about the 16 partner organizations selected to conduct outreach programs as part of SciGirls CONNECT2. The goal was for two people from each partner organization to complete the online survey about their background and prior use of the SciGirls Seven and related strategies. A total of 30 partner representatives completed the survey by the requested deadline, resulting in a response rate of 94%. The majority identified as program leaders, with smaller groups saying they
This handout was prepared for the Climate Change Showcase at the 2019 ASTC Conference in Toronto, Ontario. It highlights resources available on InformalScience.org related to the topic of climate change.
One way to motivate young people from diverse backgrounds to pursue engineering careers is to enlist them as educators who can help the general public understand how engineers help respond to the challenges of everyday life. The New York Hall of Science, which serves a large and diverse audience, is an ideal setting for testing the promise of this strategy. Youth educators and curators of public programs at the Hall of Science will mentor two groups of high school- and early college-aged youth, who will contribute to the design and facilitation of engineering-focused events and activities for museum visitors. They will work together to develop engineering programming for the public that emphasizes the cultural and interpersonal dimensions of engineering practices. This group of young people will be recruited from the Hall of Science's more than 100 Explainers, a very diverse group of young people who work part-time at the Hall of Science and engage with visitors as they explore the museum. Researchers will track participants' experiences and document their impact on museum visitors' perceptions of engineering. The expectation is that creating and delivering these experiences for visitors will have a positive impact on the youth participants' understanding of the engineering disciplines, and on visitors' perceptions of engineering and its relationship to everyday life.
The project will use observations, interviews, journaling, and the Engineering Professional Skills Assessment to explore youth experience, and visitor exit surveys and interviews to probe visitor perceptions. Both the skills assessment and visitor surveys are NSF-funded instruments. Data coding will be grounded in the engineering habits of mind defined by the National Research Council's Committee on Understanding and Improving K-12 Engineering Education in the United States (2009). The project will capture evidence regarding which habits of mind the Fellows are most frequently engaged with. The effort will also explore how interactions with peers (as colleagues), with experts (as learners, such as with Designers in Residence) and with visitors (as teachers and leaders) may be associated with different combinations of the habits of mind over the course of the project. Visitor data and assessment data will allow the project to begin to make analytic connections between participating young people's increased understanding of culturally-situated engineering challenges, and their impact on the experiences of museum visitors who engage with engineering programming at the Hall of Science.
RUFF FAMILY SCIENCE is a project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. The project is using a research and design process to create an implementation model and prototype resources (digital media, hands-on activities, and supports for educators) to build new knowledge about the potential for digital media to inspire and support intergenerational science learning among vulnerable families.
WGBH and Education Development Center, Inc. (EDC)
DATE:
TEAM MEMBERS:
Mary HaggertyHeather LavigneJessica AndrewsAlexia RaynalMarion GoldsteinJaime Gutierrez
This project will examine the characteristics and outcomes of a large sample of environmental education field trip programs for youth to elucidate program characteristics that most powerfully influence 21st century learning outcomes. Environmental education programs for youth, particularly day-long school trip programs, are popular and reside at the intersection of formal and informal STEM education. Such field trips provide opportunities for diverse audiences to participate in shared learning experiences, but current understanding of what leads to success in these programs is limited. This large-scale study will address this gap in knowledge by investigating the linkages between program characteristics and participant outcomes for at least 800 single-day environmental education field trip programs for youth in grades 5-8, particularly programs for diverse and underserved audiences. This study will result in the identification of evidence-based practices that will inform future program design for a wide variety of settings, including nature centers, national parks, zoos, museums, aquaria, and other locations providing informal environmental education programs.
This Research in Service to Practice study is guided by two research questions: 1) What program characteristics (context, design, and delivery) most powerfully influence learner self-determination and learner outcomes? And 2) Do the most influential program characteristics differ across diverse and underserved audiences (e.g. African American, Hispanic/Latino, economically disadvantaged) and contexts (e.g. rural versus urban)? This project will examine a wide range of program-related factors, including pedagogical approaches and contextual characteristics. A valid and reliable protocol for observing 78 program characteristics hypothesized to influence learner outcomes developed by a previous project will be used to systematically sample and observe 500 single-day environmental education field trip programs for youth in grades 5-8 distributed across at least 40 U.S. states and territories. Programs for diverse and underserved youth will be emphasized, and a diverse set of programs in terms of program type and context will be sought. Data from this sample will be combined with those of an existing sample of 334 programs provided by over 90 providers. The final combined sample of over 800 programs will provide sufficient statistical power to confidently identify which program components are most consistently linked with learning outcomes. This sample size will also enable stratification of the sample for examination of these relationships within relevant subpopulations. Principal component analyses will be used to reduce data in theoretically meaningful and statistically valid ways, and multilevel structural equation modeling will be employed to examine the influences of both participants' individual characteristics and program and context characteristics on participant outcomes. Since one research question focuses on whether program outcomes are the same across different audiences, the project will include at least 200 programs for each of three specific audiences to ensure sufficient statistical power for confidence in the results: primarily African American, primarily Hispanic/Latino, and primarily White.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert PowellMarc SternBrandon Frensley
resourceprojectProfessional Development, Conferences, and Networks
STEAM, the use of art as a context and tool for science education, is currently a hot topic in the science education field. In almost all instances of study and practice, it involves the use of science-themed or science-informed art in science education. As such, it does not take advantage of the majority of artistic output that does not have an obvious connection to science. The National Academies of Sciences, Engineering and Medicine recently called for more research to expand the "limited but promising" evidence that integrating arts and humanities with science education leads to better learning. The goal of this 2.5-day conference is to bring together representatives of both art and science groups to have a shared discussion around how non-scientific art can influence science education in theory, and how we can apply empirical results to the theory. For purposes of this conference, "non-science art" is defined as art that was not inspired by science. Conference attendees will include researchers (art and science education researchers) and practitioners (artists, art museum interpreters, and science educators). The conference will take place during the 2020 Black Creativity exhibition at the Museum of Science and Industry, Chicago. It is anticipated that by holding the conference at that time the audience for the conference and its impact will be informed by more diverse attendance.
The conference will be implemented starting with a pre-conference reading. Attendees will be sent a copy of the white paper from the Art as a Way of Knowing report for background reading and also asked to contribute to a Google Document that describes their various contexts. Each day of the conference will focus on a theme -- state of the field and possibilities and research -- and be comprised of large and small group interactions. Attendees will be invited from the ranks of practitioners, researchers and educators in the art and science education fields; several slots will be available for open (non-invited) participants. Key outcomes include: (a) a summary of all the research that has been conducted on using non-science art in science education, (b) starting points for building a theory on why non-science art can be used in science education; and (c) a list of specific research topics that would help inform, advance, and test the theory. In addition to assessing satisfaction with the conference, evaluation will also include a one-year post conference survey to investigate impact of participation in the conference.
This conference will generate products that will give guidance to both researchers and practitioners who want to use art in science education. These products include a white paper synthesizing the discussion and appendices that include raw transcripts and a bibliography of resources. Another product is a roadmap to create interventions that can be studied, which should lead to a stronger, more rigorous theory of practice about how art can be integrated into science education.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
The Teen Science Cafe Network is an adaptation for teens, of the popular adult science cafe model, which brings people together in a social setting to have an animated conversation with a scientist on some interesting and timely topic. Since its inception in 2012, the Network has grown at a rapid rate: it is now in 130 sites in 45 states, the District of Columbia, and British Columbia. Multiple evaluations have documented its impact. Teens are shown to have increased STEM literacy, a more realistic picture of scientists as real people leading interesting lives, and a better understanding of the nature of science. This two-and-a-half-day conference is designed to review the state of this model of teen engagement in science and science communication. Participants will examine lessons learned from this and similar networks to consider the features needed to expand this model to other audiences (e.g., rural teens, teenage college students, teenagers on military bases, and teens served by local chapters of professional societies based on ethnicity and gender).
Leaders of the Teen Science Cafe Network, along with an advisory committee comprised of individuals who are successfully managing networks, will explore these fundamental questions: 1) How can the field best take advantage of this large and growing network? 2) How can the current community of practice be leveraged for growth? 3) What are some of the most effective strategies for achieving and maintaining effective, long-term partnerships with organizations such as 4-H, science centers, networks of afterschool providers, science festivals, professional societies, and libraries? 4) What are possible outcomes for promoting discipline-specific cafes in areas such as ocean science, astrophysics, geoscience, and polar science? Outputs from the conference include a refined set of guiding principles for the current network and a white paper describing the features of strong and effective networks and recommendations for scaling.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Michelle HallJanice MokrosMichael Mayhew
This project will research and develop the Circuit, a mobile phone and web-based application that will empower families and the general public to discover the broad spectrum of informal Science, Technology, Engineering and Mathematics (STEM) opportunities that exist in most communities. These informal STEM resources include science and children's museums, science and computer camps, maker spaces, afterschool programs, citizen science and much more. There is currently no "one-stop" searching for these resources. Instead, participants must conduct multiple, inefficient Internet searches to find the sought for STEM resources. The Circuit will enable users to efficiently search a rich informal STEM database, identifying resources by location, geography, age levels, science discipline, type of program and other factors. The Circuit builds on SciStarter, an existing online platform that connects thousands of prospective and active citizen scientists to citizen science projects. SciStarter has made possible the collection and organization of several thousand citizen science projects that would otherwise be scattered across the web. The Circuit will build on SciStarter's technical achievements in the citizen science sector, while systematically encompassing the offerings of established national networks. By integrating existing networks of informal STEM resources, the app will afford the public with unrivaled access to informal STEM opportunities, while collecting data that reveals patterns of engagement towards understanding factors of influence between different types of STEM experiences.
The app will provide researchers with new opportunities for researching how families and adults participate in the ecosystem of informal STEM resources in their communities. The Circuit will develop web tools to aggregate and organize digital content from trusted, currently siloed, informal STEM networks of content providers. These include science festivals, science and children's museums, the American Association for the Advancement of Science (AAAS), and Discover Magazine (3 million readers), the largest general interest science publication. Each content partner will feed the app with information directly or through their membership and encourage adoption of The Circuit within their respective communities. The project will design digital tools, including APIs (application program interfaces) to acquire and share digital content, embeddable tools to record and analyze data about movement, engagement, and persistence across domains, and social media tools and related APIs to distribute, track, and analyze content, engagement and demographics. (An API is a code that allows two software programs to communicate with each other.) The project will conduct small-scale, proof-of-conduct studies, to test the viability of the platform to support future, independent full-scale research. An analytics dashboard will be designed and tested with partners, researchers, and evaluators to ensure access to data on patterns of visits, clicks, referrals, searches, "joins," bookmarks, shares, contributions, user-locations, persistence, and more, within and across domains. Because each partner will feed their analytics into the shared dashboard, this will provide unprecedented and much-needed data to advance research in informal STEM learning. The Circuit will allow the tracking of patterns of engagement across networks and programs. Anonymized analytics of behavioral data from end users of The Circuit will support new approaches to advance evidence-based understanding of connected informal STEM learning by exhibiting engagement patterns across informal STEM domains. Through volunteer participation by the public, the Circuit will explore the geographic and demographic patterns of participants in the system, and derive important design lessons for its own and future efforts to create curated systems of connected learning across STEM education in informal settings.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
A large body of research highlights the benefits of storybooks for children's learning. In the context of preschool classrooms, the use of storybooks to engage young children in STEM is a frequent topic of practitioner-oriented articles. There is also an increasing number of informal STEM education (ISE) projects exploring how to leverage storybooks to engage young children and their families in different STEM content domains. While there is universal excitement for the potential of storybooks in ISE, there is an acknowledgment of a critical need for more cross-project sharing, more research, and more efforts to synthesize and share findings. This award will catalyze new research studies and partnerships to advance efforts in ISE contexts, including the role of books in the overall learning experience or program, how books are selected or designed, and how the reading is facilitated by teachers and families. Participants will be educators and researchers working with or studying family learning for preschool-age children (three to five years) using early childhood fiction books as a tool for engaging families in STEM topics and skills.
Storybook STEM will be implemented in four phases: (1) pre-convening activities to plan, synthesize existing resources, engage a broader group of educators and researchers beyond convening attendees, and prepare convening participants to maximize the value of the in-person discussions; (2) in-person convening to catalyze cross-project discussions, outline promising practices, and identify questions and ideas for the future; (3) evaluation of the impact and value of the convening, from the perspective of participants and a project steering committee; and (4) dissemination of findings and recommendations to educators and researchers within and beyond the ISE field. Outcomes include: (1) documenting current and past work in ISE and other fields; (2) summarizing key recommendations and resources from the reading, literacy, and early childhood development fields; and (3) outlining promising directions for future work.
The findings from this project will provide a critical resource to help broadening participation efforts be more effective and inclusive for audiences across the country. Research studies motivated by the convening will address the lack of empirical work on storybooks as a tool for ISE programs and advance the ISE field's knowledge of how to integrate these books effectively. Because storybooks are a highly accessible and almost universally used family learning resource, the topic of the convening will be relevant to a wide range of audiences and will help educators broaden access to ISE for traditionally underserved and under-resourced communities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Increased exposure to STEM content and career pathways during out-of-school time contexts can significantly extend STEM learning and aspirational interests among middle and high school youth. Using a collective impact approach, the STEM CareerLaunch pilot project tests the feasibility of redesigning a widely used, national youth and career focused program for and by the National Boys & Girls Clubs of America to extend STEM learning and promote awareness, interest, and readiness for STEM-related occupations among youth. STEM CareerLaunch integrates extant STEM programs, such as First Robotics, Girls Who Code and Jason Learning, with newly developed STEM content and opportunities to create and test a comprehensive STEM learning and career program for youth. The results of this pilot will inform a more expansive effort to bring STEM CareerLaunch to an already networked 4,000 Boys & Girls Clubs, reaching over four million youth from predominately underrepresented groups in STEM, and youth participating in other afterschool/summer program throughout the United States.
Approximately 100 youth and informal educators in Boys & Girls Clubs in Fitchburg and Leominster, Massachusetts will participate in this pilot feasibility study. A five-pronged approach will be instituted including: (1) high quality out of school time STEM programming, (2) connected STEM career education, (3) mentorship, (4) professional development for the informal educators, and (5) incentives such as internships and field experiences for youth participants. The developmental evaluation will focus on program implementation, participant outcomes, and scale-up. Data collection methods will include quantitative and qualitative approaches such as baseline student data, project tracking logs, retrospective surveys, focus groups, staff interviews, and observations. A summative evaluation will also be conducted.
This endeavor is led by a collaborative partnership between the National Boys & Girls Clubs of America, Worcester Polytechnic Institute STEM Center, the Fitchburg and Leominster Public School Districts, and others. It is primarily funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It is also co-funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program which is committed to better understanding and promoting practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, and or mathematics (STEM).
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.