This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
The McWane Science Center (MWSC) will create a new exhibition experience entitled “Dropping Science: Hip-Hop Interactive” that will capture the elements of the popular music genre using interpretive experiences. Project activities include exhibit content development; development of a formal evaluation plan; exhibit prototyping; remedial evaluation, and a final exhibit design plan. An important project goal is to develop the process for creating lasting, reciprocal relationships with the local African American community and throughout the region, thus creating an exhibit space that connects underrepresented audiences to STEM and establishes MWSC as a true community partner. The outcome of this project will be a new interactive experience that was co-developed with and representative of MWSC’s local community that helps MWSC connect with and engage local visitors in science through a more culturally and personally relevant lens.
Through the T523: Formative Evaluation for Educational Product Development course, our team conducted a semester-long formative evaluation for the Museum of Science, Boston (MoS) Gaia Exhibit. The Gaia Exhibit (Gaia) is a new, temporary art installation located in the MoS’s Blue Wing exhibition hall. Gaia that strives to inspire appreciation for the earth and climate change awareness. The exhibit displays imagery of the Earth’s surface on a twenty feet diameter, three-dimensional globe. Additional exhibit elements include projected questions on the floor to prompt reflection and exhibit-
Fostering STEAM provided exceptional professional development that was highly rated by participants and contributed to expected participant learning outcomes. The in-person Fostering STEAM workshop reflected professional development best practices. Likewise, the online Fostering STEAM course reflected indicators of effective online continuing education and professional development.
The Fostering STEAM professional development contributed to significant self-reported growth in principles or beliefs related to the Fostering STEAM instructional approach, as well as preparedness to develop and
Maker education has increased tremendously in community settings and classrooms across the country. Maker education is learner-driven and hands-on, often collaborative, and may focus on solving a problem or designing an object or device. There is a growing need for assessment and evaluation tools and approaches to understand and improve the nature of maker learning and provide evidence for the value of maker pedagogy. This workshop will bring together approximately 25 researchers from formal and informal settings as well as practitioners to review current maker assessment and evaluation tools and examine the role those tools can play for informing research and practice. The workshop will identify areas where future work is needed, including designing assessment and evaluation that effectively addresses the interests and needs of diverse learners. The workshop will disseminate an online collection of these assessment and evaluation tools, a research brief, and several webinars sharing the results and recommendations of the conference.
The two-day, in-person conference will include pre-workshop surveys to determine and refine issues for consideration at the conference, identify a core set of readings and resources for conference participants, and to identify key topics for research briefings presented at the conference. The conference will include background briefings, hands-on try-outs of assessment tools, synthesis discussions, and identification of future directions for research and next steps. Resources developed from the workshop will be widely disseminated through workshop partner Maker Education’s website, an annual maker conference held at the University of Wisconsin, and through other publications reaching researchers and practitioners in informal and formal educational settings,
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
The goal of the National Science Foundation?s Research Coordination Network (RCN) program is to advance a field or create new directions in research or education by supporting groups of investigators to communicate and coordinate their research, training and educational activities across disciplinary, organizational, geographic and international boundaries. This RCN will bring together scholars and practitioners working at the intersection of equity and interdisciplinary making in STEM education. Making is a culture that emphasizes interest-driven learning by doing within an informal, peer-led and creative social environment. Hundreds of maker spaces and maker-oriented classroom pedagogies have developed across the country. Maker spaces often include digital technologies such as computer design, 3-D printers, and laser cutters, but may also include traditional crafts or a variety of artist-driven creations. The driving purpose of the project is to collectively broaden STEM-focused maker participation in the United States through pursuing common research questions, sharing resources, and incubating emergent inquiry and knowledge across multiple working sites of practice. The network aims to build capacity for research and knowledge, building in consequential and far-reaching mechanisms to leverage combined efforts of a core group of scholars, practitioners, and an extended network of formal and informal education partners in urban and rural sites serving people from groups underrepresented in STEM. Maker learning spaces can be particularly fruitful spaces for STEM learning toward equity because they foster interest-driven, collective, and community-oriented learning in making for social and community change. The network will be led by a team of multi-institutional and multi-disciplinary researchers from different geographic regions of the United States and guided by a steering committee of prominent researchers and practitioners in making and equity will convene to facilitate network activities.
Equitable processes are rooted in a commitment to understand and build on the skills, practices, values, and knowledge of communities marginalized in STEM. The research network aims to fill in gaps in current understandings about making and equity, including the many ways different projects define equity and STEM in making. The project will survey the existing research terrain to develop a dynamic and cohesive understanding of making that connects to learners' STEM ideas, communities, and historical ways of making. Additionally, the network will collaboratively develop central research questions for network partners. The network will create a repository for ethical and promising practices in community-based research and aggregate data across sites, among other activities. The network will support collaboration across a multiplicity of making spaces, research institutions, and community organizations throughout the country to share data, methodologies, ways of connecting to local communities and approaches to robust integration of STEM skills and practices. Project impacts will include new research partnerships, a dissemination hub for research related to making and equity, professional development for researchers and practitioners, and leveraging collective research findings about making values and practices to improve approaches to STEM-rich making integration in informal learning environments. The project is funded by NSF's Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of settings. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Libraries can provide unique opportunities for rural youth and communities. Phase III of the STAR Library Network will be a collaboration with 12 rural school districts in largely Latinx communities to address the challenges faced by rural youth, particularly English Language Learners. The project will use a coordinated and tested strategy to establish three learning pathways in public libraries: science learning spaces with exhibits, library programs, and science kits. These resources will provide learners with art-rich STEM learning opportunities.
Partners
Project partners include the Space Science Institute, the American Library Association (ALA), the Institute for Learning Innovation, and Twin Cities Public Television. The project will rely significantly on expertise from the Latinx community.
Project Plan
Building on an established librarian training model, the project will introduce library staff to the STEAM content and guide them in developing their own STEAM Learning Pathways. The project will draw on existing professional infrastructure from the ALA and the Institute for Learning Innovation’s established community of practice. SciGirls digital media, hands-on activities, family resources, and a training network will expand the depth and reach of the project.
The Research
The research team will study the efficacy of each pathway, alone and in tandem, on participant’s interest development and persistence. The research will use a mixed-methods design-based approach that involves questionnaires, interviews, and case studies. The results should yield a model for nationwide application and contribute insights for the formal education sector.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This program will derive knowledge on extreme weather and its concepts to be shared with youth in the Boston and Kansas City areas. Subsequently, the youth will share this knowledge by displaying it as art work on the rapid transit systems. The art projects will culminate in broad-based exhibition at the end of each group's sessions. The project will involve 200 youth per region resulting in an impact of 1000 youth per year, 80 adult mentors and 20,000 adult transportation riders in learning about extreme weather concepts. Participant organizations are the University of Mass-Boston, University of Mass-Lowell, The Massachusetts College of Art, the University of Kansas Center for Research Inc., and the Goodman Research Group Inc.
The goals of this project are to bring the topic of extreme weather to the foreground by educating youth and in turn having them educate a selected group of adults that use the rapid transit system. Groups of youths will learn about the topic through a series of meetings with mentors who are experts on the issues around extreme weather. The youth will derive their own art-works with their interpretation. These art-works will be displayed on the rapid transit systems in New England (Merrimack Valley and Worcester regions) and the Mid-West (Topeka and Kansas City areas). Using a quasi-experimental mixed methodology (demographics, bus ridership, initial level of science awareness, and interest) the goal is to understand science learning outcomes associated with the creation and public display of youth art. Research questions of importance in this regard are 1. In what ways does blending art with the science enhance youth learning about extreme weather concepts? 2. To what extent does youth art support adult learning of science? and 3. How does regional context affect learning about extreme weather?
Broader impacts will result from the youth diversity as well as the diversity of riders of the rapid transit systems where the art of extreme weather is displayed.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert ChenLois HetlandJill LohmeierStephen MisholSteven SchrockClaudia Bode
resourceprojectWebsites, Mobile Apps, and Online Media
The intent of this five-year project is to design, deliver, and study professional development for Informal Science Learning (ISL) educators in the arena of equity-focused STEAM (Science, Technology, Engineering, Art, and Mathematics) teaching and learning. While the strategy of integrating art and science to promote interest, identity, and other STEM-related learning has grown in recent years, this domain is still nascent with respect to a guiding set of best practices. Through prior work, the team has developed and implemented a set of design principles that incorporate effective practices for broadening participation of girls in science via science-art integration on the topic of the biology, chemistry and optics of "Colors in Nature." The continued initiative would impact the ISL field by providing a mechanism for ISL educators in museums, libraries and after-school programs to adopt and implement these STEAM design principles into their work. The team will lead long-term (12-18 months) professional development activities for ISL educators, including: 1) in-person workshops that leverage their four previously developed kits; 2) online, asynchronous learning activities featuring interactive instructional videos around their STEAM design principles; 3) synchronous sessions to debrief content and foster communities of practice; and 4) guided design work around the development or redesign of STEAM activities. In the first four years of the project, the team will work with four core institutional partners (Sitka Sound Science Center, Sno-Isle Libraries, the Fairbanks North Star Borough School District after-school program, and the Pima County Public Library system) across three states (Alaska, Washington, and Arizona). In the project's later stages, they will disseminate their learning tools to a broad, national audience. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project has three main goals: (1) To support ISL educators in offering meaningful STEAM activities, (2) To create institutional change among the partner organizations, and (3) To advance the ISL field with respect to professional development and designing for STEAM Programming. The research questions associated with the professional development activities address the ways in which change occurs and focus on all three levels: individual, institutional, and the ISL field. The methods are qualitative and quantitative, including videotaped observations, pre and post interviews, surveys and analysis of online and offline artifacts. In addition, the project evaluation will assess the implementation of the project's professional development model for effectiveness. Methods will include observations, interviews, surveys and Website analytics and program data.