In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
We present the assets that collaboration across a land grant university brought to the table, and the Winterberry Citizen Science program design elements we have developed to engage our 1080+ volunteer berry citizen scientists ages three through elder across urban and rural, Indigenous and non-Indigenous, and formal and informal learning settings.
DATE:
TEAM MEMBERS:
Katie SpellmanJasmine ShawChristine VillanoChrista MulderElena SparrowDouglas Cost
We used a youth focused wild berry monitoring program that spanned urban and rural Alaska to test this method across diverse age levels and learning settings.
DATE:
TEAM MEMBERS:
Katie SpellmanDouglas CostChristine Villano
In this study, we examined how two different CCS models, a contributory design and a co-created design, influenced science self-efficacy and science interest among youth CCS participants.
DATE:
TEAM MEMBERS:
Sarah ClementKatie SpellmanLaura OxtobyKelly KealyKarin BodonyElena SparrowChristopher Arp
resourceevaluationMuseum and Science Center Exhibits
The Kaulele Kapa Exhibit was created to explore the effectiveness of a Hawaiian culture-based framework and approach in increasing learner engagement and depth of knowledge in STEM among Native Hawaiian/Pacific Islander (NHPI) learners. The exhibit utilized hands-on and interactive activities, coupled with scientific and cultural information, to create relevant learning experiences for these communities. To determine the effectiveness, exhibit attendees were invited to complete a survey that asked about how the exhibit influenced their interest and understanding of STEM and Hawaiian culture
The University of Montana spectrUM Discovery Area will implement “Making Across Montana” —a project to engage K–12 students and teachers in rural and tribal communities with making and tinkering. In collaboration with K–12 education partners in the rural Bitterroot Valley and on the Flathead Indian Reservation, the museum will develop a mobile making and tinkering exhibition and education program. The exhibition will be able to travel to K–12 schools statewide. The project team will develop a K–12 teacher professional development workshop, along with accompanying curriculum resources and supplies. The traveling program and related materials will build schools’ capacity to incorporate making and tinkering—and informal STEM experiences more broadly—into their teaching.
Hanohano o Oahu: The Geology and Moolelo of Kona to Ewa project will provide learning opportunities for 500 fourth grade students and their teachers from ten public schools located in central and leeward Oahu, Hawaii. A geology unit will be developed that includes a 90-minute class presentation, hands-on classroom activities, a Discovery Box to extend learning opportunities, and a full-day (5-hour) field trip experience. The multi-stop bus tour will be centered on the moku (district) of Kona and Ewa and highlight significant Oahu cultural sites, their moolelo (stories, history) and geology. A culture-based student activity booklet, hands-on activities, and other education materials will also be developed for the unit. The project will target rural communities with underserved families, large Hawaiian homestead neighborhoods, and little access to museum services. Participation in the programming will provide students and teachers with a better understanding of the connection between scientific information and Hawaiian knowledge.
For thousands of years, Native Hawaiian/Pacific Islander (NHPI) seafarers have successfully utilized systemic observation of their environment to traverse vast expanses of open ocean and thrive on the most remote islands on earth. Developing NHPI trust in the scientific enterprise requires building connections that bridge the values and concepts of 'ike kupuna (traditional knowledge) with scientific knowledge systems and contemporary technology. This project will develop and research a pop-up science exhibit that connects indigenous Hawaiian knowledge with contemporary Western science concepts. The exhibit will show how community knowledge (that is consistent with underlying scientific principles and natural laws) has informed innovation by indigenous peoples. This community-initiated and developed project will begin with a single pop-up exhibit designed to incorporate several hands-on culture-based STEM activities that integrate traditional and modern technologies. For example, the exhibit may cover indigenous systems of star navigation for ocean voyaging, systems of netting for food and water containers, or systems of home design with local and natural materials. This project seeks to develop preliminary evidence of the effectiveness of such an approach for supporting rural Hawaiian youths' STEM engagement, understanding, and personal connections to Native Hawaiian STEM knowledge. Findings from this pilot and feasibility study will inform the development of a larger pop-up science center grounded in indigenous Hawaiian STEM knowledge, and advance intellectual knowledge around culturally sustaining pedagogy by helping informal STEM education practitioners understand community initiated and developed STEM exhibits.
This pop-up science center pilot will be led by a local Hawaiian community organization, INPEACE, in collaboration with several local community members and other community-based organizations. The preliminary research will iteratively explore whether and how an existing Hawaiian culture-based framework can be used to design hands-on STEM exhibits to enhance rural learner engagement, depth of STEM knowledge, and connection to Native Hawaiian STEM knowledge. Research efforts led by Kamehameha Schools, which has a long history of conducting research from an indigenous worldview, will engage 120 learners from various rural communities across Hawaii, from which 40 will be pre-selected middle-school youth, and 80 individuals will be from public audiences of learners ages 12 and up. Through a series of observations, interviews, pre and post surveys with validated instruments, and focus groups, the research will probe: (1) The learners' thoughts on the science practice and its relevance to old and new Hawaii and modern society. (2) The level at which related STEM topics have been understood, and (3) The learners' perceptions about their connection to Native Hawaiian STEM knowledge. Results from this pilot study will inform a future pop-up science center development project, and add to the scarce literature on community-driven, culturally sustaining exhibition development.
This Pilots and Feasibility Studies project is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The RASOR project is designed to increase engagement of students from rural Alaska communities in biomedical/STEM careers. Rural Alaskan communities are home to students of intersecting identities underrepresented in biomedical science, including Alaska Native, low-income, first generation college, and rural. Geographic isolation defines these communities and can limit the exposure of students to scientifically-minded peers, professional role models, and science career pathways. However these students also have a particularly strong environmental connection through subsistence and recreational activities, which makes the one-health approach to bio-medicine an intuitive and effective route for introducing scientific research and STEM content. In RASOR, we will implement place-based mentored research projects with students in rural Alaskan communities at the high school level, when most students are beginning to seriously consider career paths. The biomedical one-health approach will build connections between student experiences of village life in rural Alaska and biomedical research. Engaging undergraduate students in research has proved one of the most successful means of increasing the persistence of minority students in science (Kuh 2008). Furthermore, RASOR will integrate high school students into community-based participatory research (Israel et al. 2005). This approach is designed to demonstrate the practicality of scientific research, that science has the ability to support community and cultural priorities and to provide career pathways for individual community members. The one-health approach will provide continuity with BLaST, an NIH-funded BUILD program that provides undergraduate biomedical students with guidance and support. RASOR will work closely with BLaST, implementing among younger (pre-BLaST) students approaches that have been successful for retaining rural Alaska students along STEM pathways and tracking of post-RASOR students. Alaska Native and rural Alaska students are a unique and diverse population underrepresented in biomedical science and STEM fields.
DATE:
-
TEAM MEMBERS:
Janice StraleyEllen Chenowith
resourceprojectProfessional Development and Workshops
This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie
Abstract: We aim to disrupt the multigenerational cycle of poverty in our rural indigenous (18% Native American and 82% Hispanic) community by training our successful college students to serve as role models in our schools. Poverty has led to low educational aspirations and expectations that plague our entire community. As such, its disruption requires a collective effort from our entire community. Our Collective unites two local public colleges, 3 school systems, 2 libraries, 1 museum, 1 national laboratory and four local organizations devoted to youth development. Together we will focus on raising aspirations and expectations in STEM (Science, Technology, Engineering and Mathematics) topics, for STEM deficiencies among 9th graders place them at risk of dropping out while STEM deficiencies among 11th and 12th graders preclude them from pursuing STEM majors in college and therefore from pursuing well paid STEM careers. We will accomplish this by training, placing, supporting, and assessing the impact of, an indigenous STEM mentor corps of successful undergraduate role models. By changing STEM aspirations and expectations while heightening their own sense of self-efficacy, we expect this corps to replenish itself and so permanently increase the flow of the state's indigenous populations into STEM majors and careers in line with NSF's mission to promote the progress of science while advancing the national health, prosperity and welfare.
Our broader goal is to focus the talents and energies of a diverse collective of community stakeholders on the empowerment of its local college population to address and solve a STEM disparity that bears directly on the community's well-being in a fashion that is generalizable to other marginalized communities. The scope of our project is defined by six tightly coupled new programs: three bringing indigenous STEM mentors to students, one training mentors, one training mentees to value and grow their network of mentors, and one training teachers to partner with us in STEM. The intellectual merit of our project lies not only in its assertion that authentic STEM mentors will exert an outsize influence in their communities while increasing their own sense of self-efficacy, but in the creation and careful application of instruments that assess the factors that determine teens' attitudes, career interests, and behaviors toward a STEM future; and mentors' sense of self development and progress through STEM programs. More precisely, evaluation of the programs has the potential to clarify two important questions about the role of college-age mentors in schools: (1) To what degree is the protege's academic performance and perceived scholastic competence mediated by the mentor's impact on (a) the quality of the protege's parental relationship and (b) the social capital of the allied classroom teacher; (2) To what degree does the quality of the student mentor's relationships with faculty and peers mediate the impact of her serving as mentor on her self-efficacy, academic performance, and leadership skills?
One common barrier to STEM engagement by underserved and underrepresented communities is a feeling of disconnection from mainstream science. This project will involve citizen scientists in the collection, mapping, and interpretation of data from their local area with an eye to increasing STEM engagement in underrepresented communities. The idea behind this is that science needs to start at home, and be both accessible and inclusive. To facilitate this increased participation, the project will develop a network of stakeholders with interests in the science of coastal environments. Stakeholders will include members of coastal communities, academic and agency scientists, and citizen science groups, who will collectively and collaboratively create a web-based system to collect and view the collected and analyzed environmental information. Broader impacts include addressing the STEM barriers to those who reside in the coastal environment but who are underrepresented in STEM education, vocations and policy-making. These include tribal communities (racial and ethnic inclusion), fishery communities (inclusion of communities of practice), and rural communities without direct access to colleges or universities. This project will create a physical, a social, and a virtual, environment where all participants have an equal footing in the processes of "doing science" - the Coastal Almanac. The Almanac is simultaneously a network of individuals and organizations, and a web-based repository of coastal data collected through the auspices of the network. During the testing phase, the researchers will implement the "rules of engagement" through multiple interaction pathways in the growing Coastal Almanac network: increases in rigorous citizen science, development of specific community-scientist partnerships to collect and/or use Almanac data, development of K-12 programs to collect and/or use Almanac data. The proposed work will significantly scale up citizen science and community-based science programs on the West Coast, broadening participation by targeting members of coastal communities with limited access to mainstream science, including participants from non-STEM vocations, and Native Americans. The innovation of the Coastal Almanac is in allowing the process of deepening involvement in science, and through that process increasing agency of community members to be bona fide members of the science team, to evolve organically, in the manner dictated by community members and the situation, rather than a priori by the project team and mainstream science. The project has the potential in the long-term to increase participation in marine science education, workforce, and policy-making by underrepresented groups resident in the coastal environment. Contributions by project citizen scientists will also provide valuable data to mainstream science and to resource management efforts.
DATE:
-
TEAM MEMBERS:
Julia ParrishMarco HatchSelina Heppell