The attached evaluation is of the A2A (Awareness to Action) Planning Workshop held February 21-23 in two locations simultaneously connected by internet: the University of Colorado, Boulder and Princeton University in Princeton, New Jersey. It was made possible thanks to a collaboration of the Institute of Arctic and Alpine Research (INSTAAR) and EcoArts Connections, with additional assistance from the National Center for Atmospheric Research. A2A brought together 39 natural and social scientists, artists, urban planners, “sustainablists” (e.g. sustainability professionals working in a variety
The attached Briefing Booklet was created collaboratively by A2A (Awareness to Action) Planning Workshop facilitators and organizers in advance of the February 2018 convening and was available to participants.
The workshop's primary goal was to establish an operational strategy for knowledge sharing across entities, networks, and associations designed to strengthen communities of practice nationally to better conceive, conduct, and evaluate projects for the public, working at the intersection of science, arts, and sustainability.
The booklet contains an overview of the workshop purpose
The informal science education (ISE) sector has an important role to play in addressing current societal issues, including changes in environmental conditions, systemic poverty, and societal responses to natural and manmade disasters. These complex social problems require engaging all sectors of society in deep discussions around science, engineering, technology, and mathematics (STEM) and inclusion, diversity, equity, and access (IDEA). To do this, ISE professionals need training in how to bring in diverse perspectives, support inclusive learning, and provide equal access to institutional policymaking, practices and systems. People from different backgrounds within informal science institutions (ISIs) and local communities bring new perspectives, identify new needs, and foster innovation. This broadening of perspectives is critical to address the complex social problems of the 21st century. A key part of the needed transformations in informal science institutions is the preparation of change agents within the ISE sector capable of reimagining what just and equitable informal science institutions might look like. iPAGE 2.0 is an NSF Advancing Informal STEM Learning (AISL) Innovations in Development project conducted by the Science Museum of Minnesota and the Garibay Group in concert with 27 ISIs from across the US. The overarching goal of the project is to support transformative change toward IDEA in the ISE sector. The project is based on an extension service model of knowledge diffusion which seeks to bridge the knowledge-to-action gap by creating intermediaries that can translate research into practical innovations that can be used by practitioners in ISIs. The project brings together teams of strategically placed individuals within ISIs and prepares them to work with their colleagues to enact research-based practices and practical organizational changes toward greater equity and diversity. This project is funded by the AISL program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This ISE professional development initiative will work with annual first-year cohorts consisting of leadership teams from 4-6 ISIs. Each new cohort will spend 11 days together in a 5-day institute and three 2-day colloquia either virtually or at the Science Museum of Minnesota. Individuals and teams will adapt, implement, and refine ideas, strategies, and tools from the iPAGE 2.0 framework for use within their specific ISI context and broader professional networks and engage in ongoing communication and consultation with the iPAGE 2.0 community. All individuals on the team will develop skills, such as communication and collaboration expertise, to function as change agents acting to transform their organizations with respect to inclusion, diversity, equity, and access (IDEA) in STEM. Participants from previous cohorts will continue their roles as change agents and enhance learning in the iPAGE 2.0 community by sharing what they have learned at iPAGE 2.0 colloquia. The iPAGE 2.0 framework focuses on developing participants' understanding of 1) how structural inequalities function to reproduce social advantage and disadvantage within ISIs and the ISE sector; 2) the barriers, supports, and transmission vectors that contribute to or inhibit a continued shift in the sector toward IDEA within a network of practitioners, organizations, evaluators and researchers; and 3) how to prepare and support diversity change agents within the network. The project will employ a creative evaluation approach that combines developmental, principles-focused, arts-based, and transformative evaluation and an interactive, mixed-methods research study grounded in culturally responsive methodologies to address central questions concerning individual, organizational, and sector change. The project's primary audience is ISE professionals, and the secondary audience is researchers and evaluators working within the ISE sector. The project will work directly with an estimated 122 individuals from 27 ISIs.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This two-year Pilots and Feasibility project seeks to build knowledge and strategic impact in the informal STEM learning field by studying how and why science-education-art collaborations yield impactful informal STEM learning experiences. By design and implementing interactive and participatory experiences for adult audiences, this project will build knowledge about how to help communities learn about environmental science and apply scientific knowledge to environmental decision-making in their lives.
The project's two overarching research questions are: (1) What are the essential elements of collaboration among scientists, educators, and artists that support learning about adaptation in a changing environment? (2) In what ways do designed, participatory, informal science learning experiences support participant learning? This pilot project will: a) develop methods for facilitating and assessing collaboration among scientists, educators, and artists; b) pilot and refine approaches for engaging scientists, educators, and artists with community members for high quality participatory experiences focus on learning about adaptation to environmental change in informal learning settings; c) pilot and refine methods to measure the outcomes for community participants on knowledge about environmental change and its application to problems in their everyday lives. This project is innovative in bridging a diverse body of scholarship in order to study the process of collaboration and the specific ways interdisciplinary collaborations foster learning. Because informal STEM learning settings often combine the work of multiple disciplines, examining the process and outcomes of collaborative, participatory STEM learning has the potential to deliver widely applicable guidance for achieving more impactful educational outcomes.
The proposed project will broaden participation by engaging adult members of environmentally vulnerable communities in participatory STEM activities and will improving individual and community well-being by delivering tools for future decision-making. The collaborative project will build valuable partnerships and capacity between disparate sectors of society, allowing co-learning and co-production of knowledge. Results will be published in scholarly journals as well as shared with community participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Amy LesenSameer HonwadAma RoganCalvin Mackie
The University of South Carolina will develop and research an educational program in the Southeastern United States designed to recognize and foreground the scientific contributions of the descendants of West Africans and West Indians. Though these contributions have been vital to many scientific enterprises, including land stewardship and aquaponics, they have remained largely underappreciated in educational programs. To address this issue, this project will develop an informal science education program for youth from Gullah/Geechee communities whose ancestors were formerly enslaved West African and West Indian peoples. Across centuries, Gullah/Geechee people have developed historical and contemporary scientific, engineering, and technological practices that enabled the mastery of fishing and the cultivation of numerous crops across barrier islands and coastal cities from North Carolina to Florida. Guided by Gullah/Geechee scholars and community members, pre-service and in-service teachers will co-design culturally sustaining summer programs, which provide Gullah/Geechee youth with opportunities to engage in culturally-embedded scientific and engineering practices as they learn about numerous STEM (science, technology, engineering, and mathematics) career pathways related to these practices. The University of South Carolina will host these summer programs in partnership with the historic Penn Center, an African American historical and cultural institution, and in partnership with the Belle W. Baruch Institute for Marine and Coastal Sciences, a research organization dedicated to improving the management of marine and coastal resources. Researchers will study how the in-service and pre-service teachers enact pedagogies that sustain Gullah/Geechee cultural practices. They will also study how the Gullah/Geechee youth share their understandings of culturally-embedded scientific content through creating iMovies and through giving community presentations hosted by the Penn Center, Baruch Institute, and other community partners. This project will advance knowledge on broadening participation in STEM (science, technology, engineering, and mathematics) career pathways in informal settings through culturally sustaining pedagogies. This project will also advance partnerships through illuminating how different institutions and stakeholders?such as community leaders, cultural centers, university educator programs, and scientific research organizations can work together to support culturally-embedded learning across informal settings.
The University of South Carolina will conduct a mixed-method study grounded in principles of design-based research and community-based participatory research. Pre-service and in-service teachers from underrepresented groups will participate in an immersive two-year professional development experience during which they co-design and teach culturally sustaining summer programs with Gullah/Geechee scholars and leaders. In these programs, fifth- and sixth-grade Gullah/Geechee youth will engage in project-based learning by applying historical and contemporary scientific practices grounded in Gullah/Geechee cultures. Guided by cultural mentors, youth will engage in STEM practices similar to those of STEM professionals in the community. Researchers will study how the educators understand and apply culturally sustaining pedagogies by using constant comparative analytic methods to analyze transcripts from observations and interviews, as well as the educators' work materials (e.g., lesson plans). They will also study how the youth convey their understandings of culturally-embedded scientific content and practices by using constant comparative and multimodal analysis to analyze transcripts from interviews and observations, as well as youth-generated artifacts such as the iMovie. Additionally, pre- and post-tests will enable the research team to determine changes to the youths' understandings of scientific content and perceptions regarding participation in STEM enterprises and careers. Deliverables, such as youth-generated products, will be shared with local media and with relevant cultural centers, while empirical results will be widely disseminated through local and national conferences. This project is funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts, and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers. This project is also co-funded by the Advanced Informal STEM Learning (AISL) program. As part of its overall strategy to enhance learning in informal environments, the AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This Pilot and Feasibility project will investigate: a) the kinds of learning outcomes that occur in an informal STEM project utilizing a Critical Environmental Justice-informed Participatory Action Research framework, co-created between researchers and homeless communities, and b) the challenges and opportunities that arise in evaluating such collaborative projects. To address these questions, a team of university and community researchers will work with two self-organized homeless communities, in Portland, OR and Baltimore, MD, to systematically examine air quality at their sites and further develop a multimedia environmental justice toolkit. The toolkit is aimed at equipping homeless communities with STEM-based information and approaches to learn about and address various environmental hazards. Homeless people are disproportionately vulnerable to the impacts of air and soil pollution, rodents, extreme weather, floods, fires, and other hazards. This collaboration will study STEM learning outcomes related to the broader historical socio-political context in which people are living. The project also anticipates finding ways to adapt evaluation processes to better suit the needs of marginalized groups participating in informal STEM projects.
Guided by this integrated framework, the team will undertake participant observation, interviews, focus groups, and document analysis to assess learning. It also anticipates gaining insights into how evaluation processes may be adapted to better suit the needs of marginalized groups participating in informal STEM learning. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Chris HawnMelanie MaloneErin GoodlingDillon MahmoudiAnthony Levenda
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project aims to understand ways to empower Latinx families (adult caregivers) to feel confident in their ability to support their middle school-aged girls in science and engineering activities. The project involves seven weeks of family programming around rockets or urban farming, as well as separate conversation groups for adult family members and girls. The project is relevant for several reasons: females and Latinx individuals are both underrepresented in science, technology, engineering, and math (STEM) coursework and careers; girls tend to lose interest in STEM by middle school age; and adult family members may have an impact on their children's attitudes and interests. The project partners with school districts and nonprofit organizations in Arizona and California.
This multidisciplinary project's priority is broadening participation, with a focus on increasing Latina girls' science and engineering interests through Family Project-Based Learning Activities, Conversation Groups, and a cultivated Community of Learners. It is based on the frameworks of Social Cognitive Career Theory and Community Cultural Wealth. The project aims to empower families (adult caregivers) to feel confident in their ability to support their daughters in science and engineering activities, which is often low especially among Latinx parents. The project will develop and evaluate two out-of-school enrichment methods for aiding families in encouraging and supporting their daughters in science: Family Problem-Based Learning Activities, which focus on rockets and urban farming, and Conversation Groups, which provide information and discussion for separate groups of parents and girls. A series of pilot studies will be conducted with 80 families to iteratively evaluate and improve the materials and procedure prior to the main study with 180 families, featuring a factorial design with a control group.
The materials developed and research findings may inform similar projects, especially those for students from culturally and linguistically diverse backgrounds and projects seeking to enhance the role of families in learning. The hypothesis guiding the project is that the greatest gains will be produced with the synergistic combination of enrichment methods. Another component that can potentially have broad impact is working to create environments where Community Cultural Wealth is recognized and enhanced through interactions of different families, creating Communities of Learners. This can inform projects that recognize the importance of community and/or that seek to use culture as an asset. The proposed study will engage three geographically distributed universities and several community partners. It will also provide university students and community leaders opportunities for work on instructional design, implementation, and research. The team will disseminate their findings and methods through multiple avenues to reach researchers, parents, leaders, curators, and educators in informal and K-12 settings.
This Research in Service to Practice award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Katherine Short-MeyersonPeter RilleroPeter MeyersonMargarita Jimenez-SilvaChristopher Edwards
Our goal in creating this guide is to provide practitioners, organizations, researchers, and others with a “one-stop shop” for measuring nature connections. The guide is for those interested in assessing and enhancing the connections their audiences have to nature; we use the term “audience” to refer broadly to your participants or to any group you are trying to assess. The guide can help you choose an appropriate tool (for example, a survey or activity) for your needs, whether you work with young children, teenagers, or adults (see the Decision Tree on p. 14). The guide also includes 11 tools
DATE:
TEAM MEMBERS:
Gabby SalazarKristen KunkleMartha Monroe
The Brooklyn Botanic Garden (BBG) and Brooklyn Academy of Science and the Environment (BASE) contracted RK&A to conduct an evaluation of their partnership’s progress and outcomes over three years. The goal of the summative evaluation is to explore students, families, and teachers’ perceptions of and relationship to BBG and the BBG-BASE partnership. The evaluation also explored attitudes and understandings of how to engage in nature exploration, scientific inquiry, and environmental stewardship in a meaningful way.
How did we approach this study?
RK&A developed questionnaires to be
Science Hunters is an outreach project which employs the computer game Minecraft to engage children with scientific learning and research through school visits, events, and extracurricular clubs. We principally target children who may experience barriers to accessing Higher Education, including low socioeconomic status, being the first in their family to attend university, and disability (including Special Educational Needs). The Minecraft platform encourages teamwork and makes science learning accessible and entertaining for children, irrespective of background. We employ a flexible approach
DATE:
TEAM MEMBERS:
Laura HobbsCarly StevensJackie HartleyCalum Hartley
Scientists are increasingly motivated to engage the public, particularly those who do not or cannot access traditional science education opportunities. Communication researchers have identified shortcomings of the deficit model approach, which assumes that skepticism toward science is based on a lack of information or scientific literacy, and encourage scientists to facilitate open-minded exchange with the public. We describe an ambassador approach, to develop a scientist's impact identity, which integrates his or her research, personal interests and experiences to achieve societal impacts
Identifying private gardens in the U.K. as key sites of environmental engagement, we look at how a longer-term online citizen science programme facilitated the development of new and personal attachments of nature. These were visible through new or renewed interest in wildlife-friendly gardening practices and attitudinal shifts in a large proportion of its participants. Qualitative and quantitative data, collected via interviews, focus groups, surveys and logging of user behaviours, revealed that cultivating a fascination with species identification was key to both ‘helping nature’ and wider
DATE:
TEAM MEMBERS:
Nirwan SharmaSam GreavesAdvaith SiddharthanHelen AndersonAnnie RobinsonLaura Colucci-GrayAgung Toto WibowoHelen BostockAndrew SalisburyStuart RobertsDavid SlawsonRené van der Wal