The National Girls Collaborative Project and Education Development Center are convening “Advancing the Conversation on Scaling National Informal STEM Programs,” a two-and-a-half day knowledge-building conference that brings together key stakeholders in informal STEM education (ISE) to examine what scale looks like across informal learning settings. Currently, there is not a common definition or set of dimensions related to what it means to scale programs in informal learning settings. Approaches to scale in ISE too often center on the perspectives and needs of people who are developing and spreading programs while less consideration is given to the realities of those responsible for operationalizing programs in hyper-local contexts. This conference approaches the question of scale from the perspective of the program implementers, who are the beneficiaries of capacity building and serve as facilitators of these scaled programs. The conference also gives voice to program developers, researchers, evaluators, and funders of national informal STEM programs who study and support scale in education. The aim of the conference is to develop a new framework for scale in ISE that centers partnership and capacity building of informal educators. Such an approach to scale addresses issues of local access and diversity, equity, and inclusion, and promotes sustainability of ISE in high-need communities.
Conference discussions challenge three common misperceptions of scale across ISE: (1) simple spread and replication of turnkey programs lead to effective scale in ISE; (2) definitions of scale derived from formal learning settings should be used to scale across ISE; and (3) scale across ISE should be defined by program developers and those that seek to study it. Participants with a wide range of perspectives and who represent a diversity of organizational types will attend the conference and work together to articulate scaling success factors, barriers, diversity, equity, and inclusion strategies, and intended outcomes, distilling themes, questions, and concerns about current approaches to evaluating and researching scale in ISE. Together, conference participants will co-create a framework for scale in ISE which will define new and expanded dimensions of scale that center on capacity building and diversity, equity, and inclusion, as well as a Program Developer’s Guide for scaling ISE programs through the lens of the framework. These products will increase the knowledge and capacity of informal learning organizations involved in nationally scaled initiatives, STEM-rich institutions wanting to scale their own locally developed programs, informal STEM researchers and evaluators, and the broader field of ISE including program funders. Conference findings will be broadly disseminated through publications, conferences, and a national webinar co-hosted by the National Girls Collaborative Project and Education Development Center.
DATE:
-
TEAM MEMBERS:
Tara CoxErin Stafford
resourceevaluationProfessional Development, Conferences, and Networks
Inverness Research and Oregon State University, with support and input from CAISE, conducted an evaluation of the 2021 NSF AISL Awardee Meeting which was held virtually October 19-21, 2021. The evaluation effort included observing the meeting, participating in debriefing the meeting with CAISE co-PIs, the CAISE equity audit committee, and NSF Program Officers; developing and administering a post-event survey; and analyzing data collected through both the survey and Pathable, the virtual platform.
This report summarizes the key evaluation findings. It includes the following sections:
In 2017, the Education Development Center (EDC) received a grant from the National Science Foundation (NSF) to bring together PIs of STEM Program Resource Centers (PRC) funded under NSF’s Education and Human Resources (EHR), evaluators of NSF STEM projects and programs, and evaluation advisors to address concerns about the quality and consistency of STEM evaluations. According to the grant proposal, the goal was “to increase the capacity of evaluators to produce high quality, conceptually sound, methodologically appropriate evaluations of NSF programs and projects, specifically in the area of
This report grew out of a workshop and follow-up session sponsored by the National Science Foundation (NSF), Directorate for Education and Human Resources (EHR). The two-day workshop and subsequent meeting sought to develop and validate evaluation practices to assess the value of NSF's investment in broadening participation across all directorates and programs. Invited participants included NSF grantees, professional evaluators, and the policy community (which included representatives from Congress, the Office of Management and Budget (OMB), NSF staff, and staff from other federal agencies).
DATE:
TEAM MEMBERS:
Fitzgerald BramwellPatricia CampbellBeatriz Chu ClewellDarnella DavisNorman FortenberryAntonio GarciaDonna NelsonAdam StollVeronica Thomas
resourceevaluationProfessional Development, Conferences, and Networks
This report summarizes the evaluation outcomes of the Collaborative Project Management (CoPM) Institute project, a two-day convening centered on bringing proven project management skills and approaches in the for-profit world to the informal science education (ISE) community to support effective collaborations and successful outcomes. The CoPM Institute was conceptualized as a pilot effort to test the effectiveness of porting of tools and frameworks for collaborative project management from the business/for-profit environment to advance the following project goals:
Build the capacity of
This workshop is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project will conduct an in-person participatory workshop designed to broaden participation in STEM. The project is designed to build the capacity of informal science institutions (ISIs) and their partners to use evidence-based collaborative project management practices and culturally responsive approaches to manage complex partnership efforts. The workshop will develop structure and provide tools for effective collaborative project management between ISIs including science centers and museums, and their research and community partners. To guide the workshops, participants will explore some core dimensions of culture to understand audiences, communities traditionally underserved by informal STEM institutions, and institutional differences. Participants will leave with concrete, actionable plans that will enable them to more effectively bring their collaboration plans to fruition. The project will develop resources including a playbook of project management templates, video vignettes, and summaries of relevant research findings and lessons from the field. Proceedings and resources from the workshop will be shared online with the field and ultimately archived on informalscience.org.
Conference participants will build the human resource expertise, infrastructure, and capacity needed to develop and maintain lasting partnerships that will further their institutions' aspirations to broaden participation in STEM. The project brings together an experienced, multidisciplinary team from informal science education and private industry professionals to advance knowledge of the skills and tools needed for managing complex collaborations between researchers, practitioners, and community stakeholders that will increase their effectiveness when working with diverse audiences. During the workshop, participants will think through their current project work by using a defined collaborative project management process to build a foundation of understanding and trust. Upon completion of the Institute, participants will have: (1) a shared purpose and goals that represent the interests of all parties; (2) identified some cross cultural and organizational differences that need to be accommodated for successful collaboration; (3) fostered joint decision making based on objective steps vs priorities of one organization; and (4) clarified deliverables of their project and how to measure success; (5)identified individual roles and responsibilities within their collaboration.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
In June of 2017, the Exploratorium hosted the GENIAL Summit which brought together approximately 91 practitioners, community leaders, diversity-focused organization staff, researchers, and media/marketing specialists from across the country and Puerto Rico for a one and a half day gathering. The National Science Foundation (NSF) funded Summit focused on increasing Latino participation in Informal STEM Learning (ISL) environments by examining these five content strands identified by the GENIAL team:
1. Latino Audiences
2. Marketing, Communicating, and Media
3. Community Collaboration and
Leading science educators from 9 South and Southeastern Asian countries and the U.S. met for three days in Kuala Lumpur, Malaysia (October 4-6, 2017) in an effort to rethink and re-envision science education in the 21st Century. The attendees of this U.S. National Science Foundation-funded international conference reaffirmed the G8-Science Academies Joint Statement (2011) that education in science must be targeted not only to future scientists, engineers and other specialists in government and industry, but also to the general public, including school-aged children and adults. The attendees at
This is a report from Workshop IV, part of the Support Systems for Scientists' Communication and Engagement workshop series. Workshop IV was held May 2-3, 2018 at the Monterey Bay Aquarium in Monterey, CA. In this study, researchers sought to explore and understand the mechanisms, motivations, and outcome metrics utilized by individuals and organizations that facilitate scientists’ communication with the public. To capture the full range of engagement methods, facilitators from a wide variety of organizations were contacted and interviewed. After contacting 30 leaders the realm of science
With support from NSF/AISL, the Exploratorium held the Generating Engagement and New Initiatives for All Latinos (GENIAL) Summit on June 5-6, 2017, in San Francisco, California.
The goals of the GENIAL Summit were to:
- Identify needs and opportunities for Latinos in informal science learning (ISL) environments.
- Facilitate and strengthen professional relationships.
- Identify recommendations and actionable insights with an outlook toward the future.
- Contribute to a more informed ISL field.
A total of 91 participants, a mix of practitioners, community leaders, media specialists
With support from NSF/AISL, the Exploratorium held the Generating Engagement and New Initiatives for All Latinos (GENIAL) Summit on June 5-6, 2017, in San Francisco, California.
The goals of the GENIAL Summit were to:
- Identify needs and opportunities for Latinos in informal science learning (ISL) environments.
- Facilitate and strengthen professional relationships.
- Identify recommendations and actionable insights with an outlook toward the future.
- Contribute to a more informed ISL field.
A total of 91 participants, a mix of practitioners, community leaders, media specialists
This list of terms and definitions was produced by the GENIAL (Generating Engagement and New Initiatives for All Latinos) project, which convened Ia Summit on June 5-6, 2017, in San Francisco, California.
The goals of the GENIAL Summit were to:
- Identify needs and opportunities for Latinos in informal science learning (ISL) environments.
- Facilitate and strengthen professional relationships.
- Identify recommendations and actionable insights with an outlook toward the future.
- Contribute to a more informed ISL field.
A total of 91 participants, a mix of practitioners, community