The National Girls Collaborative Project and Education Development Center are convening “Advancing the Conversation on Scaling National Informal STEM Programs,” a two-and-a-half day knowledge-building conference that brings together key stakeholders in informal STEM education (ISE) to examine what scale looks like across informal learning settings. Currently, there is not a common definition or set of dimensions related to what it means to scale programs in informal learning settings. Approaches to scale in ISE too often center on the perspectives and needs of people who are developing and spreading programs while less consideration is given to the realities of those responsible for operationalizing programs in hyper-local contexts. This conference approaches the question of scale from the perspective of the program implementers, who are the beneficiaries of capacity building and serve as facilitators of these scaled programs. The conference also gives voice to program developers, researchers, evaluators, and funders of national informal STEM programs who study and support scale in education. The aim of the conference is to develop a new framework for scale in ISE that centers partnership and capacity building of informal educators. Such an approach to scale addresses issues of local access and diversity, equity, and inclusion, and promotes sustainability of ISE in high-need communities.
Conference discussions challenge three common misperceptions of scale across ISE: (1) simple spread and replication of turnkey programs lead to effective scale in ISE; (2) definitions of scale derived from formal learning settings should be used to scale across ISE; and (3) scale across ISE should be defined by program developers and those that seek to study it. Participants with a wide range of perspectives and who represent a diversity of organizational types will attend the conference and work together to articulate scaling success factors, barriers, diversity, equity, and inclusion strategies, and intended outcomes, distilling themes, questions, and concerns about current approaches to evaluating and researching scale in ISE. Together, conference participants will co-create a framework for scale in ISE which will define new and expanded dimensions of scale that center on capacity building and diversity, equity, and inclusion, as well as a Program Developer’s Guide for scaling ISE programs through the lens of the framework. These products will increase the knowledge and capacity of informal learning organizations involved in nationally scaled initiatives, STEM-rich institutions wanting to scale their own locally developed programs, informal STEM researchers and evaluators, and the broader field of ISE including program funders. Conference findings will be broadly disseminated through publications, conferences, and a national webinar co-hosted by the National Girls Collaborative Project and Education Development Center.
DATE:
-
TEAM MEMBERS:
Tara CoxErin Stafford
resourceprojectProfessional Development, Conferences, and Networks
This project will host a workshop in order to identify and synthesize research findings from NSF awards that addressed the unanticipated effects of the COVID-19 pandemic on STEM teaching and learning. The interruptions from the pandemic had dramatic, widespread effects in education. Across the nation, teachers, students, parents, staff, and school administrators experienced extended school closures and a rapid and unexpected shift to virtual instruction. Although long-term consequences are unknown, early observations revealed deeper disparities in access and opportunity for many students of color. These inequities extend beyond STEM education and include challenges to student’s mental health and wellbeing. In spring 2020, NSF invited researchers to submit educational research proposals in response to this national crisis. Each award has its own dissemination and plans for broader impacts, yet the public is underserved by separate reports published in many different venues. To enable stakeholders to find and discern the most important insights, our research team will aggregate and organize major findings across these projects via a workshop, synthesize key findings, identify unresolved issues, and communicate overall insights to broader audiences.
To synthesize findings, Digital Promise will organize and convene a workshop with NSF awardees who conducted research on the educational impacts of the pandemic. Workshop attendees will participate in answering four questions: (1) What are the major themes and topics across the different NSF awards? (2) How were imperatives to address emerging inequities related to STEM education addressed in research plans and findings? (3) Within each topic or theme, what are the major findings, insights and recommendations for teaching and learning in STEM? (4) Across awardees, what was learned about doing RAPID research during a pandemic, and what are recommendations for improvement when subsequent needs for RAPID research in education arise? Data sources for the synthesis will be collected from project artifacts (e.g., reports, journal articles, practitioner resources, etc.), pre/post-workshop surveys, and workshop outputs from workshop presentations, panel discussions, and small group discussions. Interviews with a subset of workshop attendees will provide insight into what was learned about conducting research during a global pandemic. Data will be codified, categorized, and coded using established qualitative methods. Digital Promise’s broad network of partners and collaborators will achieve broad dissemination and outreach to education stakeholders at both the K-12 and postsecondary levels. This project is jointly funded by the Advancing Informal STEM Learning (AISL) program, the Discovery Research PreK-12 program (DRK-12) program, the EHR Core Research (ECR:Core) program, and the Innovative Technology Experiences for Students and Teachers (ITEST) program.
HBCUs are critical to producing a diverse and inclusive workforce as they graduate a disproportionate number of African American future STEM workers and STEM leaders. Although the National Science Foundation is fully committed to diversity and inclusion, there has been little research to determine why Historically Black Colleges and Universities are not fully participating in the NSF STEM educational research opportunities. The project will investigate the challenges, needs and support for Historically Black Colleges and Universities (HBCUs) to succeed in applying for educational research support from the National Science Foundation (NSF). Participants will be recruited from 96 HBCUs that are eligible to apply for such funding and will include the wide range of college and university administration and faculty that are involved in the preparation of research projects and related applications for research funding. The investigation will focus primarily on the Division of Research on Learning in Informal and Formal Settings (DRL) within NSF. The investigation will: 1) determine the submission rate and funding success rate of HBCUs within the DRL funding mechanisms; 2) determine why a greater proportion of HBCUs are not successful in their applications of research or do not apply; and 3) determine what factors, such as institutional support, research expertise, and professional development, could lead to a larger number of research proposals from HBCUs and greater success in obtaining funding. The project has the potential to have significant influence on the national educational and research agenda by providing empirical findings on the best approach to support and encourage HBCU participation in DRL educational research funding programs.
This exploratory research project will investigate what changes and/or supports would contribute to significantly increasing the number of applications and successful grant awards for STEM educational research project proposed by HBCUs. The project has the following research questions: (1) What factors discourage participation of HBCUs in the DRL funding mechanisms and what are the best practices to encourage participation? (2) What approaches have been successful for HBCUs to obtain DRL funding? (3) What dynamic capabilities are necessary for HBCU researchers to successfully submit STEM proposals to NSF? (4) What changes would be helpful to reduce or eliminate any barriers for HBCU applications for DRL educational research funding and what supports, such as professional development, would contribute to greater success in obtaining funding? Participants will be recruited from the 96 eligible HBCUs and will include both individuals from within the administration (e.g., Office Sponsored Programs, Deans, VP, etc.) as well as from within the faculty. The research will collect variety of quantitative and qualitative data designed to support a comprehensive analysis of factors addressing the research questions. The project will develop research findings and recommendations that are relevant to faculty, administrators, and policymakers for improving HBCU participation in research funding opportunities. Results of project research will be widely disseminated to HBCUs and other Minority Serving Institutions (MSIs) through a project website, peer reviewed journals, newsletters, and conference presentations.
This project is funded by the Innovative Technology Experiences for Students and Teachers (ITEST), the Advancing Informal STEM Learning (AISL), and the Discovery Research PreK-12 (DRK-12) programs. These programs which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' and general public knowledge and interest in science, technology, engineering, and mathematics (STEM).
DATE:
-
TEAM MEMBERS:
Cynthia TrawickJohn HaynesTriscia HendricksonTerry Mills
This AISL Pilots and Feasibility project will study the data science learning that takes place as members of the public explore and analyze open civic data related to their everyday lives. Government services, such as education, transportation, and non-emergency municipal requests, are becoming increasingly digital. Generally, program workshops and events may be able to support participants in using such data to answer their own questions, such as: "How do City agencies respond to noise in my neighborhood?" and "How do waste and recycling services in my neighborhood compare with others?" This project seeks to understanding how such programs are designed and facilitated to support diverse communities in accessing and meaningfully analyzing data will promote innovation and knowledge building in informal data science education. The team will begin by summarizing best practices in data science education from a variety of fields. Next they will explore the design and impacts of two programs in New York City, a leader in publicly available Open Data initiatives. This phase will explore activities and facilitation approaches, participants' objectives and data literacy skills practice, and begin to identify potential barriers to entry and levels of participation. Finally, the team will build capacity for other similar organizations to explore and understand their impacts on community members' engagement with civic data. This pilot study will establish preliminary evidence of the effectiveness of these programs, and in turn, inform future research into the identifying and amplifying best practices to support public engagement with data.
This research team will begin by synthesizing data science learning best practices based on varied literatures and surveys with academic and practitioner experts.
Synthesis results will be applied as a lens to gather preliminary evidence regarding the impacts of two programs on participants' data science practices and understanding of the nature of data in the context of civics. The programs include one offered by the Mayor's Office of Data Analytics (MODA), which is the NYC agency with overall responsibility for the City's Open Data programs, and BetaNYC, a leading nonprofit organization working to improve lives through civic design, technology, and engagement with government open data. The research design triangulates ethnographic observations and artifacts, pre and post adapted surveys, and interviews with participants and facilitators. Researchers will identify programmatic metrics and adapts existing measures to assess various outcomes related to public engagement with data, including: question formulation, data set selection and manipulation, the use of data to make inferences, and understanding variability, sampling and context. These metrics will be shared through an initial assessment framework for data science learning in the context of community engagement with civic open data. Researchers will also begin to identify barriers to broader participation through literature synthesis, interviews with participants and facilitators, and conversations with other organizations in our networks, such as NYC Community Boards. Findings will determine the suitability of the programs under study and inform future research to identify and amplify best practices in supporting public engagement with data.
This project is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
In 2018, the Croucher Foundation conducted its third annual mapping exercise for the out-of-school STEM learning ecosystem in Hong Kong.
The study reveals a rich and vibrant ecosystem for out-of-school STEM in Hong Kong with over 3,000 discrete activities covering a very wide range of science disciplines. This third report indicates extremely rapid growth in available out-of-school STEM activities compared to 2016 and an even larger increase in the number of organisations offering out-of-school STEM activities in Hong Kong.
STEM educators are eager to foster long term collaboration with each other, and with schools. At the same time, good working practice by schools, teachers, STEM educators and institutions that involves and engages local communities was discovered, showing the diversified modes of connection which could enhance the sustainability of STEM ecosystem.
We trust that this three-year study with its associated digital maps, provides a useful resource for schools, teachers, students, parents, STEM educators and education policy makers in Hong Kong.
Addressing Societal Challenges through STEM (ASCs) received NSF AISL funding to conduct a Literature Review and Synthesis to answer the question: How are informal learning institutions advancing the use of STEM knowledge and scientific reasoning in the ways that individuals, families, and communities understand what they can do, and apply their learning to solving the societal challenges of our time? Using a definition of societal challenges based on research around the public understanding of social problems, this systematic literature review will identify, analyze, and synthesize three bodies of peer and field-reviewed literature (peer-reviewed journals, graduate theses, and evaluation reports of nationally-funded project).
Over the past decade, Informal STEM learning organizations have increasingly engaged in innovative ways to present STEM knowledge within the context of societal challenges such as climate change, energy sources, cyber-security, Nanotechnologies, coastal resilience, and other topics. These efforts significantly expand the traditional work of Informal STEM Learning (ISL) organizations, often leading to new types of interventions, partnerships, impacts, and assessment tools. Analyzing and interpreting the aggregate of this work will advance theoretical and practical knowledge about the potential of ISL’s in advancing the place of STEM in addressing societal challenges.
Demonstrating and articulating the characteristics of how ISL organizations are addressing societal challenges, encourages and informs the ways institutions can address the NSF strategic goal to “Advance the capability of the Nation to meet current and future challenges.” The project outputs aim to Enhance Knowledge-building, Build Capacity of the Field, and Maximize Strategic Impact by informing the strategies used by organizations and individuals. The results also aim to Broaden Participation by articulating the ways STEM knowledge is embedded and linked to personal experiences and choices.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Many scientists want to connect with the public, but their efforts to do so are not always easy or effective. Visionary programs and institutions are leading the way identifying the support needed to enable scientists’ connections with the public. However, the current appetite by -- and demand for -- scientists to do this exceeds the capacity of those who facilitate quality communication and engagement efforts. More can be done to ensure that those who support scientists are networked, sharing best practices, and supported by a reliable infrastructure.
This workshop series, convened by the Kavli, Rita Allen, Packard and Moore Foundations, was intended to view the entire system of people who support scientists’ engagement and communication efforts in order to explore how this system can be most effective and sustainable. The discussions examined where this system is thriving, the limits people within the system face and what can be done to ensure their efforts are commensurate with the demand for quality communication and engagement support.
Conducted over four closely scheduled workshops in late 2017 and early 2018, the convenings brought together leaders in different parts of the field who bridge scientists and the public and led to the emergence of a number of key priority areas. While the initial intention was to also hold a plenary event to provide a more holistic view of scientists’ support system in order to collectively discern directions to advance the field, we feel a more efficient way forward right now is to focus our efforts and resources on building community and advancing these priority areas.
Our invitation-only workshops brought together scientists, academic leaders, engagement professionals, researchers, communication trainers, and foundation leaders. For each workshop, we also commissioned a “landscape overview”, to better understand the high-level state of each community. Workshops included:
Workshop I: Communication and engagement training programs - Dec. 4-5, 2017 at SUNY Global Center/Alan Alda Center for Communicating Science in New York
Workshop II: Associations, societies and other professional organizations - Feb. 28 - March 1, 2018 at the Howard Hughes Medical Institute in Chevy Chase, MD
Workshop III: Academic institutions - March 27-28, 2018 at UC San Diego
Workshop IV: Science engagement facilitators (museums, science festivals, connectors) - May 2-3, 2018 at Monterey Bay Aquarium
TBD - Workshop V: Plenary event
The goal of the workshops was to explore how to ensure scientists’ communication and engagement support is effective and sustained. In doing so, we hoped to 1) deepen our understanding of how scientists are currently supported in these areas, 2) map the broader support system to expose the opportunities and obstacles that play a role in achieving this goal, and 3) identify strategic and practical next steps that move us closer to this goal. This initiative also aimed to forge and strengthen networks across communities and institutions – and in so doing, take a view of the entire system to explore how everyone can better ensure their efforts are impactful, mutually supportive, and connected to a greater whole.
Included in the links below are summaries from each workshop.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The subject of physics and all of its sub-disciplines are becoming more prevalent in the public press as the research results appear to be quite interesting and important. While the physics discipline has made a Nation-wide effort to acquaint the public with physics knowledge through informal education learning experiences for years, it has not been as successful as the community desires. Thus, this project is aimed to gather all of the informal and outreach physics education efforts that have been attempted in the hope of finding the best practices for learning physics concepts and practices. A compendium will be published to inform future opportunities on how to educate the public through informal and outreach mechanisms. This project is a collaboration between Michigan State University and the University of Colorado. The physics community has a long history of engaging audiences in informal education activities. Physics institutions that facilitate informal programs include university departments, national laboratories and centers, and professional societies and organizations. There is, however, no systemic understanding of how these programs are facilitated, nor an assessment of the collective impact that these programs have on participants. This project will address numerous research questions in the broad areas of Activity Detail, Structural Aspects, and Assessment. Further, their efforts will determine the "who, what, why, where and how" of informal physics offerings, focusing on their facilitation, impact on participants, and the academic and discipline-specific cultures from which these programs originate. The study has several definite research outcomes that will emerge from this methodology: 1) They will produce a survey of the informal efforts of university physics departments, national physics labs and national physics organizations, 2) They will develop a taxonomy of informal physics programs from which we can characterize the landscape of programs, and 3) by investigating both "successful" as well as "failed" or terminated programs, they will develop an understanding of the culture and resources needed to support outreach from these research findings. In addition, they will produce published works that can be utilized by informal practitioners and administrators in physics to examine current programs and guide the development of new programs. With regards to the research questions and framework, the overarching and driving question for this research project is: "What is the landscape of informal physics learning, specifically, of those programs in the United States facilitated by physicists and physics students at academic institutions, national labs and by national physics organizations?" This study will provide a robust understanding of the state of informal physics programs and outreach by physicists in the United States today. Findings will inform practitioners and administrators as to how best to support and design informal physics programming. The results will also have broad implications for other discipline-specific informal STEM programming. The primary data collection methods will be a nationwide survey and interviews with a large sample of informal practitioners from the physics community. Site visits will be conducted with a subset of these programs in order to observe programs in action and to glean insights from university participants, community partners, public, and K-12 audiences.
DATE:
-
TEAM MEMBERS:
Kathleen HinkoNoah Finkelstein
resourceprojectProfessional Development, Conferences, and Networks
Informal science educators, researchers, and evaluators are interested in directly engaging with the challenges and opportunities of increasing diversity and meaningful intersectionality. The annual meetings of organizations like the American Alliance of Museums (AAM), the Association of Science and Technology Centers (ASTC), and the Visitors Studies Association (VSA) have consistently featured sessions relevant to these topics. NSF's goal of broadening participation means there are also project specific efforts currently underway to directly address methods and strategies for increasing diversity and inclusion in STEM. The Connected Audience Conference will provide an opportunity to engage in an international conversation that directly leverages this momentum and has the potential to motivate focused collective action among participants producing a greater impact on the field. This travel award supports an enhanced U.S. presence at the Connected Audience International Conference to be held in Vienna, Austria September 14-16, 2017. The premise of the meeting is that the role of museums and other cultural institutions in society is rapidly changing as these institutions strive to become more vital resources and partners in initiatives designed to support science learning, social development and growth in an increasingly science and technology-driven world. The goal for U.S. participation is to support established researchers in this area as well as mid-career professionals. The meeting is comprised of: thought leaders, case study presenters, poster presenters and general participants. Thought leaders will highlight theoretical and practical approaches to broadening participation designed to be provocative and stimulate discussion in the breakout sessions. Case study presenters will be paired to illustrate similarities and/or differences in project design, implementation, or outcomes. Structuring the case studies in this way supports conversations focused on cross-country and cross-institution synergies. The poster session presenters were selected and grouped to encourage productive and comparisons specifically exploring the potential for cross-cutting methods to more effectively engage with audiences. U.S. attendees supported under this travel grant represent those who are engaged in this work actively and positioned to continue making important contributions to the field. International participants represent a range of cultural institutions with the largest proportion attending from science centers and children's museums; however, all participants come because of their interest, concerns and expertise in issues related to equity and greater participation. The structure of the meeting will provide participants with significant time for iterative reflection and active discussion to make each session personally relevant and meaningful. This intentionally allows lots of room for pushback and even outright disagreement with any of the ideas proposed by the thought leaders, case study presenters, and poster session presenters. This award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences. The Connected Audience conference is designed to significantly contribute to an international conversation about the future of informal science education institutions in the learning ecologies of 21st century citizens. Through exploration of new findings and international cross-pollination of best practices, conference participants will be able to develop improved strategies for increasing and diversifying who participates in informal science education experiences as well as how they participate. A white paper written by the U.S. participants will be used to share findings and insights with the broader informal education field.
The Institute of Arctic and Alpine Research (INSTAAR) at the University of Colorado, Boulder, in collaboration with EcoArts Connections and the National Center for Atmospheric Research (NCAR), is conducting an initial planning workshop and related activities which will be the first of three stepwise convenings over the next two or three years to gather experts from the fields of natural and social sciences, arts, energy/water conservation, and related disciplines. The initiative will work to establish an operational strategy for knowledge sharing across collaborating entities, networks, and associations. The major goal is to strengthen collaboration of professionals nationally to better conceive, conduct, and evaluate projects for the public that work at the intersection of science, arts, and sustainability (environmental, social and economic). Many communities around the country have been seeking to address increasingly pressing problems about their ability to sustain the vitality, health and resilience of their regions and the lives of their residents. Bringing inter-disciplinary knowledge and skills to bear on these issues is considered to be critical. Between 24 - 32 professionals will be involved. The workshop will be conducted simultaneously in Boulder, CO and at Princeton University, with communication between the two sites. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. Intended outcomes from this first workshop include: 1) identification and preliminary mapping of successful evidence-based best practices in science-arts-sustainability collaborations 2) a strategic vision for interdisciplinary collaboration across networks; and 3) an initial framework for the dissemination of findings that can reach across disciplines. Outputs include 1) preparation of a pre-workshop briefing booklet based in part on interviews of professionals in the various disciplines; 2) a post-workshop white paper; 3) a network of experts from the participating disciplinary fields; and 4) an agenda for the second (larger) convening. The trans-disciplinary strategy promises to more efficiently and effectively bring STEM disciplines to a wider public in collaboration with the arts through sustainability topics that are place-based, targeted to, and meaningful for specific audiences.
As part of its overall effort to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program, seeks to advance new approaches to, and evidence-based understanding of, the design and development of science, technology, engineering, and mathematics (STEM) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. In alignment with these aims, the STEM + Digital Literacies (STEM+L) project will investigate science fiction as an effective mechanism to attract and immerse adolescents (ages 10-13) from diverse cultural backgrounds in environmental and human health content and socio-scientific issues. This work is particularly novel, as the current knowledge base is limited, and largely addresses the high school level. Therefore, the results of the proposed effort could yield important findings regarding the feasibility of this activity as an effective platform for science learning and engagement for younger students. As such, STEM+L would not only advance knowledge in the field but would also contribute to a growing AISL portfolio on digital literacy and learning.
STEM+L is an early stage Innovations in Development project that will engage thirty middle school students in out of school time experiences. Over a twenty-four-week period, students will work collaboratively in groups in-person and online with their peers and field experts to design, develop, and produce STEM content rich, multimedia science fictions. The in-person learning experiences will take place on the University of Miami campus during the summer and academic year. Culminating activities include student presentations online and at a local Science Fiction Festival. The research component will employ an iterative, design-based approach. Four research questions will be explored: (a) How do students learn science concepts and multimodal digital literacies through participating in the STEM+L Academy? (b) How do students change their views in STEM related subject matter and in pursuing STEM related careers? (c) How do students participate in the STEM+L Academy? (d) How do we best support students' participation and learning of STEM+L in face-to-face and online environments? Data collection methods include video records, student-generated artifacts, online surveys, embedded assessments, interviews, and multimodal reflections. Comparative case analysis and a mixed methods approach will be employed. A rigorous evaluation will be conducted by a critical external review board. Inclusive and innovative dissemination strategies will ensure that the results of the research and program reach a broad range of audiences including both informal and formal STEM and literacy educators and researchers, learning scientists, local communities, and policy makers through national and international conference presentations, journal publications, Web2.0 resources, and community outreach activities.