Various measures exist to assess learning outcomes from informal science, technology, engineering, or math (STEM) education programming, especially for youth audiences. Although there has been growing interest in the field among practitioners, researchers and evaluators for the development and implementation of shared, common STEM measures and frameworks, informal STEM learning (ISL) institutions (e.g., museums, zoos, aquaria, botanic gardens, and the like) face a unique challenge when they design and evaluate educational programs. By nature of the broad-ranging topic areas these institutions emphasize, programming seeks to reach audiences that vary in age, ability, cultural background, interest, and more. Participation also varies--for example, participants choose which in a series of exhibits they attend and how much time they spend at each. Given this planned-for variance, how do educators target appropriate learning outcomes? To what extent do outcomes map to activity complexity? How does programming success link to institutional goals? One solution may be a framework of outcome progressions. Progressions are within outcome categories (e.g., interest, attitude, knowledge, skills, behavior, science capital, etc.), the ordinal series of effects that can be mapped to programming that ranges from short duration with simple content (e.g. a hallway cart demonstration can trigger situational interest) to extended duration with complex content (e.g. a youth internship can generate well-developed personal interest). STEM educators, evaluators and researchers working in or with ISL institutions will come together to consider the utility and feasibility of an outcome progressions framework. With this framework STEM learning institution educators may be better equipped to understand the impact of their programming and how to design for it. This work will be undertaken by the COSI Center for Research and Evaluation in conjunction with the Office of Education, Outreach, and Visitor Services of the National Museum of Natural History and the PEAR Institute.
The primary aim of this multi-day virtual convening is to inform future development of the framework for outcome progressions. These progressions will reflect and accommodate outcomes targeted by existing and shared evaluation measures. The framework will provide informal educators and evaluators with (1) a way of aligning outcome expectations with programming depth and dosage; (2) outcome choices achievable with various depths of programming; (3) a strategic tool for planning institution-wide targeted outcomes across a full portfolio of institution educational programming; and (4) a tool for documenting an education department's varied outcomes across the full range of possible outcomes. To create rich and informed critical discussion, the conference will involve research consultant experts representing each outcome category; practitioners representing diverse programming; and evaluation theorists familiar with the broad needs of informal learning institutions. A conference subcommittee with expertise in culturally responsive and equitable program development and evaluation will ensure the agenda contains flexibility to generate emergent equitable and inclusive conversations. Conference participants will review and contribute to the soundness and utility of these categorizations as well as the progressions within them. These insights and inputs will inform future development of the framework as a valid and reliable tool. Deliverables include a paper summarizing the findings from the convenings and a related webinar that describes the framework and recommendations for its use. These will be shared broadly via the informalscience.org website and other professional venues.
This conference is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The impacts of changes in the climate at local and global levels threaten how people live. Some frontline communities, especially in historically disenfranchised and under-resourced areas, are particularly vulnerable to the devastating effects of climatological events such as wildfires, flooding, and urban heat islands. As such, there is an urgent need for collective, evidence-based understanding and engagement to prevent and prepare for these potentially fatal events. Led by the Oregon Museum of Science and Industry (OMSI) in Portland, Oregon, in collaboration with local and national partners, Youth Lead the Way is an early-stage Innovations in Development project that offers a theory-based approach for youth in climatologically vulnerable communities to work in climate science research alongside field researchers, develop leadership skills, and engage in timely conversations that impact their own communities. The project will develop and evaluate a Youth Advisory Research Board model to equip and support youth and informal STEM education institutions to conduct evidence-based research on local climate impacts and communicate the findings of their research to their communities. Youth Lead the Way advances the work of several previous NSF-funded projects on climate education, youth advisory boards, and collaborative networks to engage the public in informal STEM learning. Findings from this project will support ongoing efforts in the informal STEM education field to meaningfully engage youth and to more effectively communicate science related to climate and its impacts to the public.
During this initial two-year early-stage project, youth predominantly from racial and ethnic groups underrepresented in STEM will engage in a year-long extended STEM experience. These youth will work collaboratively with scientists and museum professionals to enhance their skills as climate researchers, science communicators, and educational leaders, while reaching an estimated 4,000 or more public audience members through research and events at OMSI, in their schools, and in their communities. Using a cohort model, the youth will conduct scientifically based research studies on various local climate impact topics while concurrently serving in an advisory role at the Oregon Museum of Science and Industry, where they will participate in shaping relevant museum programs and practices. The youth will also develop and present climate stories, a communication approach based on storytelling, to raise public understanding and awareness about local climatological changes and impacts. In addition to the youth component, a companion workshop will be held at the Sciencenter in Ithaca, New York, a partner organization, to train staff and formatively assess the feasibility of scaling the model in other museums. At the program level, an exploratory qualitative research study will be conducted to identify the factors of the overall model that contribute to desired outcomes of youth engagement, climate impact education, and informal science education professional development. Interviews, surveys, focus groups, group chats among youth cohort members, and reviews of artifacts generated by the youth will inform this exploratory study. A theory-based guide outlining key findings, considerations, and recommendations will also be produced. The dissemination of this work will be multi-tiered, reaching thousands within the target communities through public programs, professional networks, at conferences, and a live virtual professional development event hosted by the Association for Science-Technology Centers. If successful, Youth Lead the Way will lay the groundwork for a model that promotes youth and public engagement in STEM through climate science research and identifies promising pathways for future research and similar efforts well beyond this project.
This early-stage Innovations in Development project is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Ideas and expectations about professions and about the process of becoming a professional are changing. Once defined largely by licenses or certificates, many fields of work are looking for more decentralized ways to determine what is a profession, and who is a professional. Many are turning to more decentralized ideas about professions and self-directed processes for lifelong professional learning. An increasing number of fields are using competency frameworks as one mechanism to guide professionalization without standardizing the preparation of those who work in the field. Research is needed
Complex political decisions increasingly require scientific knowledge and expertise. But the exchange between actors from the political and the scientific systems is confronted by challenges. Science policy interfaces are needed in order to overcome the barriers to communication. This article analyses and discusses the importance of foundations as science policy interfaces. To this end, we will first present the salient features and functions of foundations as organisations in the framework of theoretical considerations and discuss their fundamental suitability as mediators of scientific
In 2010 both India and Europe launched new strategies focused on innovation, for economic growth and for addressing societal challenges: the Decade of Innovation from the Indian Government and the Innovation Union from the European Union. This piqued our interest in investigating how these two political entities have envisioned the concept of innovation, particularly in studying and comparing how they have focused on people, both as final beneficiaries (and thus principal legitimisers) of policy actions, and as actors themselves in the innovation process. Per contra we found, in institutional
The Intergovernmental Panel on Climate Change (IPCC) proceeds on the assumption that scientific consensus is a tool for successful climate communication. While ‘speaking with one voice’ has contributed to the Panel's success in putting climate change on the public and political agenda, the consensus policy is also contested, as our literature analysis (n=106) demonstrates. The arguments identified thereby inform a survey of climate scientists (n=138), who are the ones responsible for realising the policy. The data indicate moderate support for the consensus policy but significantly more in
DATE:
TEAM MEMBERS:
Imke HoppeSimone Rödder
resourceresearchProfessional Development, Conferences, and Networks
Advances in 21st century genetic technologies offer new directions for addressing public health and environmental challenges, yet raise important social and ethical questions. Though the need for inclusive deliberation is widely recognized, institutionalized risk definitions, regulation standards, and imaginations of publics pose obstacles to democratic participation and engagement. This paper traces how the problematic precedents set by the 1975 Asilomar Conference emerge in contemporary discussions on CRISPR, and draws from a recent controversy surrounding field trial releases of genetically
DATE:
TEAM MEMBERS:
Cynthia TaylorBryan Dewsbury
resourceresearchProfessional Development, Conferences, and Networks
This poster was presented at the 2019 AISL Principal Investigators' Meeting.
This ISL Framework is a tool for professionals and informal science learning (ISL) institutions to understand, plan, and advance their professional capacity.
Individuals can identify their professional competencies and plan their professional development.
ISL institutions can plan, provide, and assess staff development.
ISL Institutions can identify staffing qualifications needed and develop appropriate job postings.
Professional organizations and academic programs can plan training and learning
This poster was presented at the 2020 American Alliance of Museums (AAM) Virutal Conference. The Informal STEM Learning (ISL) Professional Competency Framework was developed and validated through research with professionals across the field.
Informal STEM Learning (ISL) organizations such as science centers, aquariums, and natural history museums play a vital role in stimulating public interest and engagement in science, technology, engineering, and math (STEM). That work is largely dependent on the competencies of the individuals who work within the ISL field. The ISL Professional Competency Framework is a robust and flexible tool for understanding and advancing the skills, knowledge, and capabilities of those individuals. This guide was developed to support the use of the online version of the framework.
The competencies
In this comment, we focus on the ways power impacts science communication collaborations. Following Fischhoff's suggestion of focusing on internal consultation within science communication activities, we examine the ways such consultation is complicated by existing power structures, which tend to prioritize scientific knowledge over other knowledge forms. This prioritization works in concert with funding structures and with existing cultural and social hierarchies to shape science communication in troubling ways. We discuss several strategies to address problematic power structures. These
DATE:
TEAM MEMBERS:
Megan HalpernMichael O'Rourke
resourceevaluationProfessional Development, Conferences, and Networks
In 2017, the Education Development Center (EDC) received a grant from the National Science Foundation (NSF) to bring together PIs of STEM Program Resource Centers (PRC) funded under NSF’s Education and Human Resources (EHR), evaluators of NSF STEM projects and programs, and evaluation advisors to address concerns about the quality and consistency of STEM evaluations. According to the grant proposal, the goal was “to increase the capacity of evaluators to produce high quality, conceptually sound, methodologically appropriate evaluations of NSF programs and projects, specifically in the area of