The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
To advance justice, equity, diversity, and inclusion in science, we must first understand and improve the dominant-culture frameworks that impede progress and, second, we must intentionally create more equitable models. The present authors call ourselves the ICBOs and Allies Workgroup (ICBOs stands for independent community-based organizations), and we represent communities historically excluded from the sciences. Together with institutional allies and advisors, we began our research because we wanted our voices to be heard, and we hoped to bring a different perspective to doing science with
DATE:
TEAM MEMBERS:
María Cecilia Alvarez RicaldeJuan Flores ValadezCatherine CrumJohn AnnoniRick BonneyMateo Luna CastelliMarilú López FrettsBrigid LuceyKaren PurcellJ. Marcelo BontaPatricia CampbellMakeda CheatomBerenice RodriguezYao Augustine FoliJosé GonzálezJosé Miguel Hernández HurtadoSister Sharon HoraceKaren KitchenPepe Marcos-IgaTanya SchuhPhyllis Edwards TurnerBobby WilsonFanny Villarreal
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Many informal learning institutions use STEAM approaches to engage diverse learners. Our project aims to support educators in libraries, museums, and after school programs through a STEAM professional development (PD) series. Our PD approach is centered around a set of core STEAM practices that prioritize STEAM mindset and identity work. Participants engage in exemplar activities and design new experiences for their specific teaching and learning contexts. The series involves in- person sessions, online training, and team
This poster was presented at the 2021 NSF AISL Awardee Meeting.
This project presents a framework of outcome progressions developed through a virtual convening.
Maker education has increased tremendously in community settings and classrooms across the country. Maker education is learner-driven and hands-on, often collaborative, and may focus on solving a problem or designing an object or device. There is a growing need for assessment and evaluation tools and approaches to understand and improve the nature of maker learning and provide evidence for the value of maker pedagogy. This workshop will bring together approximately 25 researchers from formal and informal settings as well as practitioners to review current maker assessment and evaluation tools and examine the role those tools can play for informing research and practice. The workshop will identify areas where future work is needed, including designing assessment and evaluation that effectively addresses the interests and needs of diverse learners. The workshop will disseminate an online collection of these assessment and evaluation tools, a research brief, and several webinars sharing the results and recommendations of the conference.
The two-day, in-person conference will include pre-workshop surveys to determine and refine issues for consideration at the conference, identify a core set of readings and resources for conference participants, and to identify key topics for research briefings presented at the conference. The conference will include background briefings, hands-on try-outs of assessment tools, synthesis discussions, and identification of future directions for research and next steps. Resources developed from the workshop will be widely disseminated through workshop partner Maker Education’s website, an annual maker conference held at the University of Wisconsin, and through other publications reaching researchers and practitioners in informal and formal educational settings,
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Developing solutions to large-scale collective problems -- such as resilience to environmental challenges -- requires scientifically literate communities. However, the predominant conception of scientific literacy has focused on individuals, and there is not consensus as to what community level scientific literacy is or how to measure it. Thus, a 2016 National Academies of Sciences, Engineering, and Medicine report, “Science Literacy: Concepts, Contexts, and Consequences,” stated that community level scientific literacy is undertheorized and understudied. More specifically, the committee recommended that research is needed to understand both the i) contexts (e.g., a community’s physical and social setting) and ii) features of community organization (e.g., relationships within the community) that support community level science literacy and influence successful group action. This CAREER award responds to this nationally identified need by iteratively refining a model to conceptualize and measure community level scientific literacy. The model and metrics developed in this project may be applied to a wide range of topics (e.g., vaccination, pandemic response, genetically-modified foods, pollution control, and land-use decisions) to improve a community’s capacity to make scientifically-sound collective decisions. This CAREER award is funded by the Advancing Informal STEM Learning (AISL) and the EHR CORE Research (ECR) programs. It supports the AISL program goals to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It supports the ECR program goal to advance relevant research knowledge pertaining to STEM learning and learning environments.
The proposed research will conceptualize, operationalize, and measure community level scientific literacy. This project will use a comparative multiple case study research design. Three coastal communities, faced with the need to make scientifically-informed land-use decisions, will be studied sequentially. A convergent mixed methods design will be employed, in which qualitative and quantitative data collection and analyses are performed concurrently. To describe the i) context of each community case, this project will use qualitative research methods, including document analysis, observation, focus groups, and interviews. To measure the ii) features of community organization for each community case, social network analysis will be used. The results from this research will be disseminated throughout and at the culmination of the project through professional publications and conference presentations as well as with community stakeholders and the general public. The integrated education activities include a professional learning certificate for informal science education professionals and STEM graduate students. This certificate emphasizes high-quality community-engaged scholarship, placing students with partners such as museums, farmer’s markets, and libraries, to offer informal learning programs in their communities. This professional learning program will be tested as a model to provide training for STEM graduate students who would like to communicate their research to the public through outreach and extension activities.
Framing: Broadening participation and achieving equitable outcomes has been a core goal of the science museum field for over two decades. However, how to make progress has proven an intractable problem.
Methods: Focusing on five organizations who officially committed to diversity, equity, access, and inclusion (DEAI) by participating in a national professional development program, the researchers investigate how science museums attempt to enact internally-focused change via a mixed methods case study.
Findings: While these organizations considered a variety of structurally focused change
This workshop is funded through the "Dear Colleague Letter: Principles for the Design of Digital Science, Technology, Engineering, and Mathematics (STEM) Learning Environments (NSF 18-017)." In today's educational climate, organizations are creating physical learning spaces for hands-on STEM activities, often called makerspaces, co-working spaces, innovation labs, or fablabs. These spaces have evolved to be interdisciplinary centers that personalize learning for individual, diverse learners in collaborative settings. When designed well, these physical spaces create communities that contextualize learning around participants' goals and thus address STEM learning in a dynamic and integrated way. Participation in these learning environments encourages the cultivation of STEM identities for young people and can positively direct their career trajectories into STEM fields. This workshop will bring together a community of collaborators from multiple stakeholder groups including academia, public libraries, museums, community based organizations, non-profits, media makers and distribution channels, and educators within and beyond K-12 schools. Led by the University of Arizona, and held at Biosphere 2, an international research facility, participants will engage in activities that invite experimentation with distributed learning technologies to examine ways to adapt learning to the changing technological landscape and create robust, dynamic online learning environments. The workshop will culminate in a synthesis of design principles, assessment approaches, and tools that will be shared widely. Partnerships arising from the workshop will pave the way for sustained efforts in this area that span research and practice communities. Outcomes will address research and development of the next generation of digitally distributed learning environments.
The three day workshop convening will provide a unique forum to (1) exchange innovative ideas and share challenges and opportunities, (2) connect practical and research-based expertise and (3) form cross-institutional and cross-community partnerships that envision, propose, and implement opportunities for collecting and analyzing data to systematically inform the collective understanding. Participation-based activities will include design-based experiences, participatory activities, demonstrations of works in progress, prototyping, creative pitching, practitioner lightning talks, small group breakouts, hands-on design activities, and an 'unconference' style synthesis of bold ideas. Participants will be invited to experiment with distributed learning technologies. Five focus areas for the workshop include (1) inclusivity of learning spaces that invite multiple perspectives and full participation, (2) documenting learning in ways that are linked to outcomes and impacts for all learners, (3) implementing the use of new technologies in diverse settings, such as the workforce, (4) interpersonal interactions and peer-to-peer learning that may encourage a STEM career-path, and, (5) methods for collecting and analyzing data at the intersection of people, the learning environment, and new technologies at multiple levels. Outcomes of the workshop will serve to advance knowledge regarding critical gaps and opportunities and identify and characterize models of collaboration, networking, and innovation that operate within and across studio-based STEM learning environments.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Children and their families are practicing STEAM (Science, Technology, Engineering, Arts, and Math) skills through a library program. Hand-crank generators and LED bulbs are set out on each of the tables, along with two types of dough—conductive play dough and insulating modeling clay.
DATE:
TEAM MEMBERS:
Brooks MitchellClaire RatcliffeKeliann LaConte
Although virtual conferences have become commonplace in the age of COVID-19, this format poses both challenges and opportunities for organizers to design, implement, and engage participants in productive and connected ways. We created this brief to share an example of the process and lessons learned as we designed and hosted a virtual NSF-funded conference called: Mapping Connections Between STEM and Social-Emotional Development (SED) in Out-of-School Time (OST) Programs. This conference focused on identifying outcomes at the interface of STEM and SED in OST research and practice (e.g
The pilot test for Changemakers: Advancing Community Science Literacy was a capacity building program integrating strategic discourse & community change theory that identified a new path for advancing community STEM literacies. The results of experiment established partnerships with locally based non-profits, and a collaborative effort to address environmental justice and social disparities in areas threatened by climate change.
The evaluation was underaken with instruments developed for multiple research projects to support cross-project comparative analysis.
This instrumemts presented