Makerspaces and engineering design spaces have proliferated in science museums, schools, libraries, and community settings at a rapid pace. However, there is a risk that some of the same inequities that exist in the engineering field are being replicated in these settings. Research has provided evidence of persistent gaps between boys' and girls' levels of interest in engineering as it has been traditionally represented in informal learning environments, particularly in Making and engineering spaces. This Research-In-Service to Practice project intends to address this gap by employing a design-based research approach to examine if and to what extent narrative elements can interest and engage middle school girls in science, technology, engineering, and mathematics (STEM), and promote equitable, effective engineering design experiences and practices. This work is significant, as it will build upon current research and conceptual understanding of how to design narrative-rich engineering design activities for informal learning spaces, especially for girls, and within museum drop-in experiential learning contexts. It will also contribute to the evidence base regarding how girls approach and choose to persist in solving engineering design problems. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The New York Hall of Science (NYSCI) in collaboration with the Amazeum in Bentonville, Arkansas, the Tech Museum of Innovation in San Jose, California, the Creativity Labs at Indiana University and a team of advisors will conduct the 30-month, design-based research project in two phases. In the first phase, NYSCI will garner ongoing input from its partners to develop parallel versions of six pairs of engineering design activities, one with narrative elements and one without. These activities will be iteratively tested in NYSCI's Design Lab, a 10,000 square foot exhibition devoted to hands-on exploration of engineering design. Several research questions will be explored, focused primarily on building evidence-based design knowledge, establishing appeal and comprehensibility, and understanding facilitation. Observational and interview data will be garnered from 30 girls aged 7-14 and their family groups for each of the twelve activities developed, totaling 360 girls in the study sample. The results of the research on the paired activities will be iterative and provide insight on how narrative elements can most effectively invite girls into sustained engagement with the core engineering concepts and practices highlighted in each activity. In the second phase, formative and summative evaluation will be conducted to study the impact of the narrative and non-narrative versions of the engineering design activities on participating girls' engagement and persistence, by contrasting the quality of girls' engagement across the two types of activities while they are implemented across three museum sites. Project deliverables include journal articles reporting on project findings; documentation of activities that meet project goals; design guidelines for exhibit and curriculum developers who are interested in using narrative effectively to frame engineering design activities; and practical guidance for facilitators seeking to ensure that they are supporting girls effectively as they explore those activities.
The widespread accessibility of live streaming video now makes it possible for viewers around the world to watch live events together, including unprecedented, 24/7 views of wildlife. In addition, online technologies such as live chatting and forums have opened new possibilities for people to collaborate from locations around the world. The innovation that the projects provide is bringing these opportunities together, enabling real-time research and discussion as participants observe and annotate live streaming footage; sharing questions and insights through live Q&A sessions; and explore data with interactive visualization tools. Scientists will support the community's research interests, in contrast with traditional models of citizen science in which communities support the work of scientists. This project will enable people from diverse backgrounds and perspectives to co-create scientific investigations, including participants who might not otherwise have access to nature. The evaluation research for this project will advance the understanding of practices that enable interconnected communities of people to participate in more phases of scientific discovery, and how participation affects their learning outcomes. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of science, technology, engineering, and mathematics (STEM) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. As such, this project will advance a new genre of Public Participation in STEM Research (PPSR). It will also advance scientific exploration using live wildlife cams and establish a database for long-term research to understand how bird behavior and reproductive success are affected by environmental change. This project aims to deepen public involvement in science, building on knowledge and relevance for STEM learning by creating an online learning environment that expands on traditional crowdsourcing models of PPSR in which participants collect data to answer questions driven by scientists. In this project, participants are involved in co-created research investigations, including asking questions, deciding what data are needed, generating data, looking for patterns, making interpretations, reviewing results, and sharing findings. The goals are to 1) create a system that involves the public more deeply in scientific research; 2) develop participants' science skills and interests; 3) increase participants' understanding of birds and the environment; 4) generate new scientific knowledge about wildlife; and 5) advance the understanding of effective project design for co-created PPSR projects at a national scale. Through iterative design and evaluation, the project will advance the understanding of the conditions that foster online collaboration and establish design principles for supporting science and discovery in online learning environments. Through scaling and quasi-experimental studies, the evaluation research will advance the understanding of how learning outcomes may be similar or different for participants engaging in different ways, whether they observe the cams and read about the investigation, process data as contributors, provide some input as collaborators, or join in most or all of the scientific process as co-creators. Despite the popularity of live wildlife cams, with millions of people watching hundreds of cams around the world, little research has been conducted on the use of live cams for collaborative work in formal or informal science education. The infrastructure and open-source framework created for this project will expand the capacity for online communities of people from diverse career backgrounds and perspectives to collaborative on solving personally meaningful questions and contribute to new knowledge. Using this project as a prototype, cam operators from around the world could build networks of cams, enabling future studies with broader scope for comparative biological studies and discoveries. Additionally, it will serve as a model for use in classrooms or for online communities exploring other scientific fields using live-streaming content in collaborative research. By involving scientists and participants from across society as collaborators and co-creators, this project can help increase public engagement with science, technology, and environmental stewardship while advancing the understanding of the natural world and informing public decision-making.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will collaboratively design, test and study effective and efficient ways to develop embedded assessments (EAs) of citizen science (CS) volunteer scientific inquiry skills in order to better understand the impact of these CS experiences on volunteer scientific inquiry abilities. EAs are assessment activities that are integrated into the learning experience and allow learners to demonstrate their competencies in an unobtrusive way. The acquisition of scientific inquiry skills is an essential, even defining, characteristic of citizen science experiences that has a direct influence on data quality. Methods for assessing the direct impact of CS on volunteers' scientific inquiry skills are limited. The project will result in EA measures designed for use by diverse CS projects, strategies that CS projects can use to develop EA assessment tools, and research findings that document opportunities, supports and barriers of this innovative method across a range of CS contexts. Findings and initial resources will be shared with the broad array of stakeholders in CS through conferences, workshops, peer-reviewed publication, community websites and other relevant venues. The results of this work also have the potential to generalize to other informal science learning experiences that engage the public in science The project will address two research questions: (1) What processes are useful for developing broadly applicable EA methods or measures? and (2) What can we learn about gains in volunteers' scientific inquiry skills when citizen science organizations use EA? These will be addressed through design-based research focused on two streamlining strategies. For the reframing data validation strategy, six leaders from five established citizen science projects will conduct secondary analyses of their existing databases to uncover the skill gains of CS volunteers that are currently unexplored in their data. For the common measure strategy, ten CS projects will collaborate to create and test common EA measures of select identification-based skills. Data will be gathered through meeting notes, participant interviews and action plans, and volunteer skill gains to capture process and products of each strategy. Data will be analyzed using grounded theory, multiple process techniques, multilevel models, and repeated-measures analysis of variance. The design-based-research framework will significantly expand project impacts by jump-starting evaluation of the participating CS projects and by producing initial resources for two distinct EA strategies that have the potential to dramatically alter practice and impact citizen science efforts to ultimately enable more people to learn by contributing to the science endeavor. The project will directly equip the 15 participating citizen-science projects with authentic performance tools to assess the quality of their programing, which will expand their understanding of CS volunteer skills and help them better recruit and support their varied audiences (including rural, low-income and tribal communities).
“The Roads Taken” virtual conference was part of a three-phase research project designed to explore the very long-term impact of STEM youth programs (such as the iconic YouthALIVE program). In this first phase, a virtual conference was held to engage youth program practitioners in the development and testing of a Program Profile prototype, a structured document that helps institutions to characterize their own youth programs in useful ways.
Following the webinars and the completion of the Program Profile by each organization, participants were asked to complete a brief survey (included as
Considering whether to volunteer to be an NSF AISL reviewer? Here’s some information to help you decide if you are a good fit. Each year, the NSF Advancing Informal STEM Learning program looks for peer reviewers. New reviewers often have questions about the commitment to review. This slide deck is to help you understand what reviewers do and the commitments they make considering issues about time commitment, activities, money, etc.
In this case study, we highlight the work of the Bay Area STEM Ecosystem, which aims to increase equity and access to STEM learning opportunities in underserved communities. First, we lay out the problems they are trying to solve and give a high level overview of the Bay Area STEM Ecosystem’s approach to addressing them. Then, based on field observations and interviews, we highlight both the successes and some missed opportunities from the first collaborative program of this Ecosystem. Both the successes of The Bay Area STEM Ecosystem--as well as the partners’ willingness to share and examine
The landscape for out-of-school STEM learning in Hong Kong is evolving. In 2017, to capture this change, the Croucher Foundation conducted a mapping exercise. This is the second annual mapping exercise conducted by the Croucher Foundation.
The study reveals a rich and vibrant ecosystem for out-of-school STEM in Hong Kong with almost 2,000 discrete activities covering a very wide range of science disciplines. This second report indicates extremely rapid growth in available out-of-school STEM activities compared to 2016 and an even larger increase in the number of organisations offering out
How do afterschool programs view their local public libraries? Are they working with them, and in what ways? These are the questions that the Afterschool Alliance, along with its partners at the Space Science Institute’s National Center for Interactive Learning (NCIL) and the American Library Association, wanted to answer. Overall, our goal is to build bridges between the afterschool and library fields, so that both can share knowledge and resources to better serve our youth. While our work together has primarily focused on science, technology, engineering, and math (STEM) education through
As part of its overall effort to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program, seeks to advance new approaches to, and evidence-based understanding of, the design and development of science, technology, engineering, and mathematics (STEM) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. In alignment with these aims, the University of Washington will design and pilot an innovative leadership development program, NextGen Broadening Participation in ISE Professional Learning Program, to develop the leadership capacity of mid-career professionals, primarily from underrepresented groups in STEM, whose work focuses on broadening participation in informal STEM education (ISE). Unlike most existing ISE leadership models, this pathways project will employ a bottom-up, iterative design approach to engage program participants and garner new insights. Formative data and analysis will be used to better understand the broadening participation context, inform the model, and develop strategies and resources necessary to best support a more diversified next generation of ISE leaders. This pilot study is timely and significant. There is currently a substantial dearth of literature on the intersection between broadening participation and mid-level professional leadership development. Likewise, there are few comparable models in the current AISL portfolio. As such, the findings from this pilot will address critical gaps in the AISL portfolio and in the field, at large. It has the potential to markedly transform the capacity and impact of next generation ISE leaders. Over an eighteen-month period, this feasibility study will design, implement and test key aspects of the model to determine its potential for short and long term success. Using a competitive application process, twenty ISE mid-career professionals, who work primarily within broadening participation in STEM contexts, will be recruited to participate in the NextGen Broadening Participation in ISE Professional Learning Program. The year-long program includes four core components: (a) 4-day workshop, (b) four online webinars, (c) pilot projects carried out in participants' home institutions, and (d) poster presentations of projects at a national conference. A small cohort of faculty-mentors -- leaders from both research and practice in ISE broadening participation efforts -- will serve as participant mentors and play an integral role in the design and implementation of the program. Evaluative efforts will focus on documenting the efficacy of the design strategies (ex., recruitment, mentorship, social networking), the interests, needs, and professional growth of participants and the implications for broadening participation in STEM. The evaluation will be informed by data collected via interviews, surveys, focus groups, observations, content analyses of discourse, and participant deliverables. Formative and summative external evaluations will be conducted by the Garibay Group.
Informal science educators, researchers, and evaluators are interested in directly engaging with the challenges and opportunities of increasing diversity and meaningful intersectionality. The annual meetings of organizations like the American Alliance of Museums (AAM), the Association of Science and Technology Centers (ASTC), and the Visitors Studies Association (VSA) have consistently featured sessions relevant to these topics. NSF's goal of broadening participation means there are also project specific efforts currently underway to directly address methods and strategies for increasing diversity and inclusion in STEM. The Connected Audience Conference will provide an opportunity to engage in an international conversation that directly leverages this momentum and has the potential to motivate focused collective action among participants producing a greater impact on the field. This travel award supports an enhanced U.S. presence at the Connected Audience International Conference to be held in Vienna, Austria September 14-16, 2017. The premise of the meeting is that the role of museums and other cultural institutions in society is rapidly changing as these institutions strive to become more vital resources and partners in initiatives designed to support science learning, social development and growth in an increasingly science and technology-driven world. The goal for U.S. participation is to support established researchers in this area as well as mid-career professionals. The meeting is comprised of: thought leaders, case study presenters, poster presenters and general participants. Thought leaders will highlight theoretical and practical approaches to broadening participation designed to be provocative and stimulate discussion in the breakout sessions. Case study presenters will be paired to illustrate similarities and/or differences in project design, implementation, or outcomes. Structuring the case studies in this way supports conversations focused on cross-country and cross-institution synergies. The poster session presenters were selected and grouped to encourage productive and comparisons specifically exploring the potential for cross-cutting methods to more effectively engage with audiences. U.S. attendees supported under this travel grant represent those who are engaged in this work actively and positioned to continue making important contributions to the field. International participants represent a range of cultural institutions with the largest proportion attending from science centers and children's museums; however, all participants come because of their interest, concerns and expertise in issues related to equity and greater participation. The structure of the meeting will provide participants with significant time for iterative reflection and active discussion to make each session personally relevant and meaningful. This intentionally allows lots of room for pushback and even outright disagreement with any of the ideas proposed by the thought leaders, case study presenters, and poster session presenters. This award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences. The Connected Audience conference is designed to significantly contribute to an international conversation about the future of informal science education institutions in the learning ecologies of 21st century citizens. Through exploration of new findings and international cross-pollination of best practices, conference participants will be able to develop improved strategies for increasing and diversifying who participates in informal science education experiences as well as how they participate. A white paper written by the U.S. participants will be used to share findings and insights with the broader informal education field.
Merging art and science, "Self Reflected" aims to communicate the incredible complexity of the neural signaling in our brains that makes us who we are. The artists, Dr. Greg Dunn and Dr. Brian Edwards, invented a novel technique called reflective microetching to simulate the microscopic behavior of neurons in the viewer’s brain as they observe this work of art. "Self Reflected" is currently on display in the Your Brain exhibit at The Franklin Institute in Philadelphia. This summative evaluation study explores museum visitors’ behavior, reactions, and learning outcomes as they interact with