Informal Science, Techology, Engineering, and Mathematics (STEM) institutions seek to contribute to a scientifically literate culture, which includes new and innovative learning opportunities, a diverse community of scientists and science educators, equitable treatment for all, and the development of a well-trained workforce. In order to achieve these goals, informal STEM institutions must provide learning experiences that are welcoming and productive for all learners. The iPAGE model is a comprehensive program that prepares teams within informal STEM institutions to work with their colleagues to make their institutions more inclusive learning environments in which to learn, engage in, and identify with STEM. The project incorporates learning modules, workshops, site visits, and institution-specific activities all geared to build knowledge, awareness, and capacity related to creating inclusive environments at informal STEM institutions. The core iPAGE model is based on the US Department of Agriculture's agricultural extension service. It includes a Knowledge-to-Action approach, in which individuals adapt what they learn to local contexts by assessing barriers to knowledge use, selecting and implementing interventions, evaluating outcomes, and sustaining ongoing efforts. Through cycles of design-based iteration, the project will improve its practice, learning modules, and theory of action. Through surveys, interviews, and case studies, the research team will document learning, barriers to implementation, and culture change as teams and institutions seek to become more welcoming, diverse, and inclusive institutions. This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Informal learning, and by extension, museums, are inherently emotional experiences, evoking feelings of awe, excitement, and curiosity. Oftentimes, museum professionals have prioritized traditionally positive emotions such as excitement and interest as being the most desirable and useful in supporting museum learning. However, prior research into naturally occurring emotions at museums found that some visitors who experienced negative emotions, such as confusion or frustration, at exhibits also reported deeper engagement and overall feelings of satisfaction (Rappolt-Schlichtmann et al., 2017). Based on these findings and similar results from formal education (D’Mello et al., 2014), this project team has worked to develop and refine a framework of strategies for creating exhibits that invoke and support visitors through the complex emotional state called productive struggle (PS) which is defined as a three-part emotional arc characterized by: 1) disequilibrium (experienced emotionally as emotions like confusion, frustration, surprise, or unease) that arises from encountering a challenging task, phenomenon, or idea, 2) persistence through the task which is supported by exhibit design scaffolds, and 3) an emotionally productive resolution tied to the source of disequilibrium or an overall sense of effortful achievement. In deliberately attending to and supporting a range of negative and positive emotions in museums, visitors can gain access to a wider variety of complex emotional experiences, including those critical to STEM learning, and have potential to broaden participation in STEM by supporting learners' diverse emotional needs and preferences.
This multidisciplinary project team consisting of researchers and exhibit professionals utilized a design-based research (DBR) process to develop, test, and refine a definition of museum-based productive struggle, and create a framework of design strategies that support PS. Three physical exhibits and a virtual exhibit were created during this multi-year project. Additionally, a summative research study was conducted with 105 youth ages 10-17 to explore: 1) whether visitors experienced the expected emotional arc of PS; 2) how exhibit design strategies supported PS; and 3) the extent of visitors’ learning and engagement at these PS exhibits.
The connections between technology applications of all sorts and human users that are ubiquitous in informal learning and assume a great deal about how the technology is used and how learning takes place. Much of the research in this area has been focused on game design and interaction. This project will examine this interaction involving the use of gestures that represent how individuals work with systems and large data sets that represent complex systems like the oceans, to understand how basic elements of a project with a 3-D type of design might enhance the user experience and increase the utility and learning that takes place by understanding the cognitive elements of these game like interactions in specific STEM related settings like museums.
This exploratory pathways project will investigate the use of interactive, gesture-enabled, multi-touch spheres for teaching about ocean systems in science centers and museums. The gesture-enabled aspect of the project will improve on interactive table-top installations which can frustrate users who use unexpected gestures and receive no response leading to brief interaction and abandonment without significant interaction or learning. The project will investigate ways in which unsupported gestures would still produce a system response which would encourage the user to remain at the installation and continue to investigate. The effect of multiple gestures will be supported by using natural mappings between gestures and interactions with the on-sphere data.
The project investigates theories of embodied cognition that support the notion that by engaging with global-scale datasets on a spherical display more effectively models the earth in a non-distorted manner and therefore will be more natural and allow users to develop a more accurate conceptual model of how data relates to itself and the globe. In this way, the project shares some aspects of understanding about learning through game play. The sphere will not be a fully developed game but will share characteristics of game play.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The Wayne State University Math Corps is a mathematics enrichment and mentoring program that operates during summers and on Saturdays. The curriculum and the teach pedagogies in this informal learning program have documented success of supporting youths' mathematics learning as well as raising achievement levels in school. Through rigorous research and evaluation, this project seeks to analyze and understand the nature, extent, and reasons for Math Corps' success with youth learning in Detroit as well as the processes of program replication in three sites: Cleveland, OH; Utica, NY; and Philadelphia, PA. As such, this project will deepen understandings of program replication and of addressing the needs of youth in economically-challenged communities in order to promote mathematics learning.
The project's research studies will assess the multiple factors that make Math Corps successful with youth in Detroit and document the implementation of the program to the three replication sites. Research methods include discourse analyses, surveys, interviews, and pre/post-tests. The project will also conduct a retrospective evaluation of Math Corps based on quantitative datasets regarding both near-term and long-term youth outcomes.
This projects is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Steve KahnStephen ChrisomalisTodd KubicaCarol Philips-BeyFrancisca Richter
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This Research in Service to Practice project will examine how a wide range of pre-college out-of-school-time activities facilitate or hinder females' participation in STEM fields in terms of interest, identity, and career choices. The study will address the ongoing problem that, despite females' persistence to degree once declaring a major in college, initially fewer females than males choose a STEM career path. To uncover what these factors might be, this study will look at the extent to which college freshmen's pre-college involvement in informal activities (e.g., science clubs, internships, shadowing of STEM professionals, museum-going, engineering competitions, citizen science pursuits, summer camps, and hobbies) is associated with their career aspirations and avocational STEM interests and pursuits. While deep-seated factors, originating in culture and gender socialization, sometimes lower females' interest in STEM throughout schooling, this study will examine the degree to which out-of-school-time involvement ameliorates the subtle messages females encounter about women and science that can interfere with their aspiration to a STEM careers.
The Social Cognitive Career Theory will serve as the theoretical framework to connect the development of interest in STEM with students' later career choices. An epidemiological approach will be used to test a wide range of hypotheses garnered from a review of relevant literature, face-to-face or telephone interviews with stakeholders, and retrospective online surveys of students. These hypotheses, as well as questions about the students' demographic background and in-school experiences, will be incorporated into the main empirical instrument, which will be a comprehensive paper-and-pencil survey to be administered in classes, such as English Composition, that are compulsory for both students with STEM interests and those without by 6500 students entering 40 large and small institutions of higher learning. Data analysis will proceed from descriptive statistics, such as contingency tables and correlation matrices, to multiple regression and hierarchical modeling that will link out-of-school-time experiences to STEM interest, identity, and career aspirations. Factor analysis will be used to combine individual out-of-school activities into indices. Propensity score weighting will be used to estimate causal effects in cases where out-of-school-time activities may be confounded with other factors. The expected products will be scholarly publications and presentations. Results will be disseminated to out-of-school-time providers and stakeholders, educators, and educational researchers through appropriate-level journals and national meetings and conferences. In addition, the Public Affairs and Information Office of the Harvard-Smithsonian Center for Astrophysics will assist with communicating results through mainstream media. Press releases will be available through academic outlets and Op-Ed pieces for newspapers. The expected outcome will be research-based evidence about which types of out-of-school STEM experiences may be effective in increasing young females' STEM interests. This information will be crucial to educators, service providers, as well as policy makers who work toward broadening the participation of females in STEM.
DATE:
-
TEAM MEMBERS:
Roy GouldPhilip SadlerGerhard Sonnert
resourceprojectProfessional Development, Conferences, and Networks
With support from NSF/AISL, the Exploratorium held the Generating Engagement and New Initiatives for All Latinos (GENIAL) Summit on June 5-6, 2017, in San Francisco, California.
The goals of the GENIAL Summit were to:
- Identify needs and opportunities for Latinos in informal science learning (ISL) environments.
- Facilitate and strengthen professional relationships.
- Identify recommendations and actionable insights with an outlook toward the future.
- Contribute to a more informed ISL field.
A total of 91 participants, a mix of practitioners, community leaders, media specialists, government officials, policy professionals, and researchers from across the United States and Puerto Rico participated in the Summit.
Summit outcomes will include: strengthened partnerships and new collaborations; examples of how participants of the GENIAL summit are applying the results of the gathering in their practice; and dissemination sessions, webinars, and post-summit documentation and articles with the results of GENIAL.
Currently, many young people - especially girls and youth of color - lose confidence and interest in science, technology, engineering and math (STEM) pathways due to a perceived disconnect between their own identity and STEM fields. To address this challenge, Twin Cities PBS (TPT) is implementing SciGirls CONNECT2. This three-year Research in Service to Practice award examines how gender equitable and culturally responsive teaching strategies influence middle school girls' confidence, interest and motivation around STEM studies, and their choices around STEM careers. A set of research-based strategies, called the SciGirls Seven, are currently employed in SciGirls, an NSF-funded informal STEM educational outreach program serving 125+ educational partner organizations nationwide. The goal is to update and enrich the SciGirls Seven, providing educators with a critical, current, and more effective resource to motivate girls in STEM studies and careers. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Florida State University will conduct a formal research study investigating the hypothesis that STEM programs that use gender equitable and culturally responsive strategies contribute to girls' positive STEM identity development, including their sense of self-efficacy, persistence and aspirations around future STEM careers. This research will include a literature review and a study of girls' STEM identity creation. The mixed methods study will include quantitative and qualitative data collection and analysis measuring changes in students' STEM identity and teachers' confidence in STEM teaching. The quantitative data will come from the student, parent and teacher pre/post surveys. The qualitative research will be conducted via case studies at four sites and the qualitative data will include observations, focus groups and interviews. Girls at all partner sites will create videos that will allow the research team to gather additional insight. The independent firm Knight Williams, Inc. will conduct the project's external evaluation.
The project will work with a subset of 16 current SciGirls partners. These geographically diverse partners will reach youth in all-girls and co-ed informal STEM education programs in a variety of settings. More than half serve Hispanic or other minority populations. The updated strategies will be disseminated to the 2,500 educators within the SciGirls partner network and the 18,800 STEM education organizations of the National Girls Collaborative Project (NGCP) network. Dissemination of the strategies and literature review will focus on the informal STEM education field through publications and presentations, posts at PBS LearningMedia, a free online space reaching 1.5 million teachers and educators.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds efforts that seek to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will achieve these aims by identifying and closely evaluating critical factors and processes that are necessary to effectively broaden access and sustain professional learning (PL) for educational professionals working within informal STEM learning (ISL) settings. The context for this work builds on an evidence-based and nationally field tested professional learning model, Reflecting on Practice (RoP). This model will be refined to provide ISL educators with increased access to a proven PL curriculum via an in-person or blended approach, enhanced localized support, and cultivated regional professional learning communities. There is still little known about the effectiveness of blended PL within informal contexts. The emphasis on greater accessibility to PL is particularly important to the ISL field, given the significant number of informal STEM educators and institutions in underserved and remote locations, often facing disparate and insurmountable challenges in access to high quality STEM professional development. This modular program will not only target a broad range of informal institutions; varying in size, STEM content foci, geographic location and communities served but it is also uniquely designed for institutional customization and adoption, further increasing the likelihood of wide-spread uptake, participation, and engagement. If successful, this broad implementation effort will directly impact over 3,000 informal science educators and professionals in nearly 350 informal STEM learning institutions across the country. The intended theory of action and iterative, design-based implementation approach will be closely monitored, documented and analyzed by an experienced team of external evaluators, using formative and summative evaluative methods. A mixed methods approach will be employed to: (a) examine the effectiveness and accessibility of blended PL and regional PLCs for the ISL field, (b) identify critical design features in blended PL and regional PLCs for impacting educators' practice, (c) determine how PLCs can develop and continue in ISL through looking at what system of support is needed, and (d) ascertain the effective role of the Leaders and Leadership Sites. Data will be collected at all levels - from the RoP directors and PIs, document reviews, interviews and observations with RoP leaders at the six partnering institutions, and surveys with the RoP facilitators (n=700) and informal STEM educator participants (n=2,000). The results of the findings could be instrumental in the development of future frameworks and models designed to broadly disseminate similar professional learning models effectively within ISL contexts.
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. In this project, the primary goal of Geo-literacy Education in Micronesia is to demonstrate the potential for effective intergenerational, informal learning and development of geo-literacy through an Informal STEM Learning Team (ISLT) model for Pacific island communities. This will be accomplished by means of a suite of six informal learning modules that blend local/Indigenous approaches, Western STEM knowledge systems, and active learning. This project will be implemented across 12 select communities in the Republic of Palau, the Federated States of Micronesia - which consists of the four States of Chuuk, Kosrae, Pohnpei, and Yap - and the Republic of the Marshall Islands. Jointly, these entities are referred to as the Freely Associated States (FAS). Geo-literacy refers to combining both local knowledge and Western STEM into a synthesized understanding of the world as a set of interconnected, dynamic physical, biological, and social systems, and using this integrated knowledge to make informed decisions. Applications include natural resource management, conservation, and disaster risk reduction. The project will: (1) demonstrate that the recruitment and development of an ISLT model is an effective method of engaging communities in geo-literacy activities; (2) increase geo-literacy knowledge and advocacy skills of ISLT participants; (3) produce and disseminate geo-literacy educational materials and resources (e.g., place-based teaching guides, geospatial data systems, educational apps, 2-D and 3-D models, and digital maps); and (4) provide evidence that FAS residents use these geo-literacy educational materials and resources to positively influence decision-making.
DATE:
-
TEAM MEMBERS:
Corrin BarrosKoh Ming WeiDanko TabrosiEmerson Odango
As part of an overall strategy to enhance learning within maker contexts in formal and informal environments, the Innovative Technology Experiences for Students and Teachers (ITEST) and Advancing Informal STEM Learning (AISL) programs partnered to support innovative models for making in a variety of settings through the Enabling the Future of Making to Catalyze New Approaches in STEM Learning and Innovation Dear Colleague Letter. This Early Concept Grant for Exploratory Research (EAGER) will test an innovative approach to bringing making from primarily informal out-of-school contexts into formal science classrooms. While the literature base to support the positive outcomes and impacts of design-based making in informal settings at the K-12 level is emerging, to date, minimal studies have investigated the impacts of making design principles within formal contexts. If successful, this project would not only add to this gap in the literature base but would also present a novel model for bridging the successful engineering design practices of making and tinkering primarily found in informal science education into formal science education classrooms. The model would also demonstrate an innovative, highly interactive way to engage high school students and their teachers in engineering based design principles with immediate real-world applications, as the scientific instruments developed in this project could be integrated directly into science classrooms at relatively minimal costs.
Through a multi-phased design and implementation model, high school students and their teachers will engage deeply in making design principles through the design and development of their own scientific instruments using Arduino-compatible hardware and software. The first phase of the project will reflect a more traditional making experience with up to twenty high school students and their teachers participating in an after-school design making club, in this case, focused on the development and testing of scientific instrument prototypes. During the second phase of the project, the first effort to transpose the after school making experience to a more formalized experience will be tested with up to eight students selected to participate in two week summer research internships focused on scientific instrument design and development through making at Northwestern University. A two-day summer teacher workshop will also be held for high school teachers participating in the subsequent pilot study. The collective insights gleaned from the after school program, student internships, and teacher workshop will culminate to inform the full implementation of the formal classroom pilot study. The third and final phase will coalesce months of iterative, formative research, design and development, resulting in a comprehensive pilot investigation in up to seven high school physics classrooms.
Using a multi-phased, mixed methods exploratory design-based research approach, this 18-month EAGER will explore several salient research questions: (a) How and to what extent does the design & making of scientific instrumentation serve as useful tasks for learning important science and engineering knowledge, practices, and epistemologies? (b) How engaging is this making activity to learners of diverse abilities and prior interests? What can be generalized to other types of making activities? (c) How accessible is the Arduino hardware and coding environment to learners? What combination of hardware and software materials and tools best support accessibility and learning in this type of digital making activity? and (d) What types of scaffolding (for students and teachers) are required to support the effective use of maker materials and activities in a classroom setting? Structured interviews, artifacts, video recordings from visor cameras, student design logs, logfiles, and ethnographic field notes will be employed to garner data and address the research questions. Given the early stage of the proposed research, the dissemination of the findings will be limited to a few select journals, teacher forums and workshops, and professional conferences.
This EAGER is well-poised to directly impact up to 125 high school physics students (average= 25 students/class), approximately 7 high school physics teachers, 6-8 high school summer interns, nearly 20 high school students participating in the after-school design making club, and indirectly many more. The results of this EAGER could provide the basis and evidence needed to support a more robust, expanded future investigation to further substantiate the findings and build the case for similar efforts to bring making into formal science education contexts.
The Center for Advancement of Informal Science Education (CAISE) is a National Science Foundation (NSF) funded resource center, working in cooperation with the NSF Advancing Informal STEM Learning (AISL) program to build and advance the informal STEM education field. CAISE continues the work it began in 2007--serving professional audiences in informal STEM learning, which includes those working in science centers and museums, zoos and aquariums, parks, botanical gardens and nature centers, events and festivals, libraries, making and tinkering spaces, media (TV, radio, film, social), cyberlearning and gaming, and youth, community, and out-of-school time programs.
What We Do:
CAISE seeks to characterize, highlight, and connect quality, evidence-based informal STEM learning work supported by a diversity of federal, local, and private funders by providing access to over 8,000 (and growing) resources that include project descriptions, research literature, evaluation reports and other documentation on the InformalScience.org website. In addition, CAISE convenes inquiry groups, workshops and principal investigator meetings designed to facilitate discussion and identify the needs and opportunities for informal STEM learning.
In this award, CAISE is also tasked with advancing and better integrating the professional fields of informal STEM learning and science communication by (1) broadening participation in these fields, (2) deepening links between research and practice, and (3) building capacity in evaluation and measurement. These activities are being undertaken by cross-sector task forces of established and emerging who will be responsible for conducting field-level analyses, engaging stakeholders, and creating roadmaps for future efforts. CAISE is also building on existing communication channels for dissemination to the larger field, and through the InformalScience.org website. An External Review Board and Inverness Research are providing oversight of CAISE's program activities and evaluation of the center.
Who We Are:
CAISE operates as a network of core staff housed at the Association of Science-Technology Centers (ASTC) in Washington, D.C. and co-principal investigators and other collaborators at academic institutions and informal STEM education (ISE) organizations across the U.S. Other key collaborators are the American Association for the Advancement of Science's Center for Public Engagement with Science, the National Informal STEM Education Network, and Arizona State University.
Citizen science refers to partnerships between volunteers and scientists that answer real world questions. The target audiences in this project are middle and high school teachers and their students in a broad range of settings: two urban districts, an inner-ring suburb, and three rural districts. The project utilizes existing citizen science programs as springboards for professional development for teachers during an intensive summer workshop. The project curriculum helps teachers use student participation in citizen science to engage them in the full complement of science practices; from asking questions, to conducting independent research, to sharing findings. Through district professional learning communities (PLCs), teachers work with district and project staff to support and demonstrate project implementation. As students and their teachers engage in project activities, the project team is addressing two key research questions: 1) What is the nature of instructional practices that promote student engagement in the process of science?, and 2) How does this engagement influence student learning, with special attention to the benefits of engaging in research presentations in public, high profile venues? Key contributions of the project are stronger connections between a) ecology-based citizen science programs, STEM curriculum, and students' lives and b) science learning and disciplinary literacy in reading, writing and math.
Research design and analysis are focused on understanding how professional development that involves citizen science and independent investigations influences teachers' classroom practices and student learning. The research utilizes existing instruments to investigate teachers' classroom practices, and student engagement and cognitive activity: the Collaboratives for Excellence in Teacher Preparation and Classroom Observation Protocol, and Inquiring into Science Instruction Observation Protocol. These instruments are used in classroom observations of a stratified sample of classes whose students represent the diversity of the participating districts. Curriculum resources for each citizen science topic, cross-referenced to disciplinary content and practices of the NGSS, include 1) a bibliography (books, web links, relevant research articles); 2) lesson plans and student science journals addressing relevant science content and background on the project; and 3) short videos that help teachers introduce the projects and anchor a digital library to facilitate dissemination. Impacts beyond both the timeframe of the project and the approximately 160 teachers who will participate are supported by curriculum units that address NGSS life science topics, and wide dissemination of these materials in a variety of venues. The evaluation focuses on outcomes of and satisfaction with the summer workshop, classroom incorporation, PLCs, and student learning. It provides formative and summative findings based on qualitative and quantitative instruments, which, like those used for the research, have well-documented reliability and validity. These include the Science Teaching Efficacy Belief Instrument to assess teacher beliefs; the Reformed Teaching Observation Protocol to assess teacher practices; the Standards Assessment Inventory to assess PLC quality; and the Scientific Attitude Inventory to assess student attitudes towards science. Project deliverables include 1) curriculum resources that will support engagement in five existing citizen science projects that incorporate standards-based science content; 2) venues for student research presentations that can be duplicated in other settings; and 3) a compilation of teacher-adapted primary scientific research articles that will provide a model for promoting disciplinary literacy. The project engages 40 teachers per year and their students.
DATE:
-
TEAM MEMBERS:
Karen OberhauserMichele KoomenGillian RoehrigRobert BlairAndrea Lorek Strauss