In May, 2017, the University of Michigan School of Information hosted an NSF-funded workshop on the promise and pitfalls of using digital micro-credentials, also known as digital badges, in the college admission process. Micro-credentials are digital artifacts that can be used to recognize, display, and transmit information about an individual student’s skills, abilities, and knowledge. Modeled on the physical badges used by organizations such as the Boy/Girl Scouts of America, and websites such as Stack Overflow, micro-credentials offer learners a mechanism for displaying and sharing a wider
DATE:
TEAM MEMBERS:
Barry FishmanStephanie TeasleySteven Cederquist
MobiLLab is a mobile science education program designed to awaken young people’s interest in science and technology (S&T). Perceived novelty, or unfamiliarity, has been shown to affect pupils’ educational outcomes at similar out-of-school learning places (OSLePs) such as museums and science centers. A study involved 215 mobiLLab pupils who responded to three surveys: a pre-preparation, at-visit, and post-visit survey. Results provide evidence for four dimensions of pupils’ at-visit novelty: curiosity, exploratory behavior, oriented feeling, and cognitive load. Findings also show that classroom
STEM out-of-school time (OST) programs play an important role in helping youth develop the 21st century skills they need to prepare them for the workforce, particularly the teamwork skills necessary for the growing collaborative nature of work in STEM (National Research Council, 2015). However, there is a lack of appropriate tools to evaluate this key programmatic outcome in STEM OST settings. Through funding from the National Science Foundation, we carried out the Collaboration in the 21st Century (C2C) project to help address this need by developing and validating a survey, the Youth
Twenty-first century skills are vital for preparing youth for careers in science, technology, engineering, and math (STEM) fields. STEM out-of-school time (OST) programs play an important role in helping youth develop these skills, particularly the teamwork skills necessary for the growing collaborative nature of STEM jobs. However, there is a lack of appropriate measures to evaluate this key programmatic outcome in STEM OST settings. This dissertation research addresses the lack of measures through the development of an instrument to assess team communication skills in middle and high school
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. Informal STEM educational activities have proliferated widely in the US over the last 20 years. Additional research will further validate the long-term benefits of this mode of learning. Thus, elaborating the multitude of variables in informal learning and how those variables can be used for individual learning is yet to be defined for the circumstances of the learners. Thus, the primary objective of this work is to produce robust and detailed evidence to help shape both practice and policy for informal STEM learning in a broad array of common circumstances such as rural, urban, varying economic situations, and unique characteristics and cultures of citizen groups. Rather than pursuing a universal model of informal learning, the principal investigator will develop a series of comprehensive models that will support learning in informal environments for various demographic groups. The research will undertake a longitudinal mixed-methods approach of Out of School Time/informal STEM experiences over a five-year time span of data collection for youth ages 9-19 in urban, suburban, town, and rural communities. The evidence base will include data on youth experiences of informal STEM, factors that exert an influence on participation in informal STEM, the impact of participation on choices about educational pathways and careers, and preferences for particular types of learning activities. The quantitative data will include youth surveys, program details (e.g. duration of program, length of each program session, youth/facilitator ratio, etc.), and demographics. The qualitative data will include on-site informal interviews with youth and facilitators, and program documentation. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Informal STEM education needs high quality program evaluation. Research is particularly needed on the relationship between STEM outcomes and positive youth development (PYD) / socio-emotional learning (SEL). This pilot and feasibility project involves a collaboration between experts in STEM education, out-of-school time programs (OST), PYD, SEL, evaluation, and program development. STEM Scouts helps youth grow in character and develop skills using experiential activities and interaction with STEM professionals. This project expands the implementation of the Systems Evaluation Protocol (SEP), an evidence-based approach to evaluation planning.
The goals are to: 1) develop a theory of change for STEM Scouts highlighting the relationship between STEM outcomes and PYD/SEL outcomes; 2) pilot enhancements to the SEP (System Mapping, Ecosystem Modeling, and Model Validation); and, 3) determine the feasibility of conducting a national STEM Scouts study. STEM Scouts leadership and project researchers will work through the SEP to generate a stakeholder map, logic model, and pathway model (PM). Five STEM Scouts Labs across the country will participate in focus groups where they will complete SM to identify the system in which the Lab exists (e.g., stakeholders and decision-makers), review and revise their system maps, identify key outcomes and connections in the PM, and discuss how the PM reflects their STEM Scouts experiences. It is hypothesized the enhanced SEP will enable the working group to better understand factors hindering or enabling program and evaluation feasibility and success. Findings will be disseminated to the evaluation/research community, OST program providers/developers and the public.
This project is funded by the National Science Foundation's Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Gathering evidence for the long-term impact of programs for youth on their involvement in STEM studies and careers continues to be a challenge, especially for program interventions happening in earlier stages of development (e.g., elementary, middle, high-school years. Work that focuses on mechanisms for mitigating these challenges is important. The conference and associated activities aim to build a research action agenda that is rooted in practice to support better understanding of the long-term impacts of informal STEM programs for girls provided by cultural institutions, along with methods and approaches for measuring them. The project team will use a collaborative co-design approach to establish a STEM for Girls Research Alliance. The Alliance will include three levels of participants, with different levels of commitment: a core planning group (CPG) of 8-10 people, approximately 20-25 participating members (PM) and 50-60 interested stakeholder group representatives (SGR). The project team will utilize face-to-face meetings, digital engagement strategies, and surveys to develop the agenda and solicit multiple rounds of feedback and input. The CPG, consisting of leaders and representatives from state-based STEM for Girls organizations that are part of the National Girls Collaborative Project (NGCP) and members of the New York State STEAM for Girls Collaborative, will be responsible for setting priorities and guiding the action agenda. The PM will include representatives (educators and researchers) from informal STEM programs at cultural institutions that participate in the state-based collaboratives. The PM will be regularly consulted on important aspects of the action agenda that relate to their work. Finally, the SGR will include representatives from several audiences that are being served by or work with the participating members: girls and young women, parents, educators, funders, researchers and employers. The SG will be engaged via focus groups virtually or at national meetings to which these individuals attend.
To support broader involvement of professionals working in this sector, a comprehensive digital engagement plan using web and social media networks will be developed. The plan will utilize a consistent hashtag, #STEMeffect, allowing participants to follow the conversation across social media platforms. Social media platforms to be utilized will include Twitter, Instagram, Facebook, LinkedIn, Google+, Snapchat and others. More than 60,000 people will be engaged via the networks of the NY STEAM Collaborative, NGCP, WSKG Public Media and project partners. A robust research action plan will position researchers to further explore the role of informal STEM education experiences in shaping the career choices of girls and identify where there are breaks in the hoped-for pathways to STEM college and careers. It also will benefit informal STEM organizations by yielding information that will help them to fine-tune their programs for girls and young women. Ultimately, contributions to the knowledge base will result in broadened participation of girls and women in STEM programs and careers. This work is funded by the Advancing Informal STEM Learning (AISL) program as part of its strategy to enhance learning in informal environments and support innovative research, approaches, and resources for use in a variety of settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Lynda KennedyAlicia SantiagoBabette Moeller
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Museum of Science, Boston (MOS) and Boston University (BU) will conduct a Pilot and Feasibility Study project that leverages the current Living Laboratory (LL) model and expand it to engage high school students (teens) in experimental psychology research, science communication and science education activities. In LL, which is now an extensive network of museums and university researchers across the country, scientists and museum staff collaborate to engage children in studies on the museum floor and educate caregivers about the research. Multi-site implementation and evaluation of LL has also documented positive impacts for undergraduate researchers. Many sites are eager to extend these benefits to high school students by engaging them as practitioners within the model and by providing them with opportunities to engage in current research, education and communication, thereby helping to foster stronger youth identities with science and its applications in society. This project expands a ten-year LL partnership between MOS and BU to: 1) pilot a program in which high school students both conduct scientific research and engage the public in learning about science; 2) explore strategies for museums and universities to collaboratively engage, support and mentor high school students in science research, communication and education activities; 3) document curricular, other programmatic, and evaluation materials; and 4) convene professional participants to provide feedback on pilot materials, and assess the viability of implementing similar programs at additional sites. Guided by developmental evaluation, these activities will generate knowledge for the field, and act to increase professional capacity to integrate experiences for teens at multiple LL sites in future projects. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Many of the nation's poorest-performing schools are in rural areas. Anecdotal information suggests participation in and access to informal STEM learning opportunities in Mississippi - a state with among the lowest STEM-career readiness in the nation - is unequally distributed among geographic regions and sociocultural environments. Informal learning programs in science, technology, engineering, and math (STEM) have the potential to reach into rural communities and provide a bridge to greater STEM access, literacy, and career readiness. Building Bridges: Broadening the STEM Conversation in Rural Mississippi will initiate a dialog among key practitioners, experts, and stakeholders in informal STEM learning focused on identifying the causes of and solutions to STEM inclusion barriers among rural youth. The goal of this Advancing Informal STEM Learning (AISL) Conference Project aligns with NSF's mission to promote the progress of science for all segments of society, including rural K-12 students. Solutions to STEM disconnections identified in Mississippi through this project will have relevance and transferability to rural communities across the southeastern US, given regional commonalities in socioeconomic, educational, and cultural factors.
This project aims to conduct an interactive and participant-based summit that brings together key leaders and experts from informal science learning institutions and organizations, STEM-related agencies and industries, and rural community groups to improve methods for linking informal STEM learning opportunities with rural, K-12 students. The goal of the project is to identify the common barriers and explore potential solutions to informal STEM participation by rural K-12 students in Mississippi. With the guidance of a steering committee, a Mississippi STEM Consortium will be formed and convened at a 2019 Mississippi Informal STEM Consortium Summit with the following goals: (1) Identify broad barriers to informal STEM learning in diverse and rural K-12 populations. (2) Define crucial and transformative elements in informal STEM programs deemed successful in rural student recruitment and engagement. (3) Improve collaborative networking to enhance the role of informal education in building statewide STEM capacity. These objectives will be met by developing, implementing, and evaluating statewide needs-assessment surveys and a two-day summit of Consortium members. The project evaluator will ensure process and outcome evaluations are properly conducted throughout the entire course of the project to inform planning, promote iterative improvement, monitor progress, and ensure achievement of desire objectives. With regards to broader impacts, it is anticipated that outcomes from this project will have impact within and beyond Mississippi's borders. Expected project outcomes include scientific manuscripts on needs-assessment surveys, modified approaches to existing informal STEM activities, future research on identified informal STEM participation barriers and mitigation measures, new collaborations that broaden participation and expand future research, and a draft Informal STEM Strategic Plan for Mississippi. Varied dissemination methods will be used to communicate the findings broadly.
This conference project is funded by the AISL program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Leslie BurgerSarah LeeKatherine EcholsVemitra White
The historical under-representation of diverse youth in environmental science education is inextricably connected to access and identity-related issues. Many diverse youth with limited previous experience to the outdoors as a source for learning and/or leisure may consider environmental science as ‘unthinkable’. This is an ethnographic study of 16 diverse high school youths’ participation, none of who initially fashioned themselves as ‘outdoorsy’ or ‘animal people’, in a four-week summer enrichment program focused on herpetology (study of reptiles and amphibians). To function as ‘good’
Background: Some STEM outreach programs connect students to real-world problems and challenge them to work towards solutions. Research shows one-third of children between ages 5-17 in the U.S. are overweight. Socioeconomic status, race, and parental educational attainment all influence this issue as well as living in a rural or urban area. A rural high school STEM outreach program used a social media curriculum focused on healthy lifestyles and measured impact on the health of adolescents from these backgrounds.
Methods: Health screenings and college mentors were provided to 134
DATE:
TEAM MEMBERS:
Ann ChesterSara HanksSummer KuhnFloyd JonesTravis WhiteMisty HarrisBethany Hornbeck Sherron McKendallMary McMillionCathy MortonMallory SlusserR. Kyle Saunders
resourceresearchProfessional Development, Conferences, and Networks
This poster was presented at the 2018 Campus Office of Undergraduate Research Initiatives (COURI) Symposium in El Paso, TX. It describes an ethnographic study into the use of storytelling in science teaching.