MobiLLab is a mobile science education program designed to awaken young people’s interest in science and technology (S&T). Perceived novelty, or unfamiliarity, has been shown to affect pupils’ educational outcomes at similar out-of-school learning places (OSLePs) such as museums and science centers. A study involved 215 mobiLLab pupils who responded to three surveys: a pre-preparation, at-visit, and post-visit survey. Results provide evidence for four dimensions of pupils’ at-visit novelty: curiosity, exploratory behavior, oriented feeling, and cognitive load. Findings also show that classroom
DATE:
TEAM MEMBERS:
Rebecca Cors
resourceprojectProfessional Development, Conferences, and Networks
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
resourceprojectWebsites, Mobile Apps, and Online Media
The intent of this five-year project is to design, deliver, and study professional development for Informal Science Learning (ISL) educators in the arena of equity-focused STEAM (Science, Technology, Engineering, Art, and Mathematics) teaching and learning. While the strategy of integrating art and science to promote interest, identity, and other STEM-related learning has grown in recent years, this domain is still nascent with respect to a guiding set of best practices. Through prior work, the team has developed and implemented a set of design principles that incorporate effective practices for broadening participation of girls in science via science-art integration on the topic of the biology, chemistry and optics of "Colors in Nature." The continued initiative would impact the ISL field by providing a mechanism for ISL educators in museums, libraries and after-school programs to adopt and implement these STEAM design principles into their work. The team will lead long-term (12-18 months) professional development activities for ISL educators, including: 1) in-person workshops that leverage their four previously developed kits; 2) online, asynchronous learning activities featuring interactive instructional videos around their STEAM design principles; 3) synchronous sessions to debrief content and foster communities of practice; and 4) guided design work around the development or redesign of STEAM activities. In the first four years of the project, the team will work with four core institutional partners (Sitka Sound Science Center, Sno-Isle Libraries, the Fairbanks North Star Borough School District after-school program, and the Pima County Public Library system) across three states (Alaska, Washington, and Arizona). In the project's later stages, they will disseminate their learning tools to a broad, national audience. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project has three main goals: (1) To support ISL educators in offering meaningful STEAM activities, (2) To create institutional change among the partner organizations, and (3) To advance the ISL field with respect to professional development and designing for STEAM Programming. The research questions associated with the professional development activities address the ways in which change occurs and focus on all three levels: individual, institutional, and the ISL field. The methods are qualitative and quantitative, including videotaped observations, pre and post interviews, surveys and analysis of online and offline artifacts. In addition, the project evaluation will assess the implementation of the project's professional development model for effectiveness. Methods will include observations, interviews, surveys and Website analytics and program data.
Women continue to be underrepresented in computer science professions. In 2015, while 57% of professional occupations in the U.S. were held by women, only 25% of computing occupations were held by women. Furthermore, the share of computer science degrees going to women is smaller than any STEM field, even though technology careers are the most promising in terms of salaries and future growth. Research suggests that issues contributing to this lack of computer science participation begin early and involve complex social and environmental factors, including girls' perception that they do not belong in computer science classes or careers. Computer science instruction often alienates girls with irrelevant curriculum; non-collaborative pedagogies; a lack of opportunities to take risks or make mistakes; and a heavy reliance on lecture instead of hands-on, project-based learning. Computer science experiences that employ research-based gender equitable best practices, particularly role modeling, can help diminish the gender gap in participation. In response to this challenge, Twin Cities PBS (TPT), the National Girls Collaborative (NGC) and Code.org will lead Code: SciGirls! Media for Engaging Girls in Computing Pathways, a three-year project designed to engage 8-13 year-old girls in coding through transmedia programming which inspires and prepares them for future computer science studies and career paths. The project includes five new PBS SciGirls episodes featuring girls and female coding professionals using coding to solve real problems; a new interactive PBSKids.org game that allows children to develop coding skills; nationwide outreach programming, including professional development for informal educators and female coding professionals to facilitate activities for girls and families in diverse STEM learning environments; a research study that will advance understanding of how the transmedia components build girls' motivation to pursue additional coding experiences; and a third-party summative evaluation.
Code: SciGirls! will foster greater awareness of and engagement in computer science studies and career paths for girls. The PBS SciGirls episodes will feature girls and female computer science professionals using coding to solve real-world challenges. The project's transmedia component will leverage the television content into the online space in which much of 21st century learning takes place. The new interactive PBSKids.org game will use a narrative framework to help children develop coding skills. Drawing on narrative transportation theory and character identification theory, TPT will commission two exploratory knowledge-building studies to investigate: To what extent and how do the narrative formats of the Code: SciGirls! online media affect girls' interest, beliefs, and behavioral intent towards coding and code-related careers? The studies aim to advance understanding of how media builds girls' motivation to pursue computer science experiences, a skill set critical to building tomorrow's workforce. The project team will also raise educators' awareness about the importance of gender equitable computer science instruction, and empower them with best practices to welcome, prepare and retain girls in coding. The Code: SciGirls! Activity Guide will provide educators with a relevant resource for engaging aspiring computer scientists. The new media and guide will also reside on PBSLearningMedia.org, reaching 1.2 million teachers, and will be shared with thousands of educators across the SciGirls CONNECT and National Girls Collaborative networks. The new episodes are anticipated to reach 92% of U.S. TV households via PBS, and the game at PBSKids.org will introduce millions of children to coding. The summative evaluation will examine the reach and impact of the episodes, game and new activities. PIs will share research findings and project resources at national conferences and will submit to relevant publications. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Makerspaces and engineering design spaces have proliferated in science museums, schools, libraries, and community settings at a rapid pace. However, there is a risk that some of the same inequities that exist in the engineering field are being replicated in these settings. Research has provided evidence of persistent gaps between boys' and girls' levels of interest in engineering as it has been traditionally represented in informal learning environments, particularly in Making and engineering spaces. This Research-In-Service to Practice project intends to address this gap by employing a design-based research approach to examine if and to what extent narrative elements can interest and engage middle school girls in science, technology, engineering, and mathematics (STEM), and promote equitable, effective engineering design experiences and practices. This work is significant, as it will build upon current research and conceptual understanding of how to design narrative-rich engineering design activities for informal learning spaces, especially for girls, and within museum drop-in experiential learning contexts. It will also contribute to the evidence base regarding how girls approach and choose to persist in solving engineering design problems. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The New York Hall of Science (NYSCI) in collaboration with the Amazeum in Bentonville, Arkansas, the Tech Museum of Innovation in San Jose, California, the Creativity Labs at Indiana University and a team of advisors will conduct the 30-month, design-based research project in two phases. In the first phase, NYSCI will garner ongoing input from its partners to develop parallel versions of six pairs of engineering design activities, one with narrative elements and one without. These activities will be iteratively tested in NYSCI's Design Lab, a 10,000 square foot exhibition devoted to hands-on exploration of engineering design. Several research questions will be explored, focused primarily on building evidence-based design knowledge, establishing appeal and comprehensibility, and understanding facilitation. Observational and interview data will be garnered from 30 girls aged 7-14 and their family groups for each of the twelve activities developed, totaling 360 girls in the study sample. The results of the research on the paired activities will be iterative and provide insight on how narrative elements can most effectively invite girls into sustained engagement with the core engineering concepts and practices highlighted in each activity. In the second phase, formative and summative evaluation will be conducted to study the impact of the narrative and non-narrative versions of the engineering design activities on participating girls' engagement and persistence, by contrasting the quality of girls' engagement across the two types of activities while they are implemented across three museum sites. Project deliverables include journal articles reporting on project findings; documentation of activities that meet project goals; design guidelines for exhibit and curriculum developers who are interested in using narrative effectively to frame engineering design activities; and practical guidance for facilitators seeking to ensure that they are supporting girls effectively as they explore those activities.
In this case study, we highlight the work of the Bay Area STEM Ecosystem, which aims to increase equity and access to STEM learning opportunities in underserved communities. First, we lay out the problems they are trying to solve and give a high level overview of the Bay Area STEM Ecosystem’s approach to addressing them. Then, based on field observations and interviews, we highlight both the successes and some missed opportunities from the first collaborative program of this Ecosystem. Both the successes of The Bay Area STEM Ecosystem--as well as the partners’ willingness to share and examine
One way to encourage youth to pursue training in the STEM fields and enter the STEM workforce is to foster interest and engagement in STEM during adolescence. Informal STEM Learning Sites (ISLS) provide opportunities for building interest and engagement in the STEM fields through a multitude of avenues, including the programming that they provide for youth, particularly teens. Frequently, ISLS provide opportunities to participate in volunteer programs, internships or work, which allow teens both to learn relevant STEM knowledge as well as to share that knowledge with others through opportunities to serve as youth educators. While youth educator programs provide rich contexts for teens to engage as both learners and teachers in these informal STEM environments, research to date has not yet identified the relationship between serving as youth educators and STEM engagement. Thus, the goal of this project is to document the impact of youth educators on visitor learning in ISLS and to identify best practices for implementing youth educator programs. The project studies STEM interests and engagement in the youth participants and the visitors that they interact with at six different ISLS in the US and UK. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences.
This project examines youth educator experiences related to STEM identity, educational aspirations, and motivation. The project also identifies outcomes that the youth educators have on visitors to ISLS in terms of knowledge, interest, and engagement in STEM. The specific aims are: 1) Outcomes for Teens - To measure the longitudinal impact of participation in an extended youth educator experience in an ISLS; 2) Outcomes for Visitors - To compare visitor engagement with and learning from exhibits in ISLS when they interact with a youth educator, relative to outcomes of interacting with an adult educator or no educator; and 3) Outcomes Across Demographics and STEM Sites - To examine differences in visitor engagement based on participant characteristics such as socio-economic status (SES), age, gender, and ethnicity and to compare outcomes of youth educator experiences across different types of ISLS. This research, which draws on expectancy value theory and social cognitive theory, will follow youth participants longitudinally over the course of 5 years and use latent variable analyses to understand the impact on the youth educators as well as the visitors with whom they interact. Importantly, the results of this research will be used to develop best practices for implementing youth educator programs in ISLS and the results will be disseminated to both academic and practice-based communities.
This project has clear and measurable broader impacts in a variety of ways. First, the project provides guidance to improve programming for youth in ISLS, including both the sites involved directly in the research and to the larger community of ISLS through evaluation, development, and dissemination of best practices. Additionally, this project provides rigorous, research-based evidence to identify and describe the outcomes of youth educator programs. This study directly benefits the participants of the research, both the visiting public and the youth educators, through opportunities to engage with science. The findings speak to issues of access and inclusivity in ISLS, providing insight into how to design environments that are welcoming and accessible for diverse groups of learners. Finally, this project provides evidence for best practices for ISLS in developing programs for youth that will lead to interest in and pursuit of STEM careers by members of underrepresented groups.
DATE:
-
TEAM MEMBERS:
Adam Hartstone-RoseMatthew IrvinKelly Lynn MulveyElizabeth ClemensLauren ShenfeldAdam RutlandMark WinterbottomFrances BalkwillPeter McOwanKatie ChambersStephanie TylerLisa Stallard
The Oregon Museum of Science and Industry (OMSI), located in Portland, is a hands-on science museum. In 2013, OMSI received funding from the National Science Foundation for the project Researching the Value of Educator Actions for Learning (REVEAL) to study how museum educators can better help families learn math while interacting with museum exhibits. Through REVEAL, OMSI was able to partner with Adelante Mujeres, a non-profit community organization located in Forest Grove that educates and empowers Latina women and their families. Here we share some of the lessons learned from the
Science, Technology, Engineering, and Mathematics (STEM) education and workforce development in the US are critical for global competitiveness and national security. However, the U.S. is facing a decrease in entrants to the STEM workforce which is not shared evenly across demographics. Specifically, women, underrepresented minorities, and people with disabilities obtain STEM degrees and enter the STEM workforce at levels significantly below their demographic representation in the U.S. The National Science Foundation's (NSF) Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities. This conference focuses on collective impact as a strategy to address the broadening participation challenge. Collective impact is distinguished from collaboration in that the alliances require a backbone organization to succeed. The goal of this project is to organize a conference to inform backbone organizations toward broadening participation in STEM education and the workforce.
The conference takes place at the University of California, San Diego January 20-22, 2017 and brings together Project Investigators from the Design and Development pilots, along with stakeholders in broadening participation in STEM on a local, regional, and national scale. The overarching goal of the conference is to develop the knowledge base of participants in the application of the collective impact model, and the role of backbone organizations to address specific issues and transition points of the STEM pipeline. Conference participants include K-12, community college, and university representatives; leaders in graduate education, policy makers and private sector employers. The conference includes plenary sessions, flash presentations, and interactive workgroups engaged in the development of collective impact approaches to problems in Broadening Participation in STEM. Workgroups share their insights, and audience feedback is electronically curated via Twitter and Storify. To respond in real time to participant questions or insights this conference uses the innovative platform, IdeaWave, to solicit, sort and value ideas from the attendees before, during, and after the conference. Conference results are integrated into a final report to inform the NSF INCLUDES Alliances backbone organizations. The intellectual merit of the project is that it advances knowledge about the barriers to broadening participation in STEM education and the workforce, the collective impact model, and the role of the backbone organization to guide the vision and strategy, and support the activities, evaluation, and communication of the NSF INCLUDES Alliances. The broader impact of this project is that it benefits society by informing backbone organizations, which leads to broadening participation of the STEM workforce and ultimately increases U.S. global competitiveness and national security.
DATE:
-
TEAM MEMBERS:
Kim Barrett
resourceprojectProfessional Development, Conferences, and Networks
This award supports a conference and related activities which will bring together researchers, higher education administrators, industry representatives, members of professional societies, and other community members to design collective impact initiatives to improve the retention and continuation of Hispanics, women, and other underrepresented groups in STEM fields. Retention and continuation to the next step in their educational careers is a particular challenge for underrepresented minorities and first-generation students, whether in community college, four-year institutions, or graduate programs (Ishitani 2006, Sowell et al. 2015). The conference focuses explicitly on this critical issue, and will identify potential remedies that can scale across different types of institutions, communities, and underrepresented groups.
This conference will employ a collective impact, networked improvement approach to help fill this gap and engage the broader community. This approach offers a means of identifying and agreeing upon shared, measurable objectives, mechanisms for coordination across individuals and organizations, a commitment to contrast and comparison, and an ethic of continuous improvement. Drawing from the extant literature and recommendations from a wide array of stakeholders, the team will propose measurable strategies for Alliances and the National INCLUDES (Inclusion across the Nation of Communities of Learners that have been Underrepresented for Diversity in Engineering and Science) Network that can be implemented, tested, enhanced, and expanded. The workshop team will draw on evidence-based knowledge, leveraging findings from disciplinary and interdisciplinary fields and from differing types of institutions and educational levels to determine whether strategies identified can yield large-scale progress towards INCLUDES goals. Results will inform the INCLUDES Alliances and the backbone organization supporting the Alliances.
DATE:
-
TEAM MEMBERS:
Marjorie ZatzAnn GatesDeborah Santiago
resourceprojectProfessional Development, Conferences, and Networks
The National Science Foundation's (NSF)Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The University of Akron will convene a two-day conference to develop a backbone organization to support the preparation and advancement of underrepresented minorities K-12 through careers in the biosciences, a high growth area for engineering (biomechanics, biometrics and biomaterials). This conference draws on the expertise of a wide range of organizations, professional associations, K-20+, community based organizations, industry and museums. The intent is to strengthen the network among participants and leverage learning on how to engage youth in the biosciences.
The results of this first conference will be a white paper that will be disseminated to several professional societies that outlines a backbone infrastructure for addressing both short-term and longer-term aspects of an NSF INCLUDES alliance centered on bioengineering, biomechanics, biomedical engineering and biomaterials.
DATE:
-
TEAM MEMBERS:
Brian DavisCarin HelferRouzbeh Amini
resourceprojectProfessional Development, Conferences, and Networks
This award supports a conference entitled "Accelerating Data-Driven Collaboration for Large-Scale Progress" which will support the progress of INCLUDES (Inclusion across the Nation of Communities of Learners that have been Underrepresented for Diversity in Engineering and Science) Launch Pilots toward their broadening participation goals. The issues and challenges affecting the persistence of students of color, students from low-income households, females, and students with disabilities in STEM learning surpass the scope of programs designed to promote awareness of STEM career options. The Launch Pilots will need technical assistance to leverage their strategic plans, become poised for the next level of becoming an Alliance, and ultimately show impact that results in large-scale progress.
The conference will support the Launch Pilots in their broadening participation goals by providing opportunities to (1) develop innovative new ways to gather data and make evidence-based decisions, (2) connect with best practices on the frontiers of data-driven collaboration, and (3) apply new knowledge and innovations to their projects that address societal needs. The overarching design of Data-Driven Collaboration is to facilitate the sharing of ideas, struggles, and promising practices in a collaborative and participatory manner. This will occur by fostering a network improvement community (within and across Launch Pilots), engaging participants in systems thinking and problem-solving through collaborative modeling, and a 2.5-day Public Support and Engagement Lab conference. Launch Pilots who engage support from Data-Driven Collaboration will have a variety of technical assistance services available between November 2016 and April 2017.