This evaluation report highlights finding on the evaluation of the Center for Advancement of Informal Science Education (CAISE), a cooperative agreement with NSF, is a partnership of the Association of Science-Technology Centers with faculty and professionals from the University of Pittsburgh Center for Learning in Out-of-School Environments, Oregon State University, Science Museum of Minnesota, Visitor Studies Association, KQED Public Media, Advisors and other collaborators. CAISE is working to support ongoing improvement of, and NSF investments in, the national infrastructure for informal
In 2018, the Croucher Foundation conducted its third annual mapping exercise for the out-of-school STEM learning ecosystem in Hong Kong.
The study reveals a rich and vibrant ecosystem for out-of-school STEM in Hong Kong with over 3,000 discrete activities covering a very wide range of science disciplines. This third report indicates extremely rapid growth in available out-of-school STEM activities compared to 2016 and an even larger increase in the number of organisations offering out-of-school STEM activities in Hong Kong.
STEM educators are eager to foster long term collaboration with each other, and with schools. At the same time, good working practice by schools, teachers, STEM educators and institutions that involves and engages local communities was discovered, showing the diversified modes of connection which could enhance the sustainability of STEM ecosystem.
We trust that this three-year study with its associated digital maps, provides a useful resource for schools, teachers, students, parents, STEM educators and education policy makers in Hong Kong.
Techbridge Girls’ mission is to help girls discover a passion for science, engineering, and technology (SET). In August 2013, Techbridge Girls was awarded a five-year National Science Foundation grant to scale up its after-school program from the San Francisco Bay Area to multiple new locations around the United States. Techbridge Girls began offering after-school programming at elementary and middle schools in Greater Seattle in 2014, and in Washington, DC in 2015.
Education Development Center is conducting the formative and summative evaluation of the project. To assess the
Many environmental communication interventions are built on the assumption that increased knowledge will lead to changes in proenvironment behaviors. Our study probes the link between biodiversity-related knowledge and self-reported proconservation behavior, based on the largest and most international study of zoo visitors ever conducted. In total, 6,357 visitors to 30 zoos from 19 countries around the globe participated in the study. Biodiversity understanding and knowledge of actions to help protect biodiversity were significantly related, but only 0.6% of the variation in knowledge of
Video has become a key tool for scientific communication because it increases the outreach and impact of projects, furthers scientific research within and across fields of study, and offers an accessible medium to engage the public in the understanding of science. This project supports the expansion of an interactive, online STEM Videohall where hundreds of NSF-funded researchers share their work through brief video narratives and interactive discussion. While the Videohall is accessible year-round, periodic annual Showcase events are used to drive visitors to the site where they can engage with one another, the project investigators and trained facilitators. The Videohall is a multiplier of NSF's investments in individual projects because it allows STEM education researchers to become aware of, and learn from, related work that is funded across NSF programs and directorates, and other federal agencies. In 3-minute video narratives, investigators share ideas, resources, data, evidence of impact, strategies and challenges. The Videohall platform supports open access and is designed to foster communication in ways that scale beyond traditional formats such as academic conferences. Moreover, because the online STEM Videohall is open to the public, it allows STEM investigators to share their work with multiple stakeholder communities including K-12 educators and school leaders, informal educators and community organizations, the STEM industry, education policy makers and families. Finally, because each video narrative is accompanied by a facilitated online discussion thread, investigators have a unique and valuable mechanism for receiving feedback from these various stakeholder communities. The STEM Videohall project is funded by the Discovery Research K-12 program (DRK-12), which seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.
This project brings together seven NSF-funded resource centers who work with their respective communities to encourage Principal Investigators to share video narratives of their work through annual NSF STEM Showcase events. Each annual Showcase event presents videos created by 150-230 projects; many of the projects are affiliated with one of the seven resource centers, but others are from projects across NSF directorates and beyond. During a one-week period, Principal Investigators, their project staff, as well as the public at large, are invited to engage in interactive discourse, providing queries, comments, and feedback. Participants also vote for favorite presentations through "Presenters' Choice," "Public Choice," and "Facilitators' Choice," processes. This participant voting system serves to increase engagement and enhances outreach of the event through social media. After the one-week Showcase event concludes, all of the videos along with the related discourse remain available to the public online, who continue to access the Showcase throughout the year. Based on prior pilot work, it is estimated that over the course of a year, over 30,000 visitors, from over 150 countries, will engage with each annual Showcase. Videos from annual showcase events will be shared, reused, and repurposed to create new products with new constituencies. The project includes technical development efforts to iteratively improve its interactive platform, outreach efforts before each annual Showcase event, facilitation of the week-long event, and intensive dissemination efforts. A research component examines the extent of participation on various constituencies, the benefit of participation to projects, and the success of the events in terms of dissemination nationally and internationally.
Increasingly, the prosperity, innovation and security of individuals and communities depend on a big data literate society. Yet conspicuously absent from the big data revolution is the field of teaching and learning. The revolution in big data must match a complementary revolution in a new kind of literacy, through a significant infusion of STEM education with the kinds of skills that the revolution in 21st century data-driven science demands. This project represents a concerted effort to determine what it means to be a big data literate citizen, information worker, researcher, or policymaker; to identify the quality of learning resources and programs to improve big data literacy; and to chart a path forward that will bridge big data practice with big data learning, education and career readiness.
Through a process of inquiry research and capacity-building, New York Hall of Science will bring together experts from member institutions of the Northeast Big Data Innovation Hub to galvanize big data communities of practice around education, identify and articulate the nature and quality of extant big data education resources and draft a set of big data literacy principles. The results of this planning process will be a planning document for a Big Data Literacy Spoke that will form an initiative to develop frameworks, strategies and scope and sequence to advance lifelong big data literacy for grades P-20 and across learning settings; and devise, implement, and evaluate programs, curricula and interventions to improve big data literacy for all. The planning document will articulate the findings of the inquiry research and evaluation to provide a practical tool to inform and cultivate other initiatives in data literacy both within the Northeast Big Data Innovation Hub and beyond.
This report details the formative evaluation study conducted through collaboration with the National Science Teachers Association (NSTA) and the Association of Science-Technology Centers (ASTC) to inform the iterative development and piloting of the Connected Science Learning: Connecting In-School and Out-of-School STEM Learning journal. The journal was the result of an Early Concept Grant for Exploratory Research (EAGER) project funded by the National Science Foundation (NSF) to develop, disseminate and evaluate a new resource for connecting STEM education practitioners across settings and to
Science, Technology, Engineering, and Mathematics (STEM) education and workforce development in the US are critical for global competitiveness and national security. However, the U.S. is facing a decrease in entrants to the STEM workforce which is not shared evenly across demographics. Specifically, women, underrepresented minorities, and people with disabilities obtain STEM degrees and enter the STEM workforce at levels significantly below their demographic representation in the U.S. The National Science Foundation's (NSF) Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities. This conference focuses on collective impact as a strategy to address the broadening participation challenge. Collective impact is distinguished from collaboration in that the alliances require a backbone organization to succeed. The goal of this project is to organize a conference to inform backbone organizations toward broadening participation in STEM education and the workforce.
The conference takes place at the University of California, San Diego January 20-22, 2017 and brings together Project Investigators from the Design and Development pilots, along with stakeholders in broadening participation in STEM on a local, regional, and national scale. The overarching goal of the conference is to develop the knowledge base of participants in the application of the collective impact model, and the role of backbone organizations to address specific issues and transition points of the STEM pipeline. Conference participants include K-12, community college, and university representatives; leaders in graduate education, policy makers and private sector employers. The conference includes plenary sessions, flash presentations, and interactive workgroups engaged in the development of collective impact approaches to problems in Broadening Participation in STEM. Workgroups share their insights, and audience feedback is electronically curated via Twitter and Storify. To respond in real time to participant questions or insights this conference uses the innovative platform, IdeaWave, to solicit, sort and value ideas from the attendees before, during, and after the conference. Conference results are integrated into a final report to inform the NSF INCLUDES Alliances backbone organizations. The intellectual merit of the project is that it advances knowledge about the barriers to broadening participation in STEM education and the workforce, the collective impact model, and the role of the backbone organization to guide the vision and strategy, and support the activities, evaluation, and communication of the NSF INCLUDES Alliances. The broader impact of this project is that it benefits society by informing backbone organizations, which leads to broadening participation of the STEM workforce and ultimately increases U.S. global competitiveness and national security.
DATE:
-
TEAM MEMBERS:
Kim Barrett
resourceprojectProfessional Development, Conferences, and Networks
As the NSF INCLUDES Program seeks to scale from the Launch Pilots to the full program, achieving its goals to promote the progress of science by broadening participation will rely on the ability to successfully scale the technical and human infrastructure for collaboration across the mini-backbones and the national backbone. The American Association for the Advancement of Science (AAAS) is seeking support for an NSF INCLUDES infrastructure conference that will provide a forum for discussion about current and long term technical and human infrastructure needs for scaling. Technical infrastructure might refer to the functions provided by any communication, community building and collaboration tool, such as document sharing or storage. Human infrastructure might refer to data analysts or community managers.
The conference would include discussion of the structures and processes for creating a shared, overarching vision of the changes at all levels and for all groups that would be needed to promote the talent development goals envisioned within INCLUDES, supporting the current design and development launch pilots, and supporting scaling and promoting conditions for sustainability. Based on research on collective impact and improvement science in education, we would offer presentations followed by structured conversations within the setting of working sessions. The goals of AAAS for diversity and inclusion in science, technology, engineering and mathematics (STEM) are very much in keeping with the goals of INCLUDES; thus AAAS proposes to offer its existing online platform, Trellis, to support this comprehensive initiative to develop STEM talent from all sectors and groups in our society.
The goals of the conference activity are to: (1) define short term and long term communications and networking needs that can support the pilots; (2) outline the technical specifications and human resources needed to support the pilots; (3) envision the technical, resource and human needs required to support Alliances; (4) develop design specifications for intra- and cross Alliance networking to support technical assistance, identification and curation of resources, support for communities of practice and capture of lessons learned and (5) propose tools, techniques, capacities and functionalities for an NSF INCLUDES National Network Backbone.
DATE:
-
TEAM MEMBERS:
Shirley MalcomJosh Freeman
resourceprojectProfessional Development, Conferences, and Networks
This award supports a conference and related activities which will bring together researchers, higher education administrators, industry representatives, members of professional societies, and other community members to design collective impact initiatives to improve the retention and continuation of Hispanics, women, and other underrepresented groups in STEM fields. Retention and continuation to the next step in their educational careers is a particular challenge for underrepresented minorities and first-generation students, whether in community college, four-year institutions, or graduate programs (Ishitani 2006, Sowell et al. 2015). The conference focuses explicitly on this critical issue, and will identify potential remedies that can scale across different types of institutions, communities, and underrepresented groups.
This conference will employ a collective impact, networked improvement approach to help fill this gap and engage the broader community. This approach offers a means of identifying and agreeing upon shared, measurable objectives, mechanisms for coordination across individuals and organizations, a commitment to contrast and comparison, and an ethic of continuous improvement. Drawing from the extant literature and recommendations from a wide array of stakeholders, the team will propose measurable strategies for Alliances and the National INCLUDES (Inclusion across the Nation of Communities of Learners that have been Underrepresented for Diversity in Engineering and Science) Network that can be implemented, tested, enhanced, and expanded. The workshop team will draw on evidence-based knowledge, leveraging findings from disciplinary and interdisciplinary fields and from differing types of institutions and educational levels to determine whether strategies identified can yield large-scale progress towards INCLUDES goals. Results will inform the INCLUDES Alliances and the backbone organization supporting the Alliances.
DATE:
-
TEAM MEMBERS:
Marjorie ZatzAnn GatesDeborah Santiago
resourceprojectProfessional Development, Conferences, and Networks
The National Science Foundation's (NSF)Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The University of Akron will convene a two-day conference to develop a backbone organization to support the preparation and advancement of underrepresented minorities K-12 through careers in the biosciences, a high growth area for engineering (biomechanics, biometrics and biomaterials). This conference draws on the expertise of a wide range of organizations, professional associations, K-20+, community based organizations, industry and museums. The intent is to strengthen the network among participants and leverage learning on how to engage youth in the biosciences.
The results of this first conference will be a white paper that will be disseminated to several professional societies that outlines a backbone infrastructure for addressing both short-term and longer-term aspects of an NSF INCLUDES alliance centered on bioengineering, biomechanics, biomedical engineering and biomaterials.
DATE:
-
TEAM MEMBERS:
Brian DavisCarin HelferRouzbeh Amini
resourceprojectProfessional Development, Conferences, and Networks
This project will develop, organize and host a Conference to assist in the planning of the NSF INCLUDES (Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science) Alliances and National Network. The focus of this project is the design and implementation of program evaluations necessary for the INCLUDES Alliances and National Network. The conference will be the first to emphasize the multiple scales at which evaluations occur for programs that include components based at single institutions, at interdisciplinary centers/institutes within larger institutions, at alliances/partnerships between several institutions and at entities with a national scope. As the INCLUDES Alliances and National Network will operate across multiple scales, the proposed Conference will provide guidance on the technical aspects of designing and planning multi-scale evaluations.
The target audience for the activities are those individuals involved in current INCLUDES projects, those considering collaborating in such projects and STEM educators considering inclusion of formal evaluation in their projects. The overall goals are to (i) enhance the knowledge of the participants about evaluation methods; (ii) present the experiences of individuals who have successfully developed alliances and carried out evaluation efforts for these; and (iii) provide advice regarding evaluation methods for those planning to participate in future requests for INCLUDES Alliances and/or the National Network. The methods proposed include three components: (a) an initial webinar open to the broad community of STEM educators to introduce key concepts and vocabulary concerning evaluation methods; (b) a pre-Conference Tutorial with 30 participants to provide a one-day overview of modern methods in evaluation and connect these to projects suggested by the participants; and (c) a two-day Conference with 80 participants including as speakers leading experts on program evaluation as well as leaders of programs in STEM education that have operated at multiple scales. Virtual participation will be integrated throughout the three components of the project and a formal evaluation of the project will be carried out using the Systems Evaluation Methodology that has been in use at the host NSF-sponsored Center (NIMBioS) for many years.
DATE:
-
TEAM MEMBERS:
Louis GrossSuzanne LenhartErnest BrothersPamela Bishop