EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
resourceprojectProfessional Development, Conferences, and Networks
The Complex Adaptive Systems as a Model for Network Evaluations (CASNET) study was a four-year research project investigating evaluation capacity building (ECB) within a network using a complexity theory lens. The study used a case study approach to examine and understand evaluation capacity building within the Nanoscale Informal Science Education Network (NISE Net). NISE Net is a national community of researchers and informal science educators dedicated to fostering public awareness, engagement, and understanding of nanoscale science, engineering, and technology. Instituted in 2005 through NSF funding (DRL-0532536 and 0940143), NISE Net has continuously expanded and is currently comprised of close to 600 science museum and university partners. The intent of the CASNET project was to provide insights on (1) the implications of complexity theory for promoting widespread and systemic use of evaluation within a network, and (2) complex system conditions that foster or impede ECB within a network, i.e., in this case, within the NISE Net.
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
The Balboa Park Cultural Partnership, in collaboration with several informal science education and other cultural and business organizations in San Diego, Chicago, and Worcester, MA are implementing a research and development project that investigates a range of possible approaches for stimulating the development of 21st Century creativity skills and innovative processes at the interface between informal STEM learning and methods for creative thinking. The goal of the research is to advance understanding of the potential impacts of creative thinking methods on the public's understanding of and engagement with STEM, with a focus on 21st Century workforce skills of teens and adults. The goal of the project's development activities is to experiment with a variety of "innovation incubator" models in cities around the country. Modeled on business "incubators" or "accelerators" that are designed to foster and accelerate innovation and creativity, these STEM incubators generate collaborations of different professionals and the public around STEM education and other STEM-related topics of local interest that can be explored with the help of creative learning methodologies such as innovative methods to generate creative ideas, ideas for transforming one STEM idea to others, drawing on visual and graphical ideas, improvisation, narrative writing, and the process of using innovative visual displays of information for creating visual roadmaps. Hosting the project's incubators are the Balboa Park Cultural Partnership (San Diego), the Museum of Science and Industry (Chicago) and the EcoTarium (Worcester, MA). National partners are the Association of Science-Technology Centers, the American Association for the Advancement of Science, and the Americans for the Arts. Activities will include: the formation and collaborative processes of three incubator sites, a research study, the development of a creative thinking curriculum infused into science education, professional development based on the curriculum, public engagement events and exhibits, a project website and tools for social networking, and project evaluation. A national advisory council includes professionals in education, science, creativity, and business.
Portal to the Public: Expanding the National Network (PoP: ENN) is implementing around the county the successful NSF-funded Portal to the Public model in which researchers are trained to communicate and interact with the general public at informal science education (ISE) institutions about the research that they are conducting. The project, which follows on a thorough evaluation of the model at eight sites and current implementation at an additional fifteen sites, will incorporate twenty new ISE sites into the growing network, provide training and mentorship to ISE professionals on the use and adaptation of the PoP implementation manual and toolkits, and develop an enhanced network website that will serve as a communication and innovation hub. The work is responsive to the needs and activities of ISE organizations which continue to expand their missions beyond presenting to the public established science, technology, engineering and math (STEM) and are working to become places where visitors can also experience the process and promise of current research via face-to-face interactions with researchers. The project is expanding both the kind and number of institutions involved around the country and is facilitating their capacity to develop a knowledge base, share experiences and best practices.
This is a Broad Implementation proposal. Our goal is to create a vibrant, sustained community of practice around the established Café Scientifique New Mexico model for engaging high school teens in science, technology, engineering and math; scale-up will be accomplished via a national network of committed partners. The adult Cafe Scientifique model for engaging citizens in science has proven very effective and has been implemented widely. The interaction in a social setting with a scientist-presenter around a hot science topic is the key to the model’s success. With ISE funding, the model has been adapted by Science Education Solutions for the high school teen audience. Cafe Scientifique New Mexico, now starting its fifth year, has had documented success in providing teens with increased STEM literacy and a more realistic picture of scientists as real people leading interesting lives. Teens come to better understand the nature of science and are more likely to see the relevance of science to their lives. Scientists express strong satisfaction with the nature of our coaching and the resulting quality of their science communication. The program has been continually evaluated and improved, and is now ready for broad implementation. Intellectual Merit: Teenagers are the adult citizens and workforce of tomorrow. Teens are reaching a critical life juncture and are making choices that affect their future life style, life-long learning behaviors, and careers. Yet they are increasingly dropping out of the STEM pipeline in school. Even teens interested in STEM often know little about science and engineering careers and the nature of scientific research. Teen Cafés can play an important role in addressing these challenges. We have two major objectives: 1. Implement the Café Scientifique model of Teen Cafés in a national network of sites committed to adopting and adapting the program and validating its impacts with diverse audiences; and 2. Create a vibrant and sustainable community of practice comprised of ISE and STEM professionals interested in engaging teens in STEM through Teen Cafés. We have formed a core network of six initial partners: Southern Illinois University Edwardsville, Center for STEM Research, Education, and Outreach; The Florida Teen SciCafé Partnership; North Carolina Museum of Natural Sciences, Raleigh; Science Discovery, University of Colorado; The Pacific Science Center in Seattle; and The Missouri AfterSchool Network (MASN) – Project LIFTOF. We will add two more core partners in Year 3. The core partners will join the Teen Cafe Network in a staged fashion in years 1 - 3. Each will reach sustainability over a three-year funding period. Each node has a local area network of partners consisting of organizations that will host local Cafes; scientific organizations with potential presenters; schools and other organizations for recruiting teens; and entities capable of contributing to financial sustainability. The network will provide a structure for a dynamic, growing, and sustainable community of practice to implement the Teen Café model, in which high school teens will gain skills in scientific discourse, thought, and exploration. STEM professionals will gain improved skills for communicating with public audiences and a new perspective on their research from a broader societal perspective. ISE professionals will gain capacity to adapt, implement, test, and further disseminate the Teen Café model and increased capability for preparing STEM experts to communicate effectively with teen audiences, along with tools, resources, and expertise to help them do so. Science Education Solutions will manage the project and provide the resources to support the community of practice, while continuing Cafe Scientifique New Mexico as a ninth network node. We will stimulate intensive ongoing communication of lessons learned across the network as partners start up their Cafe programs; external observers will be able to watch the program unfold. Broader Impacts: We will build capacity for serving teens and effective communication of science in the broad ISE and STEM communities by encouraging and nurturing others wishing to start a Cafe program and join the network. We have partnered with 10 large science and science education organizations, each with its own extensive network, which will allow us to further propagate the Teen Cafe Network. They are: National Ecological Observatory Network (NEON). Nanoscale Informal Science Education Network (NISE Net), The American Institute of Physics (AIP), Science Cafés.org (to include NOVA), Science Festival Alliance, Consortium of Universities for the Advancement of Hydrologic Science (CUAHSI), Informalscience.org, Project Liftoff: Elevating Science Afterschool, ITEST Learning Resource Center, and The Center for Multiscale Modeling of Atmospheric Processes (CMMAP). Each partner will also target underserved and diverse teen audiences for their programs.
The National Girls Collaborative Project (NGCP) seeks to maximize access to shared resources within projects and with public and private sector organizations and institutions interested in expanding girls’ participation in science, technology, engineering, and mathematics (STEM). Funded primarily by the National Science Foundation, the NGCP is a robust national network of more than 3,000 girl-serving STEM organizations. Currently, 31 Collaboratives, serving 40 states, facilitate collaboration between more than 12,800 organizations who serve more than 7.7 million girls and 4.4 million boys. The NGCP occupies a unique role in the STEM community because it facilitates collaboration with all stakeholders who benefit from increasing diversity and engagement of women in STEM. These stakeholders form Regional Collaboratives, who are connected to local girl-serving STEM programs. Regional Collaboratives are led by leadership teams and advisory boards with representatives from K-12 education, higher education, community-based organizations, professional organizations, and industry. NGCP strengthens the capacity of girl-serving STEM projects by facilitating collaboration among programs and organizations and by sharing promising practice research, program models, and products through webinars, collaboration training, and institutes. This is accomplished through a tested comprehensive program of change that uses collaboration to expand and strengthen STEM-related opportunities for girls and women. In each replication state, the NGCP model creates a network of professionals, researchers, and practitioners, facilitating collaboration within this network, and delivering high-quality research-based professional development. Participating programs can also receive mini-grant funding to develop collaborative STEM-focused projects. To date, over 27,000 participants have been served in 241 mini-grant projects, and over 17,000 practitioners have been served through in-person events and webinars. The NGCP’s collaborative model changes the way practitioners and educators work to advance girls’ participation in STEM. It facilitates the development of practitioners in their knowledge of good gender equitable educational practices, awareness of the role of K-12 education in STEM workforce development, and mutual support of peers locally and across the United States.
Boston's Museum of Science (MOS), with Harvard as its university research partner, is extending, disseminating, and further evaluating their NSF-funded (DRL-0714706) Living Laboratory model of informal cognitive science education. In this model, early-childhood researchers have both conducted research in the MOS Discovery Center for young children and interacted with visitors during the museum's operating hours about what their research is finding about child development and cognition. Several methods of interacting with adult visitors were designed and evaluated, including the use of "research toys" as exhibits and interpretation materials. Summative evaluation of the original work indicated positive outcomes on all targeted audiences - adults with young children, museum educators, and researchers. The project is now broadening the implementation of the model by establishing three additional museum Hub Sites, each with university partners - Maryland Science Center (with Johns Hopkins), Madison Children's Museum (with University of Wisconsin, Madison), and Oregon Museum of Science and Industry (with Lewis & Clark College). The audiences continue to include researchers (including graduate and undergraduate students); museum educators; and adults with children visiting the museums. Deliverables consist of: (1) establishment of the Living Lab model at the Hub sites and continued improvement of the MOS site, (2) a virtual Hub portal for the four sites and others around the country, (3) tool-kit resources for both museums and scientists, and (4) professional symposia at all sites. Intended outcomes are: (1) improve museum educators' and museum visiting adults' understanding of cognitive/developmental psychology and research and its application to raising their children, (2) improve researchers' ability to communicate with the public and to conduct their research at the museums, and (3) increase interest in, knowledge about, and application of this model throughout the museum community and grow a network of such collaborations.
Three and a half billion people currently live in cities, and this is projected to rise to six billion by 2050. In much of the world, cities are warming at twice the rate of rural areas and the frequency of urban heat waves is expected to increase with climate change throughout the 21st century. Addressing the economic, environmental and human costs of urban heat islands requires a better understanding of these complex systems from many disciplinary perspectives. The goal of this four-year Urban Heat Island Network is to advance multidisciplinary understanding of urban heat islands, examine how they can be ameliorated through engineering and design practices, and share these new insights with a wide array of stakeholders responsible for managing urban warming so that the health, economic, and environmental impacts can be reduced.
DATE:
-
TEAM MEMBERS:
Peter SnyderPatrick HamiltonBrian StoneTracy TwineJ. Marshall Shepherd
resourceprojectProfessional Development, Conferences, and Networks
This award is funded under NSF's Science, Engineering, and Education for Sustainability (SEES) activities, which aim to address the challenges of creating a sustainable world. Research Coordination Network (RCN) CE3SAR (Climate, Energy, Environment, and Engagement in Semiarid Regions) is a comprehensive partnership of researchers at South Texas regional institutions and major research universities elsewhere advancing knowledge of science, engineering and education for sustainability (SEES). The network will develop and test an innovative model for conducting interdisciplinary, region-specific, sustainability research closely tied to the needs and interests of highly-engaged local stakeholders. RCN CE3SAR will aggregate regional research capacities specific to sustainability in semiarid climates contiguous to the Gulf of Mexico while leveraging research expertise infused from outside the region. Geographic information science (GIS) will play a key role in the process of integrating layers of scientific data, producing scientific insight and presenting new ideas, new research directions and new scientific knowledge to regional stakeholders as well as the scientific community. The network will align regional capacities that heretofore were largely disconnected and bring focus and synergy to a range of research that will profoundly impact the region and its socioeconomic future. The network will engage and educate regional communities, government and private-sector stakeholders throughout the process.
DATE:
-
TEAM MEMBERS:
Luis CifuentesJorge VanegasGary JeffressRudolph RosenWesley Patrick
Through "Addressing the Science of Really Gross Things: Engaging Young Learners in Biomedical Science Through a Fulldome Planetarium Show and Supporting Curricula," Morehead Planetarium and Science Center at the University of North Carolina at Chapel Hill, in close collaboration with NIH-funded researchers at the UNC and a leading children's book author, will develop an informal science education media project and a suite of hands-on, inquiry-based curricula based on the media project for use in science centers, museums and schools. This project will build the pipeline of future researchers and create awareness of NIH-funded research by generating interest and excitement among children age 9-13 in the health sciences and related careers and building their science content knowledge. To achieve the objective, the investigators will develop a fulldome planetarium show; create correlating curricula for summer camps, afterschool programs, scout programs, science center field trips, science clubs and schools; and produce a DVD highlighting careers in the health sciences. In addition, the project will use several methods to target populations traditionally underrepresented in the biomedical fields, including featuring professionals from underrepresented populations in the multimedia and curricula products, making outreach visits to counties with large populations traditionally underrepresented in health science research careers, and producing a Spanish-language version of the products. The use of a known brand, "Grossology," is an innovative way to connect to children in the target age range and to encourage the informal science education community to embrace health-science content in their fulldome theaters. In addition, the project's hub-and-spoke approach further encourages adoption of this programming by providing informal science venues with both an engaging experience (hub) and the supporting curricula (the spokes) that is necessary to extend the show's potential for having significant educational impact. A strong project team maximizes the project's likelihood for success. The team includes fulldome producers and educators from Morehead and NIH-funded researchers with expertise in appropriate science content areas. In addition, the investigators have created a network of consultants, advisory board members and evaluators that will create feedback loops designed to ensure high-quality, scientifically-accurate, educationally-effective products. The investigators will use a combination of free and revenue-based dissemination strategies to ensure that the products of this award are broadly distributed. These strategies hold significant promise for creating broad use of this project's products in the nation's science centers, museums and classrooms.
The Exploratorium comes together with the Education Development Center, Inverness Research, TERC, the University of Colorado - Boulder, and the University of Washington to form a Research+Practice (R+P) Collaboratory. The Collaboratory seeks to address and reframe the gap between research and practice in K-12 STEM education. This gap persists despite decades of work by many leading organizations, associations, and individuals. Attempts to close the gap have generally focused on creating resources and mechanisms that first explain or illustrate "what research says" and then invite educators to access and integrate findings into practice. Recently, however, attention has turned to the ways in which the medical sciences are addressing the gap between research and clinical practice through the developing field of "translational research." In medicine, the strategy has been to shift the focus from adoption to adaptation of research into practice. Implicit in the notion of adaptation is a bi-directional process of cultural exchange in which both researchers and practitioners come to understand how the knowledge products of each field can strengthen the professional activities in the other. Along these lines, the R+P Collaboratory is working with leading professional associations and STEM improvement efforts to leverage their existing knowledge and experience and to build sustainable strategies for closing the gap. The R+P Collaboratory is developing an online 'Go-To' Resource Center website that houses the resources collected, created, and curated by the Collaboratory. The Resource Center also has significant 'Take-Out' features, with all materials meta-tagged so that they can be automatically uploaded, reformatted, and integrated into the existing communication and professional development mechanisms (e.g., newsletters, digests, conferences, and websites) of a dozen leading professional associations within a Professional Association Partner Network. In light of new and emerging standards in the STEM disciplines, the Collaboratory is focusing its work on four salient and timely bodies of research: (a) STEM Practices, (b) Formative Assessment, (c) Cyberlearning, and (d) Learning as a Cross-Setting Phenomenon. Special emphasis is being placed on research and practice that focuses on the learning of children and youth from communities historically underrepresented in STEM fields.