The Museum of Science will launch the "Collaboration for Ongoing Visitor Experience Studies" (COVES) project to construct an infrastructure for collaboration, which will unite science centers across the country in the systematic collection, analysis, and reporting of visitor experience data. The COVES program will develop common instruments for studying visitors in science museums and provide staff training on how to use these instruments and how to make sense of findings. The collaborative effort will enable participating science centers to become data-driven organizations focused on their audiences and will allow museums to learn from one another.
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
resourceprojectProfessional Development, Conferences, and Networks
Arkansas State University (ASU) Museum will offer engaging STEM (Science, Technology, Engineering, and Math) learning experiences for children, at-risk youth, and teachers through three years of membership in the Arkansas Discovery Network, a coalition of seven Arkansas museums that develops and shares children's exhibits. Membership in the network will entitle ASU to nine high-quality, hands-on, STEM-based exhibits that promote "learning by doing" and the needed training in their STEM programming for educators. ASU Museum staff will build substantially upon these exhibits by developing many new and engaging tours, gallery activities, and programs that ensure STEM content registers in learners. This project will enable the museum to offer exceptional experiences with the potential to change attitudes about the value of learning in the targeted audiences in Northeast Arkansas.
These resources are designed to identify opportunities to improve training for educators and researchers during implementation of the Living Laboratory model. The Data Collection Guidelines provide general instructions and tips for conducting evaluation through observations of (and/or interviews with) visitors. Two versions of each instrument (Researcher-Caregiver Conversations Instrument and Research Toy Interactions Instrument) are included: one can be modified and printed for data collection; the second is an annotated version, which includes more detailed instructions for each item in the
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
The Balboa Park Cultural Partnership, in collaboration with several informal science education and other cultural and business organizations in San Diego, Chicago, and Worcester, MA are implementing a research and development project that investigates a range of possible approaches for stimulating the development of 21st Century creativity skills and innovative processes at the interface between informal STEM learning and methods for creative thinking. The goal of the research is to advance understanding of the potential impacts of creative thinking methods on the public's understanding of and engagement with STEM, with a focus on 21st Century workforce skills of teens and adults. The goal of the project's development activities is to experiment with a variety of "innovation incubator" models in cities around the country. Modeled on business "incubators" or "accelerators" that are designed to foster and accelerate innovation and creativity, these STEM incubators generate collaborations of different professionals and the public around STEM education and other STEM-related topics of local interest that can be explored with the help of creative learning methodologies such as innovative methods to generate creative ideas, ideas for transforming one STEM idea to others, drawing on visual and graphical ideas, improvisation, narrative writing, and the process of using innovative visual displays of information for creating visual roadmaps. Hosting the project's incubators are the Balboa Park Cultural Partnership (San Diego), the Museum of Science and Industry (Chicago) and the EcoTarium (Worcester, MA). National partners are the Association of Science-Technology Centers, the American Association for the Advancement of Science, and the Americans for the Arts. Activities will include: the formation and collaborative processes of three incubator sites, a research study, the development of a creative thinking curriculum infused into science education, professional development based on the curriculum, public engagement events and exhibits, a project website and tools for social networking, and project evaluation. A national advisory council includes professionals in education, science, creativity, and business.
Portal to the Public: Expanding the National Network (PoP: ENN) is implementing around the county the successful NSF-funded Portal to the Public model in which researchers are trained to communicate and interact with the general public at informal science education (ISE) institutions about the research that they are conducting. The project, which follows on a thorough evaluation of the model at eight sites and current implementation at an additional fifteen sites, will incorporate twenty new ISE sites into the growing network, provide training and mentorship to ISE professionals on the use and adaptation of the PoP implementation manual and toolkits, and develop an enhanced network website that will serve as a communication and innovation hub. The work is responsive to the needs and activities of ISE organizations which continue to expand their missions beyond presenting to the public established science, technology, engineering and math (STEM) and are working to become places where visitors can also experience the process and promise of current research via face-to-face interactions with researchers. The project is expanding both the kind and number of institutions involved around the country and is facilitating their capacity to develop a knowledge base, share experiences and best practices.
This is a recording of a NISE Network online brown-bag conversation held in December 2014 about the International Year of Light. In 2013, the United Nations proclaimed 2015 as the International Year of Light (IYL). More than 100 organizations from more than 85 countries are participating in IYL. During this conversation we discussed scientific organizations that would make great partners for IYL events, shared light-related activities and videos developed by the NISE Network, and talked about the science behind some of those activities.
Earth Partnership: Indigenous Arts and Sciences (EP) will develop and refine a model for integrating Indigenous and informal and formal K-20 educators in ecological restoration, project-based learning and professional development. EP will involve participants in Native habitat restoration on community spaces, school grounds and nearby natural areas as a context for intergenerational STEM learning across age, ecosystem, discipline, learning style, culture and place. EP integrates Native knowledge and core values including relationship, reciprocity, respect and responsibility with Western STEM concepts and processes. The project will integrate the expertise of university social, physical, life and learning scientists and community and tribal practitioners to design, develop and test informal STEM learning incorporating ecological restoration, citizen science and cultural diversity. EP grows out of a teacher professional development model funded by NSF and is a network that now includes participating individuals and organizations from many states. This network will enhance dissemination and provide a foundation for a larger project growing out of the results of this project. EP will build capacity of Native and non-Native informal educators and citizens to work together to generate engagement among young people and adults with ecological STEM learning and stewardship. The approach will integrate culturally authentic resources, inquiry and citizen science process skills (e.g., data collection, analysis, ecological restoration, water stewardship) in multiple learning settings. Stronger multicultural, intergenerational and community partnerships will be supported to restore aquatic and terrestrial habitats through community-based stewardship projects and Service Learning. Through EP, Native youth will be encouraged to explore STEM careers that will meet future workforce needs for managing tribal resources and become knowledgeable citizens able to use critical thinking and analysis of STEM-related issues in their communities. The project will use a developmental evaluation approach to assess project planning processes and outcomes of educational programs.
This is a Broad Implementation proposal. Our goal is to create a vibrant, sustained community of practice around the established Café Scientifique New Mexico model for engaging high school teens in science, technology, engineering and math; scale-up will be accomplished via a national network of committed partners. The adult Cafe Scientifique model for engaging citizens in science has proven very effective and has been implemented widely. The interaction in a social setting with a scientist-presenter around a hot science topic is the key to the model’s success. With ISE funding, the model has been adapted by Science Education Solutions for the high school teen audience. Cafe Scientifique New Mexico, now starting its fifth year, has had documented success in providing teens with increased STEM literacy and a more realistic picture of scientists as real people leading interesting lives. Teens come to better understand the nature of science and are more likely to see the relevance of science to their lives. Scientists express strong satisfaction with the nature of our coaching and the resulting quality of their science communication. The program has been continually evaluated and improved, and is now ready for broad implementation. Intellectual Merit: Teenagers are the adult citizens and workforce of tomorrow. Teens are reaching a critical life juncture and are making choices that affect their future life style, life-long learning behaviors, and careers. Yet they are increasingly dropping out of the STEM pipeline in school. Even teens interested in STEM often know little about science and engineering careers and the nature of scientific research. Teen Cafés can play an important role in addressing these challenges. We have two major objectives: 1. Implement the Café Scientifique model of Teen Cafés in a national network of sites committed to adopting and adapting the program and validating its impacts with diverse audiences; and 2. Create a vibrant and sustainable community of practice comprised of ISE and STEM professionals interested in engaging teens in STEM through Teen Cafés. We have formed a core network of six initial partners: Southern Illinois University Edwardsville, Center for STEM Research, Education, and Outreach; The Florida Teen SciCafé Partnership; North Carolina Museum of Natural Sciences, Raleigh; Science Discovery, University of Colorado; The Pacific Science Center in Seattle; and The Missouri AfterSchool Network (MASN) – Project LIFTOF. We will add two more core partners in Year 3. The core partners will join the Teen Cafe Network in a staged fashion in years 1 - 3. Each will reach sustainability over a three-year funding period. Each node has a local area network of partners consisting of organizations that will host local Cafes; scientific organizations with potential presenters; schools and other organizations for recruiting teens; and entities capable of contributing to financial sustainability. The network will provide a structure for a dynamic, growing, and sustainable community of practice to implement the Teen Café model, in which high school teens will gain skills in scientific discourse, thought, and exploration. STEM professionals will gain improved skills for communicating with public audiences and a new perspective on their research from a broader societal perspective. ISE professionals will gain capacity to adapt, implement, test, and further disseminate the Teen Café model and increased capability for preparing STEM experts to communicate effectively with teen audiences, along with tools, resources, and expertise to help them do so. Science Education Solutions will manage the project and provide the resources to support the community of practice, while continuing Cafe Scientifique New Mexico as a ninth network node. We will stimulate intensive ongoing communication of lessons learned across the network as partners start up their Cafe programs; external observers will be able to watch the program unfold. Broader Impacts: We will build capacity for serving teens and effective communication of science in the broad ISE and STEM communities by encouraging and nurturing others wishing to start a Cafe program and join the network. We have partnered with 10 large science and science education organizations, each with its own extensive network, which will allow us to further propagate the Teen Cafe Network. They are: National Ecological Observatory Network (NEON). Nanoscale Informal Science Education Network (NISE Net), The American Institute of Physics (AIP), Science Cafés.org (to include NOVA), Science Festival Alliance, Consortium of Universities for the Advancement of Hydrologic Science (CUAHSI), Informalscience.org, Project Liftoff: Elevating Science Afterschool, ITEST Learning Resource Center, and The Center for Multiscale Modeling of Atmospheric Processes (CMMAP). Each partner will also target underserved and diverse teen audiences for their programs.
The Global Soundscapes! Big Data, Big Screens, Open Ears Project uses the new science of soundscape ecology to design a variety of informal science learning experiences that engage participants through acoustic discovery Soundscape ecology is an interdisciplinary science that studies how humans relate to place through sound and how humans influence the environment through the alteration of natural sound composition. The project includes: (1) an interface to the NSF-funded Global Sustainable Soundscapes Network, which includes 12 universities around the world; (2) sound-based learning experiences targeting middle-school students (grades 5-8), visually impaired and urban students, and the general public; and (3) professional development for informal science educators. Project educational components include: the first interactive, sound-based digital theater experience; hands-on Your Ecosystem Listening Labs (YELLS), a 1-2 day program for school classes and out-of school groups; a soundscape database that will assist researchers in developing a soundscape Big Database; and iListen, a virtual online portal for learning and discovery about soundscape. The project team includes Purdue-based researchers involved in soundscape and other ecological research; Foxfire Interactive, an award-winning educational media company; science museum partners with digital theaters; the National Audubon Society and its national network of field stations; the Perkins School for the Blind; and Multimedia Research (as the external evaluator).