The Complex Adaptive Systems as a Model for Network Evaluations (CASNET) study was a four-year research project investigating evaluation capacity building (ECB) within a network using a complexity theory lens. The study used a case study approach to examine and understand evaluation capacity building within the Nanoscale Informal Science Education Network (NISE Net). NISE Net is a national community of researchers and informal science educators dedicated to fostering public awareness, engagement, and understanding of nanoscale science, engineering, and technology. Instituted in 2005 through NSF funding (DRL-0532536 and 0940143), NISE Net has continuously expanded and is currently comprised of close to 600 science museum and university partners. The intent of the CASNET project was to provide insights on (1) the implications of complexity theory for promoting widespread and systemic use of evaluation within a network, and (2) complex system conditions that foster or impede ECB within a network, i.e., in this case, within the NISE Net.
The Wildlife Conservation Society and Good Shepherd Services (a youth development and education agency) are implementing and evaluating a school-to-career model program that consists of afterschool and weekend programming for high school students at four New York City area zoos and an aquarium, followed by post-participation tracking, support, and mentoring. The goal is to promote affective, cognitive and behavioral outcomes among 150 low-income minority youth necessary to pursue careers in the wildlife sciences.
The Bridging the Gap project is (1) developing a science career program that includes hands-on, technology-enriched, science learning experiences at zoos/aquaria; career building services, mentoring, and long-term tracking and support, (2) forming a community of minority students who have the knowledge and skills to pursue wildlife careers, (3) generating research findings on the short-term and long-term effectiveness of the program, and (4) disseminating information about the project's resources and findings to other informal science education institutions around the nation for replication. The evaluation plan measures a variety of outputs, outcomes and impacts that include short-term and long-term cognitive and affective variables. Data collection methods include student activity monitoring and pre-post testing.
The project addresses a compelling personnel issue documented by the American Zoo and Aquarium Association - the small number of minority science professionals working in zoos and aquariums. Because few programs currently exist to help minority students enter the wildlife science professions, this project fills an important programmatic need and serves as a model workforce program that can be replicated by other informal science education organizations around the country. The project's key strategic impact is its capacity to broaden participation in the wildlife sciences by expanding the science professional pipeline beginning in high school.
DATE:
-
TEAM MEMBERS:
Karen TingleyChanda BennettDon LisowyBrian JohnsonEmily StoethCourtney Wiggins
This project will be conducted by a team of investigators from North Carolina State University. The principal investigator proposes to examine the characteristics, motivations, in and out-of-school experiences, informal science activities, and career trajectories of 1000 science hobbyists and "master hobbyists." Master hobbyists are individuals who have developed science expertise and spend considerable free time engaging in science as a leisure activity. Master science hobbyists are found across most areas of science (e.g. birdwatchers, amateur astronomers). This research will determine who these individuals are, their career pathways, how they engage in science activities and what motivates, sustains, and defines their science interests. One of the particular goals of this research is to develop new understandings of how science hobby interests develop for women and underserved minorities. In the proposed research investigators will use the results of interviews and surveys to identify contextual factors that influence the motivational processes that, in turn, influenced choices of careers and contribute to ongoing choices in hobby and citizen science activities. Of interest in this study is how citizen scientists who are also serious hobbyists differ from master science hobbyists. Research on citizen scientists has shown that this group is highly motivated by collective motives (such as a desire to help others and further science), whereas this may not be the case with the master science hobbyist. Two groups will be sampled: a) birdwatchers and b) amateur astronomers. This sampling model will allow investigators to contrast their findings by: 1) those who have selected a science career versus those that did not select a science career, 2) those who participate in citizen science activities and those that do not, and 3) those who are birdwatchers (greater mathematical components) and those who are amateur astronomers (lesser mathematical components). Additional coding and analyses will examine any differences in the evolution of bird watching and astronomy hobbies. The results of this research will be examined in light of existing motivational and sociocultural models of career selection. This research will document differences in the perceived motivational elements that influenced master science hobbyists/citizen scientists to choose a science career or not. The results can inform federal, state, and local policies for supporting youth and adults engaged in free choice learning. Results of this research will inform the design of intervention/recruitment programs and ISE outreach initiatives. Potential audiences include ISE institutions (e.g. museums and science centers), organizations with links to STEM (e.g. scouts, boys/girls clubs) and pre- and college initiatives that seek to influence career choices and life-long science interests. The proposed cross-disciplinary approach will promote new understandings of complex issues related to motivation, retention, career selection, leisure activities, engagement with formal and informal educational environments, gender and ethnicity, communities of practice and changes in interests over time. Members of the advisory board have expertise in assessment and measurement and will work closely with the project team to conduct a detailed examination of methodologies and analyses at all phases of the project.
DATE:
-
TEAM MEMBERS:
Melissa JonesThomas Andre
resourceprojectProfessional Development, Conferences, and Networks
The Center for Advancement of Informal Science Education (CAISE), a cooperative agreement with the National Science Foundation Advancing Informal STEM Learning (AISL) program, is a partnership of the Association of Science-Technology Centers with faculty and professionals from the University of Pittsburgh Center for Learning in Out-of-School Environments (UPCLOSE), Oregon State University (OSU), the Great Lakes Science Center, KQED Public Media, advisors and other collaborators. CAISE works to support and resource ongoing improvement of, and NSF investments in, the national infrastructure for informal Science Technology Engineering and Mathematics (STEM) education. CAISE's roles are to build capacity and support continued professionalization for the field by fostering a community that bridges the many varied forms in which informal STEM learning experiences are developed and delivered for learners of all ages. To that end, CAISE activities also include: creating field-driven evidence databases about the impacts of informal STEM education; facilitating federated searches of those databases; furthering dialogue and knowledge transfer between learning research and practice; working to enhance the quality and diversity of evaluation knowledge and processes; and helping STEM researchers improve their efforts in informal STEM education, outreach and communication. For Principal Investigators (PIs) and potential PIs, CAISE provides resources that can assist in the development of evidence-based proposals. It also facilitates and strengthens networks through PI meetings, communications, and other methods that encourage sharing of deliverables, practices, outcomes and findings across projects. For the AISL Program at NSF, CAISE is assisting program officers in understanding the portfolio of awards, identifying the portfolio's impacts in key areas, and integrating the program's investments in education infrastructure.
The Space Science Institute is developing an astronomy educational social game for the Facebook platform. The game uses the "sporadic play" model popular with many Facebook games, in which players take only a few actions at a time, then return to explore the results. Here players will create their own stars and planetary systems that evolve over time at a rate of a million years a minute. Players set systems in motion, revisiting the game over days or weeks to make new choices and alter strategies. The game is in effect an end-to-end solar system simulation, following a star from birth to death. As a result it encompasses a wide variety of core concepts in astronomy, including galactic structure, stellar evolution and lifecycles, planetary formation and evolution, and habitability and "habitable zones." The accompanying research program will examine the effectiveness of this type of game in informal education, and the effects of the social network on meeting the education goals, including viral spread, cooperative play, and discussions about the game and its underlying content in associated online forums.
This pathways project will study how audiences in public spaces, in this case those in a museum setting, relate to and make sense of large data displays. The project is preliminary to development of a traveling, hands-on exhibition enabling users to create and utilize representations of big data displays such as maps and charts. As the test case, the project will use science maps that provide an overview of science generally and specific areas of STEM, charting and exploring the history and future of science and technology. The data collection portion of the project will take place at the New York Hall of Science, the Marian Koshland Science Museum, COSI in Columbus, Ohio, and WonderLab Museum in Bloomington, Indiana. The project will create a foundation for the design of museum exhibits and educational programs that teach museum visitors how to explore, engage and make better sense of big data. The project is potentially transformative because big data is becoming ubiquitous and making sense out of large data displays is necessary in order to understand big data sets.
The Adler Planetarium, Johns Hopkins University, and Southern Illinois University-Edwardsville are investigating the potential of online citizen science projects to broaden the pool of volunteers who participate in analysis and investigation of digital data and to deepen volunteers' engagement in scientific inquiry. The Investigating Audience Engagement with Citizen Science project is administering surveys and conducting case studies to identify factors that lead volunteers to engage in the astronomy-focused Galaxy Zoo project and its Zooniverse extensions. The project is (1) identifying volunteers' motivations for joining and staying involved, (2) determining factors that influence volunteers' movement from lower to higher levels of involvement, and (3) designing features that influence volunteer involvement. The project's research findings will help informal science educators and scientists refine existing citizen science programs and develop new ones that maximize volunteer engagement, improve the user experience, and build a more scientifically literate public.
DATE:
-
TEAM MEMBERS:
Karen CarneyMichael RaddickPamela Gay
resourceprojectProfessional Development, Conferences, and Networks
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
The Atomic Heritage Foundation is conducting a two-day conference in Washington, D.C. that brings together scholars, researchers and informal science education professionals to explore new approaches to engage the public in issues at the interface of science and society. The conference will consider recent scholarship about the legacy of the Manhattan Project during and post WWII and address how questions about science and society raised by the development of the atomic bomb can inform and be integrated with contemporary issues. Also attending the conference will be representatives from the American Science and Energy Museum in Oak Ridge, TN, the Los Alamos Historical Society in Los Alamos, NM, the National Museum of Nuclear Science and History in Albuquerque, NM, and the Columbia River Exhibition on Science, History and Technology in Richland, WA. This exploratory workshop is intended both to advance the inter-disciplinary scholarship and to generate innovative ideas and recommendations for the development of exhibits, programs and media about this topic and its relevance to the 21st Century. The focus is not about presenting the underlying science of nuclear fission or energy, for example, but speaks to the greater challenges that emerge when presenting issues raised by science in the broader context of history, society and culture. Given the goals and inter-disciplinary nature of the topic and the diversity of the expertise of participating professionals, the workshop is being supported by the Informal Science Education program in the Directorate for Education and Human Resources (EHR) and the Science, Technology and Society Program in the Directorate for Social, Behavioral and Economic Sciences (SBE).
DATE:
-
TEAM MEMBERS:
Cynthia Kelly
resourceprojectProfessional Development, Conferences, and Networks
This conference brings together 60 people in May/June 2013 to discuss opportunities and limitations in the use of the latest in Human Computer Interactions (HCI) in museum settings, such as experiences using Kinect, Wii, multi-touch computer-based systems and voice recognition interfaces. Given that HCI is increasingly being used in museum settings, the conference will examine some of the exemplar exhibits that now exist and explore some design challenges regarding the use of HCI in museum settings. Participants at the conference include an interdisciplinary set of experts (science exhibition development experts, learning science researchers, ISE evaluators and multi-media experts) that will take a critical look at the future needs and appropriate application of HCI in museum environments. The conference will explore both the advantages and limitations of HCI use in museum environments, and will concern itself with both the nature of the hardware and the learning that can occur. A final report will be disseminated via a multi-user blog that will encourage participation/discussion and the conference leaders will encourage the development of a Community of Practice regarding the use of HCI in museum settings that builds from the existing Open Exhibits web site and Open Exhibits membership (http://openexhibits.org/).
The Oregon Museum of Science and Industry is implementing a Pathways project that will test and refine a model to promote an appreciation that science is everywhere and personally relevant by engaging transit riders in Portland, OR with location-relevant STEM content through unfacilitated, interactive science exhibits in everyday places. The study will employ a "design-based research" approach that both iteratively tests exhibit effectiveness and develops and refines an underlyting theoretical model that can contribute knowledge to the field. The "Science on the Move" model will be developed and tested using an exhibit prototype that includes 1) an easily transportable prototype core with a familiar touch-screen interface, 2) multiple sets of interactive digital content, and 3) a variety of accompanying outer skins designed to attract the public. The exhibit prototype will be placed at bus transit nodes to reach adults, specifically targeting those without college degrees who are underrepresented in science centers. A range of possible STEM content domains will be selected and tested based on topics of interest to the public. If successful, given the several challenges involved, the feasibility study will be applied more fully around Portland and be a model for other cities to consider.
This pathways project would refine and test a game based on the Kinect technology gaming tool to teach seismology concepts in an informal education setting and how they apply to phenomenon in other STEM fields. The game will be developed as a companion tool to the "Quake Catcher Network" a low-cost network of seismic sensors in schools, homes and offices world-wide and tie-ins with seismology programs such as the great California ShakeOut with a participant base of 8.6 million. The project design would select three new learning modules, chosen by a group of scientists and educators, to incorporate into the game and evaluate player experience and knowledge gain. The activities will be conducted at a partner test site, an aquarium, frequented by area youth 8 - 12 years old. The focus of the effort is to add to the knowledge of how gaming can be used effectively in informal learning environments The game places the player as a scientist, allowing the player to make decisions about seismic station deployment strategies following an earthquake, installing the sensors and monitoring incoming data. The game has levels of difficulty and players accrue points by acting swiftly and correctly. Learning goals for the project include making abstract math concepts understandable; involve participants in data collection and the process of scientific investigation, plus demonstrate how scientists and mathematicians use tools of their fields to address real-world issues.