This report summarizes findings from a three-year study of the Time Team America: Science of Archeology project, funded by the National Science Foundation. The project included a series of archaeology field schools for youth, four broadcast episodes and a redesigned website with a variety of information and instructional resources. The evaluation included both formative and summative components and a mix of qualitative and quantitative methods including surveys, interviews, and focus groups. Includes interview protocol and survey.
Goodman Research Group, Inc. conducted an external evaluation of WGBH's NOVA scienceNOW (NsN) multimedia project as part of the project’s award from the Advancing Informal STEM Learning division of the National Science Foundation. The evaluation assessed NsN’s effectiveness in meeting its broad goals for its public and professional audiences, including increasing public appreciation for, understanding of, and engagement in or pursuit of science, increasing science cafe organizers’ and speakers’ perceived expertise and skills, and fostering a community of practice among cafe organizers. The NsN
Funded jointly by the Institute of Museum and Library Services (IMLS) and the MacArthur Foundation, in partnership with the and Association of Science-Technology Centers (ASTC) and Urban Libraries Council (ULC), Learning Labs in Libraries and Museums supports the planning and design of 24 learning labs in libraries and museums nationwide. The inaugural cohort of 12 sites ran from January 2012 to June 2013, and a second cohort of 12 additional sites began in January 2013 and will extend through June 2014. In addition to the primary awardees, most grants included additional institutional partners, resulting in a rich community including over 100 professionals from approximately 50 participating organizations (libraries, museums, universities, and community-based organizations). The labs are intended to engage middle- and high-school youth in mentor-led, interest-based, youth-centered, collaborative learning using digital and traditional media. Inspired by YOUmedia, an innovative digital space for teens at the Chicago Public Library, as well as innovations in science and technology centers, projects participating in Learning Labs are expected to provide prototypes for the field based on current research about digital media and youth learning, and build a "community of practice" among the grantee institutions and practitioners interested in developing similar spaces.
Across the globe, citizen science projects are becoming increasingly poised to address social and environmental challenges and answer broad scientific questions. Although rapidly increasing in number, these projects need easy-to-use software tools for data management, analysis, and visualization to be successful. This project transforms how citizen science projects unfold locally, regionally, and globally by creating software that supports the full spectrum of project activities. It empowers projects to ask and answer their own local questions while contributing data critical to larger-scale issues. These tools will allow projects to announce training events; track volunteers; create datasheets; enter, review, analyze, and visualize data; publish reports; discover resources; integrate data; and ensure that data are contributed to repositories (e.g., DataONE, NEON, GBIF, HydroShare, and EOL). Tools will be made available to citizen science projects and will be delivered as reusable software elements for use in existing websites; as website features on CitSci.org; and as Application Programming Interface (API) services and mobile applications. The tools will expand the national reach, local appeal, computational abilities, visualization techniques, statistical analysis capabilities, and interoperability of the nations' cyber-infrastructure. Using participatory design and agile methods, the project will: (1) develop reusable software elements that citizen science organizations can embed into their own websites, (2) harden and expand the functionality and capabilities of CitSci.org through new website features, and (3) extend the APIs of CitSci.org and develop associated mobile applications to increase system and tool interoperability. The target user communities will include citizen science project coordinators. It will deliver customizable tools and services related to all project activities and engage projects across a wide array of disciplines. Project coordinators will be able to customize all tools developed to suit their specific project needs. Adoption and use of the tools developed will create a cyber-ready workforce capable of collecting, contributing, and applying high quality ecological, geophysical, social, and human health related observations to solve real-world problems. These broader impacts will help the citizen science community better understand effective models of public engagement to ensure more impactful application of citizen science to societal challenges.
DATE:
-
TEAM MEMBERS:
Gregory NewmanStacy LynnMelinda Laituri
Living Liquid is a full-scale development project that will develop and research a new genre of science exhibit that engage visitors in inquiry with large scientific datasets through interactive visualizations. Building on findings from a prior pathways project, Living Liquid will develop three interactive visualizations on a multi-touch Viz Table with a tangible user interface. Each visualization will support visitors in the exploration of a dataset provided by the project’s science partners: 1) Plankton Patterns will show how the ocean is defined by regions of microscopic life using data from the MIT Darwin Project; 2) Ocean Tracks will reveal the “highways” large marine creatures travel with data from the TOPP project at Stanford University; and 3) Genetic Rhythms will follow the activity of marine creatures’ genes in response to environmental conditions based on data from the Center for Microbial Oceanography Research and Education (C-MORE). Through an iterative process of collaborative research and development among museum professionals, educational researchers, computer scientists, marine biologists, data artists and interaction designers, this project seeks to: (1) Advance public understanding of ocean ecosystems and large data inquiry skills through the development of a Viz Table. (2) Advance STEM professionals’ knowledge of how to engage the public in inquiry with visualizations through an educational research study. (3) Increase the capacity of STEM professionals (both ISE developers and research scientists) to develop visualizations through a collaborative development process that includes graduate student training and residencies.
Brigham Young University and the University of Maryland, in partnership with the Smithsonian Institution, the Computer History Museum, and NASA, plus leading game designers, educators, scientists, and researchers, will conduct research on the design and development of two large-scale Alternate Reality Games (ARGs) based on deep-time science in astrobiology, astrophysics, and interplanetary space travel. The project will iteratively design and test two distinct types of ARGs (closed- and open-ended) to study the effects of these ARGs on STEM learning. The ARGs will be based upon the Next Generation Science Standards (NGSS), affording learners with intensive, self-driven, and scaffolded scientific learning and will be aimed at attracting girls and other groups historically underrepresented in science and technology. Each ARG will be designed by NASA scientists, educators and education researchers, and game-based learning experts and will be highly interactive: engaging learners in collaborative investigations in real and virtual worlds to collect scientific data, conduct data analysis, and contribute scientific evidence that will help solve scientific questions within a science-based narrative derived from real world problems that will develop learners' computational thinking skills in a collaborative, participatory virtual learning environment. Combining data from web and social media analytics, player interviews, surveys, and user-generated content, researchers, and evaluation experts at UXR who will provide an outcomes-based evaluation, including front-end, formative, remedial, and summative evaluations, will establish the properties of ARGs that most effectively advance informal STEM learning outcomes. By comparing open-ended and closed-ended ARGs, the PIs will be able to assess the relative strengths and weaknesses of two distinct approaches to Alternate Reality Game design. The project team will test the hypothesis that open-ended, user-generated content will support inquiry-based learning, peer-to-peer learning, and life-wide and life-deep learning, while close-ended, narrative-rich ARGs will support specific transfer of STEM knowledge, collaboration, and problem solving. To help ensure that the games appeal to their target audiences, the project team will adopt co-design methods, enlisting the creative input of participating teens at each stage of the design process. Supplementary materials and lesson plans developed in close consultation with teachers, librarians, teens, and external stakeholders will enable the ARGs to be widely and effectively used as a model in museums, classrooms, libraries, and after-school programs. The proposed ARGs represent a unique environment to test learning principles that enable players to bridge their learning through transmedia across multiple contexts and test the effects of collaboration with massive numbers of concurrent players. As a result, the project should yield insights on how learning principles can be adopted and re-appropriated for emerging learning environments, including those that that might be crowd-sourced. The research is well grounded in the literature and the PIs do an excellent job of mapping ARG design principles to the pertinent learning science research, providing a clear sense of the particular affordances of the genre that should lead to new understandings. The approach has profound implications for the way we might teach the next generation of students. The ability to mix problem solving and learning in virtual spaces with experiences and data derived from the physical world could dramatically change how we understand the role of technology in education.
This project from the University of Florida proposes to derive and develop a network and community of practice (CoP) among amateur and professional paleontologists across the country. Should this project be successful, it would put together 40 professional Paleontologist with 23 amateur Paleontology clubs across the country. The advantage of this organization would be to facilitate sharing of specimens (digitally on the web), educating each other, and most important, making the public outreach from each club more effective. While each club has specimens, this network would provide access to over 100 million digitized samples. The web-base for this collection will be managed at the University of Florida under the direction of the PI. The research portion of this project will determine what the essential elements necessary are for effective learning between professionals and amateurs and how the CoP enhances amateur learning and outreach efficacy. The project plan includes a centralized organization to initially form the community of practice, call general meetings, publish newsletters and organized a large meeting at the University of Florida in the coming year. Further, the project team will conduct evaluation on how the project is helping members develop and how the organization can be improved. Educating individuals in the field of paleontology is generally a positive experience. This project will facilitate knowledge building among the individual members of the clubs, which will enhance their perspective and enable them to reach out to members of their communities. The project will be evaluated at every level to ensure that the existing clubs are incorporated into the project and new clubs are welcomed and engaged as well.
This full-scale project addresses the need for more youth, especially girls, to pursue an interest in engineering and eventually fill a critical workforce need. The project leverages museum-based exhibits, girls' activity groups, and social media to enhance participants' engineering-related interests and identities. The project includes the following bilingual deliverables: (1) Creative Solutions programming will engage girls in group oriented engineering activities at partner community-based organizations, where the activities highlight altruistic, personally relevant, and social aspects of engineering. Existing community groups will use the activities in their regular meeting structure. Visits to the museum exhibits, titled Design Your World will reinforce messages; (2) Design Your World Exhibits will serve as a community hub at two ISE institutions (Oregon Museum of Science and Industry and the Hatfield Marine Science Center). They will leverage existing NSF-funded Engineer It! (DRL-9803989) exhibits redesigned to attract, engage, and mobilize a more diverse population by showcasing altruistic, personally relevant, and social aspects of engineering; (3) Digital engagement through targeted use of social media will complement program and exhibit content and be an online portal for groups engaged in the project; (4) A community action group (CAG) will provide professional development opportunities to stakeholders interested in girls' STEM identity (e.g. parents, STEM-based business professionals) to promote effective engineering messaging throughout the community and engage them in supporting project participants; and (5) Longitudinal research will explore how girls construct and negotiate engineering-related identities through discourse across the project activities and over time.
COASSTal Communities of Science is a citizen-science project whose goal is to increase the scientific and educational reach of a highly successful, action-oriented and rigorous citizen science program - the Coastal Observation And Seabird Survey Team (COASST), by adding a new data module on marine debris that will feature innovative technological approaches including mobile apps and web-based crowdsourcing. The marine debris module will complement an existing module on beached birds, allowing COASST to more completely assess coastal environmental health. For instance, marine debris data, focused particularly on issues of invasive species, harm to wildlife, and debris sourcing, will be immediately useful in marine science and resource management. Once designed and vetted by professional scientists and science educators, the new module will be implemented by citizen scientists in over 100 in-community trainings conducted throughout the COASST geographic range, from northern California to the coast of Alaska, including remote coastal communities with limited access to scientific information. Over 1,000 new participants will join the program, bringing the total number of active volunteers to 2,000 within the 4 years of the project. A complementary social science research component will advance the field of informal STEM learning by focusing on the factors facilitating recruitment and especially retention in citizen science projects, using COASST as a model. The current models of science learning in informal contexts will be extended by bringing them together with conceptual approaches to the development of interest, communities of practice, and activity theory. Research will specifically focus on differences in individual motivation to join COASST; follow participants as they enter the program and eventually become central members of the COASST community of practice; and assess the degree to which individual, programmatic and socio-cultural factors contribute to participant retention. A linked independent evaluation will assess the depth of learning individuals experience as a function the training and materials they receive, and amount and type of data they collect. Both research and evaluation components will utilize pre/post surveys, interviews, and longitudinal journaling.
The Badges for College Credit project designs and researches: (1) a digital badge system that leads to college credit as the context for investigating how to integrate badges with learning programs; (2) how to assess learning associated with badges; and (3) how badges facilitate learning pathways and contribute to science identity formation. The project is one of the first efforts to develop a system to associate informal science learning with college credit. The project will partner with three regional informal science institutions, the Pacific Science Center, the Future of Flight, and the Seattle of Aquarium, that will facilitate activities for participants that are linked to informal science learning and earning badges. The project uses the iRemix platform, a social learning platform, as a delivery system to direct participants to materials, resources, and activities that support the learning goals of the project. Badges earned within the system can be exported to the Mozilla Open Badges platform. Participants can earn three types of badges, automatic (based on participation), community (based on contributions to building the online community), and skill (based on mastery of science and communication) badges. Using a learning ecologies framework, the project will investigate multiple influences on how and why youth participate in science learning and making decisions. Project research uses a qualitative and quantitative approach, including observations, interviews, case studies, surveys, and learning analytics data, and data analytics. Project evaluation will focus on the nature and function of the collaboration, and on the scale-up aspects of the innovation and expansion, by: (1) analyzing and documenting effective procedures,and optimal contexts for the dissemination of the model and (2) by analyzing the collaboration between informal science organizations and higher education.
DATE:
-
TEAM MEMBERS:
Carrie TzouKaren LennonAmanda GoertzGray Kochlar-Lindgren
The Global Soundscapes! Big Data, Big Screens, Open Ears Project uses the new science of soundscape ecology to design a variety of informal science learning experiences that engage participants through acoustic discovery Soundscape ecology is an interdisciplinary science that studies how humans relate to place through sound and how humans influence the environment through the alteration of natural sound composition. The project includes: (1) an interface to the NSF-funded Global Sustainable Soundscapes Network, which includes 12 universities around the world; (2) sound-based learning experiences targeting middle-school students (grades 5-8), visually impaired and urban students, and the general public; and (3) professional development for informal science educators. Project educational components include: the first interactive, sound-based digital theater experience; hands-on Your Ecosystem Listening Labs (YELLS), a 1-2 day program for school classes and out-of school groups; a soundscape database that will assist researchers in developing a soundscape Big Database; and iListen, a virtual online portal for learning and discovery about soundscape. The project team includes Purdue-based researchers involved in soundscape and other ecological research; Foxfire Interactive, an award-winning educational media company; science museum partners with digital theaters; the National Audubon Society and its national network of field stations; the Perkins School for the Blind; and Multimedia Research (as the external evaluator).