University of Washington researchers and their collaborators are evaluating the impacts and effectiveness of a citizen science program called COASST (Coastal Observation and Seabird Survey Team) that engages 600 trained non-scientists in collecting data on beached birds found on more than 300 beaches from the north coast of California to Alaska. The goals of the COASST program are to expand coastal citizen involvement in scientifically meaningfully science and improve the use of citizen science as a tool for scientific inquiry and resource management. Project personnel are analyzing current COASST materials and activities to determine (1) the best uses of COASST bird data, (2) how to maximize engagement of coastal citizens in COASST\'s scientific activities, (3) how to increase COASST participant learning, skills development, awareness and action, and (4) how to scale up the project by developing additional materials and facilitating adoption of the COASST model by other organizations around the country. The analysis includes an evaluation study of the existing beached bird instructional module to identify successful components for future use and determine whether the balance between automation and individualization of components, such as the materials, website, and training, optimizes participant experience. The project team is also working with current participants, marine scientists, and marine natural resource managers via surveys, focus groups and design and testing groups, to determine what other types of data are important for citizen scientists to collect. The project's findings will help researchers understand how citizens, scientists, and resource managers can partner to engage the public in rigorous citizen science activities, create a flexible citizen science program that can be scaled-up demographically and geographically, and work with new and existing COASST participants, COASST data end-users, and potential COASST model adopters to meet new scientific, educational, and resource management needs.
The Science Museum of Minnesota (SMM) is collaborating with the Museum of Science in Boston (MoS), the North Carolina Museum of Life and Science in Durham (NCMLS), Explora in Albuquerque, the Center for Research in Mathematics and Science Education at San Diego State University (CRMSE), and TERC in Cambridge, MA to develop, create and evaluate "MathCore for Museums," long-term math environments that children can interact with over multiple visits and over several years. The project is prototyping and producing 12 open-source, validated interactive exhibits about proportion: fractions, ratios, similarity, scaling, and percentages, basic concepts for understanding Algebra. The eight best exhibits will be replicated for each MathCore museum and the exhibits will be supported by a limited-access website designed to support and extend repeated use of exhibits and further exploration of ratio and proportion. Selinda Research Associates will conduct a longitudinal evaluation of the project. CRSME will conduct a research study of selected exhibit prototypes to investigate when children start to work on proving relations between similarity and proportion in informal settings, the relationship between children's artwork and mathematical insight, and the roles of bodily activity in learning to see relations in similarity and proportion. Results will be disseminated in peer-reviewed publications, at professional meetings, at the Association of Science and Technology Center's RAP Sessions at the NCMLS, and through the project's website.
The University of Minnesota is partnering with several nature centers in the Midwest to transform citizen "technicians" into citizen "scientists." The Driven to Discover project will use existing citizen science programs with strong educational components to engage 12-14 year old youth and their adult mentors in authentic research. The goal of the project is to develop a training model for adults who work with youth in a variety of informal education settings to involve them in authentic scientific inquiry via citizen science rather than just data collection activities. In the proof-of-concept phase, teams consisting of 4-H youth, adult leaders, and several scientists are conducting participatory action research to understand what factors lead youth to full engagement in ecological research. In phase two, project personnel are training 4-H educators, naturalists, and teachers how to engage youth and their adult leaders in other 4-H programs and other informal education programs to conduct ecological research with scientists in advisory roles. Phase one involves approximately 10 adults and 70 youth, whereas phase two involves approximately 40 adults and 300 youth. A front-end study defined the project's target audiences and partners. Formative evaluation study will monitor interactions among members of the research teams and summative evaluation will measure impacts on participants' knowledge, skills development, attitudes, and behavior. Project deliverables include youth-generated ecological research findings, web-based program implementation materials, an annual conference, and a model for engaging youth groups in informal settings in authentic scientific inquiry. The model is expected to impact more than six million youth nationwide.
DATE:
-
TEAM MEMBERS:
Karen OberhauserNathan MeyerAndrea Lorek StraussPamela NippoltKatie ClarkRobert Blair
This development project will create, test, validate, and disseminate a suite of evaluation tools for use by professionals who are developing Public Participation in Scientific Research projects. The necessary evaluation tools for what participants learn or believe after participating in citizen science projects (called Public Participation in Scientific Research or PPSR) are generally unavailable to project managers where conference participants. The project will collect examples of cognitive and affective test instruments and try them out in citizen science projects underway. This project grew from discussions at a conference on Developing a Citizen Science Toolkit at Cornell in 2007 where participants noted that evaluation is the most challenging and least understood step in the process of project development. Thus to provide projects with the tools of evaluation that are relevant to the field itself and to the development of the projects on citizen science, the investigators intend to conduct a study to demonstrate how an evaluation framework can be used to assess the impact of projects by conducting evaluations and presenting them as case studies. The investigators will provide evaluation tools for project developers and will facilitate community discussion about the use of these materials. The project also will provide an evaluation of the procedures used to create the tool kit for investigators. The evaluators are expert professionals in the field of attitude measurement, cognitive measurement, informal science program creation, and citizen science management. The investigators will provide webinars for investigators planning to use the tool kit in their projects. This project is intended to strengthen the field of informal science education researchers and administrators by providing a source for acceptable measurement methods of the impact on the public of participating in a scientific research project.
Understanding the Tree of Life was a 36-month-long conference project that brought together evolutionary biologists, museum educators (including natural history museums, science centers, zoos, aquaria and botanical gardens), and STEM-education/cognitive psychology researchers with the goal of improving both the research agenda and practice of the use of phylogenetic "tree of life" visual representations in museum exhibits on evolution. The project was multi-faceted, incorporating pilot research studies, a planning meeting and a major conference, and evaluation of the conference and impact on professionals. Participants represented several museums and university-based researchers across the country and one in Israel. Four research groups, twenty planning meeting participants, sixty-two conference attendees from thirty institutions, and twelve advisors were involved.
The proposed CAREER study uses a comprehensive mixed-methods design to develop measures of motivational beliefs and family supports for Spanish and English speaking Mexican-origin youth in high school physical science. The research examines a three-part model which may provide a deeper understanding of how Mexican families support youth through their general education strategies, beliefs about physical science, and science specific behaviors. This approach incorporates motivation and ecodevelopmental theories while pursuing an innovative line of research that examines how the contributions of older siblings and relatives complement or supplement parental support. The study has four aims which are to (1) to develop reliable, valid measures of Mexican-origin adolescent motivational beliefs and family supports in relation to high school chemistry and physics, (2) to test whether family supports predict motivational beliefs and course enrollment, (3) to test how indicators in Aim 2 vary based on gender, culture, English language skills and relationship quality, and (4) to examine how family supports strengthen or weaken the relationship between school-based interactions (teachers and peer support) and the pursuit of physical science studies. Spanish and English-speaking Mexican-origin youth will participate in focus groups to inform the development of a survey instrument which will be used in a statistical measurement equivalence study of 300 high school students in fulfillment of Aim 1. One hundred and fifty Mexican high school students and their families will participate in a longitudinal study while students progress through grades 9-12 to examine Aims 2- 4. Data to be collected includes information on science coursework, adolescent motivational beliefs, supports by mothers and older youth in the family, and family interactions. All materials will be in English and Spanish. The educational and research integration plan uses a three pronged approach which includes mentoring of doctoral students, teacher outreach, and the evaluation of the ASU Biodesign high school summer internship program using measures resulting from the research. It is anticipated that the study findings will provide research-based solutions to some of the specific behaviors that influence youth motivation in physical sciences. Specifically, the study will identify youth that might be most affected by an intervention and the age of maximum benefit, as well as valid, reliable measures of youths' motivation that can used in interventions to measure outcomes. The study will also identify family behaviors that may be influenced, including education strategies for school preparation, beliefs about physical science, and sciece-specific strategies such as engaging in science activities outside school. The findings will be broadly disseminated to science teachers, scholars, and families of Mexican-origin youth. This multi-tiered approach will advance current scholarship and practice concerning Mexican-origin adolescents' pursuit of physical science.
The Zoo and Aquarium Action Research Collaborative research project targets zoo and aquarium staff with a cascading action research model meant to build the capacity of the informal science education field to conduct action research on visitor learning. Research questions focus on the experiences of participating zoo and aquarium staff in conducting action research on visitor experiences and how they use the information from that research to improve and develop educational programs. In the first year of the project, zoo and aquarium staff will implement a well validated educational activity with visitors to their institutions and learn how to develop and implement action research in their context. In the second year of the project, zoo and aquarium staff will take their new skills in action research and develop their own questions to investigate visitor learning in their own organizational settings. Project staff will train zoo and aquarium staff in action research, provide technical assistance and facilitate collaboration among the sites and staff. This project will contribute to learning in the field about how action research can be used to develop ISE staffs\' skills in data collection, data analysis and data-driven decision making. Partners in this project include TERC and Oregon State University, and sites are situated in zoos and aquariums in six states: CA, MO, MA, AZ, MD and WA. At each of these institutions approximately 15 senior staff will participate in the professional development. Evaluation of the project will focus on the learning that is generated about collaborative models for action research and the impact on ISE staff of participating in action research as professional development. Methods for the evaluation will include surveys and interviews with participants, observations, document review and site visits. Outcomes of the project include increased capacity for zoo and aquarium staff to conduct action research on visitor learning, case studies of collaborative action research projects that will be disseminated widely through workshops and conferences, and research papers presented at conferences and published.
This research project, from The University of Central Florida, and the Museum of Science and Industry, investigates a three-cycle research and development process where middle school student learners will be immersed in a mixed reality environment while interacting with functional metaphors to determine the effects of conceptual change, motivation and scientific habits of mind while engaged in learning physics content. The project is guided by the following research questions: How does the opportunity to embody elements of an immersive simulation affect a learner's propensity to experience conceptual change and develop scientific habits of mind? What design features of missed reality environments best support metaphors? What metrics are most effective for assessing learning through body-based metaphors? What are the practical considerations to creating immersive metaphor-based learning experiences in ISE institutions such as a Science Center? The investigators will use a between subjects mixed method approach with middle school students (N = 360) involving three research cycles that are performed in controlled conditions. The multiple iterations will allow modifications to the study's design to dig deeper into the data and afford more careful analysis, revisions and modifications to simulation content, protocol and data collection instruments and the technology installation. Middle school students will be recruited from local schools and the Museum of Science and Industry visitors. The evaluation plan includes the assessment of perceived values of using whole-body metaphors within mixed reality environments to learn physics. Professional audiences, educators and ISE practitioners will assess the impact, design and content associated with research on learning, mixed reality design, science and physics education. Research on understanding the process of using whole-body interactions in a mixed reality environments will help educational researchers and practitioners in the field understand the effectiveness of metaphor based learning of scientific concepts with whole body interactions. This project contributes knowledge about how people learn within informal settings. This theory-driven design approach has the potential for broad implementation in both formal and informal environments.
This project will develop a prototype intelligent cyberlearning platform for middle school audiences at a museum location to test and evaluate the use of virtual learning technologies. The content for this test is focused on sustainability issues that enable students to develop an age-appropriate understanding of the relationships between specific conservation decisions, energy use, human health, and population growth within Earth's ecosystem. The prototype cyberlearning system will demonstrate how users can learn about science topics by interacting with a display of environmental factors that enable them to explore the impact of social, economic, and technological forces that may change one existing state and condition to another. The system will enable users to understand the interrelationships of those elements by enabling them to change conditions and then observing the effect of the changes they make on the conditions presented in the initial model. The prototype intelligent cyberlearning system will provide a unique integration of a sophisticated agent-based modeling simulation of environmental, social, and economic phenomena with three advanced learning technologies: game-based learning systems, intelligent tutoring systems, and narrative-centered learning systems. The game-based and narrative aspects of the project are embodied in the interactive time-travel focus of the 3D display on a multi-touch surface computing table in which users will play the role of environmental scientists who have been charged with helping earth become a thriving green planet. They will go back in time and be given the opportunity to make different decisions on any range of options. After they make their decisions, they will travel forward in time to see the results of their decisions. All of the interactions will be used to dynamically generate their time-travel adventures. The intelligent tutoring system will track user\'s problem-solving activities in the simulated world. As users make decisions, the intelligent tutoring system will draw inferences about their level of understanding of key environmental concepts. Given the current problem-solving goal (e.g., reduce green house gases) and the current state of the environment (e.g., climatological state, earth's population, factory emissions), the intelligent tutoring system will draw on its knowledge of common environmental misconceptions to assist students as they progress through the sustainability narratives. The intelligent tutoring system will receive the updated state from the agent-based simulation, which will then provide explanatory commentary and advice through the virtual human to the users about the causal connections underlying the results of the decisions they have made. Similarly, during the course of decision-making, users will be able to request advice, and the same computational framework will drive the virtual human\'s advice generation functionalities. The project will design, development, deploy, and evaluate a prototype intelligent cyberlearning platform for sustainability that supports independent, but guided, exploration of science topics. Because all users interactions will be accompanied by a virtual environmental scientist who will narrate their journeys and offer problem-solving advice, users will be afforded rich learning opportunities that support independent inquiry but also provided guided exploration of complex science topics. With a focus on group learning experiences in the out-of-school setting, the virtual environmental scientist will answer questions that will engage groups of users in a collaborative effort to understand the rich interrelationships of sustainability. The project will demonstrate the transformative potential of intelligent cyberlearning systems that integrate agent-based modeling with game-based learning, intelligent tutoring systems, and narrative-centered learning in an out-of-school setting to enable users to experience science in fundamentally new ways.
DATE:
-
TEAM MEMBERS:
James LesterBradford MottJames MinoguePatrick Fitzgerald
The Exploratorium and the Museum of Life and Science will develop, evaluate and implement Science of Sharing, a three-year full-scale development project designed to bring the scientific study of human social behavior to a broad public audience. Science of Sharing will create new ways for visitors to experiment with social psychology and will generate important information for informal science institutions committed to involving visitors in discussions of personal, societal, and scientific responses to real-world challenges. Science of Sharing addresses a critical ISE issue: creating ways for visitors to experiment with inquiry based exhibits and activities that heighten public knowledge of the study of human social behavior. Based on research in social psychology and game theory, the project (a) fosters public engagement in activities exploring collaborative behavior and resource sharing; (b) promotes awareness of connections between these experiences and STEM-related research in psychology and economics; and (c) links individual behaviors to real-world issues of resource depletion and group conflict. The primary audience is youth and youth-adult museum visitors, with particular focus on underrepresented communities with limited access to communication technologies. The secondary audience is ISE professionals with interest in new kinds of interactive experience and visualization tools focusing on social behavior and techniques for fostering social interaction and public discussion of science. The project will (1) conduct front end evaluation to assess visitor attitudes and knowledge about issues of cooperation and resource use; (2) design, prototype, and evaluate 15 inquiry-based exhibits and 4 Experimonths (public events with web, museum, and community-based components on social-psychological topics); (3) conduct design-based research to investigate aspects of these exhibits and activities that prompt self-reflection and build metacognitive skills; and (4) work with local school districts to adapt exhibits for classroom use.
The Fort Worth Museum of Science and History will partner with The Exploratorium and with three smaller science museums that have strong connections to rural and Spanish-speaking populations in Texas: Discovery Science Place, Loredo Children's Museum, and Science Spectrum to develop TexNET, a four-year project modeled on the Exploratorium Network for Exhibit-based Teaching (ExNET). TexNET builds on lessons learned from past exhibit outreach models and addresses the needs of small, rural partners for exhibits and capacity-building workshops. Each small museum partner will host a set of ten exhibits for one year. Exhibit topics are 1) motion, 2) weather and 3) sound. Workshops focus on inquiry learning techniques, science content, programming and workshop design, as well as the institutional needs of each partner. Based on feedback from formative evaluation, the project added three additional partners in its final year, the Children's Museum of Houston, the Austin Children's Museum, and the Don Herrington Discovery Center, and focused its remaining year on building institutional capacity around tinkering. Inverness Research Associates will conduct the project evaluation. They will examine the success of this project by looking at the effectiveness of the TexNET model, the success of the individual exhibit elements to engage rural communities, the effectiveness with which this project has enhanced the abilities of local rural communities to sustain their own educational improvements and the effectiveness of the training components in increasing the capabilities of the local museums to serve their rural audiences.
DATE:
-
TEAM MEMBERS:
Charlie WalterSamuel DeanJoe HastingsRobert Lindsey
resourceprojectProfessional Development, Conferences, and Networks
This is a five-year project aimed at organizing a DRK-12 Resource Network to provide assistance for projects in areas such as research and development methods, implementation, and analysis procedures; synthesis of findings across the portfolio of projects; and national dissemination of the R&D contributions of the DRK-12 program. To accomplish these goals, Education Development Center (EDC) will join efforts with Abt Associates Inc., and Policy Studies Associates to implement three major strands: (1) Technical Assistance, which consists of (a) a portfolio assessment to define it in terms of composition and major characteristics and identify project needs, (b) individual technical work services to project leadership, (c) focus groups, (d) thematic meetings, (e) Principal Investigators (PI) meetings, and (f) a web portal; (2) Portfolio Analysis, including (a) synthesis activities to capture a comprehensive view of the portfolio in order to understand the role that the program has played in advancing K-12 student and teacher learning, and (b) evaluative studies of selected projects describing specific contributions to the field; and (3) Dissemination, comprising (a) the development of a white paper to summarize research findings on dissemination and implementation of research in practice and policy settings and highlight examples from the portfolio, and (b) a series of dissemination-related workshops.
DATE:
-
TEAM MEMBERS:
Barbara BernsAlina MartinezJacqueline MillerE. Paul GoldenbergCatherine McCullochBrenda TurnbullFran O'Reilly