The Citizen Science Embedded Assessment project will explore the use of embedded assessment to measure participant science inquiry skill development within the context of citizen science projects. Citizen science (CS) projects partner volunteers with scientists to participate directly in research endeavors. Embedded assessments (EAs) assess participant skills and performance that are directly integrated and are indistinguishable from day-to-day activities. As such, EAs allow learners to demonstrate their science competencies through tasks that are integrated seamlessly into the learning experience itself. The CS field has a growing inventory of self-assessment tools, however, the evaluation of citizen science (and other informal science projects) using such subjective assessments can be remarkably improved when these are used in combination with objective measures of knowledge, skills or other resources participants gain through their participation. Science skills, such as data collection and analysis, are particularly important for CS projects because of their focus on the scientific process and their need for rigorous data collection. Despite the focus on skill gains, CS projects rarely measure such improvements. Embedded assessments (EAs) offer a critical method for understanding the impacts of these participatory learning environments. The project will develop and field test EAs on citizen science topics with an environmental science focus. It will also design training to support their use by individual projects. The project has three primary research foci: (1) identifying common and unique science inquiry skills targeted by CS projects, and how skills are currently being measured to document project impact; (2) identifying the opportunities and challenges present in developing and administering EA tools customized for CS projects to assess science inquiry skills; and (3) assessing whether EA tools created for a CS project can provide project leaders with a better understanding of their project's impact on participant science inquiry skills. The project will address these questions with a needs assessment of research and evaluation studies within the CS community and case studies to develop and test EAs customized for three identified and interested CS projects.
This project will bring STEM education to rural communities through local public libraries. Museum quality exhibits labelled as "Discover Earth", "Discover Technology", and "Discover Space" will spend 3 months at a series of locations around the Nation. Twenty four medium sized libraries will be chosen for the large exhibits and forty small libraries will be chosen for scaled down versions. The project's intent is to provide exhibits in every state and to reach as many under-represented individuals as possible. The significance of this project is that rural areas of this country are underserved regarding STEM education and since this segment of society is represented by 50-60 million residents, it is important to reach out to them. There is a significant segment of the Nation's population (50-60 million) that is underserved by out-of-school learning venues such as museums and science centers. An earlier phase 1 project demonstrated at 18 sites that rural libraries and librarians could provide STEM education to community members ranging in age from adults to children using these hands-on exhibits. Each exhibit (earth, space or technology) includes information about the topic and technologically enabled models to provide interesting and fun discovery mechanisms. They use common layman friendly language that highlights the most recent discoveries in each area. Each exhibit will be placed in the selected library for 3 months during which the library will organize events to feature and advertise the STEM learning opportunities. Another feature of this project will be to determine the models of learning in library settings and as a function of the demographics. The partners in this project that bring the necessary expertise are the American Library Association, the Afterschool Alliance, the Association of Rural and Small Libraries, the University of Colorado Museum, Datum Advisors, LLC, Evaluation and Research Associates, the Lunar and Planetary Institute, the American Geophysical Union, and the Space Science Institute.
This early-stage design and development, integrated media and research project will contribute important new understandings to the informal science learning literature by exploring science engagement on social media when integrated with broadcast television. It will help answer questions including: What does such engagement look like? Who participates? How and why does it happen? and What is the degree or depth of engagement? The project builds on the previous successful work by WGBH nationally distributing the television series NOVA scienceNOW and the research expertise of EDC. WGBH's NOVA scienceNOW program will collaborate with EDC to develop new metrics to understand how and why learners engage with science on social media. Deliverables will include six one-hour episodes of NOVA scienceNOW, short online videos, moderated online discussion events, and an online film festival. A new social Media Initiative will develop six live broadcast microblogging events, six post-broadcast online discussion events, daily social media updates, and an online film festival that will feature user generated videos. A range of STEM content in the videos and online posts will be framed around big science and engineering questions such as animal communication and survival systems, the biology of sleep, climate change, new technologies, energy, genetics, and natural disasters. The continued innovations and expansion of social media channels provides significant new opportunities for providing learner's access to high quality science content, researchers, and opportunities to participate in science. In the first phase of this work to deepen the evidence based understanding of how social media supports informal science engagement, NOVA and EDC will collaborate to develop new measurement instruments: (1) a Network Profile to quantitatively represent the size and activity of NOVA's social media network; (2) an Informal Science Engagement (ISE) index to measure the degree of engagement by coding and analyzing conversations and posts; (3) a Follower Profile to assess the degree of activity and the nature of the engagement; and (4) a Science Social Media Engagement survey instrument. They will then use these measures and data collection protocols to explore whether and how the initiative might influence science engagement. External expert reviewers with content and methodological expertise will review all aspects of the project at critical junctures. This project will contribute important new knowledge and research instruments and methods to better understand how the learning opportunities of social media channels can be realized most effectively. This has significant potential for broad and lasting benefits to society as well as advancing the informal science learning field.
For over two decades NSF has been investing in the development and evaluation of giant screen films for viewing by audiences in science centers and museums. These have been highly successful in terms of audiences reached and project evaluations that indicate their impact on learning. Less well understood is how the unique attributes of giant screen films (e.g., "immersion" and "presence") affect learners in ways that differ from other film formats. This integrated research and media project will contribute to that knowledge base. Project deliverables will include a giant screen film that tells the story of the discovery of biological mimicry (the critical proof for natural selection and in turn, evolution) through the life story of Henry Bates and his travels through the Amazon rainforest more than 150 years ago; 2D dome, and 2D flat format versions; live interactive science demonstrations and educational resources; and workshops for ISE professionals. The film and the related outreach via science centers, social media, and the web are expected to reach large public audiences; workshops and web resources will reach ISE professionals nationally. A strategy for reaching underrepresented audiences through science museums and partnerships with educational societies is a part of the broadening participation effort. Building on results of an NSF-funded workshop in which researchers, evaluators, and filmmakers began to develop a research agenda to provide evidence about giant screen attributes and their impacts on learning, the research component of this project will focus on the differences in learner knowledge among the various film formats, their unique attributes, and whether format plays a role in science interest and science identity. A baseline study will be conducted to begin gathering evidence on how each of these formats affects learning. Data on audience knowledge gains, interest, and science identity will be collected using a novel tablet-based game-like assessment pre-film viewing, immediately post viewing, and in a later follow-up. These baseline data will inform follow-on research that, over time, can better explain the unique impacts on learning of the giant screen format. Project partners include the Pacific Science Center, SK Films, Howard Hughes Medical Institute, Rutgers University, and Arizona State University.
This project is intended to develop a model for STEM education through local libraries. There are several unique features in this endeavor. The model is being aimed at rural libraries and adult residents that are geographically remote from typical venues such as museums, zoos, and science centers. According to the 2000 census, there are 50 million individuals in this designation and the size of the group is increasing and becoming more diverse. Efforts to impact diverse audiences who are economically disadvantaged will be part of the plan. In many rural locations there are few community venues, but libraries are often present. The American Library Association and the Association Rural and Small Libraries have begun the reinvention of these libraries so they can become more attuned to the communities in which they are apart. Thus, this project is an effort to find new ways of communicating STEM concepts to a reasonably large underserved group. The design is to derive a "unit of knowledge enhancement" (some portion of Climate Change, for example) through a hybrid combination of book-club and scientific cafe further augmented with videos and web materials. Another part of the design is to enhance the base STEM knowledge of library staff and to associate the knowledge unit with an individual who has the specific STEM topic knowledge for a specific unit. Considerable effort shall be expended in developing the models for staff knowledge enhancement with a progressive number of librarians in training from 8 to 20 to 135. To build the content library model, five units of knowledge will be devised and circulated to participating libraries. Evaluation of the project includes front end, formative and summative by the Goodman Research Group. In addition to the "units of knowledge enhancement," the major results will be the model on how best to relate and educate citizens in rural environments and how to educate the library staff.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. Nationally, the US has a shortage of computer scientists; a big part of this problem is that girls are discouraged from learning computer science at a very young age. This project tries to address this problem by creating a videogame specifically oriented towards getting middle school girls interested in learning computer science concepts outside traditional programming classes. Based on evidence that stories provide a compelling way to present complicated technical subjects and that girls in particular respond to technology careers as a way to help others, the project is building a videogame called "Gram's House" in which social workers intend to move a fictional grandmother to a retirement home unless the player can outfit her home with sufficient technology for her to remain independent. Solving puzzles in the game requires learning core computer science concepts. Research studies will be conducted to determine whether the videogame is effective at getting girls interested in computer science, at teaching computer science concepts, and whether using stories makes videogames more effective for learning. This project based on an earlier successful prototype uses an iterative research-based design process including paper prototyping, playtesting, and focus groups (N=20) to create age appropriate activities, based on the CS Unplugged series, that support learning concepts from the Data, Internet, Algorithms, and Abstraction sections of the high-school level CS Principles curriculum. A quantitative, quasi-experimental design will be used to determine the overall effectiveness of teaching CS concepts under three types of game conditions: (a) games alone, (b) games with fictional settings, and (c) games with stories. A novel assessment instrument will be developed to assess content learning and qualitative observation using a standard observation protocol will be used to gauge interest and engagement. 70-80 middle school girls will be recruited for afterschool participation in the study in two states. As part of the dissemination efforts, a facilitator's guide, rule book, and materials such as maps and storyboards will be created and shared with the game. In addition, a workshop for computer science and other teachers who are interested in using games to teach CS concepts will be conducted.
Many communities across the country are developing "maker spaces," environments that combine physical fabrication equipment, social communities of people working together, and educational activities for learning how to design and create objects. Increasingly, maker spaces and maker technologies are being designed to provide extended learning opportunities for school-aged young people. Unfortunately, few youth from under-represented populations have had the opportunity to participate in these maker spaces, and many communities do not have the resources to establish facilities dedicated to making activities. This project, a collaboration of faculty at California State University, San Marcos and San Diego County Office of Education, the Vista Unified School District, and the San Diego Fab Lab, is a feasibility study that will work to address these needs by implementing and evaluating a pilot Mobile Making program in an underserved youth population. It will bring Making to four after-school programs in underserved communities in San Diego by using a van to take both equipment and undergraduate student mentors to program sites. At these sites, between 50% and 90% of the students are Hispanic or Latino and between 40% and 90% are eligible for free or reduced price lunch. The project employs a research-based approach to the design and implementation of the Mobile Making program, coupled with an evidenced-based plan for developing a model for future dissemination. Project objectives are: increasing the participants' interest, self-efficacy, and perception of the relevance of Making/STEM in everyday life; identifying and overcoming challenges associated with a Mobile Making program; developing a model for implementing and assessing Mobile Making in underserved communities; and disseminating materials and guides for practitioners. Development will be guided by five research-based principles for design of out-of-school time programs in underserved communities: access to resources; ethnically diverse near-peer leaders; authentic activities; legitimacy within the community; and ongoing input from participants. To inform program development and implementation, including continuous monitoring and adjustment throughout the two-year initiative, the evaluation component will use a mixed methods approach to study outcomes with respect to the students, their parents and the undergraduate mentors. Future work will apply the lessons learned in the project to guide implementations and study the model's applicability in other informal education settings. The dissemination plan will include publication of project findings, activities, practitioner's guides, and the model for implementing making programs in underserved communities.
The mission of the New Mexico Informal Science Education Network (NM ISE Net) is to provide opportunities and resources for informal educators to work together to impact science teaching, science learning, and science awareness throughout the state of New Mexico. The NM Museum of Natural History and Science leads NM ISE Net with support from NM EPSCoR.
DATE:
-
TEAM MEMBERS:
New Mexico Museum of Natural HistorySelena ConnealyCharlie Walter
The Conservation Trust of Puerto Rico is creating citizen science projects in five research areas (insect monitoring; coastal/river system management; bird communities; bat assemblages; and cultural resources) that allow 140 Hispanic residents of Puerto Rico (age 14 and older) to move along a continuum of research involvement from contributor to collaborator to co-creator. As citizen scientists engage in scientific research that measures the effects of urban development on the Manati River watershed in northern Puerto Rico, the project team is evaluating the degree to which participants show changes in science knowledge, skills, attitudes, communication, and behavior. The proposed project is accelerating the development of citizen science activities in Puerto Rico. New scientific knowledge generated by citizen scientists will have practical importance within and beyond the Manati watershed because Puerto Rico is undergoing rapid urban development, resulting in the loss of biodiversity and emergence of environmental problems such as lower water quality. Environmental data collected by citizen scientists will form an environmental database that permits long-term watershed monitoring and informs land use decision making.
"Let's Talk" will bring together professionals who are engaged in facilitating, evaluating or studying dialogue in STEM and history-based institutions for a symposium in Summer of 2015 structured as a 'meta-conversation' about what we know about dialogue. The project addresses the lack of a generalizable body of knowledge about dialogue, the need for instructional models and theory to inform the use of Dialogue programming, and the opportunity to prepare future museum professionals. Co-PI's: Kris Morrissey and Robert Garfinkle. Key activities include: Research Synthesis Paper; Symposium of professionals across STEM and history-based museums; Development of theory-based resources.
NNOCCI is a collaborative effort led by the New England Aquarium with the Association for Zoos and Aquariums, the FrameWorks Institute, the Woods Hole Oceanographic Institution, the National Aquarium in Baltimore, Monterey Bay Aquarium, the New Knowledge Organization in partnership with Penn State University and the Ohio's Center for Science and Industry. With support from the National Science Foundation Climate Change Education Partnership program, NNOCCI's goal is to establish a national network of professionals who are skilled in communicating climate science to the American public.
This Pathways project, led by Hubbard Brook Research Foundation (HBRF), develops and pilots a model to foster engagement and learning among diverse stakeholders related to timely ecosystem, social, economic, and policy issues in rural regions of New England's Northern Forest. As such, this project seeks to serve as a model for how other rural areas across the US that have pressing concerns that relate to science, technology, mathematics, and engineering (STEM) may partner with scientists, community members, and local organizations to better understand and become involved in regional issues. Research carried out for more than 50 years at the 7,800-acre Hubbard Brook Experimental Forest?among the longest-running ecosystem studies in the world?has significant implications for decision making at local as well as national levels on topics including climate change, environmental stresses on tree physiology, biomass energy, and invasive pests and pathogens. By employing a Pubic Engagement with Science approach, the project goals focus on learning and equitable participation by both public audiences (local communities and organizations) and professional audiences (scientists who want to engage in informal science learning). In this case, "equitable" means valuing the experiences and knowledge that diverse people have. "Learning" is designed to occur for all participants, such that everyone has a deeper, broader, and more nuanced understanding of STEM, the regional issues, and opportunities for the future. HBRF has designed a three-part model that includes multi-stakeholder dialogue events, workshops and dialogues with scientists working in the region, and regional capacity building for supporting outcomes of the dialogues and workshops. The project evaluation aligns closely with the Public Engagement with Science approach and project goals. As such, over the course of project activities, the evaluation measures both the public's learning and capacity to engage with other stakeholder around regional issues as well as those of the scientists. In addition, the evaluation will document the strategies and capacities of the HBRF model to broaden and sustain productive interactions among diverse regional stakeholders. Dissemination of this pilot project's findings include a case study reflecting on the process, lessons learned, and potential best practices related to the PES model as well as presentations by project leadership at community, scientific, and educational meetings. The pilot would then provide a foundation for an on-going, expanded effort for HBRF in the Northern Forest and/or an expanded effort in the region around a set off issues. In either case, the full-scale project would build from the refined model as well as the capacity built through the pilot.