The Exploratorium, in collaboration with the Boys and Girls Club Columbia Park (BGC) in the Mission District of San Francisco, is implementing a two-year exploratory project designed to support informal education in science, technology, engineering, and mathematics (STEM) within underserved Latino communities. Building off of and expanding on non-STEM-related efforts in a few major U.S. cities and Europe, the Exploratorium, BGC, and residents of the District will engage in a STEM exhibit and program co-development process that will physically convert metered parking spaces in front of the Club into transformative public places called "parklets." The BGC parklet will feature interactive, bilingual science and technology exhibits, programs and events targeting audiences including youth ages 8 - 17 and intergenerational families and groups primarily in the Mission District and users of the BGC. Parklet exhibits and programs will focus on STEM content related to "Observing the Urban Environment," with a focus on community sustainability. The project explores one approach to working with and engaging the public in their everyday environment with relevant STEM learning experiences. The development and evaluation processes are being positioned as a model for possible expansion throughout the city and to other cities.
Earth Partnership: Indigenous Arts and Sciences (EP) will develop and refine a model for integrating Indigenous and informal and formal K-20 educators in ecological restoration, project-based learning and professional development. EP will involve participants in Native habitat restoration on community spaces, school grounds and nearby natural areas as a context for intergenerational STEM learning across age, ecosystem, discipline, learning style, culture and place. EP integrates Native knowledge and core values including relationship, reciprocity, respect and responsibility with Western STEM concepts and processes. The project will integrate the expertise of university social, physical, life and learning scientists and community and tribal practitioners to design, develop and test informal STEM learning incorporating ecological restoration, citizen science and cultural diversity. EP grows out of a teacher professional development model funded by NSF and is a network that now includes participating individuals and organizations from many states. This network will enhance dissemination and provide a foundation for a larger project growing out of the results of this project. EP will build capacity of Native and non-Native informal educators and citizens to work together to generate engagement among young people and adults with ecological STEM learning and stewardship. The approach will integrate culturally authentic resources, inquiry and citizen science process skills (e.g., data collection, analysis, ecological restoration, water stewardship) in multiple learning settings. Stronger multicultural, intergenerational and community partnerships will be supported to restore aquatic and terrestrial habitats through community-based stewardship projects and Service Learning. Through EP, Native youth will be encouraged to explore STEM careers that will meet future workforce needs for managing tribal resources and become knowledgeable citizens able to use critical thinking and analysis of STEM-related issues in their communities. The project will use a developmental evaluation approach to assess project planning processes and outcomes of educational programs.
The Cyberlearning and Future Learning Technologies Program funds efforts that will help in envisioning the next generation of learning technologies and advancing what we know about how people learn in technology-rich environments. Development and Implementation (DIP) Projects build on proof-of-concept work that showed the possibilities of the proposed new type of learning technology, and project teams build and refine a minimally-viable example of their proposed innovation that allows them to understand how such technology should be designed and used in the future and answer questions about how people learn with technology. Although for years researchers have believed technology could afford anytime-anywhere learning, we still don't understand how learners behave differently across contexts, such as home, school, and in the community, and how to get youth to identify as learners across those contexts. This proposal aims to use mobile devices and strategically placed shared kiosks to 'scientize' youth in two low-income communities. Through strategic partnerships with community organizations, educators, and families, the innovation is to get primary and middle-school students engaging in scientific inquiry in the context of their neighborhoods. Research will help determine how the technology can best be deployed, but also answer important questions about how communities can provide support to help kids think like scientists and identify with science. This project will design and implement ubiquitous technology tools that include mobile social media and tangible, community displays (collectively called ScienceKit) that are deeply embedded into two urban neighborhoods, and demonstrate how such ubiquitous technologies and related cyberlearning strategies are vital to improve information flow and coordination across a neighborhood ecosystem, in order to create environments where children can connect their science learning across contexts and time (e.g. scientizing). A program called ScienceEverywhere comprised of partnerships between tightly connected neighborhood organizations with mentors, teachers, parents, and researchers will help learners develop scientifically literate practices both in and out of school, and will demonstrate students' learning to their communities. Research will consist of mixed methods studies of use of the tools, including iterative design-based research, ethnography, and the use of participant observers from the community; these will be triangulated with usage logs of the technologies and content analysis of microblogs by the learners on their identities and interests. Discourse analysis of interviews with focal learners will orient the qualitative work on identity development, and analysis using activity theory will inform the influences of the social practices and sociotechnical systems on learner trajectories. Formative evaluation will help shed light on if and how the sociotechnical system promotes STEM literacy and STEM identity development.
The Cyberlearning and Future Learning Technologies Program funds efforts that support envisioning the future of learning technologies and advancing what we know about how people learn in technology-rich environments. Development and Implementation (DIP) Projects build on proof-of-concept work that shows the possibilities of the proposed new type of learning technology, and PI teams build and refine a minimally-viable example of their proposed innovation that allows them to understand how such technology should be designed and used in the future and that allows them to answer questions about how people learn, how to foster or assess learning, and/or how to design for learning. This project team aims to explore how to foster learning in socially-networked communities, particularly learning that results in behavior change. Understanding how to foster such learning could have a wide variety of societal impacts, e.g., better fostering science, engineering, mathematical, or design thinking in school or college or on the job, fostering healthy behaviors, helping teens develop pro-social behaviors, and helping people learn to make environmentally-friendly choices as they live their lives. In previous work, this team has developed YardMap, an infrastructure for citizen science that brings together retired adults who are interested in planting and managing their yards in environmentally-friendly ways. YardMap enables social interactions and shared creation of virtual worlds in which participants can try out different ways of managing their yards and see what the downstream effects will be. They also track and display their changing practices and actual yards in ways that are visible to others. YardMap is used by many thousands of participants. In this project, the team is taking YardMap to the next level, using what is known about how people learn and come to change their behaviors to design and refine ways to more directly support individuals in critiquing and improving their behaviors and designs for the common good. What can be learned from the new YardMap will be useful in other fields that focus on helping people change their behaviors in productive ways. The PIs seek to explore how people learn and how to foster learning in socially-networked citizen science communities. Their research addresses how learning happens, how to foster learning, how to design to increase social activity, and how increased interaction with others elevates interest, generates knowledge, and leads to behavior change. Their technological innovation, an infrastructure for citizen science that fosters behavior change, builds on YardMap, an existing infrastructure for citizen science around environmental issues that allows collective data collection and analysis and supports interactive graphing and mapping. Participants design and refine ways of managing their yards in ways that take into account environmental concerns. YardMap enables social interaction and co-creation of a set of virtual worlds for trying out new ideas; learners who are part of the community interact with others in the community, create and refine virtual worlds together, interact with things in the virtual world, manipulate those worlds and collect and analyze data about outcomes, and discuss visual objects that represent real things and practices. As well, individuals track and display their changing practices and actual yards in ways that are visible to others. YardMap can be thought of as a maker movement community focused on yard maintenance; like other maker communities, it encourages participants to create, share and discuss new inventions and practices in a social-networked community setting. Using both what is known about learning in communities and what is known about social drivers of interaction, the team is is extending YardMap to focus on fostering learning and investigating the relationships between learning and behavior change and the influences each has on the other. Much will be learned about how to use social interactions in positive ways to help individuals become more comfortable with behaviors they need to or should take on for health, civic, or educational reasons. What is learned and the technological infrastructure that is created will be directly applicable to other situations where individual behavior changes are needed for change to happen in a social system (e.g., environmental action, changing the culture of an organization, changing norms in a community, perhaps even creating learning communities in formal on-line courses).
This project will research factors influencing the implementation of programs designed to increase diverse participation in informal science. The goal is to provide the informal science education field with information and tools that will help them design effective programs that more effectively engage a broad range of diverse audiences. The project has two major components. First, the project will research the implementation of a citizen science project, Celebrate Urban Birds (CUB), in major U.S. cities. Citizen science projects involve public volunteers in gathering scientifically valid data as part of ongoing research. Second, building on results of the research, the project will launch a website and learning community (called a Community of Practice or CoP) supporting informal science educators that are involved in designing and implementing informal science programs with an emphasis on engaging diverse participants. The project will be lead by the Cornell Lab of Ornithology (CLO), a leader in designing and researching citizen science projects, in collaboration with the Association of Science-Technology Centers (ASTC) and five science center members of ASTC, where the CUB program will be implemented and researched. The objective of the research is to better understand contextual factors and how they impact implementation even when accepted practices are followed. Such research is key not only to revealing accepted practices but also to understanding how projects are implemented in the face of concrete operational, cultural, economic, and demographic variables. The research will use a comparative case study approach, which is designed for studies requiring holistic, in-depth investigation. The development of the website and the CoP will be guided by a Network Improvement Strategy, a research-based approach to designing educational CoPs. The development of the CoP will involve the project stakeholders including the informal science organization practitioners, community organization representatives, CUB staff, ASTC staff, advisors and consultants. This strategy will allow the project team and pilot sites to leverage their diverse experiences and skill sets to improve practice; provide space for researchers and practitioners to work together as partners; and develop a nuanced set of strategies that can be implemented across a variety of organizational contexts.
This Michigan State University and University of Texas-Austin project will focus on making science communication more scientific. It will primarily use interview and survey research to improve societal understanding of how those involved in science communication, particularly scientists, think about science communication. The goal is to use this knowledge to help improve science communication training and recruiting with a focus on increasing the likelihood that scientists will adopt evidence-based communication strategies to increase public interest, engagement, and identification with science, technology, engineering, and math (STEM). A central underlying reason for the study is a mismatch between scientists' motivations and goals when interacting with public audiences and what research suggests would be the most positive and productive with public audiences. This study is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project will be conducted in three phases. The first is interviews with a wide range of science communication experts to assess priority research questions. These interviews will be followed by surveys with U.S.-based members of up to 10 different scientific societies representing a broad range of academic fields as well as a survey of science communication researchers. The survey will focus on three different public engagement modes, including face-to-face engagement, online engagement, and engagement via the news media. Consistent with the Theory of Planned Behavior, the surveys will assess scientists' attitudes about public engagement and specific public engagement goals, as well as perceptions of social norms (both descriptive and injunctive) and efficacy beliefs (both internal and external). These will be used as predictors of general and goal-specific engagement willingness, as well as reported past behavior, using multigroup modeling. Potential communication goals of interest include transferring knowledge, developing interest and excitement, building trust in scientists, demonstrating openness and a willingness to listen, shaping how people think about subjects (i.e. framing), and/or defending science. The final phase of the project will explore the potential to design experiments aimed at testing the impact that mention of specific goals has on communication training recruitment as well as the degree to which online content about various goals is attractive to scientists interested in developing their communication skills. The research is the most targeted and largest attempt to date to understand how scientists' views about the public and communication processes may shape science communication behavior.
Project TRUE (Teens Researching Urban Ecology) was a summer research experience for New York City youth that focused on strengthening their STEM interest, skills, and ultimately, increasing diversity in STEM fields. Through a partnership between an informal science institution (the Wildlife Conservation Society) and a university (Fordham University), 200 high school students conducted urban ecology research at one of four zoos in New York City under the guidance of STEM mentors. A unique feature of Project TRUE was its near-peer mentorship model, in which university professors mentored graduate urban ecology students, who mentored undergraduate students, who mentored high school students Science research projects focused on urban ecology topics, with high school students identifying their own research questions that were nested within the undergraduate mentor’s larger research question, thereby establishing a sense of ownership. Youth collected and analyzed their own data and the experience culminated in the creation of research posters, with teams presenting their posters to the public at a student science symposium.
This project was funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. We studied the impacts of two key parts of the program – conducting authentic science research and near-peer mentorship – on the STEM trajectories of almost 200 high school students who participated in the program from 2015 to 2018. The research explored short-term outcomes immediately after the program and followed up with students multiple years after participation to understand the medium-term impacts of the experience during and after the transition from high school to college.
EvalFest (Evaluation Use, Value, and Learning through Festivals of Science and Technology) will test innovative evaluation methods in science festivals that are being held across the country and assess in what ways and how effectively they are used. Morehead Planetarium and Science Center (at the University of North Carolina-Chapel Hill) and the University of California, San Francisco, in collaboration with over twenty science festivals, will (1) investigate whether a multisite evaluation approach is an effective model for creating common metrics for informal STEM education, (2) develop common methods to measure the effects of Festivals, (3) create a query-able database of 50,000 Festival attendees to share with the informal STEM learning field, and (4) document whether these efforts also result in new knowledge related to informal STEM education. The project will develop the Enterprise Feedback Management (EFM) system and query-able database for the festival community. EFMs are systems, including processes and software, that enable groups (such as the festival network) to collect, organize, analyze and share data. The EFM system will be designed to integrate data across sites and to allow users to extract data of interest. The project will refine evaluation tools currently used within the Science Festival Alliance that assess self-reported festival learning, and the effects of festival attendance, motivation, and future science participation. It will collect economic impact data and longitudinal festival attendee data. The project will also develop some new evaluation tools such as secret shopper observational protocols. Data from festival attendees will be collected onsite at participating festivals.
The Citizen Science Embedded Assessment project will explore the use of embedded assessment to measure participant science inquiry skill development within the context of citizen science projects. Citizen science (CS) projects partner volunteers with scientists to participate directly in research endeavors. Embedded assessments (EAs) assess participant skills and performance that are directly integrated and are indistinguishable from day-to-day activities. As such, EAs allow learners to demonstrate their science competencies through tasks that are integrated seamlessly into the learning experience itself. The CS field has a growing inventory of self-assessment tools, however, the evaluation of citizen science (and other informal science projects) using such subjective assessments can be remarkably improved when these are used in combination with objective measures of knowledge, skills or other resources participants gain through their participation. Science skills, such as data collection and analysis, are particularly important for CS projects because of their focus on the scientific process and their need for rigorous data collection. Despite the focus on skill gains, CS projects rarely measure such improvements. Embedded assessments (EAs) offer a critical method for understanding the impacts of these participatory learning environments. The project will develop and field test EAs on citizen science topics with an environmental science focus. It will also design training to support their use by individual projects. The project has three primary research foci: (1) identifying common and unique science inquiry skills targeted by CS projects, and how skills are currently being measured to document project impact; (2) identifying the opportunities and challenges present in developing and administering EA tools customized for CS projects to assess science inquiry skills; and (3) assessing whether EA tools created for a CS project can provide project leaders with a better understanding of their project's impact on participant science inquiry skills. The project will address these questions with a needs assessment of research and evaluation studies within the CS community and case studies to develop and test EAs customized for three identified and interested CS projects.
The Designing Our World (DOW) project centers on science, technology, engineering, and mathematics (STEM) equity and addresses the need for more youth, especially girls, to pursue engineering and fill vital workforce gaps. DOW will integrate tested informal science education (ISE) programs and exhibits with current knowledge of engaging diverse youth through activities embedded in a social context. Led by teams of diverse community stakeholders and in partnership with several local girl-serving organizations, DOW will leverage existing exhibits, girls’ groups, and social media to impact girls’
DATE:
TEAM MEMBERS:
Oregon Museum of Science and IndustryAnne Sinkey
This resource showcases a conference poster that the Wildlife Conservation Society presented at the 2014 Visitor Studies Association Conference and the 2014 Inclusive Museum Conference, outlining the work we undertook to explore the development of a proposed new family exhibit at the Bronx Zoo, "Safari Adventure," paired with selected results and takeaways. In 2011, the Institute of Museum and Library Services awarded WCS a grant to support our investigation and development. We asked ourselves the questions: How can zoo exhibits better connect people to nature? By what methods can we explore
This is the Front End Evaluation report for the NSF-AISL-funded Pushing the Limits: Building Capacity to Enhance Public Understanding of Math and Science through Rural Libraries (Limits) project. A national survey of rural librarians and their patrons was carried out between February and April 2011. Key guiding questions were: 1) How interested/motivated are rural librarians in: a. Providing science and technology related programming at their libraries; b. Participating in professional development for running public programs; c. Personally learning about science and technology topics. 2) How
DATE:
TEAM MEMBERS:
Dartmouth CollegeJohn H FalkJennifer BachmanMichael Liu