The poster presents information about a research study where we used video-based data collection to investigate how framing of interpretive signage influences visitors’ talk and behaviors at exhibits. The poster shared details of our methods as well as lessons learned from using cameras for capturing video of visiting groups.
The New Jersey Historical Commission (NJHC) initiated the Understanding Communities Study with the goal to better understand how New Jersey history and history organizations can be more inclusive for all. NJHC contracted RK&A for the first phase of the study to conduct focus groups with members of Hispanic and Latino communities in New Jersey. NJHC plans to expand the study to other communities in the future. The New Jersey Center for Hispanic Policy, Research and Development served as advisors in the project.
With support from NJHC partners, RK&A conducted three focus groups with
The National Building Museum (NBM) contracted RK&A to evaluate Creative-in-Residence (CIR), a program that invites visual and performing artists to NBM for short-term residencies to create original work that promotes engagement with the built environment. The study goal was to consider future implications for the CIR program based on the most recent CIR iteration (a January 2019 dance performance inviting visitors to explore NBM’s historic building) and past program iterations.
How did we approach this study?
To hear a variety of perspectives on CIR, RK&A conducted in-depth telephone
The purpose of the Science Center Public Forums project was to engage citizens with NOAA data about climate-related hazards, resilience strategies, and related policies. Forum modules about four climate-related hazards were created, and used as a part of forum programs at eight museums around the US. Evaluation findings are structured around three themes: 1) learning, 2) interest, engagement, and attitudes, and 3) educator outcomes. Data showed high levels of prior knowledge about environmental hazards and interactions between human and natural systems; resilience efforts; and the ways science
This evaluation was commissioned to explore visitors’ reactions to and experience of the Monterey Bay Aquarium's special exhibition Fishing for Solutions. The exhibit team sought feedback about whether visitors perceived the main messages, what mood people leave with, and issues of media choice in exhibit design, among other topics. To provide systematic information on these issues, interviews were conducted with a sample of 343 randomly selected visitors as they were exiting from the exhibition, plus “mini-studies” of 40 people each were conducted at four specific exhibits. Details about
DATE:
TEAM MEMBERS:
People, Places & Design Research
resourceevaluationProfessional Development, Conferences, and Networks
This report summarizes the evaluation outcomes of the Collaborative Project Management (CoPM) Institute project, a two-day convening centered on bringing proven project management skills and approaches in the for-profit world to the informal science education (ISE) community to support effective collaborations and successful outcomes. The CoPM Institute was conceptualized as a pilot effort to test the effectiveness of porting of tools and frameworks for collaborative project management from the business/for-profit environment to advance the following project goals:
Build the capacity of
The project will develop and research how an emerging technology, immersive virtual reality (IVR) using head mounted displays (HMDs), can enhance ocean literacy and generate empathy towards environmental issues. Recent advances in design have resulted in HMDs that provide viscerally realistic and immersive experiences that situate participants in underwater or other remote environments. IVR can provide many people with virtual access to these environments, including persons with disabilities, people living away from coastal areas, or those who lack access for other reasons (e.g., low-income families, underserved/underrepresented communities, persons untrained in diving). The project will develop a high quality 360-degree underwater film that includes live action footage, animation, and interactive elements. The IVR experience will take the participant through an immersive underwater journey of a Pacific reef, using realistic visualizations, narrative, and a compelling story to engage participants in learning the ecology and biology of coral reefs, as well as the impacts of climate change and human disturbances on ocean ecosystems. In addition to the IVR ocean journey, the project will integrate interactive functionality of being on a reef during mass coral spawning, an annual natural phenomenon through which coral reefs replenish their populations. With hand-held controllers, participants will be able to "swim" through the water, watch the degraded reef recover and grow and will have the ability to change the rate of coral recovery and learn how increases in temperature impede coral recovery. While research has been conducted on early, desk-top versions of IVR, the potential impact of IVR on learning is still unclear. The research findings will help guide the development of IVR for use in informal STEM environments such as aquariums, zoos, science museums, and others. The IVR experience will be shared on online platforms for home viewing, at film festivals and conferences, and in informal learning environments.
The project addresses the need for research on the impacts of IVR devices as it become more affordable and more widely used at home and in other informal and formal environments. Few studies have investigated how design elements impact the user in IVR, in which the increased immersion affects the stimuli perception and cognitive processing. The research will assess the learning affordances and impacts of the IVR experience on participant ocean literacy (adapting items from an existing ocean literacy survey), environmental empathy/feelings of presence (naturalistic observations and post-experience interviews), and perceived self-efficacy (pre-post survey, post-interview interviews). In addition, the project will research how segmentation (i.e., a continuous experience vs. an experience with breaks), generative learning tasks (hands-on experiences and interactive during IVR), and gender of the narrator in an IVR experience supports learning about ocean environments. Researchers will collect data from students attending high schools with predominantly minority student enrollments. Research findings will be widely shared through peer-reviewed publications, conference presentations, and publications for educators and designers.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Addressing Societal Challenges through STEM (ASCs) received NSF AISL funding to conduct a Literature Review and Synthesis to answer the question: How are informal learning institutions advancing the use of STEM knowledge and scientific reasoning in the ways that individuals, families, and communities understand what they can do, and apply their learning to solving the societal challenges of our time? Using a definition of societal challenges based on research around the public understanding of social problems, this systematic literature review will identify, analyze, and synthesize three bodies of peer and field-reviewed literature (peer-reviewed journals, graduate theses, and evaluation reports of nationally-funded project).
Over the past decade, Informal STEM learning organizations have increasingly engaged in innovative ways to present STEM knowledge within the context of societal challenges such as climate change, energy sources, cyber-security, Nanotechnologies, coastal resilience, and other topics. These efforts significantly expand the traditional work of Informal STEM Learning (ISL) organizations, often leading to new types of interventions, partnerships, impacts, and assessment tools. Analyzing and interpreting the aggregate of this work will advance theoretical and practical knowledge about the potential of ISL’s in advancing the place of STEM in addressing societal challenges.
Demonstrating and articulating the characteristics of how ISL organizations are addressing societal challenges, encourages and informs the ways institutions can address the NSF strategic goal to “Advance the capability of the Nation to meet current and future challenges.” The project outputs aim to Enhance Knowledge-building, Build Capacity of the Field, and Maximize Strategic Impact by informing the strategies used by organizations and individuals. The results also aim to Broaden Participation by articulating the ways STEM knowledge is embedded and linked to personal experiences and choices.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Funded by the National Science Foundation (NSF), Amazon Adventure is an Innovations in Development project directed by Pacific Science Center in partnership with: SK Films; Rutgers, The State University of New Jersey; Embodied Games; and the Howard Hughes Medical Institute’s Tangled Bank Studios. The project deliverables produced during the grant period include a giant screen film, live stage presentation for use at informal science education (ISE) institutions, and educational resources.
The centerpiece of the project, the Amazon Adventure film, is a 45-minute giant screen film shown in
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will explore how understanding visitors' experiences with science museum exhibits may contribute to increasing engagement among diverse audiences. Museums have made great strides in understanding how exhibit design can support underrepresented audiences, but often tend to focus on individual demographic groups such as females, certain racial and ethnic minorities, and people with disabilities. This project will explore relationships between visitors' demographic and science identities to assess the affordances of using science identity as an intersectional proxy that could help the field move beyond its reliance on demographics. Building on prior National Science-funded work about museum engagement, the project applies appraisal theory--a psychological model about how people make conscious and subconscious assessments of situations that manifest in emotions--to the informal learning context. To date, museums have tended to focus on cognitive and behavioral aspects of engagement. Appraisal theory can add emotional processes to the conceptual understanding of engagement, and can be applied to help exhibit professionals develop a design framework that upholds complex identities. Such a framework could have implications for inclusive design of learning experiences in museums, schools, and other educational contexts.
This Pilot and Feasibility Study will address methodological and theoretical questions about the feasibility of a research approach that considers the relationships among: 1) exhibit design features; 2) multiple identity factors including science identity, demographics, and self-defined personal identity; 3) visitor appraisals; and 4) engagement with exhibits. Led by researchers at the Museum of Science, Boston and EdTogether, a non-profit research and development organization for inclusive design, the project will begin with a pre-piloting phase during which researchers will work with youth and professional advisors from local community organizations to test a suite of data collection approaches including self-report in the form of questionnaires and interviews; observations of visitor engagement; and biometric data collection including galvanic skin response and eye tracking. Building from this pre-piloting phase, the team will conduct four mini-studies that will iteratively refine measures towards enhanced validity and parsimony while gathering data to test the investigators' hypothesized model of design, identity, appraisal, and engagement. The evidence from testing this model through the four mini-studies will lay the foundation for larger-scale research that intends to explore causal relationships among intersectional identities, science identities, appraisal, and visitor engagement.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
It is estimated that there could be 40 billion earth-sized planets orbiting in the habitable zones of stars in the Milky Way. Major advances in long range telescopes have allowed astronomers to identify thousands of exoplanets in recent decades, and the discovery of new exoplanets is a now a common occurrence. Public excitement for the discoveries grown alongside these discoveries, thus opening new possibilities for inspiring a new generation of scientists and engineers that may dream of one day visiting these planets. This project investigates the use of interactive, intelligent educational technologies to generate interest in STEM by allowing learners to explore and even create their own exoplanets. Research will occur across several informal learning contexts, including summer camps, after school programs, planetarium shows, and at home. The approach is based on the idea of "What if?"questions about Earth (e.g., "What if the Moon did not exist?"), designed to trigger interest in STEM and frame exploratory and elaborative discussions around hypothetical science questions that are subsequently linked to the search for habitable exoplanets. Learners are able to interact with and explore scientifically accurate simulations of alternative versions of Earth, while making observations and posing explanations for what they see. Technology-based informal learning experiences designed to act as triggers for and sustainment of interest in STEM have the potential to plug the leaky STEM pipeline, and thus have profound implications for the future of science and technology in the United States.
The project seeks to advance the science of designing technologies for promoting interest in STEM and informal astronomy education in several ways. First, the project will develop simulations for exploratory learning about astronomy and planetary science. These simulations will present hypothetical worlds based on what-if questions and feasible models of known exoplanets, thus giving learners a chance to better understand the challenges of finding a habitable world and learning about what is needed to survive there. Second, a new PBS NOVA Lab will be developed that will focus on Exoplanet education. This web-based activity has the potential to reach millions of learners and will help them understand how planets are formed and the requirements for supporting life. Learners who use the lab will have an opportunity to invent their own exoplanets and export them for first-person exploration. Third, researchers on the project will design and implement Artificial Intelligence-based pedagogical agents to support learning and promote interest. These agents will inhabit the simulations with the learner, acting as a coach and guide, and be designed to be culturally responsive and personalized based on learner preferences. Fourth, interactive exoplanet-focused planetarium shows, that will involve live interaction with simulations, will take place at the Fiske Planetarium (Boulder, CO). Finally, the project will develop a server-based infrastructure for tracking and supporting long term development of interest in STEM. This back-end will track fine-grained behaviors, including movement, actions, and communications in the simulations. Such data will reveal patterns about how interest develops, how learners engage in free-choice learning activities, and how they interact with agents and peers in computer simulations. A design-based research methodology will be employed to assess the power of these different experiences to trigger interest and promote learning of astronomy. A range of different pathways for interest in STEM will therefore be considered and assessed. Research will measure the power of these experiences to trigger interest in STEM and promote re-engagement over time. Innovation lies in the use of engaging and intelligent technologies with thought-provoking pedagogy as a method for extended engagement of diverse young learners in STEM. Project research and educational resources will be widely disseminated to researchers, designers developers and the general public via peer-reviewed research journals, conference presentations, informal STEM education networks of science museums, children's museums, Fab Labs, and planetariums, and public media such as public television's NOVA science program website.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
H Chad LaneNeil CominsJorge Perez-GallegoDavid Condon
Consideration of the needs of individuals with a wide range of disabilities is not always considered in the early design stages of an informal STEM learning (ISL) activity or program. The primary access approach for people with disabilities becomes the provision of accommodations once the ISL product or environment is created. In contrast, the Universal Design approach considers users with a wide range of characteristics throughout the design process and works to create products and environments that are accessible, usable, and inclusive. This project, called AccessISL, led by the University of Washington's DO-IT (Disabilities, Opportunities, Internetworking and Technology) Center and Museology Program, includes an academic museology program and local ISL sites, representing museums, zoos, aquariums, makerspaces, science centers, and other sites of informal STEM learning. Insights will be gained through the engagement of people with disabilities, museology graduate students and faculty, and ISL practitioners. The AccessISL project model, composed of a set of approaches and interventions, builds on existing research and theory in the fields of education science, change management, effective ISL practices, and inclusive design processes. The project will collect evidence of policies and practices (or lack thereof) that improve the inclusiveness of ISL with respect to a wide range of disabilities and considers approaches for the design and development of new strategies; explores what stakeholders need to make change happen; uncovers challenges to the adoption of inclusive practices in public ISL settings and explores ways to overcome them; and proposes relevant content that might be included in museology curriculum. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project addresses the following two objectives:
For ISL personnel and museology faculty: to increase knowledge, skills, and actions to make ISL programs, facilities, courses, and resources more welcoming and accessible to participants with disabilities and embed relevant practices within their work.
For postsecondary STEM students with disabilities and museology students: to increase knowledge and skills in advocating for ISL offerings that are welcoming and accessible to everyone, including those with a wide variety of disabilities, and to encourage individuals with disabilities to pursue careers in ISL.
The project employs a student-centered approach and a set of practices that embrace the social model of disability, social justice education, disability as a diversity issue, intersectionality, and Universal Design. A leadership team of interns--each member a STEM student with a disability or a museology graduate student--along with project staff will engage with the University of Washington's Museology Program to identify and implement strategies for making ISL activities and courses more welcoming and accessible to individuals with disabilities. An online community of practice will be developed from project partners and others nationwide. A one-day capacity building institute will be held to include presentations, student/personnel panels for sharing project and related experiences, and group discussions to explore issues and further identify systemic changes to make ISL programs more welcoming and accessible to individuals with disabilities. As prototypes of the AccessISL Model are developed, evaluation activities will primarily be formative (looking for strengths and weaknesses) and remedial (identifying/implementing changes that could be made to improve the model). The model will continue to be fine-tuned through formative evaluation. Evaluation of the model components will focus on the experience of a range of stakeholders in the project. Specifically, quantitative data collected will include levels and quality of engagement, accessibility recommendations and products developed, and delivery of ISL services. Qualitative data will be collected through observations, surveys, focus groups, interviews, and case studies.
AccessISL project products will include proceedings of an end-of-project capacity building institute, promising practices, case studies, a video, and other online resources to help ISL practitioners and museology faculty that will result in making future ISL opportunities more inclusive of people with disabilities. AccessISL will advance knowledge and ensure long-term impact using multiple strategies:
broadening the STEM participation of people with disabilities as well as women, racial/ethnic minorities, and other underrepresented groups through the application of universal design
strengthening associations and creating synergy and durable relationships among stakeholders,
encouraging teaching about disability, accessibility, and universal design in museology courses,
empowering students with disabilities and current and future ISL practitioners to advocate for accessible ISL and develops an infrastructure to promote accessible ISL programs nationwide, and
contributing to the body of promising practices with products that will (a) enhance understanding of issues related to the inclusion of people with disabilities in ISL programs and (b) promote inclusive practices.
Outcomes will benefit society by making STEM opportunities available to more people and enhancing STEM fields with the talents and perspectives of people with disabilities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.