During middle school, many young people disengage from and consequently do not achieve in school-based STEM subjects. This phenomenon is more pronounced among young people in low-income communities than elsewhere. Many summer, out-of-school STEM programs are designed to offer young people opportunities to engage in hands-on, inquiry-based learning that promote interest and engagement in STEM. Research on the effect of these types of programs is limited, however. This research project seeks to fill this gap by identifying and studying practices that promote interest and engagement in STEM-related topics. The central goal of the summer STEM Interest and Engagement Study is to identify instructional practices associated with cultivating and sustaining young people's interest and engagement in out-of-school STEM summer learning programs for middle school youth. The project is based on a model of change developed from existing theory and empirical research on the cultivation of youths' interest and engagement in STEM. The project is a descriptive study that will apply multiple data collection and analytic methods, including the Experience Sampling Method (ESM), to determine instructional practices and the resulting interest, engagement, and perceptions of youth as they participate in STEM activities. In addition, survey data provided by program participants will allow the researchers to account for individual differences in preexisting interest and background factors, such as gender and ethnicity, and to measure changes in dispositions toward STEM. By better understanding these connections, practitioners can better understand how the design of their programs may influence the outcome of the participants' experience, including their education and career decisions.
DATE:
-
TEAM MEMBERS:
Deborah MoroneyNeil NaftzgerLee ShumowJennifer Schmidt
QUEST Beyond Local is a consortium of six public media providers across the country coming together in a unique collaborative structure to foster widespread STEM literacy for general audiences; support formal and informal education outcomes in the sciences; and revive ailing science and environment journalism in the face of its rapid decline. QUEST Beyond Local is built on the success of the local, cross-editorial QUEST model, in which media making professionals from multiple disciplines--radio, television, web, and especially education--collaborate to distribute high-quality content to general and underserved audiences. Two years ago, KQED (serving Northern California) introduced a capacity-building effort with five other public media stations serving markets across the nation: Seattle (KCTS), Wisconsin (WPT/WPR), Nebraska (NET), Cleveland (ideastream), and North Carolina (UNC-TV). On the heels of this pilot process, QUEST Beyond Local will expand production in all markets and focus its multimedia efforts around the theme "Science of Sustainability" so as to achieve maximum effect on critical STEM outcomes in formal and informal education settings, and to foster science/environment literacy among a wide general audience. QUEST Beyond Local is defined by an organizationally and technologically innovative model of content creation: a newsroom structured according to a hub and spoke model; with common branding, technical, and style guidelines; and with a central coordinating and editorial office liaising between local production teams. Under the guidance of this central office, the collaborative seeks to create content with both local authority and national relevance. Building on existing media impact research, and previous research and evaluation of QUEST, research firm Rockman et al will apply evaluation theory to determine: (1) the structures and strategies to a successful STEM collaborative that contribute to a greater understanding of and engagement in science and environment topics; and (2) determine the interests, priorities, and media consumption habits of local and national STEM audiences. Primary project deliverables include three diverse multimedia packages for general and professional audiences, focusing on three main themes and anchored in STEM disciplines. In total, the three packages will include: 18 television segments; 6 half-hour television programs; 20 radio reports; 18 "web extras" (slide shows, maps, etc.); 12 web-based videos; 144 blog posts; 18 education "explainers"; 5 educator trainings; and a comprehensive distribution and social media campaign. All efforts will be supported by at least 18 science community partners, including zoos, museums, aquariums, research centers, and others. Through these efforts, the collaborative seeks to repair the systemic damage done by years of neglect to science/environment journalism--particularly the marked decline in this type of coverage over the last decade. This decline is perhaps related to the observed disconnect between the public and scientific knowledge, despite a demonstrated public appetite for science content and educators' reported desire for more resources and professional development opportunities focused on STEM topics. At a time when an evolving workforce and economy increasingly demand STEM skills and environmental literacy, QUEST Beyond Local will contribute resources to address these challenges.
This Pathways project focuses on research that explores diverse family visitors' engagement with and thinking about science as they experience exhibits at the Museum of Science, Boston. The research team will work closely with museum staff on the implementation of three studies during which they will systematically investigate the arc of visitors' engagement (cognitive, emotional, and physical) as the visitors experience a range of exhibits. The team will also describe how visitors' engagement relates to their thinking about science concepts. The project team uses a mix of data collection and analysis methods, including self-report measures and physiological data along with the tracking of visitor behavior to understand and articulate engagement, along with information on learners' thinking about scientific concepts and demographic information. This project will advance the ISE field by offering findings about engagement that account for the applied and complex nature of the museum setting. The research team will be able to help the ISE field move forward in terms of building theoretical understanding about engagement and offering potential lines of inquiry for future research. The results can also be used to inform exhibit and programmatic design as well as how family learning in museums is evaluated.
DATE:
-
TEAM MEMBERS:
Gabrielle Rappolt-SchlictmannChristine ReichSamantha Daley
Many communities across the country are developing "maker spaces," environments that combine physical fabrication equipment, social communities of people working together, and educational activities for learning how to design and create works. Increasingly, maker spaces and maker technologies provide extended learning opportunities for school-aged young people. In such environments participants engage in many forms of communication where individuals and groups of people are focused on different projects simultaneously. The research conducted in this project will address an important need of those engaged in the making movement: evidence leading to a better understanding of how participants in maker spaces engage with science, technology, engineering and mathematics (STEM) as they create and produce physical products of personal and social value. Specifically, this research will generate new knowledge regarding how participants: pose and solve problems; identify, organize and integrate information from different sources; integrate information of different kinds (visual, quantitative, and verbal); and share ideas, knowledge and work with others. To understand and support STEM literacies involved in making, the investigators will study a number of different informal learning sites that self-identify as maker spaces and serve different-aged participants. The project will use ethnographic and design research techniques in three cycles of qualitative research. In Cycle One, the researchers will investigate two adult-oriented maker spaces in order to generate case studies and develop theories about how more experienced adult makers use the spaces and to create case studies of adult maker spaces, and to develop methodological techniques for understanding literacy in maker spaces. In Cycle Two, the study will expand into two out-of-school time youth-oriented maker spaces, building two new case studies and initiating design-based research activities. In Cycle Three, the team will further apply their developing theories and findings, through rapid iterative design-based research, to interventions that support participants' science literacy and making practices in two maker spaces that exist in schools. Through peer-reviewed publications, briefs, conference presentations, presence on websites of local and national maker organizations, project findings will be widely shared with organizations and individuals that are engaged in broadening the base of U.S. science and mathematics professionals for an innovation economy.
This project will bring STEM content knowledge to visitors to Cuyahoga Valley National Park via mobile device applications. Visitors will be able to use their mobile phones to access details about Park features (such as where they are in the park, what they are looking at, and where are related features), supporting just-in-time STEM learning. Cuyahoga Valley National Park receives around 2.5 million visitors every year and experiences multitudes of inquiries. Until this project, visitors were subjected to less than optimum signage for information and background about a given feature that may or may not be of interest to them. In this project, knowledge building information will be selected by the visitors and delivered to them with convenience and speed. The data base supporting this effort will provide the visitor with identification and the history of park features as well as more in depth knowledge building information while they are in the park and after the leave, providing a more holistic experience than is currently available. The investigators will build the system in parts, testing the feasibility at each stage and evaluating affective and cognitive outcomes of each portion. Research questions that will be addressed in the course of this project include: (1) What outcomes associated with use of this GPS-base system could inform future development and implementation? and (2) What contributions do these GPS-based mobile learning applications have on informal science learning as understood within the Six Strands of Informal Science Learning? It is expected knowledge generated in this project will stimulate additional programing for increasing efficacy and use in other widely ranging venues. If successful, it is easy to imagine how this STEM knowledge-building application could be extended for use in other venues across the country.
DATE:
-
TEAM MEMBERS:
Richard FerdigRuoming JinPatrick LorchAnnette Kratcoski
resourceprojectProfessional Development, Conferences, and Networks
This conference at Arizona State University is an early-stage activity inspired by the upcoming 2016 - 2018 bicentennial of the conception, writing and publication of Mary Shelley's "Frankenstein - or The Modern Prometheus." That book, and the dozens of films produced subsequently, have provoked questions for researchers and citizens that have endured for two centuries and are relevant today. - How have we gone from a world in which Mary Shelley could watch public demonstrations of voltaic power on dead animals to one in which the dissection of animals in classrooms is frowned upon, but the creation of new life forms via an international synthetic biology competition (iGEM) is celebrated? - How do literary, artistic and other cultural portrayals of science and engineering inspire and inflect STEM research? - What steps do contemporary scientists and engineers need to take in order to proceed with their innovative activity in a responsible fashion? - What role do lay citizens have in making decisions about science and technology?- How can we understand the broad relationship between creativity and responsibility? The convening brings together a USA and international group of educators in informal science education and multi-disciplinary scholars who study various aspects of the interactions of science, technology and society (STS). This team of natural and social scientists, engineers, museum professionals (Museum of Science, Boston (MOS); Science Museum of Minnesota (SMM)), artists and humanities scholars will begin to formulate plans for producing exhibits, educational programs and demonstrations, fiction and nonfiction writing contests, performances, and curricula that explore science education, ethics and artistry. An overarching goal is to establish a process that could create a national and global network of collaborators to plan programs worldwide and establish new professional collaborations of researchers beyond the bicentennial. The workshop, a first step toward a possible larger initiative, could be significant both for the public's engagement with contemporary issues of science and society and for stimulating new inter-disciplinary research on such issues.
The Exploratorium, in collaboration with the Boys and Girls Club Columbia Park (BGC) in the Mission District of San Francisco, is implementing a two-year exploratory project designed to support informal education in science, technology, engineering, and mathematics (STEM) within underserved Latino communities. Building off of and expanding on non-STEM-related efforts in a few major U.S. cities and Europe, the Exploratorium, BGC, and residents of the District will engage in a STEM exhibit and program co-development process that will physically convert metered parking spaces in front of the Club into transformative public places called "parklets." The BGC parklet will feature interactive, bilingual science and technology exhibits, programs and events targeting audiences including youth ages 8 - 17 and intergenerational families and groups primarily in the Mission District and users of the BGC. Parklet exhibits and programs will focus on STEM content related to "Observing the Urban Environment," with a focus on community sustainability. The project explores one approach to working with and engaging the public in their everyday environment with relevant STEM learning experiences. The development and evaluation processes are being positioned as a model for possible expansion throughout the city and to other cities.
This project is making novel use of familiar technology (smartphones and tablets) to address the immediate and pressing challenge of affordable, ongoing, large-scale museum evaluation, while encouraging museum visitors to engage deeply with museum content. Using a smartphone app, museum visitors pose questions to a 'virtual scientist' called Dr. Discovery (Dr. D). Dr. D provides answers and the chance to complete fun mini-challenges. The questions visitors ask are gathered in a large database. An analytics system analyzes these data and a password-protected website provides continuous, accessible evaluation data to museum staff, helping them make just-in-time tweaks (or longer term changes) to exhibit-related content (such as multimedia, lecture topics, docent training, experience carts, etc.) as current events and visitors' needs and interests change. The intellectual merit of this project is that it is building evaluation capacity among informal educators, advancing the fields of visitor studies, museum evaluation, informal science learning, and situated engagement, and is contributing to the development of novel evaluation techniques in museums. This project has many broader impacts: The Ask Dr. Discovery system is available to any venue that wishes to use or adapt it to their context. By enhancing the visitor experience and improving museum access to data for evaluation and data-driven decision making across the country, Ask Dr. Discovery has both a direct and indirect impact on museums and visitors of all types. This project is also training the next generation of STEM and education innovators by employing a diverse team of undergraduate students.
A growing body of research suggests that many types of institutions and experiences contribute to science and technology learning by the public. These include the formal education system, libraries, science centers, citizen science, after school programs, television programs, film and video, newspapers, radio, books and magazines, the internet, community and health organizations, environmental organizations, and conversations with friends and family. It is also important that research about who learns and how they learn from these institutions and experiences is informed by and discussed within the communities themselves. This project focuses specifically on STEM learning in interactive science centers. It invites science center professionals from around the country to contribute to and share findings from an on-going research study designed to better understand the influence that interactive science centers have on youth and adult's long-term understanding, interest and engagement with science and technology. The pair of workshops supported by this grant will engage science center administrators, educators, exhibition and program designers, evaluators and researchers in two sets of tasks. The first workshop, held prior to the start of the larger research project, will examine and focus the research's overall goals and help frame a set of specific research questions. Although no research study can answer all important issues, the goal of the workshop is to ensure that the planned investigation attempts to address the issues and outcomes considered most critical to the broader science center community. The second workshop will occur after completion of all data collection and initial data analysis. It will engage a broad cross-section of the science center community in discussing findings, brainstormind implications and usage, and developing dissemination strategies to insure that the findings of the research reach the broader science center and policy communities. The goal of these workshops is to use the collective wisdom of dozens of active professionals from across the country to develop a suite of strategies for grounding research in practice, incorporating research results into practice as well as bringing important research findings to a broader national audience.
This Michigan State University and University of Texas-Austin project will focus on making science communication more scientific. It will primarily use interview and survey research to improve societal understanding of how those involved in science communication, particularly scientists, think about science communication. The goal is to use this knowledge to help improve science communication training and recruiting with a focus on increasing the likelihood that scientists will adopt evidence-based communication strategies to increase public interest, engagement, and identification with science, technology, engineering, and math (STEM). A central underlying reason for the study is a mismatch between scientists' motivations and goals when interacting with public audiences and what research suggests would be the most positive and productive with public audiences. This study is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project will be conducted in three phases. The first is interviews with a wide range of science communication experts to assess priority research questions. These interviews will be followed by surveys with U.S.-based members of up to 10 different scientific societies representing a broad range of academic fields as well as a survey of science communication researchers. The survey will focus on three different public engagement modes, including face-to-face engagement, online engagement, and engagement via the news media. Consistent with the Theory of Planned Behavior, the surveys will assess scientists' attitudes about public engagement and specific public engagement goals, as well as perceptions of social norms (both descriptive and injunctive) and efficacy beliefs (both internal and external). These will be used as predictors of general and goal-specific engagement willingness, as well as reported past behavior, using multigroup modeling. Potential communication goals of interest include transferring knowledge, developing interest and excitement, building trust in scientists, demonstrating openness and a willingness to listen, shaping how people think about subjects (i.e. framing), and/or defending science. The final phase of the project will explore the potential to design experiments aimed at testing the impact that mention of specific goals has on communication training recruitment as well as the degree to which online content about various goals is attractive to scientists interested in developing their communication skills. The research is the most targeted and largest attempt to date to understand how scientists' views about the public and communication processes may shape science communication behavior.
Project TRUE (Teens Researching Urban Ecology) was a summer research experience for New York City youth that focused on strengthening their STEM interest, skills, and ultimately, increasing diversity in STEM fields. Through a partnership between an informal science institution (the Wildlife Conservation Society) and a university (Fordham University), 200 high school students conducted urban ecology research at one of four zoos in New York City under the guidance of STEM mentors. A unique feature of Project TRUE was its near-peer mentorship model, in which university professors mentored graduate urban ecology students, who mentored undergraduate students, who mentored high school students Science research projects focused on urban ecology topics, with high school students identifying their own research questions that were nested within the undergraduate mentor’s larger research question, thereby establishing a sense of ownership. Youth collected and analyzed their own data and the experience culminated in the creation of research posters, with teams presenting their posters to the public at a student science symposium.
This project was funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. We studied the impacts of two key parts of the program – conducting authentic science research and near-peer mentorship – on the STEM trajectories of almost 200 high school students who participated in the program from 2015 to 2018. The research explored short-term outcomes immediately after the program and followed up with students multiple years after participation to understand the medium-term impacts of the experience during and after the transition from high school to college.
EvalFest (Evaluation Use, Value, and Learning through Festivals of Science and Technology) will test innovative evaluation methods in science festivals that are being held across the country and assess in what ways and how effectively they are used. Morehead Planetarium and Science Center (at the University of North Carolina-Chapel Hill) and the University of California, San Francisco, in collaboration with over twenty science festivals, will (1) investigate whether a multisite evaluation approach is an effective model for creating common metrics for informal STEM education, (2) develop common methods to measure the effects of Festivals, (3) create a query-able database of 50,000 Festival attendees to share with the informal STEM learning field, and (4) document whether these efforts also result in new knowledge related to informal STEM education. The project will develop the Enterprise Feedback Management (EFM) system and query-able database for the festival community. EFMs are systems, including processes and software, that enable groups (such as the festival network) to collect, organize, analyze and share data. The EFM system will be designed to integrate data across sites and to allow users to extract data of interest. The project will refine evaluation tools currently used within the Science Festival Alliance that assess self-reported festival learning, and the effects of festival attendance, motivation, and future science participation. It will collect economic impact data and longitudinal festival attendee data. The project will also develop some new evaluation tools such as secret shopper observational protocols. Data from festival attendees will be collected onsite at participating festivals.