Finding inclusive approaches to broaden the participation of underrepresented communities in the sciences is the focus of this project. The team will create pathways for Native American students from the development of new partnerships between tribal communities and STEM institutions that promote the participation and inclusion of Native American scientists in the geosciences. Each partner brings a successful program, based on good practices from the research literature in improving outcomes for underrepresented students and scientists. Together, the researchers will create scientific collaborations that support a pipeline for Native American students from middle school through to graduate school and beyond. In addition, the project will work on building welcoming workplace climates for indigenous researchers within ?traditional Western? organizations. The approach will integrate indigenous and Western knowledge in research collaborations to create more creative, innovative, and culturally relevant science research programs.
This project, Integrating Indigenous and Western Knowledge to Transform Learning and Discovery in the Geosciences, uses the principles of collective impact to create new partnerships between tribal communities and STEM institutions that promote the participation and inclusion of Native American scientists in the geosciences. The project collaborators will more strongly integrate indigenous and Western knowledge into collectively-developed research projects. The project partners the Rising Voices: Collaborative Science for Climate Solutions (Rising Voices) and member tribal colleges and communities with Haskell Indian Nations University, the National Center for Atmospheric Research (NCAR), the University of Arizona?s Biosphere 2, and National Center for Atmospheric Research?s Significant Opportunities in Atmospheric Research and Science (SOARS) internship and Global Learning and Observation to Benefit the Environment (GLOBE) citizen science programs. Together, they will build research partnerships between Native American and traditional Western scientists, provide professional development for NCAR and Biosphere 2 scientists on how to engage appropriately with tribal communities, and provide pathways for NA students from middle school through college, to grad school and beyond. The project will connect community-based citizen science programs for middle- and high school youth with undergraduate programs at Haskell Indian Nations University and University of Arizona, and with summer research internship experiences for undergraduates and graduate students that address topics of interest across tribal communities, tribal college faculty, traditional science institutions, and community-based citizen science. This project also enhances the research capacity of all partners, and brings together diverse perspectives, which have been shown to lead to greater innovation, creativity, and higher impact research. The project has the potential to provide a tried and tested model for building similar partnerships at other institutions, including content and methods for professional development for mainstream scientists, ways to create more welcoming spaces for Native American students and scientists, promising practices for improving how research in the geosciences carried out, and an increase in the representation of Native American students and scientists in that vital research enterprise.
The Colleges of Science & Engineering and Graduate Education, and the Metro Academies College Success Program (Metro) at San Francisco State University in partnership with San Francisco Unified School District and the San Francisco Chamber of Commerce develop an integrated approach for computing education that overcomes obstacles hampering broader participation in the U.S. science, technology, engineering and mathematics (STEM) workforce. The partnership fosters a more diverse and computing-proficient STEM workforce by establishing an inclusive education approach in computer science (CS), information technology, and computer engineering that keeps students at all levels engaged and successful in computing and graduates them STEM career-ready.
Utilizing the collective impact framework maximizes the efficacy of existing regional organizations to broaden participation of groups under-educated in computing. The collective impact model establishes a rich context for organizational engagement in inclusive teaching and learning of CS. The combination of the collective impact model of social agency and direct engagements with communities yields unique insights into the views and experiences of the target population of students and serves as a platform for national scalable networks.
DATE:
-
TEAM MEMBERS:
Keith BowmanIlmi YoonLarry HorvathEric HsuJames Ryan
This NSF INCLUDES Launch Pilot project, STEPs to STEM, will create a statewide STEM pipeline within an integrated program of community college education throughout the state prisons of New Jersey. The Pilot leverages a long-standing collaboration among education, government, and volunteer sectors including NJ-Scholarship and Transformative Education in Prisons (STEP), all of whom commit to work together to accredit and ensure articulation (transferability) of the required STEM courses. The broadening participation challenge that will be addressed by this Pilot is to extend college-level STEM education to incarcerated persons, who are overwhelmingly minorities from the lowest socioeconomic levels of American society. Education in general and STEM education in particular equips students for high-level workforce readiness, offering improved quality of life for formerly incarcerated persons and their families and contributing to American economic success.
Technical Abstract:
Four major goals of the Pilot are: 1. consolidate and ensure articulation of STEM A.A. courses in NJ state prisons with a seamless path to B.A. study at Rutgers, the State University of New Jersey; 2. begin teaching new accredited STEM courses and offering REU and internship opportunities to released students; 3. implement tracking of students in STEM courses while incarcerated and beyond, enabling a supplementary research goal to evaluate student and teacher performance in comparison with mainstream educational settings; 4. work with partners in business, government, non-profit, development, and public sectors to build a complete STEM pipeline with a long-term goal of enabling formerly incarcerated students to clear their records through education and workforce participation in STEM. Implementation of the goals will proceed as follows. Senior personnel from each of the cooperating institutions and a jointly-supervised postdoctoral trainee will negotiate the terms of accreditation and articulation across the state system with our partner, the lead accreditation institution, Raritan Valley Community College. Teaching of STEM courses by our established team of volunteers will commence as each course is accredited. Our industry and research partners will begin offering REU and training internships in the first summer. Educational research professional on the team will guide the design, implementation, and analysis of student and teacher performance. New partners will be brought in to the collective from the non-profit, business, and public sectors to extend the reach and impact of this initiative.
This is a two-year "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot targeting high school students in the Hudson Valley, including the New York Metropolitan Area. It will support a network of institutional partners that are committed to providing internship and mentoring opportunities to youths interested in authentic research projects. The proposed work will build on a current research immersion program--the Secondary School Field Research Program (SSFRP) at Columbia University's Lamont-Doherty Earth Observatory. SSFRP serves high school students, mainly from underrepresented and underserved communities, who work with college students, science teachers, and researchers around a specific science problem. Over the past decade, the program has had demonstrable impact, including attendance to college, and students' selection of STEM majors. Tracking data indicates that retention rates of its alumni in four-year colleges are well above the norm, and a significant fraction of early participants are now in graduate programs in science or engineering. The program has surpassed all expectations in its effectiveness at engaging underserved populations in science and promoting entry into college, recruitment into STEM majors, and retention through undergraduate and into graduate studies. Hence, the project's overall goal will be to extend and adapt the research-immersive summer internship model through an alliance with peer research institutions, school districts and networks, public land and resource management agencies, private funding agencies, informal educational institutions, and experts in pedagogical modeling, metrics, and evaluation. Focused on earth and environmental sciences, the summer and year-round mentoring model will allow high school students to work in research teams led by college students and teachers under the direction of research scientists. The mentoring model will be multilayered, with peer, near-peer, and researcher-student relationships interweaving throughout the learning process.
The project has formulated a set of testable explanatory hypotheses: (1) Beyond specific subject knowledge, success rests on increased student engagement in a community of practice, with near-peer mentors, teachers, and scientists in the context of scientific research; (2) The intensity of engagement also shifts the students' vision of their future to include higher education, and specifically to imagine and move toward a STEM career; and (3) Early engagement, before students attend college, is critical because high school is where students form patterns of engagement and capacities related to science learning. Thus, the immediate goal of the two-year plan will be to create approximately 11 research internship programs focused on earth and environmental sciences, and to build the networks for growth through engagement with a wider community of educational partners. The main focus of this approach will be removing barriers between high school students and STEM organizations, and adapting the current mentoring model at Columbia University to the specific cultures of other research groups and internship programs throughout the lower Hudson Valley. The team has already assembled a diverse set of partners committed to broadening participation in STEM using a collective impact approach to early engagement in project-based learning. Research partners will provide the mentors, research projects, and laboratory facilities. The educational network partners will provide access for students, particularly those from under-resourced communities to participate, as well as participation opportunities for interested teachers. Informal learning organizations will provide access to field and research sites, along with research dissemination opportunities. In Year 1, the project will conduct a series of development workshops for partners already in place and foster the formation of new partnership clusters according to shared interest, complementary resources and geographic proximity. The workshops will provide a forum for partners to learn about each other's visions, values, challenges, and existing structures, while working through theoretical and practical issues related to STEM engagement for young investigators. In Year 2, the project will target the implementation of the internship programs at various sites according to the agreed-upon goals, program model, research projects, recruitment and retention strategy, staff training, data collection, and evaluation plans. An external evaluator will address both the formative and summative evaluation of the effort directed toward examining the three project's hypotheses concerning the educational impacts of scientific research on student engagement, extent of the immersion, and overall effectiveness of the programs.
DATE:
-
TEAM MEMBERS:
Robert NewtonLuo Cassie XuMargie TurrinEinat LevMatthew Palmer
resourceprojectProfessional Development, Conferences, and Networks
Physics awards smaller percentages of PhDs to women (19%) and underrepresented ethnic and racial minorities (7%) than any other field in the sciences, and underrepresentation is especially pronounced at selective universities. As global competition for scientific talent heats up and US demographics shift, cultivating a robust domestic workforce is critical to US technological leadership. We seek to build on the successful American Physical Society Bridge Program (apsbridgeprogram.org) by transforming physics graduate education to fully support the inclusion of women and ethnic and racial minorities. Our vision is to create a national network of disciplinary colleagues, expert researchers, and representatives from professional associations who will develop and build evidence-based knowledge of effective practices for recruitment, admissions, and retention of women and underrepresented ethnic and racial minorities. This pilot project will include six large, highly selective physics graduate programs to demonstrate and map out a plan for a discipline-wide effort. The pilot focuses on improving admissions practices, because this strategy promises immediate and measurable impact backed by extant research. The pilot will also take exploratory steps to develop scalable recruitment and retention strategies. To refine interventions, we will conduct research to identify and understand demographically-based loss points of students in graduate physics programs and to understand how network participation facilitates change. The project will also establish connections with other STEM disciplines, beginning with mathematics and chemistry, to explore expanding these efforts.
This project is grounded in research on diversity in graduate education, organizational learning, and the resources of networks to catalyze cultural change. The project team includes expertise in institutional change, graduate admissions, student success, diverse and inclusive environments, and social science research. The pilot advances a novel research agenda on inclusion in STEM by addressing recruitment, admissions, and retention in physics graduate education as interconnected challenges of faculty learning, professional networks, and disciplinary cultural change. Physics graduate programs will report admissions data and common metrics, and will document changes resulting from project activities. Faculty will be trained on holistic admissions and diversity in selection processes, and be guided in the use of inclusive admissions practices. An external evaluator will examine project effectiveness and readiness for scaling to an Alliance phase project.
DATE:
-
TEAM MEMBERS:
Monica PlischTheodore HodappJulie PosseltGeraldine CochranCasey Miller
Changes in household-level actions in the U.S. have the potential to reduce rates of greenhouse gas (GHG) emissions and climate change by reducing consumption of food, energy and water (FEW). This project will identify potential interventions for reducing household FEW consumption, test options in participating households in two communities, and collect data to develop new environmental impact models. It will also identify household consumption behavior and cost-effective interventions to reduce FEW resource use. Research insights can be applied to increase the well-being of individuals at the household level, improve FEW resource security, reduce climate-related risks, and increase economic competitiveness of the U.S. The project will recruit, train, and graduate more than 20 students and early-career scientists from underrepresented groups. Students will be eligible to participate in exchanges to conduct interdisciplinary research with collaborators in the Netherlands, a highly industrialized nation that uses 20% less energy and water per person than the U.S.
This study uses an interdisciplinary approach to investigate methods for reducing household FEW consumption and associated direct and indirect environmental impacts, including GHG emissions and water resources depletion. The approach includes: 1) interactive role-playing activities and qualitative interviews with homeowners; 2) a survey of households to examine existing attitudes and behaviors related to FEW consumption, as well as possible approaches and barriers to reduce consumption; and 3) experimental research in residential households in two case-study communities, selected to be representative of U.S. suburban households and appropriate for comparative experiments. These studies will iteratively examine approaches for reducing household FEW consumption, test possible intervention strategies, and provide data for developing systems models to quantify impacts of household FEW resource flows and emissions. A FEW consumption-based life cycle assessment (LCA) model will be developed to provide accurate information for household decision making and design of intervention strategies. The LCA model will include the first known farm-to-fork representation of household food consumption impacts, spatially explicit inventories of food waste and water withdrawals, and a model of multi-level price responsiveness in the electricity sector. By translating FEW consumption impacts, results will identify "hot spots" and cost-effective household interventions for reducing ecological footprints. Applying a set of climate and technology scenarios in the LCA model will provide additional insights on potential benefits of technology adoption for informing policymaking. The environmental impact models, household consumption tracking tool, and role-playing software developed in this research will be general purpose and publicly available at the end of the project to inform future education, research and outreach activities.
DATE:
-
TEAM MEMBERS:
David WatkinsBuyung AgusdinataChelsea SchellyRachael ShwomJenni-Louise Evans
This INSPIRE project addresses the issue of high volume hydraulic fracturing, also called fracking, and its effects on ground water resources. Fracking allows drillers to extract natural gas from shale deep within the earth. Methane gas sometimes escapes from shale gas wells and can contaminate water resources or leak into the atmosphere where it contributes to greenhouse gas emissions. Monitoring for these potential leaks is difficult because methane is also released into aquifers naturally, and because monitoring is time- and resource-intensive. Such subsurface leakage may also be relatively rare. This project seeks to improve overall understanding of the impacts of natural gas drilling using both advances in computer science and geoscience, and to teach the public about such impacts. The project will elucidate both the effects of human activities such as shale gas development as well as natural processes which release methane into natural waters. Results of the proposed research will lead to a better understanding of water quality in areas of shale-gas development and will highlight problems and potentially problematic management practices. The research will advance both the fields of geoscience and computer science, will train interdisciplinary graduate students, and involve citizen scientists in collecting data and understanding environmental data analysis.
The project combines new hydro-geochemical strategies and data mining approaches to study the release of methane into streams and ground waters. For example, researchers will explore how to analyze the heterogeneous spatial data that describe distributions of methane concentrations in natural waters. The objectives of this project are to i) transform the ability to measure methane in streams; ii) train citizen scientists to work with project scientists to sample streams in an area of shale-gas development and publish large-volume datasets of methane in natural waters and aquifers; iii) innovate data mining and machine learning methods for environmental data to identify anomalous spots with potential leakage; iv) run field campaigns to measure methane concentrations and isotopic signatures of water samples in these spots; v) foster dialogue among nonscientists, consultants, university scientists, members of the gas industry, government agencies, and nonprofit organizations in and beyond the target region. Toward this end, the team will host workshops aimed to build dialogue among stakeholders and will release data analytic software for environmental measurements to benefit a broader research community.
This is an Early-concept Grant for Exploratory Research supporting research in Smart and Connected Communities. The research supported by the award is collaborative with research at DePaul University. The researchers are studying the use of technologies to enable communities to connect youth and youth organizations to effectively support diverse learning pathways for all students. These communities, the youth, the youth organizations, formal and informal education organizations, and civic organizations form a learning ecology. The DePaul University researchers will design and implement a smart community infrastructure in the City of Chicago to track real-time student participation in community STEM activities and to develop mobile applications for both students and adults. The smart community infrastructure will bring together information from a variety of sources that affect students' participation in community activities. These include geographic information (e.g., where the student lives, where the activities take place, the student transportation options, the school the student attends), student related information (e.g., the education and experience background of the student, the economic status of the student, students' schedules), and activity information (e.g., location of activity, requirements for participation). The University of Colorado researchers will take the lead on analyzing these data in terms of a community learning ecologies framework and will explore computational approaches (i.e., recommender systems, visualizations of learning opportunities) to improve youth exploration and uptake of interests and programs. These smart technologies are then used to reduce the friction in the learning connection infrastructure (called L3 for informal, formal, and virtual learning) to enable the student to access opportunities for participation in STEM activities that are most feasible and most appropriate for the student. Such a flexible computational approach is needed to support the necessary diversity of potential recommendations: new interests for youth to explore; specific programs based on interests, friends' activities, or geographic accessibility; or programs needed to "level-up" (develop deeper skills) and complete skills to enhance youths' learning portfolios. Although this information was always available, it was never integrated so it could be used to serve the community of both learners and the providers and to provide measurable student learning and participation outcomes. The learning ecologies theoretical framework and supporting computational methods are a contribution to the state of the art in studying afterschool learning opportunities. While the concept of learning ecologies is not new, to date, no one has offered such a systematic and theoretically-grounded portfolio of measures for characterizing the health and resilience of STEM learning ecologies at multiple scales. The theoretical frameworks and concepts draw together multiple research and application domains: computer science, sociology of education, complexity science, and urban planning. The L3 Connects infrastructure itself represents an unprecedented opportunities for conducting "living lab" experiments to improve stakeholder experience of linking providers to a single network and linking youth to more expanded and varied opportunities. The University of Colorado team will employ three methods: mapping, modeling, and linking youth to STEM learning opportunities in school and out of school settings in a large urban city (Chicago). The recommender system will be embedded into youth and parent facing mobile apps, enabling the team to characterize the degree to which content-based, collaborative filtering, or constraint based recommendations influence youth actions. The project will result in two measurable outcomes of importance to key L3 stakeholder groups: a 10% increase in the number of providers (programs that are part of the infrastructure) in target neighborhoods and a 20% increase in the number of youth participating in programs.
Child Trends is a nonprofit organization focused on improving the lives of children and their families by conducting research and sharing the resulting knowledge with practitioners and the public. In this project, Child Trends will conduct research and development to launch a Child Trends News Service aimed at providing news reports that feature social science child-centric research. The resulting work is designed to improve outcomes for at-risk children, particularly Latinos, the largest and fastest-growing minority group among U.S. children. Working with a professional news syndication company, the Child Trends News Service will produce engaging reports for key news media outlets that feature the latest actionable social science research related to behaviors that help mitigate negative child outcomes associated with poverty, lack of education, violence, among other challenges. Child Trends will draw attention to the reports through social media and outreach to stakeholders. By airing these reports on local television news programs in English and Spanish, millions of people will have greater access to this information. This is early R&D work to demonstrate that local television stations will air these stories and to examine the audience impact—how does accessing this social science research through preferred media channels influence news audiences’ knowledge and attitudes toward specific social science research? The study will also delve deeper to better understand how news might, or might not, motivate behavioral change. The study will provide valuable lessons to the informal science education and the STEM communication science field.
The overarching aim of this project is to use commercial news to reach populations, especially Latinos, who have historically been underrepresented in science, technology, engineering and math (STEM) education and careers. The goals of the project are to:
* Leverage mass media news outlets to effectively communicate developments in social science research on child well-being and development to Latino audiences.
* Advance the field of informal STEM learning by exploring how the public interacts with actionable social science child research.
* Expand the reach and application of the news products through strategic collaborations with provider organizations serving at-risk Latino families; the child research and STEM fields; and other organizations working on Latino family issues.
Activities include the development and formative testing of the news service, the qualitative and quantitative testing of the news service's impact on audiences, and evaluation of the implementation of the project's components. The quantitative research, using a control group and treatment group, will work to establish preliminary evidence that the Child Trends News Service will result in changes in viewers' knowledge, attitudes, and intent to adopt behaviors related to child-centric social science research. The Child Trends' project team will be informed by an Advisory Board and Technical Working Group as well by working closely with Abriendo Puertas, the largest U.S. parenting education program for low-income Latino parents. Child Trends will partner with Ivanhoe Broadcast News to produce and distribute the materials. Group I&I Consultancy will evaluate the project. In year-two, Child Trends will produce a research brief on lessons learned and research outcome measures. The proposed research and development will be conducted over a two-year period; findings will inform ongoing service and additional research.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Informal Science, Techology, Engineering, and Mathematics (STEM) institutions seek to contribute to a scientifically literate culture, which includes new and innovative learning opportunities, a diverse community of scientists and science educators, equitable treatment for all, and the development of a well-trained workforce. In order to achieve these goals, informal STEM institutions must provide learning experiences that are welcoming and productive for all learners. The iPAGE model is a comprehensive program that prepares teams within informal STEM institutions to work with their colleagues to make their institutions more inclusive learning environments in which to learn, engage in, and identify with STEM. The project incorporates learning modules, workshops, site visits, and institution-specific activities all geared to build knowledge, awareness, and capacity related to creating inclusive environments at informal STEM institutions. The core iPAGE model is based on the US Department of Agriculture's agricultural extension service. It includes a Knowledge-to-Action approach, in which individuals adapt what they learn to local contexts by assessing barriers to knowledge use, selecting and implementing interventions, evaluating outcomes, and sustaining ongoing efforts. Through cycles of design-based iteration, the project will improve its practice, learning modules, and theory of action. Through surveys, interviews, and case studies, the research team will document learning, barriers to implementation, and culture change as teams and institutions seek to become more welcoming, diverse, and inclusive institutions. This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
A frequently missing element in environmental education programs is a concerted effort by communities, organizations, government, and academic stakeholders to build meaningful partnerships and cultivate informal science learning opportunities via public participation in environmental research. This collaborative approach not only makes scientific information more readily available, it also engages community members in the processes of scientific inquiry, synthesis, data interpretation, and the translation of results into action. This project will build a co-created citizen science program coupled with a peer education model and an extensive communication of results to increase environmental STEM literacy. The project targets historically underrepresented populations that are likely to be disproportionately impacted by climate, water scarcity, and food security. Based upon past needs assessments in the targeted communities, gardens irrigated by harvested rainwater will become hubs for environmental STEM education and research. For this project, gardens irrigated by harvested rainwater will serve as hubs for environmental literacy education efforts. Researchers from the University of Arizona and Sonora Environmental Research Institute will work alongside community environmental health workers, who will then train families residing in environmentally compromised areas (urban and rural) on how to monitor their soil, plant, and harvested water quality. The project aims to: (1) co-produce environmental monitoring, exposure, and risk data in a form that will be directly relevant to the participants' lives, (2) increase the community's involvement in environmental decision-making, and (3) improve environmental STEM literacy and learning in underserved rural and urban communities. The project will investigate and gather extensive quantitative and quantitative data to understand how: (1) participation in a co-created citizen science project enhances a participant's overall environmental STEM literacy; (2) a peer-education model coupled with a co-created citizen science program affects participation of historically underrepresented groups in citizen science; and (3) the environmental monitoring approach influences the participant's environmental health learning outcomes and understanding of the scientific method. In parallel, this project will evaluate the role of local-based knowledge mediators and different mechanisms to communicate results. These findings will advance the fields of informal science education, environmental science, and risk communication. Concomitantly, the project will facilitate the co-generation of a robust dataset that will not only inform guidelines and recommendations for harvested rainwater use, it will build capacity in underserved communities and inform the safe and sustainable production of food sources. This research effort is especially critical for populations in arid and semiarid environments, which account for ~40% of the global land area and are inhabited by one-third of the world's population. This program will be available in English and Spanish and can truly democratize environmental STEM research and policy. This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of STEM learning in informal environments.
Chemistry is an important and widely relevant field of science. However, when compared with other STEM content areas, chemistry is under-represented in U.S. science museums and other informal educational environments. This project will build, and build knowledge about, innovative approaches to delivering informal science learning activities in chemistry. The project will not only increase public interest and understanding of chemistry but also increase public perception of chemistry's relevance and increase the public's self-efficacy with respect to chemistry. This project outcomes will include a guide for practitioners along with activity materials that will be packaged into a kit, distributed, and replicated for use by informal science educators, chemists, and chemistry students at 250 sites across the U.S. The project team will reach out to organizations that serve diverse audiences and diverse geographic locations, including organizations in rural and inner-city areas. The kits will provide guidance on engaging girls, people with various abilities, Spanish speakers, and other diverse audiences, and include materials in Spanish. Written guides, training videos, and training slides will be included to support training in science communication in general, as well as chemistry in particular. This project is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.
This project will take an innovative approach to develop informal educational activities and materials about chemistry. Rather than starting with content goals, the project will start with a theoretical framework drawn from research about affecting attitudes about science related to interest, relevance, and self-efficacy. A design-based research approach (DBR) will be used to apply that framework to the development of hands-on educational activities about chemistry, while also testing and modifying the framework itself. (DBR blends empirical educational research with the theory-driven design of learning environments.) Existing or new educational activities that appear to embody key characteristics defined in the framework will be tested with public audiences for their impact on visitors. Researchers and educators will determine how different characteristics of the educational activities defined in the framework affect the outcomes. The activities will be modified and tested iteratively until the investigators achieve close alignment between framework and impacts.. The project team will continue the design-based research approach both to examine groups of activities in which synergies can have impacts beyond single interactions as well as to examine varied ways of training facilitators who can also significantly affect outcomes. In this way, the project will generate knowledge about how kits of hands-on informal learning activities can stimulate attitudes of interest, relevance, and self-efficacy with respect to the neglected field of chemistry. The project teams will broadly disseminate project outcomes within the educational research, science and informal Science, Technology, Engineering and Mathematics (STEM) education communities. While this project will focus on chemistry, the strategies it will develop and test through a design-based research process will provide valuable insight into effective approaches for informal STEM education more broadly.