This study was a longitudinal summative evaluation of repeat visitors’ experiences in four Math Moves! exhibitions that were developed as part of a large collaborative exhibition development project called Math Core for Museums, and mounted at four museums around the country: Museum of Science (Boston); Museum of Life & Science (Durham, NC); Explora (Albuquerque); and Science Museum of Minnesota (St. Paul). The summative evaluation purposively selected four family groups at each institution and collected naturalistic data as the 16 groups engaged with the exhibits from 4-6 times over a two
This is a two-year "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot targeting high school students in the Hudson Valley, including the New York Metropolitan Area. It will support a network of institutional partners that are committed to providing internship and mentoring opportunities to youths interested in authentic research projects. The proposed work will build on a current research immersion program--the Secondary School Field Research Program (SSFRP) at Columbia University's Lamont-Doherty Earth Observatory. SSFRP serves high school students, mainly from underrepresented and underserved communities, who work with college students, science teachers, and researchers around a specific science problem. Over the past decade, the program has had demonstrable impact, including attendance to college, and students' selection of STEM majors. Tracking data indicates that retention rates of its alumni in four-year colleges are well above the norm, and a significant fraction of early participants are now in graduate programs in science or engineering. The program has surpassed all expectations in its effectiveness at engaging underserved populations in science and promoting entry into college, recruitment into STEM majors, and retention through undergraduate and into graduate studies. Hence, the project's overall goal will be to extend and adapt the research-immersive summer internship model through an alliance with peer research institutions, school districts and networks, public land and resource management agencies, private funding agencies, informal educational institutions, and experts in pedagogical modeling, metrics, and evaluation. Focused on earth and environmental sciences, the summer and year-round mentoring model will allow high school students to work in research teams led by college students and teachers under the direction of research scientists. The mentoring model will be multilayered, with peer, near-peer, and researcher-student relationships interweaving throughout the learning process.
The project has formulated a set of testable explanatory hypotheses: (1) Beyond specific subject knowledge, success rests on increased student engagement in a community of practice, with near-peer mentors, teachers, and scientists in the context of scientific research; (2) The intensity of engagement also shifts the students' vision of their future to include higher education, and specifically to imagine and move toward a STEM career; and (3) Early engagement, before students attend college, is critical because high school is where students form patterns of engagement and capacities related to science learning. Thus, the immediate goal of the two-year plan will be to create approximately 11 research internship programs focused on earth and environmental sciences, and to build the networks for growth through engagement with a wider community of educational partners. The main focus of this approach will be removing barriers between high school students and STEM organizations, and adapting the current mentoring model at Columbia University to the specific cultures of other research groups and internship programs throughout the lower Hudson Valley. The team has already assembled a diverse set of partners committed to broadening participation in STEM using a collective impact approach to early engagement in project-based learning. Research partners will provide the mentors, research projects, and laboratory facilities. The educational network partners will provide access for students, particularly those from under-resourced communities to participate, as well as participation opportunities for interested teachers. Informal learning organizations will provide access to field and research sites, along with research dissemination opportunities. In Year 1, the project will conduct a series of development workshops for partners already in place and foster the formation of new partnership clusters according to shared interest, complementary resources and geographic proximity. The workshops will provide a forum for partners to learn about each other's visions, values, challenges, and existing structures, while working through theoretical and practical issues related to STEM engagement for young investigators. In Year 2, the project will target the implementation of the internship programs at various sites according to the agreed-upon goals, program model, research projects, recruitment and retention strategy, staff training, data collection, and evaluation plans. An external evaluator will address both the formative and summative evaluation of the effort directed toward examining the three project's hypotheses concerning the educational impacts of scientific research on student engagement, extent of the immersion, and overall effectiveness of the programs.
DATE:
-
TEAM MEMBERS:
Robert NewtonLuo Cassie XuMargie TurrinEinat LevMatthew Palmer
resourceprojectProfessional Development, Conferences, and Networks
Physics awards smaller percentages of PhDs to women (19%) and underrepresented ethnic and racial minorities (7%) than any other field in the sciences, and underrepresentation is especially pronounced at selective universities. As global competition for scientific talent heats up and US demographics shift, cultivating a robust domestic workforce is critical to US technological leadership. We seek to build on the successful American Physical Society Bridge Program (apsbridgeprogram.org) by transforming physics graduate education to fully support the inclusion of women and ethnic and racial minorities. Our vision is to create a national network of disciplinary colleagues, expert researchers, and representatives from professional associations who will develop and build evidence-based knowledge of effective practices for recruitment, admissions, and retention of women and underrepresented ethnic and racial minorities. This pilot project will include six large, highly selective physics graduate programs to demonstrate and map out a plan for a discipline-wide effort. The pilot focuses on improving admissions practices, because this strategy promises immediate and measurable impact backed by extant research. The pilot will also take exploratory steps to develop scalable recruitment and retention strategies. To refine interventions, we will conduct research to identify and understand demographically-based loss points of students in graduate physics programs and to understand how network participation facilitates change. The project will also establish connections with other STEM disciplines, beginning with mathematics and chemistry, to explore expanding these efforts.
This project is grounded in research on diversity in graduate education, organizational learning, and the resources of networks to catalyze cultural change. The project team includes expertise in institutional change, graduate admissions, student success, diverse and inclusive environments, and social science research. The pilot advances a novel research agenda on inclusion in STEM by addressing recruitment, admissions, and retention in physics graduate education as interconnected challenges of faculty learning, professional networks, and disciplinary cultural change. Physics graduate programs will report admissions data and common metrics, and will document changes resulting from project activities. Faculty will be trained on holistic admissions and diversity in selection processes, and be guided in the use of inclusive admissions practices. An external evaluator will examine project effectiveness and readiness for scaling to an Alliance phase project.
DATE:
-
TEAM MEMBERS:
Monica PlischTheodore HodappJulie PosseltGeraldine CochranCasey Miller
While interest in citizen science as an avenue for increasing scientific engagement and literacy has been increasing, understanding how to effectively engage underrepresented minorities (URMs) in these projects remains a challenge. Based on the research literature on strategies for engaging URMs in STEM activities and the project team’s extensive experience working with URMs, the project team developed a citizen science model tailored to URMs that included the following elements: 1) science that is relevant to participants’ daily lives, 2) removal of barriers to participation, such as
The mixed methods randomized experimental study assessed a model of engagement and education that examined the contribution of SciGirls multimedia to fifth grade girls’ experience of citizen science. The treatment group (n = 49) experienced 2 hours of SciGirls videos and games at home followed by a 2.5 hour FrogWatch USA citizen science session. The control group (n = 49) experienced the citizen science session without prior exposure to SciGirls. Data from post surveys and interviews revealed that treatment girls, compared to control girls, demonstrated significantly greater interest in their
Through the NSF Innovation Corps for Learning Program, (I-Corps L), this project will develop ways to enable the SciStarter program to extend the promise of citizen science by connecting millions of citizen scientists with scientists in need of their help through formal and informal research projects. Citizen science is a fast growing field that engages the public in scientific inquiry through data collection projects and environmental monitoring using sensors, mini spectrometers, water testing kits and other tools. A challenge for the citizen science community has been access to the tools required to collect the types of data needed in citizen science projects. SciStarter facilitates broader participation in citizen science by reducing the barrier for volunteers to identify, acquire, and use the right scientific tools and instruments for each project. This I-Corps for Learning project will develop approaches to enable SciStarter to provide a larger number of citizen scientists with easier access to required and recommended instruments needed for meaningful participation in citizen science projects.
SciStarter aims to provide a holistic solution to the needs of citizen scientists that includes projects, support, and products such as training materials and consulting. SciStarter can be a catalyst in citizen science by connecting people to opportunities to engage and in lowering barriers to public participation in scientific research while creating a hybrid academic-consumer sustainability model. A central focus of this current effort will be establishing a sustainable and scalable means of enabling citizen scientists to obtain equipment and instruments in an efficient and cost-effective manner. The project will make use of elements already in place to expand the engagement of citizen scientists in new or multiple projects, to empower citizens in the process of citizen science, and to provide a useful, scalable and sustainable solution for scientists leading citizen science research projects. The extension of SciStarter will set the stage for greater inclusion of previously marginalized groups in citizen science activities and will extend to all forms of public engagement in science.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This conference proposal represents the first phase of a larger three-phase participatory research project that will use communities of interest as a vehicle for solving problems of common concern about designing youth-based STEM programs. It will set the stage for research over the next 10-25 years about the long-term impact of a variety of youth programs on STEM learning and career aspirations. Through a virtual format, the Association of Science-Technology Centers will bring together two representatives from ten long-standing youth programs, experts in the field of out-of-school time youth programming, and researchers to collaboratively develop a program profile template for measuring the impact of youth programming. The program profile template will help identify specific characteristics that will capture the influence of youth programs on their participation in out-of-school STEM activities.
The program profile template will be the main outcome from the conference. It will serve as the foundation for designing long-term impact studies that support the needs of program staff interested in improving youth programming in informal environments. It will also allow program staff and researchers to document and share intellectual capital, compare goals and features across programs, and support network efforts among informal agencies worldwide. The program profile template will be shared online through informalscience.org, the Association of Science-Technology Centers' communities of practice networks, and through other out-of-school-time national organizations.
Mathematics is a notoriously disliked subject; there is so little stigma associated with being "bad at math", that educated adults openly describe themselves in this way. There are many reasons for math's unpopularity; chief among them is that school mathematics seldom offers opportunities to engage with the richness of this potentially fascinating subject. As a result, the mathematics education pipeline in the United States is more often a filter than a pump, siphoning students out rather than bringing them along. Children have libraries to help them fall in love with literature: where do they get a chance to fall in love with math? This project presents a unique opportunity to study children engaged with mathematics in an informal setting, the Minnesota State Fair, facilitated by mathematically knowledgeable volunteers. The Math On-a-Stick mathematical playground provides a place for children to engage with mathematics by exploring patters, asking quantitative questions, and investigating shape and space to mathematize their play. The project will observe and videotape this engagement to inform the design of mathematical learning environments in a variety of outside of school time settings, such as after school programs and summer camps, that are accessible to a wider range of the population. This project is co-funded by the EHR Core Research (ECR) and Advancing Informal STEM Learning (AISL) programs. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in three thematic areas: STEM learning and learning environments, broadening participation, and STEM workforce development. The AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The project will investigate three research questions: (1) How does the design of various parts of the exhibit differently support rich mathematical interactions between children and mathematicians? (2) How do children engage different parts of the exhibit? How do differences in engagement relate to (a) exhibit design and (b) prior mathematical experience? (3) How do exhibit volunteers, mathematicians, and caregivers interact to support (or undermine) students' mathematical play? The project will use participant observation and videography to capture visitors' activities through the exhibit, analyzing them as qualitative case studies.
This project was submitted in response to EHR Core Research (ECR) program announcement NSF 15-509. The ECR program of fundamental research in STEM education provides funding in critical research areas that are essential, broad and enduring. EHR seeks proposals that will help synthesize, build and/or expand research foundations in the following focal areas: STEM learning, STEM learning environments, STEM workforce development, and broadening participation in STEM. The ECR program is distinguished by its emphasis on the accumulation of robust evidence to inform efforts to (a) understand, (b) build theory to explain, and (c) suggest interventions (and innovations) to address persistent challenges in STEM interest, education, learning, and participation.
In 2015, average mathematics scores on the National Assessment of Educational Progress (NAEP) declined in fourth and eighth grades, the first declines in mathematics at these grade levels since 1990. Declines in U.S. mathematics performance has important implications for overall STEM education as well as STEM workforce and international competitiveness. Researchers at Rutgers University will conduct an analysis to isolate the cause of the mathematics decline by investigating the dimensionality of the NAEP assessment, state-level outcomes, and demographic trends.
The team will use multilevel item response theory modeling techniques to investigate the declines by examining the factor structures to determine dimensionality across years. Researchers will examine subscores corresponding to each dimension of the factor structure at the state and national levels. In addition, subscores will be examined for trends in individual states and jurisdictions. Potentially, the analyses will allow for examination of factors related to state standards adoptions, demographic shifts, and participation rates.
DATE:
-
TEAM MEMBERS:
Gregory Camilli
resourceprojectProfessional Development, Conferences, and Networks
The Museum of Science (MOS) will conduct a conference and associated activities to consider ways to foster the STEM workforce via both science research and science communications experiences for students at the high school level. The work will draw on and expand the scope in the USA of the NSF-funded National Living Laboratory Network which currently involves more than 350 institutions across 48 states and 21 countries. The National Living Laboratory initiative involves university researchers and museum professionals in co-implementing research and science communications activities in museum settings with the public, primarily families with young children. The research and communications focus is on cognitive science pertaining to the development of young children. While many scientists and museum professionals are interested in integrating high school research experiences into their practices, particularly for under-represented youth, existing infrastructure at museums and universities limits the quality of experiences and quantity of students that institutions can support. Current academic and museum members of the National Living Laboratory community have identified an opportunity to advance shared interests and knowledge in engaging youth in STEM by leveraging the Living Laboratory framework.
This project involves pre- and post- conference activities and will convene a group of science research and museum professionals at a workshop in Boston, MA to: 1) document current opportunities and challenges in engaging high-school aged youth in cognitive science research activities; 2) outline strategies to engage youth in research and science communication through Living Laboratory, with particular emphasis on cognitive sciences; and 3) create and disseminate a report on workshop outcomes through existing communication channels in both fields. The project includes pre-conference surveys of professionals about the topic and an evaluation of the project activities and outcomes. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
As part of an overall strategy to enhance learning within informal environments, the Innovations at the Nexus of Food, Energy, and Water Systems (INFEWS) and Advancing Informal STEM Learning (AISL) programs partnered to support innovative models poised to catalyze well-integrated interdisciplinary research and development efforts within informal contexts that transform scientific understanding of the food, energy, and water systems (FEWS) nexus in order to improve system function and management, address system stress, increase resilience, and ensure sustainability. This project addresses this aim by using systems thinking and interdisciplinary integration approaches to develop a novel immersive educational simulation game and associated materials designed to highlight the role and importance of corn-water-ethanol-beef (CWEB) systems in supporting the ever increasing demands for food, energy, and water in the United States. The focus on FEWS and sustainable energy aligns well with both the INFEWS program and the sizable sustainability-related projects in the AISL program portfolio. The development and broad dissemination of a multiuser game specific to CWEB systems are particularly innovative contributions and advance for both program portfolios and their requisite fields of study. An additional unique feature of the game is the embedding of varying degrees of economic principles and decision-making along with the nuisances of cultural context as salient variables that influence systems thinking. Of note, a team of computer science, management and engineering undergraduate students at the University of Nebraska - Lincoln will be responsible for the engineering, development, and deployment of the game as their university capstone projects. If successful, this game will have a significant reach and impact on youth in informal programs (i.e., 4-H clubs), high school teachers and students in agriculture vocational education courses, college students, and the public. The impact could extend well beyond Nebraska and the targeted Midwestern region. In conjunction with the game development, mixed-methods formative and summative evaluations will be conducted by an external evaluator. The formative evaluation of the game will focus on usability testing, interest and engagement with a select sample of youth at local 4-H clubs and youth day camps. Data will be collected from embedded in-game survey questionnaires, rating scales, observations and focus groups conducted with evaluation sample. These data and feedback will be used to inform the design and refinement of the game. The summative evaluation will focus on the overall impacts of the game. Changes in agricultural systems knowledge, attitudes toward agricultural systems, interest in pursuing careers in agricultural systems, and decision making will be aligned with the Nebraska State Science Standards and tracked using the National Agricultural Literacy Outcomes (NALOs) assessment, game analytics and pre/post-test measures administered to the evaluation study sample pre/post exposure to the game.
DATE:
-
TEAM MEMBERS:
Jeyamkondan SubbiahEric ThompsonDeepak KeshwaniRichard KoelschDavid Rosenbaum
Changes in household-level actions in the U.S. have the potential to reduce rates of greenhouse gas (GHG) emissions and climate change by reducing consumption of food, energy and water (FEW). This project will identify potential interventions for reducing household FEW consumption, test options in participating households in two communities, and collect data to develop new environmental impact models. It will also identify household consumption behavior and cost-effective interventions to reduce FEW resource use. Research insights can be applied to increase the well-being of individuals at the household level, improve FEW resource security, reduce climate-related risks, and increase economic competitiveness of the U.S. The project will recruit, train, and graduate more than 20 students and early-career scientists from underrepresented groups. Students will be eligible to participate in exchanges to conduct interdisciplinary research with collaborators in the Netherlands, a highly industrialized nation that uses 20% less energy and water per person than the U.S.
This study uses an interdisciplinary approach to investigate methods for reducing household FEW consumption and associated direct and indirect environmental impacts, including GHG emissions and water resources depletion. The approach includes: 1) interactive role-playing activities and qualitative interviews with homeowners; 2) a survey of households to examine existing attitudes and behaviors related to FEW consumption, as well as possible approaches and barriers to reduce consumption; and 3) experimental research in residential households in two case-study communities, selected to be representative of U.S. suburban households and appropriate for comparative experiments. These studies will iteratively examine approaches for reducing household FEW consumption, test possible intervention strategies, and provide data for developing systems models to quantify impacts of household FEW resource flows and emissions. A FEW consumption-based life cycle assessment (LCA) model will be developed to provide accurate information for household decision making and design of intervention strategies. The LCA model will include the first known farm-to-fork representation of household food consumption impacts, spatially explicit inventories of food waste and water withdrawals, and a model of multi-level price responsiveness in the electricity sector. By translating FEW consumption impacts, results will identify "hot spots" and cost-effective household interventions for reducing ecological footprints. Applying a set of climate and technology scenarios in the LCA model will provide additional insights on potential benefits of technology adoption for informing policymaking. The environmental impact models, household consumption tracking tool, and role-playing software developed in this research will be general purpose and publicly available at the end of the project to inform future education, research and outreach activities.
DATE:
-
TEAM MEMBERS:
David WatkinsBuyung AgusdinataChelsea SchellyRachael ShwomJenni-Louise Evans