Well-designed educational games represent a promising technology for increasing students interest in and learning of STEM topics such as physics. This project will research how to optimally combine and embed dynamic assessment and adaptive learning supports within an engaging game design to build effective educational games. The project will add enhancements to a physics game called Physics Playground. The general goal of this research is to test a valid methodology that can be used in the design of next-generation learning games. The enhancement of Physics Playground will leverage the popularity of video games to capture and sustain student attention and teach physics to a much broader audience than is currently the case in traditional physics classrooms. To be most effective, this new genre of learning games needs to not only be highly engaging as a game but also to provide real-time assessment and feedback to students; support understanding of science content (i.e.,Newtonian physics); be accessible to beginners; accommodate a range of proficiencies and interests; and support equity. The research will have particular relevance to designers developing other science games and simulation by providing information about the kinds of learning supports and feedback to students are most effective in promoting engagement and learning. The project is supported by the Cyberlearning and Future Learning Technologies Program, which funds efforts that will help envision the next generation of learning technologies and advance what we know about how people learn in technology-rich environments. Cyberlearning Exploration (EXP) Projects explore the viability of new kinds of learning technologies by designing and building new kinds of learning technologies and studying their possibilities for fostering learning and challenges to using them effectively.
The project will systematically develop, test, and evaluate ways to integrate engaging, dynamic learning supports in Physics Playground to teach formal conceptual physics competencies. More generally, the project aims to advance the learning sciences, particularly in the fields of adaptivity and assessment in educational technology. Using a design-based research approach spanning three years, the research team will: (1) develop and test the effectiveness of various learning support features included in the game in Year 1; (2) develop and test an adaptive algorithm to manage the progression of difficulty in game levels in Year 2; and (3) test learning supports and adaptive sequencing in a controlled evaluation study. This research will provide evidence of the instructional effectiveness of an educational game designed using principles of instructional, game, and assessment design. It will advance understanding of the contributions of different kinds of learning supports (e.g., visualizations and explanations) and adaptivity to game-based learning and contribute to the design of next-generation learning games that successfully blur the distinction between assessment and learning. The project will generate research findings that can be incorporated into other types of STEM learning games.
DATE:
-
TEAM MEMBERS:
Valerie ShuteRussell AlmondFengfeng Ke
This Research in Service to Practice project, a collaboration of Pepperdine University and the New York Hall of Science, will establish a network of STEM-related Media Making Clubs comprised of after-school students aged 12 - 19 and teachers in the U.S. and in three other countries: Kenya, Namibia and Finland. The media produced by the students may include a range of formats such as videos, short subject films, games, computer programs and specialized applications like interactive books. The content of the media produced by the students will focus on the illustration and teaching of STEM topics, where the shared media is intended to help other students become enthused about and learn the science. This proposal builds on the principal investigator's previous work on localized media clubs by now creating an international network in which after-school students and teachers will collaborate at a distance with other clubs. The central research questions for the project pertain to three themes at the intersection of learning, culture and collaboration: the impact of participatory teaching, virtual networks, and intercultural, global competence. The research will combine qualitative, cross-cultural and big data methods. Critical to the innovation of the project, the research team will also develop a network assessment tool, adapting epistemic network analysis methods to the needs of this initiative. This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Eric HamiltonKatherine McMillanPriya Mohabir
This project, a collaboration of teams at Georgia Institute of Technology, Northwestern University, and the Museum of Design Atlanta and the Museum of Science and Industry in Chicago, will investigate how to foster engagement and broadening participation in computing by audiences in museums and other informal learning environments that can transfer to at-home and in-school engagement (and vice versa). The project seeks to address the national need to make major strides in developing computing literacy as a core 21st century STEM skill. The project will adapt and expand to new venues their current work on their EarSketch system which connects computer programming concepts to music remixing, i.e. the manipulation of musical samples, beats and effects. The initiative involves a four-year process of iteratively designing and developing a tangible programming environment based on the EarSketch learning environment. The team will develop three new applications: TuneTable, a multi-user tabletop exhibit for museums; TunePad, a smaller version for use at home and in schools; and an online connection between the earlier EarSketch program and the two new devices.
The goal is to: a) engage museum learners in collaborative, playful programming experiences that create music; b) direct museum learners to further learning and computational music experiences online with the EarSketch learning environment; c) attract EarSketch learners from local area schools to visit the museum and interact with novice TuneTable users, either as mentors in museum workshops or museum guests; and d) inform the development of a smaller scale, affordable tangible-based experience that could be used at homes or in smaller educational settings, such as classrooms and community centers. In addition to the development of new learning experiences, the project will test the hypothesis that creative, playful, and social engagement in the arts with computer programming across multiple settings (e.g. museums, homes, and classrooms) can encourage: a) deeper learner involvement in computer programming, b) social connections to other learners, c) positive attitudes towards computing, and d) the use and recognition of computational concepts for personal expression in music. The project's knowledge-building efforts include research on four major questions related to the goals and evaluation processes conducted by SageFox on the fidelity of implementation, impact, success of the exhibits, and success of bridging contexts. Methods will draw on the Active Prolonged Engagement approach (unobtrusive observation, interviews, tracking-and-timing, data summaries and team debriefs) as well as Participatory Action Research methods.
This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Michael HornBrian MagerkoJason Freeman
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. This Broad Implementation project would scale up the CryptoClub Project, an afterschool and online program designed to engage middle school youth in mathematics and cryptography. The project builds on previous successful work and evaluation that is ready for scale up using a train-the-trainer model implemented through a partnership with the National Girls Collaborative. The project will train 160 new CryptoClub leaders who will then train 800 new leaders at 20 hub sites reaching 9600 students. In addition, professional development modules and webinars will continue to refresh leader skills. Other project components include an online multiplayer cryptography game, weekly challenges through social media, and digital cryptology badges for students.
The research uses a think-aloud method with students as they actually attempt to solve the cryptology problems using mathematical thinking. Three think-aloud studies will be performed during the Project. The research team will code transcripts of the interviews for evidence of the mathematical thinking intended to be addressed by each activity, as well as capturing unexpected kinds of thinking. Tasks will also be rated according to the type of knowledge elicited. A written report will include statistical analyses of the think-aloud and interview responses, interpreted in light of the overall CryptoClub goals. The findings will contribute to both future research efforts and practice. The evaluation by EDC uses a quasi-experimental design, which assesses project outcomes for trainers, leaders, students, and Internet users. EDC will also investigate the fidelity to the CryptoClub model as it is scaled up. These studies have strong potential for informing numerous other projects that are at a stage where scale up is under consideration.
This summative report evaluates the accessibility and efficacy of a project website as a tool for teaching ecosystem science. Edu ran a qualitative study with twelve participants in order to determine the overall usability and learnability of IntotheRift.org – an online textbook offering a virtual field trip to Lake Tanganyika in East Africa. The goal of the study – identify usability issues and also what currently works well. A learnability study focused on learners’ increase in awareness of ecosystem concepts and research scientists working in Lake Tanganyika. An efficacy study evaluated
DATE:
TEAM MEMBERS:
Douglas SpencerSasha MinskyJediah Graham
In this chapter we present the ways in which institutional cultural differences impact the development and implementation of learning activities in informal settings. Five university-based centers for the study of chemistry worked with informal learning professionals to re-envision educational and public outreach activities about science. The projects were part of a broader effort to catalyze new thinking and innovation in informal education and chemistry centers. The set of projects illustrates the broad possibilities for informal learning settings, with projects targeting diverse audiences
Currently, many young people - especially girls and youth of color - lose confidence and interest in science, technology, engineering and math (STEM) pathways due to a perceived disconnect between their own identity and STEM fields. To address this challenge, Twin Cities PBS (TPT) is implementing SciGirls CONNECT2. This three-year Research in Service to Practice award examines how gender equitable and culturally responsive teaching strategies influence middle school girls' confidence, interest and motivation around STEM studies, and their choices around STEM careers. A set of research-based strategies, called the SciGirls Seven, are currently employed in SciGirls, an NSF-funded informal STEM educational outreach program serving 125+ educational partner organizations nationwide. The goal is to update and enrich the SciGirls Seven, providing educators with a critical, current, and more effective resource to motivate girls in STEM studies and careers. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Florida State University will conduct a formal research study investigating the hypothesis that STEM programs that use gender equitable and culturally responsive strategies contribute to girls' positive STEM identity development, including their sense of self-efficacy, persistence and aspirations around future STEM careers. This research will include a literature review and a study of girls' STEM identity creation. The mixed methods study will include quantitative and qualitative data collection and analysis measuring changes in students' STEM identity and teachers' confidence in STEM teaching. The quantitative data will come from the student, parent and teacher pre/post surveys. The qualitative research will be conducted via case studies at four sites and the qualitative data will include observations, focus groups and interviews. Girls at all partner sites will create videos that will allow the research team to gather additional insight. The independent firm Knight Williams, Inc. will conduct the project's external evaluation.
The project will work with a subset of 16 current SciGirls partners. These geographically diverse partners will reach youth in all-girls and co-ed informal STEM education programs in a variety of settings. More than half serve Hispanic or other minority populations. The updated strategies will be disseminated to the 2,500 educators within the SciGirls partner network and the 18,800 STEM education organizations of the National Girls Collaborative Project (NGCP) network. Dissemination of the strategies and literature review will focus on the informal STEM education field through publications and presentations, posts at PBS LearningMedia, a free online space reaching 1.5 million teachers and educators.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. Using hand-held mobile devices this project would test specialized Signing Glossaries for Science Exhibits (SGSE). The glossaries are developed from 5000 unique signing terms specific to the science in 6 partner institutions and designed to reach families with at least one member, ages 5-12+, who is deaf or hard of hearing and uses American Sign Language (ASL) for communication. The project would demonstrate the potential effectiveness of the venue-specific signing glossaries to enhance access to STEM learning during visits to informal STEM learning environments such as aquariums, botanical gardens, natural history museums, nature centers, science museums, and zoos.
While utilizing existing domain specific signing terms, the project will adapt and improve on their use in content specific informal science venues to increase the opportunity for the target audience to both enjoy and benefit from the wide array of informal science learning opportunities available to this group. The research should reveal how this approach might benefit those with other types of disabilities. The research questions are designed to understand both how family members might interact with a hearing disabled family member as well as how the disabled individual might learn more about a variety of STEM content in a setting that is not domain specific but uses the influence of science exhibits to inform, engage and interest members of the public generally.
Domain specific signing dictionaries have been developed, many by this PI, to address access to content specific topics in STEM. This proposal extends this concept to informal learning environments that are content specific to increase the opportunity for those with hearing disabilities to increase their capability to both enjoy informal science learning venues and to understand more of what these venues provide in terms of science learning.
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. In this project, the primary goal of Geo-literacy Education in Micronesia is to demonstrate the potential for effective intergenerational, informal learning and development of geo-literacy through an Informal STEM Learning Team (ISLT) model for Pacific island communities. This will be accomplished by means of a suite of six informal learning modules that blend local/Indigenous approaches, Western STEM knowledge systems, and active learning. This project will be implemented across 12 select communities in the Republic of Palau, the Federated States of Micronesia - which consists of the four States of Chuuk, Kosrae, Pohnpei, and Yap - and the Republic of the Marshall Islands. Jointly, these entities are referred to as the Freely Associated States (FAS). Geo-literacy refers to combining both local knowledge and Western STEM into a synthesized understanding of the world as a set of interconnected, dynamic physical, biological, and social systems, and using this integrated knowledge to make informed decisions. Applications include natural resource management, conservation, and disaster risk reduction. The project will: (1) demonstrate that the recruitment and development of an ISLT model is an effective method of engaging communities in geo-literacy activities; (2) increase geo-literacy knowledge and advocacy skills of ISLT participants; (3) produce and disseminate geo-literacy educational materials and resources (e.g., place-based teaching guides, geospatial data systems, educational apps, 2-D and 3-D models, and digital maps); and (4) provide evidence that FAS residents use these geo-literacy educational materials and resources to positively influence decision-making.
DATE:
-
TEAM MEMBERS:
Corrin BarrosKoh Ming WeiDanko TabrosiEmerson Odango
Roots of Wisdom (also known as Generations of Knowledge; NSF-DRL #1010559) is a project funded by the National Science Foundation that aims to engage Native and non-Native youth (ages 11-14) and their families in Traditional Ecological Knowledge (TEK) and western science within culturally relevant contexts that present both worldviews as valuable, complementary ways of knowing, understanding, and caring for the natural world. The Oregon Museum of Science and Industry (OMSI) and its partner organizations, The Indigenous Education Institute (IEI), The National Museum of the American Indian (NMAI
Roots of Wisdom (also known as Generations of Knowledge) is a 5-year project funded by the National Science Foundation (NSF-DRL #1010559) in support of a cross-cultural reciprocal collaboration to develop a traveling exhibit, banner exhibit, and education resources that bring together Traditional Ecological Knowledge (TEK) and western science. The summative evaluation for public audience impacts was conducted by the Lifelong Learning Group (COSI, Columbus, OH), in collaboration with Native Pathways (Laguna, NM).
Nurture Nature Center recently completed a 2 year project to develop a 6 Degrees of Connection educational program, supported by a grant from NASA’s CP4SMP. The program focuses on earth science concepts and the cross-cutting theme of interconnectedness, using personal relevance as a hook to capture students’ interest and motivate them to pursue STEM experiences and careers.
Over the course of two years, students, interns, and teachers were engaged to help develop a SOS program with an associated arts-based creative activity. An iterative program design process based on student and teacher evaluations resulted in the 6 Degrees of Connectionprogram which discusses earth systems connections involving the sun, space weather, and ozone; transportation, atmosphere and acid rain; climate change; and marine debris. The program is purposefully interactive and multi-disciplinary - students are encouraged to consider the cascading effects related to the production and transportation of their clothing during an interactive activity using the SOS, an arts-based activity after the SOS program helps participants visualize and physically diagram their connections to global issues, and students learn about STEM careers from clips of STEM professionals discussing the ways their work is tied to various human and earth systems.
We are pleased to share more about the project, the evaluation, and program materials on our website here http://nurturenaturecenter.org/6-degrees-of-connection-understanding-the-interconnectedness-of-earth-systems/.