Becoming computationally literate is increasingly crucial to everyday life and to expanding workforce capacity. Research suggests that computational literacy--knowing what, when, how, and why to use the ideas of computer science, in combination with the capacity to view problems and potential solutions through the lens of computational structures and procedures--can be supported through digital game play. This project aims to develop a social and creative exhibit game that foregrounds aspects of computer science, specifically artificial intelligence (AI) and computer programming, in ways that enable youth to explore, construct, and share computational complex systems content with one another and other museum visitors. To play the game, pairs of youth visitors will use code cards to program the behavior of AI animals in a virtual forest. As they do so, youth will engage with computational literacy practices, such as basic computer programming, describing their computational ideas, and doing computational problem solving with their friends. Their activity will be projected on a large screen as a strategy for enabling youth to test, rehearse, and communicate their computational ideas and to also interest other visitors into computational problem solving.
Using multi-perspective and iterative design-based research, university learning scientists, museum practitioners, and game developers will pursue research questions around how science museums can better engage youth who are traditionally underrepresented in computer science in complex computational practices. Data sources will include interactive-log data, observations of visitor interactions with the game, visitor interviews, and visitor surveys. A multimodal and mixed methods approach that searches for convergences between qualitative analysis, quantitative analysis, and learning analytics will be used to generate research findings. Changes in computational literacy will be assessed by evaluating what problems visitors choose to solve with programming, how they frame those problems, and their selections from among possible solutions, what they program, how they program, and how they describe programming ideas. The results of this project will include: 1) a social, interactive gameplay experience that supports the development of computational literacy; 2) design principles for game-based exhibits that facilitate development of computational literacy; and 3) new knowledge of variations in design and gameplay across diverse gameplay users, including those from underrepresented groups in computer science. It is anticipated that 1,000 museum youth visitors will directly participate in the study.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
Matthew BerlandLeilah LyonsMatthew Cannady
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This Research in Service to Practice project will address the issues around Informal Education of rural middle school students who have high potential regarding academic success in efforts to promote computer and IT knowledge, advanced quantitative knowledge, and STEM skills. Ten school districts in rural Iowa will be chosen for this study. It is anticipated that new knowledge on rural informal education will be generated to benefit the Nation's workforce. The specific objectives are to understand how informal STEM learning shapes the academic and psychosocial outcomes of rural, high-potential students, and to identify key characteristics of successful informal STEM learning environments for rural, high-potential students and their teachers. The results of this project will provide new tools for educators to increase the flow of underserved students into STEM from economically-disadvantaged rural settings.
The President's Council of Advisors on Science and Technology predicts a rapid rise in the number of STEM jobs available in the next decade, describing an urgent need for students' educational opportunities to prepare them for this workforce. In 2014, 62% of CEOs of major US corporations reported challenges filling positions requiring advanced computer and information technology knowledge. The project team will use a mixed methods approach, integrating comparative case study and mixed effects longitudinal methods, to study the Excellence program. Data sources include teacher interviews, classroom observations, and student assessments of academic aptitude and psychosocial outcomes. The analysis and evaluation of the program will be grounded in understanding the local efforts of school districts to build curriculum responsive to the demands of their high-potential student body. The project design, and subsequent analysis plan, utilizes a mixed methods approach, incorporating case study and longitudinal quantitative methods to analyze naturalistic data and build robust evidence for the implementation and impact of this program. This project will provide significant insights in how best to design, implement, and support informal out-of-school learning environments to broaden participation in the highest levels of STEM education and careers for under-resourced rural students.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. In this exploratory Change Makers project, the Concord Consortium will develop, test, and evaluate a citizen science program that leverages innovative technology, such that youth engage directly with energy issues through scientific inquiry. The project will create the Infrared Street View, a citizen science program that aims to produce a thermal version of Google's Street View using an affordable infrared camera attached to a smartphone. The infrared camera serves as a high-throughput data acquisition instrument that collects thousands of temperature data points each time a picture is taken. Youth will collect massive geotagged thermal data that have considerable scientific and educational value for visualizing energy usage and improving energy efficiency at all levels. The Infrared Street View program will provide a Web-based platform for youth and anyone interested in energy efficiency to view and analyze the aggregated data to identify possible energy losses. By sharing their scientific findings with stakeholders, youth will make changes to the way energy is being used. The project will start with school, public, and commercial buildings in selected areas where performing thermal scan of the buildings and publishing their thermal images for educational and research purposes are permitted by school leaders, town officials, and property owners. In collaboration with high schools and out-of-school programs in Massachusetts, this project will conduct pilot-tests with approximately 200 students.
To contribute to advancing learning, the study will probe three research questions: 1) Under what circumstances can technology bridge out-of-school and classroom science learning and improve learning on both sides? 2) To what extent can unobtrusive assessment based on data mining support research and evaluation of student learning in out-of-school settings? and 3) To what extent can instructional intelligence built into the app used in the program help students learn in out-of-school programs and improve the quality of data they contribute to the citizen science project? Data sources for investigating these questions include students' interaction data with the app logged behind the scenes and the images they have taken, as well as results based on traditional assessments from a small number of participants. Throughout the project, staff will widely disseminate project products and findings through the Internet, science fairs, conferences, publications, and partner networks. An eight-member Advisory Board consisting of cleantech experts, science educators, and educational researchers will oversee and evaluate this project.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
This INSPIRE project addresses the issue of high volume hydraulic fracturing, also called fracking, and its effects on ground water resources. Fracking allows drillers to extract natural gas from shale deep within the earth. Methane gas sometimes escapes from shale gas wells and can contaminate water resources or leak into the atmosphere where it contributes to greenhouse gas emissions. Monitoring for these potential leaks is difficult because methane is also released into aquifers naturally, and because monitoring is time- and resource-intensive. Such subsurface leakage may also be relatively rare. This project seeks to improve overall understanding of the impacts of natural gas drilling using both advances in computer science and geoscience, and to teach the public about such impacts. The project will elucidate both the effects of human activities such as shale gas development as well as natural processes which release methane into natural waters. Results of the proposed research will lead to a better understanding of water quality in areas of shale-gas development and will highlight problems and potentially problematic management practices. The research will advance both the fields of geoscience and computer science, will train interdisciplinary graduate students, and involve citizen scientists in collecting data and understanding environmental data analysis.
The project combines new hydro-geochemical strategies and data mining approaches to study the release of methane into streams and ground waters. For example, researchers will explore how to analyze the heterogeneous spatial data that describe distributions of methane concentrations in natural waters. The objectives of this project are to i) transform the ability to measure methane in streams; ii) train citizen scientists to work with project scientists to sample streams in an area of shale-gas development and publish large-volume datasets of methane in natural waters and aquifers; iii) innovate data mining and machine learning methods for environmental data to identify anomalous spots with potential leakage; iv) run field campaigns to measure methane concentrations and isotopic signatures of water samples in these spots; v) foster dialogue among nonscientists, consultants, university scientists, members of the gas industry, government agencies, and nonprofit organizations in and beyond the target region. Toward this end, the team will host workshops aimed to build dialogue among stakeholders and will release data analytic software for environmental measurements to benefit a broader research community.
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. This media and technology project will scale up Youth Radio's proven model of STEM education through youth-driven multimedia journalism and related app development using the MIT App Inventor. A new Youth News Network (YNN) will implement a nationwide feeder system of youth reporters and educators using the previously developed and proven STEM curriculum. Previous research and evaluation has demonstrated that this model can engage underserved youth and put them in leadership positions in technological innovation. Key deliverables include the YNN STEM Desk that will produce 15-20 STEM-related stories each year; bootcamps (1-3 day workshops) training youth around the country focusing on app development and media links; and new toolkits providing resources to help with app development, data analysis and other STEM-specific skills. Project partners include MIT Media Lab, National Public Radio, Best Buy's Teen Tech Centers, National Writing Project, Computer Clubhouses, and PBS Learning Media among others.
Over the previous eight years, research and evaluation findings had been used to refine the project. These data served as the foundation for this scale-up project. The research conducted by the investigator and the Scholar-in-Residence in this scale-up uses an embedded ethnographic approach that combines field notes, recorded meetings and discussions, media artifacts, etc.--data that is transcribed and coded for indicators of STEM learning and critical computational literacy. The external summative evaluation will build on prior evidence regarding how this unique model engages youth and impacts their skills in STEM related media and technology.
DATE:
-
TEAM MEMBERS:
Elisabeth SoepEllin O'LearyHarold Abelson
This Research in Service to Practice project, a collaboration of Pepperdine University and the New York Hall of Science, will establish a network of STEM-related Media Making Clubs comprised of after-school students aged 12 - 19 and teachers in the U.S. and in three other countries: Kenya, Namibia and Finland. The media produced by the students may include a range of formats such as videos, short subject films, games, computer programs and specialized applications like interactive books. The content of the media produced by the students will focus on the illustration and teaching of STEM topics, where the shared media is intended to help other students become enthused about and learn the science. This proposal builds on the principal investigator's previous work on localized media clubs by now creating an international network in which after-school students and teachers will collaborate at a distance with other clubs. The central research questions for the project pertain to three themes at the intersection of learning, culture and collaboration: the impact of participatory teaching, virtual networks, and intercultural, global competence. The research will combine qualitative, cross-cultural and big data methods. Critical to the innovation of the project, the research team will also develop a network assessment tool, adapting epistemic network analysis methods to the needs of this initiative. This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Eric HamiltonKatherine McMillanPriya Mohabir
This project will capitalize on the power of story to teach foundational computational thinking (CT) concepts through the creation of animated and live-action videos, paired with joint media engagement activities, for preschool children and their parents. Exposure at a young age to CT is critical for preparing all students to engage with the technologies that have become central to nearly every occupation. But despite this recognized need, there are few, if any, resources that (1) introduce CT to young children; (2) define the scope of what should be taught; and (3) provide evidence-based research on effective strategies for bringing CT to a preschool audience. To meet these needs, WGBH and Education Development Center/Center for Children and Technology (EDC/CCT) will utilize an iterative research and design process to create animated and live-action videos paired with joint media engagement activities for parents and preschool children, titled "Monkeying Around". Animated videos will model for children how to direct their curiosity into a focused exploration of the problem-solving process. Live-action videos will feature real kids and their parents and will further illustrate how helpful CT can be for problem solving. With their distinctive visual humor and captivating storytelling, the videos will be designed to entice parents to watch alongside their children. This is important since parents will play an important role in guiding them in explorations that support their CT learning. To further promote joint media engagement, hands-on activities will accompany the videos. Following the creation of these resources, an experimental impact study will be conducted to capture evidence as to if and how these resources encourage the development of young children's computational thinking, and to assess parents' comfort and interest in the subject. Concurrent with this design-based research process, the project will build on the infrastructure of state systems of early education and care (which have been awarded Race to the Top grants) and local public television stations to design and develop an outreach initiative to reach parents. Additional partners--National Center for Women & Information Technology, Code in Schools, and code.org (all of whom are all dedicated to promoting CT)--will further help bring this work to a national audience.
Can parent/child engagement with digital media and hands-on activities improve children's early learning of computational thinking? To answer this question, WGBH and EDC/CCT are collaborating on a design-based research process with children and their parents to create Monkeying Around successive interactions. The overarching goal of this mixed-methods research effort is to generate evidence that supports the development of recommendations around the curricular, instructional, and contextual factors that support or impede children's acquisition of CT as a result of digital media viewing and hands-on engagement. Moving through cycles of implementation, observation, analysis, and revision over the course of three years, EDC/CCT researchers will work closely with families and WGBH's development team to determine how children learn the fundamentals of CT, how certain learning tasks can demonstrate what children understand, how to stimulate interest in hands-on activities, and the necessary scaffolds to support parental involvement in the development of children's CT. Each phase of the research will provide rich feedback to inform the next cycle of content development and will include: Phase 1: the formulation of three learning blueprints (for algorithmic thinking, sequencing, and patterns); Phase 2: the development of a cohesive set of learning tasks to provide evidence of student learning, as well as the production of a prototype of the digital media and parent/child engagement resources (algorithmic thinking); Phase 3-Part A: pilot research on the prototype, revisions, production of two additional prototypes (sequencing and patterns); Phase 3-Part B: pilot research on the three prototypes and revisions; and Phase 4: production of 27 animated and live-action videos and 18 parent/child engagement activities and a study of their impact. Through this process, the project team will build broader knowledge about how to design developmentally appropriate resources promoting CT for preschool children and will generate data on how to stimulate interest in hands-on activities and the necessary scaffolds to support parental involvement in the development of children's CT. The entire project represents an enormous opportunity for WGBH and for the informal STEM media field to learn more about how media can facilitate informal CT learning in the preschool years and ways to broaden participation by building parents' capacity to support STEM learning. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project, a collaboration of teams at Georgia Institute of Technology, Northwestern University, and the Museum of Design Atlanta and the Museum of Science and Industry in Chicago, will investigate how to foster engagement and broadening participation in computing by audiences in museums and other informal learning environments that can transfer to at-home and in-school engagement (and vice versa). The project seeks to address the national need to make major strides in developing computing literacy as a core 21st century STEM skill. The project will adapt and expand to new venues their current work on their EarSketch system which connects computer programming concepts to music remixing, i.e. the manipulation of musical samples, beats and effects. The initiative involves a four-year process of iteratively designing and developing a tangible programming environment based on the EarSketch learning environment. The team will develop three new applications: TuneTable, a multi-user tabletop exhibit for museums; TunePad, a smaller version for use at home and in schools; and an online connection between the earlier EarSketch program and the two new devices.
The goal is to: a) engage museum learners in collaborative, playful programming experiences that create music; b) direct museum learners to further learning and computational music experiences online with the EarSketch learning environment; c) attract EarSketch learners from local area schools to visit the museum and interact with novice TuneTable users, either as mentors in museum workshops or museum guests; and d) inform the development of a smaller scale, affordable tangible-based experience that could be used at homes or in smaller educational settings, such as classrooms and community centers. In addition to the development of new learning experiences, the project will test the hypothesis that creative, playful, and social engagement in the arts with computer programming across multiple settings (e.g. museums, homes, and classrooms) can encourage: a) deeper learner involvement in computer programming, b) social connections to other learners, c) positive attitudes towards computing, and d) the use and recognition of computational concepts for personal expression in music. The project's knowledge-building efforts include research on four major questions related to the goals and evaluation processes conducted by SageFox on the fidelity of implementation, impact, success of the exhibits, and success of bridging contexts. Methods will draw on the Active Prolonged Engagement approach (unobtrusive observation, interviews, tracking-and-timing, data summaries and team debriefs) as well as Participatory Action Research methods.
This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Michael HornBrian MagerkoJason Freeman
Citizen science engages members of the public in science. It advances the progress of science by involving more people and embracing new ideas. Recent projects use software and apps to do science more efficiently. However, existing citizen science software and databases are ad hoc, non-interoperable, non-standardized, and isolated, resulting in data and software siloes that hamper scientific advancement. This project will develop new software and integrate existing software, apps, and data for citizen science - allowing expanded discovery, appraisal, exploration, visualization, analysis, and reuse of software and data. Over the three phases, the software of two platforms, CitSci.org and CyberTracker, will be integrated and new software will be built to integrate and share additional software and data. The project will: (1) broaden the inclusivity, accessibility, and reach of citizen science; (2) elevate the value and rigor of citizen science data; (3) improve interoperability, usability, scalability and sustainability of citizen science software and data; and (4) mobilize data to allow cross-disciplinary research and meta-analyses. These outcomes benefit society by making citizen science projects such as those that monitor disease outbreaks, collect biodiversity data, monitor street potholes, track climate change, and any number of other possible topics more possible, efficient, and impactful through shared software.
The project will develop a cyber-enabled Framework for Advancing Buildable and Reusable Infrastructures for Citizen Science (Cyber-FABRICS) to elevate the reach and complexity of citizen science while adding value by mobilizing well-documented data to advance scientific research, meta-analyses, and decision support. Over the three phases of the project, the software of two platforms, CitSci.org and CyberTracker, will be integrated by developing APIs and reusable software libraries for these and other platforms to use to integrate and share data and software. Using participatory design and agile methods over four years, the project will: (1) broaden the inclusivity, accessibility, and reach of citizen science; (2) elevate the value and rigor of citizen science software and data; (3) improve interoperability, usability, scalability and sustainability of citizen science software and data; and (4) mobilize data to allow cross-disciplinary research and meta-analyses. These outcomes benefit society by making citizen science projects and any number of other possible topics more possible, efficient, and impactful through shared software and data. Adoption of Cyber-FABRICS infrastructure, software, and services will allow anyone with an Internet or cellular connection, including those in remote, underserved, and international communities, to contribute to research and monitoring, either independently or as a team. This project is also being supported by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Gregory NewmanLouis LiebenbergStacy LynnMelinda Laituri
Situated within the Advancing Informal STEM Learning program, this Research in Service to Practice award seeks to design, implement, and evaluate an intervention aimed at fostering a culture of productive failure practices. The project responds to a broad concern in educational research and practice: Experiences of failure are frequently so negative that students shut down, lose agency, and develop low self-efficacy and learned helplessness. Surrendering too quickly to obstacles is particularly unfortunate, given evidence that initially "getting it wrong" ultimately breeds deep and sustained learning. In order to learn how students can make the most of productive failure, the proposed project will study how a community of practice that includes middle school youth and their mentors attempts to change its handling of learning obstacles. Building on prior research documenting storytelling practices in an afterschool program, the team now aims to embolden young students' productive practices of failure storytelling in computer science, a field in which experts practice candid, pervasive, and collaborative discourse around errors ("bugs"). Pulling together the domains of narrative analysis, meta-cognitive reflection, and control theories of motivation, within the context of authentic computer-science debugging activity, this study develops a theoretical framework that views productive responses to failure as a discipline-specific process of reflecting as a community on how to locate obstacles, how to construct causal theories about why those obstacles emerged, and how to plan productive responses. A design-based research approach will investigate three questions: (1) What is the impact of the interventions on students and instructors' actions and discourse when they are debugging errors in computer code? (2) What is the impact of the interventions on students and instructors' reflections back on their prior debugging experiences and on failure in general? and (3) What is the impact of the instructor-development efforts on the instructors' capacity to foster students' productive attitudes toward failure? The study focus will be 15 summer and weekend coding workshops with 5th-8th grade students from populations typically under-represented in STEM. The interventions are (a) setting new norms and practices for debugging, (b) instructor education, and (c) coding software that provides students with feedback on their productive struggle. Data sources include video and audio recordings of the learning environment, artifacts produced during the activities, and semi-structured interviews. Measures will capture variations in debugging activities, reflections on debugging, students' ideas about grit and growth mindset, and instructors' struggles and successes with the new curriculum. The empirical results will consist of mixed-methods, micro-longitudinal accounts of how a community of practice works to reform its orientation to failure. The products of this work include empirical knowledge, theory, and curriculum about how learning communities help students develop robust and efficient responses to failure. These will be disseminated through journals, open-source software, and workshops/conferences for researchers and practitioners working with youth afterschool programs. The products may be useful for exploring practices in the classroom. This project is being conducted by the 9 Dots Community Learning Center, UCLA and UC Berkeley.
DATE:
-
TEAM MEMBERS:
Melissa ChenDor AbrahamsonNoel EnyedyFrancis SteenDavid DeLiema
EvalFest (Evaluation Use, Value, and Learning through Festivals of Science and Technology) will test innovative evaluation methods in science festivals that are being held across the country and assess in what ways and how effectively they are used. Morehead Planetarium and Science Center (at the University of North Carolina-Chapel Hill) and the University of California, San Francisco, in collaboration with over twenty science festivals, will (1) investigate whether a multisite evaluation approach is an effective model for creating common metrics for informal STEM education, (2) develop common methods to measure the effects of Festivals, (3) create a query-able database of 50,000 Festival attendees to share with the informal STEM learning field, and (4) document whether these efforts also result in new knowledge related to informal STEM education. The project will develop the Enterprise Feedback Management (EFM) system and query-able database for the festival community. EFMs are systems, including processes and software, that enable groups (such as the festival network) to collect, organize, analyze and share data. The EFM system will be designed to integrate data across sites and to allow users to extract data of interest. The project will refine evaluation tools currently used within the Science Festival Alliance that assess self-reported festival learning, and the effects of festival attendance, motivation, and future science participation. It will collect economic impact data and longitudinal festival attendee data. The project will also develop some new evaluation tools such as secret shopper observational protocols. Data from festival attendees will be collected onsite at participating festivals.