This INSPIRE award is partially funded by the Cyber-Human Systems Program in the Division of Information and Intelligent Systems in the Directorate for Computer Science and Engineering, the Gravitational Physics Program in the Division of Physics in the Directorate for Mathematical and Physical Sciences, and the Office of Integrative Activities.
This innovative project will develop a citizen science system to support the Advanced Laser Interferometer Gravitational wave Observatory (aLIGO), the most complicated experiment ever undertaken in gravitational physics. Before the end of this decade it will open up the window of gravitational wave observations on the Universe. However, the high detector sensitivity needed for astrophysical discoveries makes aLIGO very susceptible to noncosmic artifacts and noise that must be identified and separated from cosmic signals. Teaching computers to identify and morphologically classify these artifacts in detector data is exceedingly difficult. Human eyesight is a proven tool for classification, but the aLIGO data streams from approximately 30,000 sensors and monitors easily overwhelm a single human. This research will address these problems by coupling human classification with a machine learning model that learns from the citizen scientists and also guides how information is provided to participants. A novel feature of this system will be its reliance on volunteers to discover new glitch classes, not just use existing ones. The project includes research on the human-centered computing aspects of this sociocomputational system, and thus can inspire future citizen science projects that do not merely exploit the labor of volunteers but engage them as partners in scientific discovery. Therefore, the project will have substantial educational benefits for the volunteers, who will gain a good understanding on how science works, and will be a part of the excitement of opening up a new window on the universe.
This is an innovative, interdisciplinary collaboration between the existing LIGO, at the time it is being technically enhanced, and Zooniverse, which has fielded a workable crowdsourcing model, currently involving over a million people on 30 projects. The work will help aLIGO to quickly identify noise and artifacts in the science data stream, separating out legitimate astrophysical events, and allowing those events to be distributed to other observatories for more detailed source identification and study. This project will also build and evaluate an interface between machine learning and human learning that will itself be an advance on current methods. It can be depicted as a loop: (1) By sifting through enormous amounts of aLIGO data, the citizen scientists will produce a robust "gold standard" glitch dataset that can be used to seed and train machine learning algorithms that will aid in the identification task. (2) The machine learning protocols that select and classify glitch events will be developed to maximize the potential of the citizen scientists by organizing and passing the data to them in more effective ways. The project will experiment with the task design and workflow organization (leveraging previous Zooniverse experience) to build a system that takes advantage of the distinctive strengths of the machines (ability to process large amounts of data systematically) and the humans (ability to identify patterns and spot discrepancies), and then using the model to enable high quality aLIGO detector characterization and gravitational wave searches
DATE:
-
TEAM MEMBERS:
Vassiliki KalogeraAggelos KatsaggelosKevin CrowstonLaura TrouilleJoshua SmithShane LarsonLaura Whyte
The Adler Planetarium, Johns Hopkins University, and Southern Illinois University-Edwardsville are investigating the potential of online citizen science projects to broaden the pool of volunteers who participate in analysis and investigation of digital data and to deepen volunteers' engagement in scientific inquiry. The Investigating Audience Engagement with Citizen Science project is administering surveys and conducting case studies to identify factors that lead volunteers to engage in the astronomy-focused Galaxy Zoo project and its Zooniverse extensions. The project is (1) identifying volunteers' motivations for joining and staying involved, (2) determining factors that influence volunteers' movement from lower to higher levels of involvement, and (3) designing features that influence volunteer involvement. The project's research findings will help informal science educators and scientists refine existing citizen science programs and develop new ones that maximize volunteer engagement, improve the user experience, and build a more scientifically literate public.
Reconceptualizing STEM + Computing Literacy is funded by the STEM+Computing Partnership (STEM+C) program, which seeks to advance multidisciplinary integration of computing and computational thinking in K-12 science, technology, engineering, and mathematics (STEM) teaching and learning through applied research and development across one or more domains, and broadening participation in computing and computing-related fields. The project will study the integration of computational thinking as part of a new and more contemporary perspective of STEM literacy, and will design, develop, and beta-test a prototype literacy assessment tool that will measure computational thinking literacy along with measures of literacy in other STEM content areas. The tool will be available to the general public as a self-measurement application (App) that can be used by individuals to test their own literacy, and by teachers, schools, and informal educators and organizations to assess literacy development in their students and in their STEM education programs. This transdisciplinary research project will begin the process of creating an innovative approach and tool for measuring literacy that will expand the definition of literacy to include computational skills along with science reasoning. Literacy is an important concept and measurement that has traditionally been used to assess an individual's knowledge of science. This project will explore a broader literacy perspective that incorporates learning derived from out of school and one that incorporates computational skills and thinking as part of a more contemporary perspective of STEM literacy. A prototype web-based App allowing individuals and education organizations to assess literacy levels, and ways to enhance literacy, will be developed and studied. The methodology will be developed using discussions and knowledge from over 60 experts across computing, education, science, social science, and other STEM fields using a Delphi method to engage in reconceptualization of literacy. The hypothesis is that this new STEM+C literacy framework should be structured along four interacting but semi-independent domains: 1) general STEM+C knowledge; 2) self-defined areas of STEM+C knowledge and expertise; 3) attitudes and beliefs related to STEM+C; and 4) the skills and competencies necessary to participate in STEM+C related pursuits and discussions, including measures of modes of STEM+C thinking. Each of these four domains is likely to include numerous sub-domains and associated descriptors, which collectively describe the different aspects of being a STEM+C literate citizen. The application will be designed to provide feedback to individuals on their knowledge, attitudes and skills compared with those of others and suggest ways to enhance and improve their skills and understanding through an embedded feedback mechanism. This project creates public benefit by providing individuals and organizations with a responsive real-time understanding measuring STEM+C literacy, deepening the dialogue about the value of public engagement in science, engineering, technology, math and computing and revealing the dynamic factors that inform STEM+C literacy.
The Discovery Research K-12 program (DR-K12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. This project scales up the PBS NewsHour Student Reporting Labs (SRL), a model that trains teens to produce video reports on important STEM issues from a youth perspective. Participating schools receive a SRL journalism and digital media literacy curriculum, a mentor for students from a local PBS affiliate, professional development for educators, and support from the PBS NewsHour team. The production of news stories and student-oriented instruction in the classroom are designed to increase student learning of STEM content through student-centered inquiry and reflections on metacognition. Students will develop a deep understanding of the material to choose the best strategy to teach or tell the STEM story to others through digital media. Over the 4 years of the project, the model will be expanded from the current 70 schools to 150 in 40 states targeting schools with high populations of underrepresented youth. New components will be added to the model including STEM professional mentors and a social media and media analytics component. Project partners include local PBS stations, Project Lead the Way, and Share My Lesson educators.
The research study conducted by New Knowledge, LLC will add new knowledge about the growing field of youth science journalism and digital media. Front-end evaluation will assess students' understanding of contemporary STEM issues by deploying a web-based survey to crowd-source youth reactions, interest, questions, and thoughts about current science issues. A subset of questions will explore students' tendencies to pass newly-acquired information to members of the larger social networks. Formative evaluation will include qualitative and quantitative studies of multiple stakeholders at the Student Reporting Labs to refine the implementation of the program. Summative evaluation will track learning outcomes/changes such as: How does student reporting on STEM news increase their STEM literacy competencies? How does it affect their interest in STEM careers? Which strategies are most effective with underrepresented students? How do youth communicate with each other about science content, informing news media best practices? The research team will use data from pre/post and post-delayed surveys taken by 1700 students in the STEM Student Reporting Labs and 1700 from control groups. In addition, interviews with teachers will assess the curriculum and impressions of student engagement.
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by developing a suite of digital tools designed to support positive messaging around skill-based education and careers and to improve mentors' communication with middle school-aged youth mentees. Maintaining U.S. economic advantage requires attracting talent to high-growth, high-demand skill-based, STEM-related careers that are traditionally attained through Career and Technical Education (CTE). Replacing old negative perceptions with new, more accurate messages about CTE and then reaching youth with these messages before high school is essential. Career-focused mentoring is a vehicle for delivering these messages and supporting youth exploration of CTE as a possible path for their own lives. Investigators will explore the hypothesis that through strong connections between those best positioned to articulate industry needs (mentors) and those most receptive to filling that need (mentees), this project will improve youth awareness and interest in CTE and the rewarding careers that are available to them. Research and development activities will be carried out collaboratively in informal learning environments in Boston and New York City that serve middle school-aged youth from underrepresented communities, through career-focused mentoring programs. The project team, led by media producers of the WGBH Education Foundation, includes market researchers and communications strategists at Global Strategy Group, learning scientists at Education Development Center, and mentorship program partners at SkillsUSA, Learning for Life's Middle School Explorer Clubs, and Boy Scouts of America's Scoutreach. If promising, the career-focused mentoring programs of SkillsUSA, Learning for Life, and Boy Scouts of America will incorporate the messaging roadmap and digital tools to support their mentoring curricula, which impact greater than one million youth in each year.
In the first phase of research, investigators will study perceptions of STEM-focused CTE from a nationwide sample of 800 middle school-aged youth and 30 mentors from skill-based STEM industries. In the second phase, investigators will work with six program leaders and 30 mentors from SkillsUSA, Explorer Clubs, Scoutreach, and other mentoring programs to document the needs of mentors for support as they enter into the mentoring process. The third phase will engage mentorship program leaders and 36 mentors in the iterative development of a suite of digital tools that would support positive messaging around skill-based education and careers and that would improve mentors' communication with youth mentees. In addition, a pre-post mentorship program pilot study will explore the promise of the digital tools for effectively supporting mentor-mentee communications that improve youth awareness and interest in STEM-focused CTE and skill-based, STEM-related careers. Thirty six mentors and 288 of their youth mentees will participate in the pilot study. Data sources for research include interviews and surveys of program leaders, mentors, and mentees, as well as tracking mentor activity within the online digital tool environment. This research would advance knowledge of how mentors influence disadvantaged youth perceptions of and interest in CTE and skill-based, STEM career pathways, in which there is currently little evidence as to how mentor preparation shapes ability to positively impact youth outcomes. Major outcomes will include a) deeper understandings of youth and mentor perceptions of CTE and mentors' needs for supporting their work with mentees, b) a messaging roadmap and digital tools that prepare mentors for their work with middle school youth, and c) empirical findings regarding the potential of the digital tools for effectively supporting mentor-mentee communications that improve youth's awareness and interest in CTE and skill-based, STEM-related careers. Outcomes will be shared widely to research, education, and industry communities, locally and nationally, through social media, partner networks, conference presentations, and research publications. An advisory board will provide independent review on the project activities.
“Monkeying Around: Digital Media and Parent/Child Engagement Resources to Increase Preschool Computational Thinking” is a new project that uses animation, live-action videos, and hands-on activities to support joint engagement of children and caregivers around computational thinking concepts and practices. WGBH, a leading producer of educational STEM media, developed prototypes of videos and hands-on activities around the project’s computational thinking learning goals for young children. Education Development Center (EDC), WGBH’s research partner for the project, conducted a small formative
DATE:
TEAM MEMBERS:
Heather LavigneLeslie Cuellar
resourceevaluationWebsites, Mobile Apps, and Online Media
Summary brief describing summative evaluation associated with the MarcellusByDesign component of Marcellus Matters: EASE. Marcellus Matters: Engaging Adults in Science and Energy (EASE) was a program of Penn State University’s Marcellus Center for Outreach and Research (MCOR), in collaboration with other experts across the university. The first year of program activities took place in 2012, and the project continued through September 2016. EASE was a multidisciplinary initiative that provided adults in rural Pennsylvania with opportunities to increase their knowledge of science and energy
In March of 2016, the Exploratorium transmitted a live webcast of a total solar eclipse from Woleai, a remote island in the southwestern Pacific. The webcast reached over 1 million viewers. Evaluation reveals effective use of digital media to engage learners in solar science and related STEM content.
Edu, Inc. conducted an external evaluation study that shows clear and consistent evidence of broad distribution of STEM content through multiple online channels, social media, pre-produced videos, and an app for mobile devices. IBM Watson did a deep analysis of tweets on eclipse topics that
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. This Broad Implementation project would scale up the CryptoClub Project, an afterschool and online program designed to engage middle school youth in mathematics and cryptography. The project builds on previous successful work and evaluation that is ready for scale up using a train-the-trainer model implemented through a partnership with the National Girls Collaborative. The project will train 160 new CryptoClub leaders who will then train 800 new leaders at 20 hub sites reaching 9600 students. In addition, professional development modules and webinars will continue to refresh leader skills. Other project components include an online multiplayer cryptography game, weekly challenges through social media, and digital cryptology badges for students.
The research uses a think-aloud method with students as they actually attempt to solve the cryptology problems using mathematical thinking. Three think-aloud studies will be performed during the Project. The research team will code transcripts of the interviews for evidence of the mathematical thinking intended to be addressed by each activity, as well as capturing unexpected kinds of thinking. Tasks will also be rated according to the type of knowledge elicited. A written report will include statistical analyses of the think-aloud and interview responses, interpreted in light of the overall CryptoClub goals. The findings will contribute to both future research efforts and practice. The evaluation by EDC uses a quasi-experimental design, which assesses project outcomes for trainers, leaders, students, and Internet users. EDC will also investigate the fidelity to the CryptoClub model as it is scaled up. These studies have strong potential for informing numerous other projects that are at a stage where scale up is under consideration.
Video has become a key tool for scientific communication because it increases the outreach and impact of projects, furthers scientific research within and across fields of study, and offers an accessible medium to engage the public in the understanding of science. This project supports the expansion of an interactive, online STEM Videohall where hundreds of NSF-funded researchers share their work through brief video narratives and interactive discussion. While the Videohall is accessible year-round, periodic annual Showcase events are used to drive visitors to the site where they can engage with one another, the project investigators and trained facilitators. The Videohall is a multiplier of NSF's investments in individual projects because it allows STEM education researchers to become aware of, and learn from, related work that is funded across NSF programs and directorates, and other federal agencies. In 3-minute video narratives, investigators share ideas, resources, data, evidence of impact, strategies and challenges. The Videohall platform supports open access and is designed to foster communication in ways that scale beyond traditional formats such as academic conferences. Moreover, because the online STEM Videohall is open to the public, it allows STEM investigators to share their work with multiple stakeholder communities including K-12 educators and school leaders, informal educators and community organizations, the STEM industry, education policy makers and families. Finally, because each video narrative is accompanied by a facilitated online discussion thread, investigators have a unique and valuable mechanism for receiving feedback from these various stakeholder communities. The STEM Videohall project is funded by the Discovery Research K-12 program (DRK-12), which seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.
This project brings together seven NSF-funded resource centers who work with their respective communities to encourage Principal Investigators to share video narratives of their work through annual NSF STEM Showcase events. Each annual Showcase event presents videos created by 150-230 projects; many of the projects are affiliated with one of the seven resource centers, but others are from projects across NSF directorates and beyond. During a one-week period, Principal Investigators, their project staff, as well as the public at large, are invited to engage in interactive discourse, providing queries, comments, and feedback. Participants also vote for favorite presentations through "Presenters' Choice," "Public Choice," and "Facilitators' Choice," processes. This participant voting system serves to increase engagement and enhances outreach of the event through social media. After the one-week Showcase event concludes, all of the videos along with the related discourse remain available to the public online, who continue to access the Showcase throughout the year. Based on prior pilot work, it is estimated that over the course of a year, over 30,000 visitors, from over 150 countries, will engage with each annual Showcase. Videos from annual showcase events will be shared, reused, and repurposed to create new products with new constituencies. The project includes technical development efforts to iteratively improve its interactive platform, outreach efforts before each annual Showcase event, facilitation of the week-long event, and intensive dissemination efforts. A research component examines the extent of participation on various constituencies, the benefit of participation to projects, and the success of the events in terms of dissemination nationally and internationally.
The Cyberlearning and Future Learning Technologies Program funds efforts that will help envision the next generation of learning technologies and advance what we know about how people learn in technology-rich environments. Cyberlearning Exploration (EXP) Projects explore the viability of new kinds of learning technologies by designing and building new kinds of learning technologies and studying their possibilities for fostering learning and challenges to using them effectively. This project brings together two approaches to help K-12 students learn programming and computer science: open-ended learning environments, and computer-based learning analytics, to help create a setting where youth can get help and scaffolding tailored to what they know about programming without having to take tests or participate in rigid textbook exercises for the system to know what they know.
The project proposes to use techniques from educational data mining and learning analytics to process student data in the Alice programming environment. Building on the assessment design model of Evidence-Centered Design, student log data will be used to construct a model of individual students' computational thinking practices, aligned with emerging standards including NGSS and research on assessment of computational thinking. Initially, the system will be developed based on an existing corpus of pair-programming log data from approximately 600 students, triangulating with manually-coded performance assessments of programming through game design exercises. In the second phase of the work, curricula and professional development will be created to allow the system to be tested with underrepresented girls at Stanford's CS summer workshops and with students from diverse high schools implementing the Exploring Computer Science curriculum. Direct observation and interviews will be used to improve the model. Research will address how learners enact computational thinking practices in building computational artifacts, what patters of behavior serve as evidence of learning CT practices, and how to better design constructionist programming environments so that personalized learner scaffolding can be provided. By aligning with a popular programming environment (Alice) and a widely-used computer science curriculum (Exploring Computer Science), the project can have broad impact on computer science education; software developed will be released under a BSD-style license so others can build on it.
DATE:
-
TEAM MEMBERS:
Shuchi GroverMarie BienkowskiJohn Stamper
Education stakeholders from advocates to developers are increasingly recognizing the potential of science games in advancing student academic motivation for and interest in science and science careers. To maximize this potential, the project will use science games (e.g. Land Science, River City, and EcoMUVE), shown to be enjoyable to students and proven to promote student learning in science at the middle school level. Through a two-phase process, games will be used as vehicles for learning about ways to change how students think about science and potentially STEM careers. The goal of the intervention is to explore which processes and design features of science games will actually help students move beyond a temporary identity of being a scientist or engineer (as portrayed while playing the game) to one where students began to see themselves in real STEM careers. Students' participation will be guided by teams of teachers, faculty members, and graduate students from Drexel University and a local school. All science students attending the local inner city middle school in Philadelphia, PA, will participate in the intervention.
Using an exploratory mixed-method design, the first two years of the project will focus on exploring, characterizing, coding, and analyzing data sets from three large games designed to help students think about possible careers in science. During year 3, the project will integrate lessons learned from the first two years into the existing middle school science curriculum to engage students in a one-year intervention using PCaRD (Play Curricular activity Reflection Discussion). During the intervention, the PI will work with experts from Drexel University and a local school to collect data on the design features of Land Science to capture identity change in the science identity of the participating students. Throughout the course of year 3, the PI will observe, video, interview, survey, and use written tasks to uncover if the Land Science game is influencing students' identity in any way (from a temporary to a long-term perspective about being a scientist or engineer). Data collected during three specified waves during the intervention will be compared to analyses of existing logged data through collaborations with researchers at Harvard University and the University of Wisconsin-Madison. These comparisons will focus on similar middle-aged science students who used the same gaming environments as the students involved in this study. However, the researcher will intentionally look for characteristics related to motivation, science knowledge, and science identity change.
This project will integrate research and education to investigate learning as a process of change in student science identity within situated environmental contexts of digital science gameplay around curricular and learning activities. This integrated approach will allow the researcher to explore how gaming is inextricably linked to the student as an individual while involved in the learning of domain specific content in science. The collaboration among major university and school partners; the expertise of the researcher in educational psychology, educational technology, and science games; and the project's advisory board makes this a real-life opportunity for the researcher to use information that naturally exists in games to advance knowledge in the field about the value of gaming to changing students' science identities. It also responds to reports by the National Research Council committee on science learning and computer games, which identifies games as having the potential to catalyze new approaches to science learning.