Purpose: Purpose: This project team will fully develop and test Teachley Connect, a platform that syncs a variety of third-party math games to give elementary schools formative assessment data and intervention support. Mobile math games provide opportunities for students to access educationally-meaningful content in and out of the classroom and to supplement instruction. There are a number of examples of math apps that show promise for supporting and assessing student learning in different areas of mathematics, yet few apps in the marketplace provide meaningful data that teachers can use. Many games provide an overall score at the end of the session, but do not help teachers know what skills students are struggling with or how to provide additional support.
Project Activities: During Phase I, (completed in 2015), the team developed a prototype of Teachley Connect, which enables the secure transfer of game and learning data between third-party math games and the Teachley servers. At the end of Phase I, researchers completed a pilot study with 20 students and two teachers and demonstrated that the prototype operated as intended with important trends indicating that the system promotes student engagement and less time spent seeking help. In Phase II, the team will add additional third party math apps to the platform, strengthen the backend management system to tag user game-play data, and build out the teacher reporting dashboard to inform instruction and identify apps to address particular student and class needs. After development is complete, the research team will conduct a larger pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the Teachley Connect for teachers to use formative assessment data to inform classroom practice, select apps to address individual student needs, and support student math learning. The study will include 12 (grade K to 3) classrooms and randomly assign them into one of three groups: 1) apps only, 2) Teachley-enabled apps, or 3) Teachley-enabled apps + data. Researchers will compare pre-and-post scores of student's math learning, classroom observations, and teacher surveys/interviews.
Product: Teachley Connect will be a mobile tablet-based platform that uses games to give elementary schools rich formative assessment data and intervention support. Teachley Connect will permit students to continue playing exactly where they left off on any tablet. The platform will also connect apps into a single teacher dashboard, providing teachers detailed reports on student performance across games, with insights for informing individual or whole group instruction. The platform will include teacher resources to support the alignment of game play with learning goals and to support implementation.
In prior research and development, the project team developed PocketLab, a set of web-based hands-on science simulations for middle school classrooms. With this Phase I funding, the team will develop and test a prototype of CloudLab, a classroom management platform to extend the functionality of PocketLab. The prototype will include a portal so that a class of students can collaborate on experiments, a lab notebook to analyze experimental data with graphing tools, and a teacher dashboard to monitor student progress in real time. In the Phase I pilot research, with six middle school teachers and 150 students, the project team will examine whether the prototype functions as planned, whether teachers are able to integrate it within the classroom environment, and whether students are engaged while using the prototype.
In prior research and development, the project team developed a StoryWorld, a computer-based intervention for English Learners (ELs) that presents children oral and written narratives in English while also providing the information in their first language. With this Phase I funding, the team will develop and test a prototype of a web-based dashboard that provides EL teachers real-time reports on children's progress in areas including for vocabulary, comprehension, fluency, and proficiency. At the end of Phase I, in a pilot study in three first grade classrooms, the researchers will examine whether the prototype functions as planned, is easy to use, and provides information teachers can understand and use to inform their language and literacy instruction?
DESIGN SQUAD GLOBAL (DSG) is a web-based, mobile-accessible digital hub and outreach initiative that creates new opportunities to empower middle school youth to solve real-world problems and understand the impact of engineering in a global context. The project builds on the Design Squad model for engineering education (including a television show and website). The ultimate goals of Design Squad Global are to: (1) develop innovative ways to incorporate effective engineering education into informal learning environments; (2) inform the field about promising practices in cross-cultural
Public Participation in Scientific Research (PPSR), often referred to as crowdsourcing or citizen science, engages participants in authentic research, which both advances science discovery as well as increases the potential for participants' understanding and use of science in their lives and careers. This four year research project examines youth participation in PPSR projects that are facilitated by Natural History Museums (NHMs). NHMs, like PPSR, have a dual focus on scientific research and science, technology, engineering, and mathematics (STEM) education. The NHMs in this project have established in-person and online PPSR programs and have close ties with local urban community-based organizations. Together, these traits make NHMs appropriate informal learning settings to study how young people participate in PPSR and what they learn. This study focuses on three types of PPSR experiences: short-term outdoor events like bioblitzes, long-term outdoor environmental monitoring projects, and online PPSR projects such as crowdsourcing the ID of field observations. The findings of this study will be shared through PPSR networks as well as throughout the field in informal STEM learning in order to strength youth programming in STEM, such that youth are empowered to engage in STEM research and activities in their communities. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences.
The study employs observations, surveys, interviews, and learning analytics to explore three overarching questions about youth learning: 1) What is the nature of the learning environments and what activities do youth engage in when participating in NHM-led PPSR? 2) To what extent do youth develop three science learning outcomes, through participation in NHM-led citizen science programs? The three are: a) An understanding of the science content, b) identification of roles for themselves in the practice of science, and c) a sense of agency for taking actions using science? 3) What program features and settings in NHM-led PPSR foster these three science learning outcomes among youth? Based on studies occurring at multiple NHMs in the US and the UK, the broader impact of this study includes providing research-based recommendations for NHM practitioners that will help make PPSR projects and learning science more accessible and productive for youth. This project is collaboration between education researchers at University of California, Davis and Open University (UK), and Oxford University (UK) and citizen science practitioners, educators, and environmental scientists at three NHMs in the US and UK: NHM London, California Academy of Sciences, and NHM Los Angeles.
Abstract
In 2011, Donna DiBartolomeo and Zachary Clark enrolled in the Arts in Education Program at Harvard Graduate School of Education. Harvard Graduate School of Education is home to Project Zero, an educational research group comprising multiple, independently funded projects examining creativity, ethics, understanding, and other aspects of learning and its processes. Under the guidance of Principal Investigator Howard Gardner and Project Manager Katie Davis, the authors were tasked with developing a methodology capable of observing finegrained, objective detail in complete works of
This award supports a conference that will inform the design of "backbone" organizations for the NSF INCLUDES (Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science) program. NORC at the University of Chicago (an independent research institution that delivers reliable data and rigorous analyses to guide programmatic and policy decisions) and TERC (a nonprofit education research and development organization based in Cambridge, MA, dedicated to improving STEM learning for all) collaborate on Envisioning Impact, a two-part in-person and virtual event that will inform the design of INCLUDES Alliance and National Network backbone organizations.
The objectives of the conference are to: (1) facilitate a shared vision of impact for INCLUDES broadening participation projects and program; (2) stimulate discourse on key elements of a shared measurement system for continuous improvement and outcome assessment; and (3) inform decisions on the infrastructure and priority services INCLUDES backbone organizations will provide to assist grantees (and others) in assessing progress towards collective impact. The conference will bring members of three communities together: PIs and evaluators of INCLUDES Design and Development Launch Pilots; investigators and evaluators of other NSF-supported broadening participation alliances, extension projects, and other collective efforts to support inclusion and diversity in STEM; and members of prior and extant NSF-supported knowledge-networking, collaboratory, and resource network initiatives. Members of these communities will collaborate in two separate events: an in-person, 1.5 day conference, and a follow-on virtual Video Hall that will allow a larger number of participants to engage, over a one week period, in facilitated community discourse around short video narratives produced by each project.
DATE:
-
TEAM MEMBERS:
Kevin BrownSarah-Kathryn McDonaldJoni Falk
InformalScience.org is an online collection of resources designed to serve a broad community of professionals whose work relates to informal education in science, technology, engineering, and math (STEM). Funded by the National Science Foundation and managed by the Center for Advancement of Informal Science Education (CAISE), InformalScience hosts a variety of usercontributed resources, including a wiki of evidence-based information on the impacts of informal STEM and a database of over 7,000 reports, articles, project descriptions, and other items uploaded by CAISE and website members.
The
This Research in Service to Practice project, a collaboration of Pepperdine University and the New York Hall of Science, will establish a network of STEM-related Media Making Clubs comprised of after-school students aged 12 - 19 and teachers in the U.S. and in three other countries: Kenya, Namibia and Finland. The media produced by the students may include a range of formats such as videos, short subject films, games, computer programs and specialized applications like interactive books. The content of the media produced by the students will focus on the illustration and teaching of STEM topics, where the shared media is intended to help other students become enthused about and learn the science. This proposal builds on the principal investigator's previous work on localized media clubs by now creating an international network in which after-school students and teachers will collaborate at a distance with other clubs. The central research questions for the project pertain to three themes at the intersection of learning, culture and collaboration: the impact of participatory teaching, virtual networks, and intercultural, global competence. The research will combine qualitative, cross-cultural and big data methods. Critical to the innovation of the project, the research team will also develop a network assessment tool, adapting epistemic network analysis methods to the needs of this initiative. This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Eric HamiltonKatherine McMillanPriya Mohabir
This infographic presents a visual summary of a user study of the InformalScience.org website, which was conducted in 2016. The study used online surveys, task-based interviews, and web analytics to explore the following questions: (1) Who are the site's users and what content do they value? (2) Does the site clearly convey its purpose to visitors? and (3) Are users able to navigate the site and use search tools effectively?
This project formed a partnership between a research team with experience in computer science (CS) education and learning sciences research and a newly fashioned practitioner team focused on building a grassroots, informal, volunteer group created to help women help themselves and others learn to write computer code. This research-practitioner partnership had a two-pronged focus, first on improving the program offered to learners through making adjustments based on research findings, and second on investigating the phenomenon of how women in the workforce informally learn CS skills that enable them to rewrite their career paths to contribute to what we know from research. The context of the study was situated in the virtual community that has formed around the phenomenally successful Salesforce Customer Relationship Management software platform.
This Exploratory Pathways project aimed to fill a gap in the research; we know little about the phenomenon of adult women in the workforce who are patching together resources to learn CS skills with a goal of job enhancement or job change. This project took an ethnographic approach to studying the informal learning (both through online, written resources and through sharing of knowledge with others) of the women involved in a 10-week, virtual Women’s Coaching and Learning group. The organization of this group consisted of learners—novice coders in the Apex language that is used on the Salesforce software platform, of coaches—more knowledgeable coders, and of a steering committee that ran the group and created the informal curriculum followed in the 10-week course.
Our overarching research question in this study was: In what ways are informal CS learning opportunities being used and created by adult women, what are their experiences with those opportunities, and how does this suggest ways to enhance those opportunities in the future to increase effectiveness in broadening access to and engagement in informal CS learning experiences for women?
We broke the question down into a number of sub questions, including:
Sociocultural context: What past gendered interactions do women report that discouraged (or encouraged) them from learning to code? What do interactions look like in female-only coaching and learning groups? In what ways does a coaching and learning group support persistence? What social barriers and supports outside the group affect persistence?
Personal context: What are the characteristics and backgrounds of female administrators who seek out resources to teach themselves to code? What are the motivations for these women to teach themselves to code? What motivates them to seek out and join all-women coding groups?
Physical context: How are women learning to code both through written resources and in virtual, informal coaching and learning classes? What are the conceptual barriers and supports that they encounter, and what works for women in these classes to overcome barriers? What conceptual barriers and supports affect persistence?
Persistence and identity: In what ways does participating in a learning group with female coaching motivate (or not) women to persist in learning to code? How do their goals or reasons for learning to code change through their participation? How does their identity as a “coder” change or shift as they participate?
Our findings for these subquestions are summarized in the “project products” linked to below.
The achievement gap begins well before children enter kindergarten. Research has shown that children who start school having missed critical early learning opportunities are already at risk for academic failure. This project seeks to narrow this gap by finding new avenues for bringing early science experiences to preschool children (ages 3-5), particularly those living in communities with few resources. Bringing together media specialists, learning researchers, and two proven home visiting organizations to collaboratively develop and investigate a new model that engages families in science exploration through joint media engagement and home visiting programs. The project will leverage the popularity and success of the NSF-funded PEEP and the Big Wide World/El Mundo Divertido de PEEP to engage both parents and preschool children with science.
To address the key goal of engaging families in science exploration through joint media engagement and home visiting programs, the team will use a Design Based Implementation Research (DBIR) approach to address the research questions by iteratively studying the intervention model (the materials and implementation process) and assessing the impact of the intervention model on parents/caregivers. The intervention model will include the PEEP Family Engagement Toolkit that will support 20 weeks of family science investigations using new digital and hands-on science learning resources. It will also include new professional development resources for home educators as well as and the implementation process and strategies for developing and implementing the Toolkit with families.
The proposed research focuses first on refining and improving program design and implementation, and second, on investigating whether the intervention improves the capacity of parent/caregivers to support young children's learning in science. Ultimately this research will accomplish two important aims: it will inform the design of the PEEP family engagement intervention model, and, more broadly, it will build practical and theoretical understanding of: 1) effective family engagement models in science learning; 2) the types of supports that families and home educators need to implement these models; and 3) how to implement these models across different home visiting programs. Given the reach of the home visiting programs and the increasing interest in supporting early science learning the potential for broad impact is significant. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.