Researchers at Georgia Tech and staff at the Center for Puppetry Arts in Atlanta will address the following problem: The growth of computing calls for increased teaching of basic hardware skills, but engaging students beyond those who are already interested in STEM fields is difficult. Emphasizing cultural context through personal expression has shown to attract new audiences such as women and minorities; however, balancing accessibility and educational effectiveness remains problematic. Current educational tools often use "black boxing" to simplify access, to protect the underlying functionality, and/or to stay commercially competitive. Innovations are needed where the basic skills of design and making, along with new educational models, can support students' exploration of everyday electronics and critical thinking. The team will test an after-school model that could be applied in cultural institutions and other venues that would provide students in 4 - 8 grades with multiple computer/electronics-driven puppet design and building workshops. These workshops will provide opportunities for basic hardware and electronics prototyping, personal cultural expression, and performance.
The exploratory research and development method involves three steps: the students develop a story-line (narrative) that will incorporate puppets; they learn and apply basic electronics and mechanical crafts to design, build and test their puppets; and they perform their shows to other participants and their families. Over the course of the project, there will be five workshops: two pilot tests (to test feasibility and design), one mid-project evaluation workshop (to evaluate and re-iterate), and two final workshops conducted by educators, where the research team only observes (to test for transferability). Data collection throughout this development cycle will include video and sound recording, still photography, field notes, pre- and post-questionnaires, and the production of puppet "artifacts" during the workshops. In addition to the data collected in the workshops, the project will produce design documents and educational guidelines, as well as other media (such as instructional video clips), which will be disseminated to educators and researchers.
The project has been successfully concluded. It included additional pilot workshops with puppetry experts and educators in addition to the scheduled development and final evaluation workshops. Overall, the project has led to publications in both educational as well as performance/ game- and interface-related events.
The project also published material on the puppet designs and their possible adaptation to educational settings on the project web site, which also include video documentation. More information is available at: http://dwig.lmc.gatech.edu/projects/prototypingpuppets/
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. This Broad Implementation project would scale up the CryptoClub Project, an afterschool and online program designed to engage middle school youth in mathematics and cryptography. The project builds on previous successful work and evaluation that is ready for scale up using a train-the-trainer model implemented through a partnership with the National Girls Collaborative. The project will train 160 new CryptoClub leaders who will then train 800 new leaders at 20 hub sites reaching 9600 students. In addition, professional development modules and webinars will continue to refresh leader skills. Other project components include an online multiplayer cryptography game, weekly challenges through social media, and digital cryptology badges for students.
The research uses a think-aloud method with students as they actually attempt to solve the cryptology problems using mathematical thinking. Three think-aloud studies will be performed during the Project. The research team will code transcripts of the interviews for evidence of the mathematical thinking intended to be addressed by each activity, as well as capturing unexpected kinds of thinking. Tasks will also be rated according to the type of knowledge elicited. A written report will include statistical analyses of the think-aloud and interview responses, interpreted in light of the overall CryptoClub goals. The findings will contribute to both future research efforts and practice. The evaluation by EDC uses a quasi-experimental design, which assesses project outcomes for trainers, leaders, students, and Internet users. EDC will also investigate the fidelity to the CryptoClub model as it is scaled up. These studies have strong potential for informing numerous other projects that are at a stage where scale up is under consideration.
Youth environmental education (EE) programs often serve as gateway experiences in which diverse audiences engage in informal science learning. While there is evidence that these programs can have positive impacts on participants, little empirical research has been conducted to determine what makes one program more successful than another. To be able to conduct such research, this Exploratory Pathways study will (1) develop and statistically validate ways to measure meaningful outcomes for participants across a variety of programs and (2) test observational methods that will enable research that can determine which elements of program delivery most powerfully influence participant engagement and learning outcomes in different contexts. These efforts will include consultations with diverse subject matter experts from the National Park Service, nature centers, and academia; survey research with participants in afterschool and free-choice EE programs; and observations of EE programs designed to fine tune the measurement of program delivery elements and student engagement. Developing valid and reliable outcomes measures and observational protocols will enable a larger investigation that will specifically address the following research question: What program characteristics lead to the best learning outcomes for program participants in different contexts? This research will result in empirically tested guidelines that will enable educators to design and deliver more effective programs for a wide range of audiences in a wide range of contexts. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This effort will refine methods necessary to undertake an unprecedented study (and future AISL Research in Service to Practice proposal) to examine the linkages between pedagogical approaches, participant engagement, and learning outcomes in informal STEM-focused youth EE programs. The larger study will involve systematically observing a large number of programs to assess the use of different approaches and to link those approaches to engagement and learning outcomes through both observation and survey research. In this current study the team will develop and refine crosscutting outcome measures to ensure validity, reliability, and sensitivity by drawing upon the literature and consultation with key stakeholders to develop suites of indicators for subsequent psychometric testing and revision. They will also refine observational techniques for assessing pedagogical approaches through extensive testing of inter-rater reliability. Finally, techniques for measuring participant engagement, incorporating both observational techniques and retrospective participant surveys will be refined. The work will be conducted by researchers at Clemson University and Virginia Tech, in partnership with the U.S. National Park Service, the North American Association for Environmental Education, and the American Association of Nature Center Administrators. This work represents the first step in a longer research process to determine the "best practices" most responsible for achieving outcomes in a wide range of contexts.
In this chapter we present the ways in which institutional cultural differences impact the development and implementation of learning activities in informal settings. Five university-based centers for the study of chemistry worked with informal learning professionals to re-envision educational and public outreach activities about science. The projects were part of a broader effort to catalyze new thinking and innovation in informal education and chemistry centers. The set of projects illustrates the broad possibilities for informal learning settings, with projects targeting diverse audiences
Situated within the Advancing Informal STEM Learning program, this Research in Service to Practice award seeks to design, implement, and evaluate an intervention aimed at fostering a culture of productive failure practices. The project responds to a broad concern in educational research and practice: Experiences of failure are frequently so negative that students shut down, lose agency, and develop low self-efficacy and learned helplessness. Surrendering too quickly to obstacles is particularly unfortunate, given evidence that initially "getting it wrong" ultimately breeds deep and sustained learning. In order to learn how students can make the most of productive failure, the proposed project will study how a community of practice that includes middle school youth and their mentors attempts to change its handling of learning obstacles. Building on prior research documenting storytelling practices in an afterschool program, the team now aims to embolden young students' productive practices of failure storytelling in computer science, a field in which experts practice candid, pervasive, and collaborative discourse around errors ("bugs"). Pulling together the domains of narrative analysis, meta-cognitive reflection, and control theories of motivation, within the context of authentic computer-science debugging activity, this study develops a theoretical framework that views productive responses to failure as a discipline-specific process of reflecting as a community on how to locate obstacles, how to construct causal theories about why those obstacles emerged, and how to plan productive responses. A design-based research approach will investigate three questions: (1) What is the impact of the interventions on students and instructors' actions and discourse when they are debugging errors in computer code? (2) What is the impact of the interventions on students and instructors' reflections back on their prior debugging experiences and on failure in general? and (3) What is the impact of the instructor-development efforts on the instructors' capacity to foster students' productive attitudes toward failure? The study focus will be 15 summer and weekend coding workshops with 5th-8th grade students from populations typically under-represented in STEM. The interventions are (a) setting new norms and practices for debugging, (b) instructor education, and (c) coding software that provides students with feedback on their productive struggle. Data sources include video and audio recordings of the learning environment, artifacts produced during the activities, and semi-structured interviews. Measures will capture variations in debugging activities, reflections on debugging, students' ideas about grit and growth mindset, and instructors' struggles and successes with the new curriculum. The empirical results will consist of mixed-methods, micro-longitudinal accounts of how a community of practice works to reform its orientation to failure. The products of this work include empirical knowledge, theory, and curriculum about how learning communities help students develop robust and efficient responses to failure. These will be disseminated through journals, open-source software, and workshops/conferences for researchers and practitioners working with youth afterschool programs. The products may be useful for exploring practices in the classroom. This project is being conducted by the 9 Dots Community Learning Center, UCLA and UC Berkeley.
DATE:
-
TEAM MEMBERS:
Melissa ChenDor AbrahamsonNoel EnyedyFrancis SteenDavid DeLiema
Currently, many young people - especially girls and youth of color - lose confidence and interest in science, technology, engineering and math (STEM) pathways due to a perceived disconnect between their own identity and STEM fields. To address this challenge, Twin Cities PBS (TPT) is implementing SciGirls CONNECT2. This three-year Research in Service to Practice award examines how gender equitable and culturally responsive teaching strategies influence middle school girls' confidence, interest and motivation around STEM studies, and their choices around STEM careers. A set of research-based strategies, called the SciGirls Seven, are currently employed in SciGirls, an NSF-funded informal STEM educational outreach program serving 125+ educational partner organizations nationwide. The goal is to update and enrich the SciGirls Seven, providing educators with a critical, current, and more effective resource to motivate girls in STEM studies and careers. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Florida State University will conduct a formal research study investigating the hypothesis that STEM programs that use gender equitable and culturally responsive strategies contribute to girls' positive STEM identity development, including their sense of self-efficacy, persistence and aspirations around future STEM careers. This research will include a literature review and a study of girls' STEM identity creation. The mixed methods study will include quantitative and qualitative data collection and analysis measuring changes in students' STEM identity and teachers' confidence in STEM teaching. The quantitative data will come from the student, parent and teacher pre/post surveys. The qualitative research will be conducted via case studies at four sites and the qualitative data will include observations, focus groups and interviews. Girls at all partner sites will create videos that will allow the research team to gather additional insight. The independent firm Knight Williams, Inc. will conduct the project's external evaluation.
The project will work with a subset of 16 current SciGirls partners. These geographically diverse partners will reach youth in all-girls and co-ed informal STEM education programs in a variety of settings. More than half serve Hispanic or other minority populations. The updated strategies will be disseminated to the 2,500 educators within the SciGirls partner network and the 18,800 STEM education organizations of the National Girls Collaborative Project (NGCP) network. Dissemination of the strategies and literature review will focus on the informal STEM education field through publications and presentations, posts at PBS LearningMedia, a free online space reaching 1.5 million teachers and educators.
The America After 3PM survey is the nation’s most comprehensive household survey of how children spend the hours after school and asks parents and guardians of school-age children in the United States about availability and access to after-school programs. The 2014 survey, which followed prior surveys conducted in 2004 and 2009, reveals that over the past decade, the number of children in after-school programs has grown from 6.5 million to more than 10 million. Parents of an additional 19.4 million children would enroll their children in a program if one were available to them.
For decades, K–12 science education researchers have echoed the need for inquiry-based teaching approaches to connect students to real scientists and science environments (AAAS 1989; NRC 1996, 2007). The Next Generation Science Standards (NGSS) amplify these needs by stressing the importance of student-developed conceptual models to explain real-world phenomena and coherent integration of authentic science practices, concepts, and core ideas across grade levels (NRC 2012; NGSS Lead States 2013).
"Local Investigations of Natural Science (LIONS)" engages grade 5-8 students from University City schools, Missouri in structured out-of-school programs that provide depth and context for their regular classroom studies. The programs are led by district teachers. A balanced set of investigations engage students in environmental research, computer modeling, and advanced applications of mathematics. Throughout, the artificial boundary between classroom and community is bridged as students use the community for their studies and resources from local organizations are brought into school. Through these projects, students build interest and awareness of STEM-related career opportunities and the academic preparation needed for success.
DATE:
-
TEAM MEMBERS:
Robert CoulterEric KlopferJere Confrey
Commonly described as youth-led or youth-driven, the youth-adult partnership (Y-AP) model has gained increasing popularity in out-of-school time (OST) programs in the past two decades (Larson, Walker, & Pearce, 2005; Zeldin, Christens, & Powers, 2013). The Y-AP model is defined as “the practice of (a) multiple youth and multiple adults deliberating and acting together (b) in a collective (democratic) fashion (c) over a sustained period of time (d) through shared work (e) intended to promote social justice, strengthen an organization and/or affirmatively address a community issue” (Zeldin et al
DATE:
TEAM MEMBERS:
Heng-Chieh Jamie WuMariah KornbluhJohn WeissLori Roddy
One day, as I was working with a student after school on a problem involving division with decimals, I told him which number goes in the “division house.” Suddenly the student blurted out, “That is not what my teacher told me, and I hate math!” I knew I had not yet found the key to helping this student. Was I addressing how he felt about math? Should I put the problem away and start over with the beauty of decimals, those smaller-than-one numbers that enable us to measure the speed of an Olympic athlete, the diameter of a pinhead, or the exact length of a ladybug? Teaching afterschool allows
From Intel to Facebook, Google and Apple, technology companies are joining other science, technology, engineering, and mathematics (STEM) industry leaders in a grand challenge to diversify their workforce. Finally, two sides of the diversity message can be heard simultaneously: expanding opportunities for women and girls is not just the right thing to do, investing in diversity is also a smart business opportunity. To meet workforce supply demands, improve innovation, and ensure social equity, STEM professions need the imaginations and talents of girls and underrepresented communities of color