How can programs be exciting, innovative, and engaging when providers and youth do not have what they need? How can youth feel valued and respected when they are surrounded by worn-out and broken materials?
Out-of-school time (OST) youth programs are inherently difficult to assess. They are often very dynamic: Many youth interact with one another and with staff members in various physical environments. Despite the challenge, measuring quality is critical to help program directors and policy makers identify where to improve and how to support those improvements.
DATE:
TEAM MEMBERS:
Allison TracyLinda CharmaramanIneke CederAmanda RicherWendy Surr
STEM learning is a process that unfolds through dynamic interactions over time and across settings. Formal education in schools is not the only—or necessarily the most significant—context for STEM learning.
A skilled workforce is critical in high-quality out-of-school time (OST) programs (Smith, Devaney, Akiva & Sugar, 2009). However, the workshops commonly used to train OST staff are not adequately preparing practitioners to deliver quality programs that can benefit youth(Durlak & Weissberg, 2007; Smith et al, 2009).
DATE:
TEAM MEMBERS:
Femi VanceEmily SalvaterraJocelyn Atkins MichelsenCorey Newhouse
According to the Harvard Family Research Project (2010), schools need collaborative partners to help children and youth thrive. For over a decade, afterschool programs have been positioning themselves as viable partners. After all, afterschool programs challenge students’ thinking, teach collaboration, and help children and youth find their passion.
As part of an overall strategy to enhance learning within informal environments, the Innovations at the Nexus of Food, Energy, and Water Systems (INFEWS) and Advancing Informal STEM Learning (AISL) programs partnered to support innovative models poised to catalyze well-integrated interdisciplinary research and development efforts within informal contexts that transform scientific understanding of the food, energy, and water systems (FEWS) nexus in order to improve system function and management, address system stress, increase resilience, and ensure sustainability. This project addresses this aim by using systems thinking and interdisciplinary integration approaches to develop a novel immersive educational simulation game and associated materials designed to highlight the role and importance of corn-water-ethanol-beef (CWEB) systems in supporting the ever increasing demands for food, energy, and water in the United States. The focus on FEWS and sustainable energy aligns well with both the INFEWS program and the sizable sustainability-related projects in the AISL program portfolio. The development and broad dissemination of a multiuser game specific to CWEB systems are particularly innovative contributions and advance for both program portfolios and their requisite fields of study. An additional unique feature of the game is the embedding of varying degrees of economic principles and decision-making along with the nuisances of cultural context as salient variables that influence systems thinking. Of note, a team of computer science, management and engineering undergraduate students at the University of Nebraska - Lincoln will be responsible for the engineering, development, and deployment of the game as their university capstone projects. If successful, this game will have a significant reach and impact on youth in informal programs (i.e., 4-H clubs), high school teachers and students in agriculture vocational education courses, college students, and the public. The impact could extend well beyond Nebraska and the targeted Midwestern region. In conjunction with the game development, mixed-methods formative and summative evaluations will be conducted by an external evaluator. The formative evaluation of the game will focus on usability testing, interest and engagement with a select sample of youth at local 4-H clubs and youth day camps. Data will be collected from embedded in-game survey questionnaires, rating scales, observations and focus groups conducted with evaluation sample. These data and feedback will be used to inform the design and refinement of the game. The summative evaluation will focus on the overall impacts of the game. Changes in agricultural systems knowledge, attitudes toward agricultural systems, interest in pursuing careers in agricultural systems, and decision making will be aligned with the Nebraska State Science Standards and tracked using the National Agricultural Literacy Outcomes (NALOs) assessment, game analytics and pre/post-test measures administered to the evaluation study sample pre/post exposure to the game.
DATE:
-
TEAM MEMBERS:
Jeyamkondan SubbiahEric ThompsonDeepak KeshwaniRichard KoelschDavid Rosenbaum
This is an Early-concept Grant for Exploratory Research supporting research in Smart and Connected Communities. The research supported by the award is collaborative with research at the University of Colorado. The researchers are studying the use of technologies to enable communities to connect youth and youth organizations to effectively support diverse learning pathways for all students. These communities, the youth, the youth organizations, formal and informal education organizations, and civic organizations form a learning ecology. The DePaul University researchers will design and implement a smart community infrastructure in the City of Chicago to track real-time student participation in community STEM activities and to develop mobile applications for both students and adults. The smart community infrastructure will bring together information from a variety of sources that affect students' participation in community activities. These include geographic information (e.g., where the student lives, where the activities take place, the student transportation options, the school the student attends), student related information (e.g., the education and experience background of the student, the economic status of the student, students' schedules), and activity information (e.g., location of activity, requirements for participation). The University of Colorado researchers will take the lead on analyzing these data in terms of a community learning ecologies framework and will explore computational approaches (i.e., recommender systems, visualizations of learning opportunities) to improve youth exploration and uptake of interests and programs. These smart technologies are then used to reduce the friction in the learning connection infrastructure (called L3 for informal, formal, and virtual learning) to enable the student to access opportunities for participation in STEM activities that are most feasible and most appropriate for the student. Such a flexible computational approach is needed to support the necessary diversity of potential recommendations: new interests for youth to explore; specific programs based on interests, friends' activities, or geographic accessibility; or programs needed to "level-up" (develop deeper skills) and complete skills to enhance youths' learning portfolios. Although this information was always available, it was never integrated so it could be used to serve the community of both learners and the providers and to provide measurable student learning and participation outcomes. The learning ecologies theoretical framework and supporting computational methods are a contribution to the state of the art in studying afterschool learning opportunities. While the concept of learning ecologies is not new, to date, no one has offered such a systematic and theoretically-grounded portfolio of measures for characterizing the health and resilience of STEM learning ecologies at multiple scales. The theoretical frameworks and concepts draw together multiple research and application domains: computer science, sociology of education, complexity science, and urban planning. The L3 Connects infrastructure itself represents an unprecedented opportunities for conducting "living lab" experiments to improve stakeholder experience of linking providers to a single network and linking youth to more expanded and varied opportunities. The University of Colorado team will employ three methods: mapping, modeling, and linking youth to STEM learning opportunities in school and out of school settings in a large urban city (Chicago). The recommender system will be embedded into youth and parent facing mobile apps, enabling the team to characterize the degree to which content-based, collaborative filtering, or constraint based recommendations influence youth actions. The project will result in two measurable outcomes of importance to key L3 stakeholder groups: a 10% increase in the number of providers (programs that are part of the infrastructure) in target neighborhoods and a 20% increase in the number of youth participating in programs.
This is an Early-concept Grant for Exploratory Research supporting research in Smart and Connected Communities. The research supported by the award is collaborative with research at DePaul University. The researchers are studying the use of technologies to enable communities to connect youth and youth organizations to effectively support diverse learning pathways for all students. These communities, the youth, the youth organizations, formal and informal education organizations, and civic organizations form a learning ecology. The DePaul University researchers will design and implement a smart community infrastructure in the City of Chicago to track real-time student participation in community STEM activities and to develop mobile applications for both students and adults. The smart community infrastructure will bring together information from a variety of sources that affect students' participation in community activities. These include geographic information (e.g., where the student lives, where the activities take place, the student transportation options, the school the student attends), student related information (e.g., the education and experience background of the student, the economic status of the student, students' schedules), and activity information (e.g., location of activity, requirements for participation). The University of Colorado researchers will take the lead on analyzing these data in terms of a community learning ecologies framework and will explore computational approaches (i.e., recommender systems, visualizations of learning opportunities) to improve youth exploration and uptake of interests and programs. These smart technologies are then used to reduce the friction in the learning connection infrastructure (called L3 for informal, formal, and virtual learning) to enable the student to access opportunities for participation in STEM activities that are most feasible and most appropriate for the student. Such a flexible computational approach is needed to support the necessary diversity of potential recommendations: new interests for youth to explore; specific programs based on interests, friends' activities, or geographic accessibility; or programs needed to "level-up" (develop deeper skills) and complete skills to enhance youths' learning portfolios. Although this information was always available, it was never integrated so it could be used to serve the community of both learners and the providers and to provide measurable student learning and participation outcomes. The learning ecologies theoretical framework and supporting computational methods are a contribution to the state of the art in studying afterschool learning opportunities. While the concept of learning ecologies is not new, to date, no one has offered such a systematic and theoretically-grounded portfolio of measures for characterizing the health and resilience of STEM learning ecologies at multiple scales. The theoretical frameworks and concepts draw together multiple research and application domains: computer science, sociology of education, complexity science, and urban planning. The L3 Connects infrastructure itself represents an unprecedented opportunities for conducting "living lab" experiments to improve stakeholder experience of linking providers to a single network and linking youth to more expanded and varied opportunities. The University of Colorado team will employ three methods: mapping, modeling, and linking youth to STEM learning opportunities in school and out of school settings in a large urban city (Chicago). The recommender system will be embedded into youth and parent facing mobile apps, enabling the team to characterize the degree to which content-based, collaborative filtering, or constraint based recommendations influence youth actions. The project will result in two measurable outcomes of importance to key L3 stakeholder groups: a 10% increase in the number of providers (programs that are part of the infrastructure) in target neighborhoods and a 20% increase in the number of youth participating in programs.
Summary
Girlstart’s mission is to increase girls’ interest and engagement in STEM through innovative, nationally-recognized informal STEM education programs. Girlstart examines in this report how STEM education directed toward elementary school girls influences long-term readiness and participation to math and science learning. This report compares Girlstart After School participants’ academic performance to nonparticipant performance. Specifically, it examines how Girlstart After School influences science STAAR performance and course enrollment in subsequent elementary and early middle
This Research in Service to Practice project, a collaboration of Pepperdine University and the New York Hall of Science, will establish a network of STEM-related Media Making Clubs comprised of after-school students aged 12 - 19 and teachers in the U.S. and in three other countries: Kenya, Namibia and Finland. The media produced by the students may include a range of formats such as videos, short subject films, games, computer programs and specialized applications like interactive books. The content of the media produced by the students will focus on the illustration and teaching of STEM topics, where the shared media is intended to help other students become enthused about and learn the science. This proposal builds on the principal investigator's previous work on localized media clubs by now creating an international network in which after-school students and teachers will collaborate at a distance with other clubs. The central research questions for the project pertain to three themes at the intersection of learning, culture and collaboration: the impact of participatory teaching, virtual networks, and intercultural, global competence. The research will combine qualitative, cross-cultural and big data methods. Critical to the innovation of the project, the research team will also develop a network assessment tool, adapting epistemic network analysis methods to the needs of this initiative. This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Eric HamiltonKatherine McMillanPriya Mohabir
This project by California State University San Marcos and their collaborators will expand and continue to innovate on a pilot Mobile Making program with the goal of developing a sustainable, regional model for serving underserved, middle-school aged youth in twelve after-school programs in the San Diego region. Evaluation of the current Mobile Making program has documented positive impacts on participants' interest, self-efficacy, and perception of the relevance of Making/STEM in everyday life, and led to a model for engaging underserved youth in Making. The work will focus on implementing the program model sustainably at greater capacity by increasing the number of undergraduate activity leaders, after-school sites, and level of community engagement. The expanded Mobile Making program is expected to engage ~1800 middle school youth at 12 local school sites, with activities facilitated by ~1020 undergraduate CSU-SM STEM majors. The sites are in ethnically diverse and economically disadvantaged neighborhoods, with as many as 90% of students at some sites qualifying for free or reduced price lunch. The undergraduate facilitators are drawn from CSU-SM's diverse student body, which includes 44% underrepresented minorities. Outcomes are expected to include increases in the youth participants' interest, self-efficacy, and perception of the relevance of Making/STEM in everyday life. Positive impacts on the undergraduate facilitators will include broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. The program is designed to achieve sustainability through innovative means such as involving undergraduate facilitators via Community Service Learning (rather than paid positions), and increased community engagement via development and support of a community of practice including local after-school providers, teachers, Makers, and University members. Evaluation of the program outcomes and lessons learned are expected to result in a comprehensive model for a sustainable, university-based after-school Making program with regional impact in underserved communities. Dissemination to other regions will be leveraged via CSU-SM's membership in the California State University (CSU) system, yielding a potential statewide impact. The support of the CSU Chancellor's Office and input from a CSU implementation group will ensure the applicability of the model to other regional university settings, identify common structural barriers and solutions, and increase the probability of secondary implementations. This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Researchers at Georgia Tech and staff at the Center for Puppetry Arts in Atlanta will address the following problem: The growth of computing calls for increased teaching of basic hardware skills, but engaging students beyond those who are already interested in STEM fields is difficult. Emphasizing cultural context through personal expression has shown to attract new audiences such as women and minorities; however, balancing accessibility and educational effectiveness remains problematic. Current educational tools often use "black boxing" to simplify access, to protect the underlying functionality, and/or to stay commercially competitive. Innovations are needed where the basic skills of design and making, along with new educational models, can support students' exploration of everyday electronics and critical thinking. The team will test an after-school model that could be applied in cultural institutions and other venues that would provide students in 4 - 8 grades with multiple computer/electronics-driven puppet design and building workshops. These workshops will provide opportunities for basic hardware and electronics prototyping, personal cultural expression, and performance.
The exploratory research and development method involves three steps: the students develop a story-line (narrative) that will incorporate puppets; they learn and apply basic electronics and mechanical crafts to design, build and test their puppets; and they perform their shows to other participants and their families. Over the course of the project, there will be five workshops: two pilot tests (to test feasibility and design), one mid-project evaluation workshop (to evaluate and re-iterate), and two final workshops conducted by educators, where the research team only observes (to test for transferability). Data collection throughout this development cycle will include video and sound recording, still photography, field notes, pre- and post-questionnaires, and the production of puppet "artifacts" during the workshops. In addition to the data collected in the workshops, the project will produce design documents and educational guidelines, as well as other media (such as instructional video clips), which will be disseminated to educators and researchers.
The project has been successfully concluded. It included additional pilot workshops with puppetry experts and educators in addition to the scheduled development and final evaluation workshops. Overall, the project has led to publications in both educational as well as performance/ game- and interface-related events.
The project also published material on the puppet designs and their possible adaptation to educational settings on the project web site, which also include video documentation. More information is available at: http://dwig.lmc.gatech.edu/projects/prototypingpuppets/