Skip to main content

Community Repository Search Results

resource evaluation Public Programs
Techbridge Girls’ mission is to help girls discover a passion for science, engineering, and technology (SET). In August 2013, Techbridge Girls was awarded a five-year National Science Foundation grant to scale up its after-school program from the San Francisco Bay Area to multiple new locations around the United States. Techbridge Girls began offering after-school programming at elementary and middle schools in Greater Seattle in 2014, and in Washington, DC in 2015. Education Development Center is conducting the formative and summative evaluation of the project. To assess the
DATE:
TEAM MEMBERS: Ginger Fitzhugh Carrie Liston Sarah Armstrong
resource evaluation Public Programs
Techbridge Girls’ mission is to help girls discover a passion for science, engineering, and technology (SET). In August 2013, Techbridge Girls was awarded a five-year National Science Foundation grant to scale up its after-school program from the San Francisco Bay Area to multiple new locations around the United States. Techbridge Girls began offering after-school programming at elementary and middle schools in Greater Seattle in 2014, and in Washington, DC in 2015. Education Development Center is conducting the formative and summative evaluation of the project. To assess the
DATE:
TEAM MEMBERS: Ginger Fitzhugh Carrie Liston Sarah Armstrong
resource project Media and Technology
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. This Broad Implementation project would scale up the CryptoClub Project, an afterschool and online program designed to engage middle school youth in mathematics and cryptography. The project builds on previous successful work and evaluation that is ready for scale up using a train-the-trainer model implemented through a partnership with the National Girls Collaborative. The project will train 160 new CryptoClub leaders who will then train 800 new leaders at 20 hub sites reaching 9600 students. In addition, professional development modules and webinars will continue to refresh leader skills. Other project components include an online multiplayer cryptography game, weekly challenges through social media, and digital cryptology badges for students.

The research uses a think-aloud method with students as they actually attempt to solve the cryptology problems using mathematical thinking. Three think-aloud studies will be performed during the Project. The research team will code transcripts of the interviews for evidence of the mathematical thinking intended to be addressed by each activity, as well as capturing unexpected kinds of thinking. Tasks will also be rated according to the type of knowledge elicited. A written report will include statistical analyses of the think-aloud and interview responses, interpreted in light of the overall CryptoClub goals. The findings will contribute to both future research efforts and practice. The evaluation by EDC uses a quasi-experimental design, which assesses project outcomes for trainers, leaders, students, and Internet users. EDC will also investigate the fidelity to the CryptoClub model as it is scaled up. These studies have strong potential for informing numerous other projects that are at a stage where scale up is under consideration.
DATE: -
TEAM MEMBERS: Janet Beissinger
resource project Public Programs
This project will coordinate and focus existing educational elements with the common goal of increasing the participation of underrepresented minorities in STEM degree programs and the STEM workforce. This goal will help the US maintain its leadership in science and engineering innovation while supporting the expansion of the talent pool needed to fuel economic growth in technical areas. The program will feature an assessment system that addresses both social influence factors and the transfer of STEM skills with the aim of identifying the reasons that underrepresented minorities leave the STEM pipeline. By including both curricular and extracurricular elements of the STEM pipeline, ranging from middle school through college, the program will be able to respond quickly to findings from the assessment component and take proactive steps to retain STEM students and maintain their self perception as future scientists or engineers.

The program proposes to assess, unite and coordinate elements in the New Mexico STEM pipeline with the ultimate goal of increasing the participation of underrepresented groups in the STEM workforce. The need to grow a diverse science, technology, engineering and mathematics (STEM) workforce is recognized throughout the State of New Mexico, and beyond, by both the public and private sectors. The project develops a crosscutting assessment system that addresses both social influence factors and the skills component of STEM education. The project develops a collective impact framework aimed at increasing the participation of underrepresented minorities in the STEM workforce and implements a common assessment system for students in the 6-20+ STEM pipeline. This assessment system will address both social influence factors and the transfer of STEM related skills with the aim of building a research base to investigate why students from underrepresented minorities leave the STEM pipeline. The output from this research will drive the development of a set of best practices for increasing retention and a scheme for improving the integration of minority students into the STEM community. The retention model developed as part of the program will be shared with the STEM partners through a series of workshops with the goal of developing a more coordinated approach to the retention of underrepresented minorities. The program focuses on a small set of STEM programs with existing connections to the College of Engineering.
DATE: -
TEAM MEMBERS: Steven Stochaj Patricia Sullivan Luis Vazquez
resource project Public Programs
This NSF INCLUDES pilot addresses the challenge of broadening participation in Science, Technology, Engineering and Math (STEM) among minoritized youth in grades 5-8 and their access to computer science (CS), which is recognized as integral to all STEM disciplines. This project will specifically focus on developing and understanding computing experiences intentionally designed to strengthen mathematical skills utilizing culturally responsive pedagogy. Culturally responsive pedagogy integrates knowledge relevant to students' identities and communities with computational learning activities, and maximizes the potential for increasing engagement, competence, and belonging of underrepresented youth in computing. This pilot will be situated in community-based organizations, including Boys and Girls Clubs and Public Libraries, with the support of industry partners and the local Department of Education. Given the role of community-based organizations and libraries across the nation for community engagement and educational enrichment, this work represents an exciting opportunity for spreading into thousands of libraries and community centers across the nation, thereby having collective impact that materializes CS for All.

This project will engage minoritized youth in grades 5-8. The overarching vision is to establish a scalable model for providing these students with recurrent opportunities to create computational artifacts that are culturally-responsive to their community contexts. In addition, there will be an explicit and simultaneous focus on strengthening students' mathematical skills. The project has four goals: (1) facilitate culturally-responsive learning of key CS concepts and practices; (2) build youth and community knowledge around positive impacts of computing on local communities; (3) increase participants' knowledge, confidence and interest in becoming creators of computing innovations; and (4) strengthen mathematical skills through intentional computing experiences. The project will adapt and implement CS modules from the NSF-funded Exploring Computer Science curriculum, and will intentionally reinforce mathematics skills and community engagement. It will design and implement a culturally-responsive training model for establishing community instructors who can support CS project learning. Finally, it will create instruments for monitoring project goals and participant outcomes. Due to the collaboration with community-based organizations present in cities across the nation, the model has strong potential to scale up regionally and nationally.
DATE: -
TEAM MEMBERS: Lori Pollock Chrystalla Mouza John Pelesko Rosalie Rolon-Dow
resource project Public Programs
General Summary

This project seeks to prepare female Hispanic students for leadership in the STEM workforce. The project seeks to determine if a blended set of STEM engagement activities including summer intensive laboratory-based experiential learning and out-of-school STEM activities, peer support, mentoring, and financial assistance can help to take target students through a traditional leaky workforce and educational pipeline resulting in matriculation to and graduation from undergraduate STEM programs. If successful, the work will increase participation and leadership of Hispanic women in the STEM workforce. To accomplish these goals, the PIs will: (1) work with partners to identify, recruit, and screen bright, energetic Hispanic females in their freshman year of high school who show promise and interest in STEM disciplines; (2) engage selected students and their families in formal and informal STEM learning both throughout the school year and during summer residential experiences to enable the students to further develop and clarify their STEM calling; (3)prepare the students to matriculate to undergraduate college; (4) provide program participants with full-tuition scholarships to ensure undergraduate education is attainable; and (5) at our institution and partner colleges, provide dedicated advisors and mentors and cohort activities to ensure undergraduate persistence and success.

Technical Summary

The PIs seek to prepare female Hispanic students for leadership in the STEM workforce. To compete in the global economy, maintain national security, and meet serious environmental challenges, more skilled graduates are needed to fill STEM jobs. An untapped source of talent exists in those populations that continue to be underrepresented in STEM fields, including women and people of color. This work will help to determine if a blended set of STEM engagement activities including summer intensive laboratory-based experiential learning and out-of-school STEM activities, peer support, mentoring, and financial assistance can help to take target students through a traditional leaky pipeline resulting in matriculation to and graduation from undergraduate STEM education. The work builds on research that shows that mentored research opportunities and peer support and interaction improves persistence in female students. It also builds on regional models of collective impact whereby a variety of corporate, nonprofit, and foundation organizations successfully join together for large-impact projects. If successful, the work will increase participation and leadership of Hispanic women in the STEM workforce.
DATE: -
TEAM MEMBERS: April Marchetti Charles English Rebecca Michelsen Rachele Dominguez Laurie Massery
resource project Media and Technology
As part of an overall strategy to enhance learning within informal environments, the Innovations at the Nexus of Food, Energy, and Water Systems (INFEWS) and Advancing Informal STEM Learning (AISL) programs partnered to support innovative models poised to catalyze well-integrated interdisciplinary research and development efforts within informal contexts that transform scientific understanding of the food, energy, and water systems (FEWS) nexus in order to improve system function and management, address system stress, increase resilience, and ensure sustainability. This project addresses this aim by using systems thinking and interdisciplinary integration approaches to develop a novel immersive educational simulation game and associated materials designed to highlight the role and importance of corn-water-ethanol-beef (CWEB) systems in supporting the ever increasing demands for food, energy, and water in the United States. The focus on FEWS and sustainable energy aligns well with both the INFEWS program and the sizable sustainability-related projects in the AISL program portfolio. The development and broad dissemination of a multiuser game specific to CWEB systems are particularly innovative contributions and advance for both program portfolios and their requisite fields of study. An additional unique feature of the game is the embedding of varying degrees of economic principles and decision-making along with the nuisances of cultural context as salient variables that influence systems thinking. Of note, a team of computer science, management and engineering undergraduate students at the University of Nebraska - Lincoln will be responsible for the engineering, development, and deployment of the game as their university capstone projects. If successful, this game will have a significant reach and impact on youth in informal programs (i.e., 4-H clubs), high school teachers and students in agriculture vocational education courses, college students, and the public. The impact could extend well beyond Nebraska and the targeted Midwestern region. In conjunction with the game development, mixed-methods formative and summative evaluations will be conducted by an external evaluator. The formative evaluation of the game will focus on usability testing, interest and engagement with a select sample of youth at local 4-H clubs and youth day camps. Data will be collected from embedded in-game survey questionnaires, rating scales, observations and focus groups conducted with evaluation sample. These data and feedback will be used to inform the design and refinement of the game. The summative evaluation will focus on the overall impacts of the game. Changes in agricultural systems knowledge, attitudes toward agricultural systems, interest in pursuing careers in agricultural systems, and decision making will be aligned with the Nebraska State Science Standards and tracked using the National Agricultural Literacy Outcomes (NALOs) assessment, game analytics and pre/post-test measures administered to the evaluation study sample pre/post exposure to the game.
DATE: -
TEAM MEMBERS: Jeyamkondan Subbiah Eric Thompson Deepak Keshwani Richard Koelsch David Rosenbaum
resource project Media and Technology
This is an Early-concept Grant for Exploratory Research supporting research in Smart and Connected Communities. The research supported by the award is collaborative with research at the University of Colorado. The researchers are studying the use of technologies to enable communities to connect youth and youth organizations to effectively support diverse learning pathways for all students. These communities, the youth, the youth organizations, formal and informal education organizations, and civic organizations form a learning ecology. The DePaul University researchers will design and implement a smart community infrastructure in the City of Chicago to track real-time student participation in community STEM activities and to develop mobile applications for both students and adults. The smart community infrastructure will bring together information from a variety of sources that affect students' participation in community activities. These include geographic information (e.g., where the student lives, where the activities take place, the student transportation options, the school the student attends), student related information (e.g., the education and experience background of the student, the economic status of the student, students' schedules), and activity information (e.g., location of activity, requirements for participation). The University of Colorado researchers will take the lead on analyzing these data in terms of a community learning ecologies framework and will explore computational approaches (i.e., recommender systems, visualizations of learning opportunities) to improve youth exploration and uptake of interests and programs. These smart technologies are then used to reduce the friction in the learning connection infrastructure (called L3 for informal, formal, and virtual learning) to enable the student to access opportunities for participation in STEM activities that are most feasible and most appropriate for the student. Such a flexible computational approach is needed to support the necessary diversity of potential recommendations: new interests for youth to explore; specific programs based on interests, friends' activities, or geographic accessibility; or programs needed to "level-up" (develop deeper skills) and complete skills to enhance youths' learning portfolios. Although this information was always available, it was never integrated so it could be used to serve the community of both learners and the providers and to provide measurable student learning and participation outcomes. The learning ecologies theoretical framework and supporting computational methods are a contribution to the state of the art in studying afterschool learning opportunities. While the concept of learning ecologies is not new, to date, no one has offered such a systematic and theoretically-grounded portfolio of measures for characterizing the health and resilience of STEM learning ecologies at multiple scales. The theoretical frameworks and concepts draw together multiple research and application domains: computer science, sociology of education, complexity science, and urban planning. The L3 Connects infrastructure itself represents an unprecedented opportunities for conducting "living lab" experiments to improve stakeholder experience of linking providers to a single network and linking youth to more expanded and varied opportunities. The University of Colorado team will employ three methods: mapping, modeling, and linking youth to STEM learning opportunities in school and out of school settings in a large urban city (Chicago). The recommender system will be embedded into youth and parent facing mobile apps, enabling the team to characterize the degree to which content-based, collaborative filtering, or constraint based recommendations influence youth actions. The project will result in two measurable outcomes of importance to key L3 stakeholder groups: a 10% increase in the number of providers (programs that are part of the infrastructure) in target neighborhoods and a 20% increase in the number of youth participating in programs.
DATE: -
TEAM MEMBERS: Nichole Pinkard
resource project Media and Technology
This is an Early-concept Grant for Exploratory Research supporting research in Smart and Connected Communities. The research supported by the award is collaborative with research at DePaul University. The researchers are studying the use of technologies to enable communities to connect youth and youth organizations to effectively support diverse learning pathways for all students. These communities, the youth, the youth organizations, formal and informal education organizations, and civic organizations form a learning ecology. The DePaul University researchers will design and implement a smart community infrastructure in the City of Chicago to track real-time student participation in community STEM activities and to develop mobile applications for both students and adults. The smart community infrastructure will bring together information from a variety of sources that affect students' participation in community activities. These include geographic information (e.g., where the student lives, where the activities take place, the student transportation options, the school the student attends), student related information (e.g., the education and experience background of the student, the economic status of the student, students' schedules), and activity information (e.g., location of activity, requirements for participation). The University of Colorado researchers will take the lead on analyzing these data in terms of a community learning ecologies framework and will explore computational approaches (i.e., recommender systems, visualizations of learning opportunities) to improve youth exploration and uptake of interests and programs. These smart technologies are then used to reduce the friction in the learning connection infrastructure (called L3 for informal, formal, and virtual learning) to enable the student to access opportunities for participation in STEM activities that are most feasible and most appropriate for the student. Such a flexible computational approach is needed to support the necessary diversity of potential recommendations: new interests for youth to explore; specific programs based on interests, friends' activities, or geographic accessibility; or programs needed to "level-up" (develop deeper skills) and complete skills to enhance youths' learning portfolios. Although this information was always available, it was never integrated so it could be used to serve the community of both learners and the providers and to provide measurable student learning and participation outcomes. The learning ecologies theoretical framework and supporting computational methods are a contribution to the state of the art in studying afterschool learning opportunities. While the concept of learning ecologies is not new, to date, no one has offered such a systematic and theoretically-grounded portfolio of measures for characterizing the health and resilience of STEM learning ecologies at multiple scales. The theoretical frameworks and concepts draw together multiple research and application domains: computer science, sociology of education, complexity science, and urban planning. The L3 Connects infrastructure itself represents an unprecedented opportunities for conducting "living lab" experiments to improve stakeholder experience of linking providers to a single network and linking youth to more expanded and varied opportunities. The University of Colorado team will employ three methods: mapping, modeling, and linking youth to STEM learning opportunities in school and out of school settings in a large urban city (Chicago). The recommender system will be embedded into youth and parent facing mobile apps, enabling the team to characterize the degree to which content-based, collaborative filtering, or constraint based recommendations influence youth actions. The project will result in two measurable outcomes of importance to key L3 stakeholder groups: a 10% increase in the number of providers (programs that are part of the infrastructure) in target neighborhoods and a 20% increase in the number of youth participating in programs.
DATE: -
TEAM MEMBERS: Bill Penuel Tamara Sumner Nichole Pinkard
resource project Media and Technology
This Research in Service to Practice project, a collaboration of Pepperdine University and the New York Hall of Science, will establish a network of STEM-related Media Making Clubs comprised of after-school students aged 12 - 19 and teachers in the U.S. and in three other countries: Kenya, Namibia and Finland. The media produced by the students may include a range of formats such as videos, short subject films, games, computer programs and specialized applications like interactive books. The content of the media produced by the students will focus on the illustration and teaching of STEM topics, where the shared media is intended to help other students become enthused about and learn the science. This proposal builds on the principal investigator's previous work on localized media clubs by now creating an international network in which after-school students and teachers will collaborate at a distance with other clubs. The central research questions for the project pertain to three themes at the intersection of learning, culture and collaboration: the impact of participatory teaching, virtual networks, and intercultural, global competence. The research will combine qualitative, cross-cultural and big data methods. Critical to the innovation of the project, the research team will also develop a network assessment tool, adapting epistemic network analysis methods to the needs of this initiative. This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE: -
TEAM MEMBERS: Eric Hamilton Katherine McMillan Priya Mohabir
resource project Public Programs
This project by California State University San Marcos and their collaborators will expand and continue to innovate on a pilot Mobile Making program with the goal of developing a sustainable, regional model for serving underserved, middle-school aged youth in twelve after-school programs in the San Diego region. Evaluation of the current Mobile Making program has documented positive impacts on participants' interest, self-efficacy, and perception of the relevance of Making/STEM in everyday life, and led to a model for engaging underserved youth in Making. The work will focus on implementing the program model sustainably at greater capacity by increasing the number of undergraduate activity leaders, after-school sites, and level of community engagement. The expanded Mobile Making program is expected to engage ~1800 middle school youth at 12 local school sites, with activities facilitated by ~1020 undergraduate CSU-SM STEM majors. The sites are in ethnically diverse and economically disadvantaged neighborhoods, with as many as 90% of students at some sites qualifying for free or reduced price lunch. The undergraduate facilitators are drawn from CSU-SM's diverse student body, which includes 44% underrepresented minorities. Outcomes are expected to include increases in the youth participants' interest, self-efficacy, and perception of the relevance of Making/STEM in everyday life. Positive impacts on the undergraduate facilitators will include broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. The program is designed to achieve sustainability through innovative means such as involving undergraduate facilitators via Community Service Learning (rather than paid positions), and increased community engagement via development and support of a community of practice including local after-school providers, teachers, Makers, and University members. Evaluation of the program outcomes and lessons learned are expected to result in a comprehensive model for a sustainable, university-based after-school Making program with regional impact in underserved communities. Dissemination to other regions will be leveraged via CSU-SM's membership in the California State University (CSU) system, yielding a potential statewide impact. The support of the CSU Chancellor's Office and input from a CSU implementation group will ensure the applicability of the model to other regional university settings, identify common structural barriers and solutions, and increase the probability of secondary implementations. This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE: -
TEAM MEMBERS: Edward Price Charles De Leone
resource project Public Programs
Researchers at Georgia Tech and staff at the Center for Puppetry Arts in Atlanta will address the following problem: The growth of computing calls for increased teaching of basic hardware skills, but engaging students beyond those who are already interested in STEM fields is difficult. Emphasizing cultural context through personal expression has shown to attract new audiences such as women and minorities; however, balancing accessibility and educational effectiveness remains problematic. Current educational tools often use "black boxing" to simplify access, to protect the underlying functionality, and/or to stay commercially competitive. Innovations are needed where the basic skills of design and making, along with new educational models, can support students' exploration of everyday electronics and critical thinking. The team will test an after-school model that could be applied in cultural institutions and other venues that would provide students in 4 - 8 grades with multiple computer/electronics-driven puppet design and building workshops. These workshops will provide opportunities for basic hardware and electronics prototyping, personal cultural expression, and performance.

The exploratory research and development method involves three steps: the students develop a story-line (narrative) that will incorporate puppets; they learn and apply basic electronics and mechanical crafts to design, build and test their puppets; and they perform their shows to other participants and their families. Over the course of the project, there will be five workshops: two pilot tests (to test feasibility and design), one mid-project evaluation workshop (to evaluate and re-iterate), and two final workshops conducted by educators, where the research team only observes (to test for transferability). Data collection throughout this development cycle will include video and sound recording, still photography, field notes, pre- and post-questionnaires, and the production of puppet "artifacts" during the workshops. In addition to the data collected in the workshops, the project will produce design documents and educational guidelines, as well as other media (such as instructional video clips), which will be disseminated to educators and researchers.

The project has been successfully concluded. It included additional pilot workshops with puppetry experts and educators in addition to the scheduled development and final evaluation workshops. Overall, the project has led to publications in both educational as well as performance/ game- and interface-related events.

The project also published material on the puppet designs and their possible adaptation to educational settings on the project web site, which also include video documentation. More information is available at: http://dwig.lmc.gatech.edu/projects/prototypingpuppets/
DATE: -
TEAM MEMBERS: Michael Nitsche Crystal Eng