Rockman et al (REA) conducted an independent summative evaluation of the Eutelelost Tree of Life: Web Module. The Euteleost Tree of Life (EToL) is a collaborative National Science Foundation research project between eight institutions, including Kansas University, to resolve evolutionary relationships within the euteleost fishes. The main aim of the interactive Web module is for users to explore the evolutionary history of fish and how they are related to one another. REA's summative evaluation was designed to (1) gather users' feedback about the website, as well as (2) assess the impact of
Our goal is to demonstrate an educational model fully commensurate with the demands of the 21st Century workforce, and more specifically, with the emerging “green-tech” economy. We recognize a pressing need creating more sustainable solutions for the (human) built-environment and of stabilizing economic patterns that uphold sustainable systems. to prepare citizens for the challenges of The ASCEND model is designed to encourage these societal shifts, but at the same time, it is an attempt to put theory into practice - activating educational practices aligned with research on human development and cognition. For some time now strong recommendations for apprenticeship learning have emphasized the function of legitimate peripheral participation – the possibility of which becomes more prevalent in robust communities of practice. As compared to top-down approaches (typical of formal education settings) these "learning communities" are seen as being more closely aligned with our natural propensities for learning and cognition. ASCEND represents a design-experiment -an attempt to learn how we can create and sustain opportunities for apprenticeship learning in an interdisciplinary arena at the leading edge of technical innovation. In addition, the ASCEND model introduces and examines the efficacy of “digital storytelling” as an alternative to more traditional forms of apprenticeship learning and as a means to engage and advance this and future generations in STEM. A further goal is to develop innovative measures of assessment commensurate with this new model of apprenticeship learning. Finally ASCEND explore how informal learning organizations (museums, libraries, preserves etc.) can use digital storytelling to develop community-driven programs inclusive of at-risk youth and other hard to reach audiences.
Brigham Young University and the University of Maryland, in partnership with the Smithsonian Institution, the Computer History Museum, and NASA, plus leading game designers, educators, scientists, and researchers, will conduct research on the design and development of two large-scale Alternate Reality Games (ARGs) based on deep-time science in astrobiology, astrophysics, and interplanetary space travel. The project will iteratively design and test two distinct types of ARGs (closed- and open-ended) to study the effects of these ARGs on STEM learning. The ARGs will be based upon the Next Generation Science Standards (NGSS), affording learners with intensive, self-driven, and scaffolded scientific learning and will be aimed at attracting girls and other groups historically underrepresented in science and technology. Each ARG will be designed by NASA scientists, educators and education researchers, and game-based learning experts and will be highly interactive: engaging learners in collaborative investigations in real and virtual worlds to collect scientific data, conduct data analysis, and contribute scientific evidence that will help solve scientific questions within a science-based narrative derived from real world problems that will develop learners' computational thinking skills in a collaborative, participatory virtual learning environment. Combining data from web and social media analytics, player interviews, surveys, and user-generated content, researchers, and evaluation experts at UXR who will provide an outcomes-based evaluation, including front-end, formative, remedial, and summative evaluations, will establish the properties of ARGs that most effectively advance informal STEM learning outcomes. By comparing open-ended and closed-ended ARGs, the PIs will be able to assess the relative strengths and weaknesses of two distinct approaches to Alternate Reality Game design. The project team will test the hypothesis that open-ended, user-generated content will support inquiry-based learning, peer-to-peer learning, and life-wide and life-deep learning, while close-ended, narrative-rich ARGs will support specific transfer of STEM knowledge, collaboration, and problem solving. To help ensure that the games appeal to their target audiences, the project team will adopt co-design methods, enlisting the creative input of participating teens at each stage of the design process. Supplementary materials and lesson plans developed in close consultation with teachers, librarians, teens, and external stakeholders will enable the ARGs to be widely and effectively used as a model in museums, classrooms, libraries, and after-school programs. The proposed ARGs represent a unique environment to test learning principles that enable players to bridge their learning through transmedia across multiple contexts and test the effects of collaboration with massive numbers of concurrent players. As a result, the project should yield insights on how learning principles can be adopted and re-appropriated for emerging learning environments, including those that that might be crowd-sourced. The research is well grounded in the literature and the PIs do an excellent job of mapping ARG design principles to the pertinent learning science research, providing a clear sense of the particular affordances of the genre that should lead to new understandings. The approach has profound implications for the way we might teach the next generation of students. The ability to mix problem solving and learning in virtual spaces with experiences and data derived from the physical world could dramatically change how we understand the role of technology in education.
This Pathways project from the Ocean Discovery Institute (ODI) seeks to develop and pilot a program model designed to fill an identified gap in citizen science research and practice literature: how to effectively engage and better understand how to foster participation among people from under-represented groups in citizen science research. The ODI model is designed around six principles: (1) leaders who are reflective of the community, (2) science that is locally relevant, (3) guided, as opposed to self-guided, experiences, (4) direct interactions with scientists, (5) progressively increasing responsibilities for participants who express interest, and (6) removing barriers to participation, such as transportation, language, family involvement and access to technology. The project addresses environmentally degraded, crime-ridden local canyons, a locally relevant STEM-related issue, and leverages the Southern California Coastal Water Research Project's (SCCWRP) regional citizen science effort focused on identifying the sources and pathways of trash through regional watersheds. The scientific research components of the project focus on four canyons in the area, employing sampling methods developed by SCCWRP. Youth who are part of other ODI programs and who have demonstrated leadership and interest in science, work with the project team to scaffold family and youth participation in project activities taking place during afterschool and weekend time. Based on continued participation in the project, community participants can become more involved in the project, starting as "new scientists" and moving through "returning scientists" to "expert scientists" roles. The project evaluation seeks to identify the role and importance of the components of the proposed model with respect to participation, retention, and learning by participants from groups under-represented in STEM. The dissemination products of this Pathways project include a white paper describing the model and lessons learned as well as presentations to community groups and education and citizen science practitioners. Based on insights from the iterative approach to the model during this Pathways study, a subsequent full-scale development project would seek to engage citizen science projects around the nation in adapting the model to increase participation of individuals from groups underrepresented in STEM, including building out ODI's citizen science programming.
DATE:
-
TEAM MEMBERS:
Lindsay GoodwinRoxanne RuzicTheresa Sinicrope Talley
The University of Texas at El Paso will conduct a research project that implements and documents the impact of co-generative dialogues on youth learning and youth-scientist interactions as part of a STEM research program (i.e., Work with A Scientist Program). Co-generative dialogues seek to specifically assist with communication and understanding among collaborators. Over four years, 108 11th grade youth from a predominantly (90%) Hispanic high school will conduct STEM research with twelve scientists/engineers (e.g., chemist, civil engineer, geologist, biologist) and undergraduate/graduate students as part of 7 month-long after school program, including bi-weekly Saturday activities for 5 months followed by an intensive month-long, self-directed research project in the summer. Youth will be randomly assigned to experimental groups that include the co-generative dialogue treatment and control groups without the intervention. The scientists and their STEM undergraduate/graduate students will participate in both experimental and control groups, with different youth. Youth will receive high school credit to encourage participation and retention. The PI team hypothesizes that co-generative dialogues will result in improved learning, communication, and research experiences for both youth and scientists. Educational researchers will conduct co-generative dialogues, observations, interviews, and surveys using validated instruments to address the following research goals: (1) To investigate the impact of the treatment (co-generative dialogues) on youth knowledge, attitudes, perceptions of their experience, and their relationships with the scientists; (2) To investigate the impact of the treatment on scientists and graduate students; and (3) To identify critical components of the treatment that affect youth-scientist interactions. It is anticipated that, in addition to providing in-depth STEM research experiences for 108 youth from underrepresented groups at a critical time in their lives, the project will result in widely applicable understandings of how pedagogical approaches affect both youth learning and scientist experiences. The project also seeks to bridge learning environments: informal, formal, university and digital.
This full-scale development project will address the need for creative models to support STEM learning in underserved rural communities that lack traditional infrastructure such as science centers. The project will create and study an innovative model of capacity-building: viz., small networks of community-embedded “STEM Guides” will be trained to identify a range of existing STEM resources available in their local regions, and to connect STEM-interested youth with them in creative and personal ways. Anticipated learning outcomes for youth and families include greater awareness of and interest in STEM experiences and pathways. At the regional level, the project will build capacity through increasing the STEM Guides’ knowledge of local STEM opportunities, and by enhancing connections among STEM-related resources, programs, and industries. The project will implement and study STEM Guide networks in a staggered series of five low-income, rural regions, providing startup resources and professional development. The project will increase the frequency and depth of out-of-school STEM experiences for approximately 3,000 youth aged 10-18 at a relatively low cost, creating a national model for STEM capacity-building in rural settings. It is led by the Maine Mathematics and Science Alliance, with 4-H, Cornerstones of Science (library-based STEM) and Maine’s university system as collaborators. EDC is the primary external evaluator.
This full-scale project addresses the need for more youth, especially girls, to pursue an interest in engineering and eventually fill a critical workforce need. The project leverages museum-based exhibits, girls' activity groups, and social media to enhance participants' engineering-related interests and identities. The project includes the following bilingual deliverables: (1) Creative Solutions programming will engage girls in group oriented engineering activities at partner community-based organizations, where the activities highlight altruistic, personally relevant, and social aspects of engineering. Existing community groups will use the activities in their regular meeting structure. Visits to the museum exhibits, titled Design Your World will reinforce messages; (2) Design Your World Exhibits will serve as a community hub at two ISE institutions (Oregon Museum of Science and Industry and the Hatfield Marine Science Center). They will leverage existing NSF-funded Engineer It! (DRL-9803989) exhibits redesigned to attract, engage, and mobilize a more diverse population by showcasing altruistic, personally relevant, and social aspects of engineering; (3) Digital engagement through targeted use of social media will complement program and exhibit content and be an online portal for groups engaged in the project; (4) A community action group (CAG) will provide professional development opportunities to stakeholders interested in girls' STEM identity (e.g. parents, STEM-based business professionals) to promote effective engineering messaging throughout the community and engage them in supporting project participants; and (5) Longitudinal research will explore how girls construct and negotiate engineering-related identities through discourse across the project activities and over time.
The Badges for College Credit project designs and researches: (1) a digital badge system that leads to college credit as the context for investigating how to integrate badges with learning programs; (2) how to assess learning associated with badges; and (3) how badges facilitate learning pathways and contribute to science identity formation. The project is one of the first efforts to develop a system to associate informal science learning with college credit. The project will partner with three regional informal science institutions, the Pacific Science Center, the Future of Flight, and the Seattle of Aquarium, that will facilitate activities for participants that are linked to informal science learning and earning badges. The project uses the iRemix platform, a social learning platform, as a delivery system to direct participants to materials, resources, and activities that support the learning goals of the project. Badges earned within the system can be exported to the Mozilla Open Badges platform. Participants can earn three types of badges, automatic (based on participation), community (based on contributions to building the online community), and skill (based on mastery of science and communication) badges. Using a learning ecologies framework, the project will investigate multiple influences on how and why youth participate in science learning and making decisions. Project research uses a qualitative and quantitative approach, including observations, interviews, case studies, surveys, and learning analytics data, and data analytics. Project evaluation will focus on the nature and function of the collaboration, and on the scale-up aspects of the innovation and expansion, by: (1) analyzing and documenting effective procedures,and optimal contexts for the dissemination of the model and (2) by analyzing the collaboration between informal science organizations and higher education.
DATE:
-
TEAM MEMBERS:
Carrie TzouKaren LennonAmanda GoertzGray Kochlar-Lindgren
This initiative is a collaboration of the University of Massachusetts Amherst, the EcoTarium science museum in Worcester, MA, other scientists and teachers at Clark University in Massachusetts and at Loyola Marymount University in Los Angeles, along with six other museums in New England and California. The project seeks to develop and study a model that would integrate the science research on urban systems into science museum exhibits and programs, starting in this phase in a new "City Science" exhibit space at the EcoTarium. The goal is to learn how to assist citizens in decision-making and shaping a sustainable future for their communities. The work builds on the NSF/SBS-funded Urban Long-term Research Area Exploratory (ULTRA-Ex) network, one of a set of awards by NSF/SBS and NSF/BIO in the area of urban ecology. The exhibit (with four sections: neighborhood design; land use and land cover; urban biodiversity; urban heat island effect) will include activities related to "alternative futures" of cities, will be designed to be updated as new results from this research are produced and also to allow for visitors to respond to survey questions about their city environment that will be used by the researchers. Deliverables will also include an integration of the prototype exhibits with an NSF-funded K-12 urban ecology curriculum (co-PI from Loyola Marymount University), which has already been done with nature centers and would now expand into science museums. The significance of this work includes the growing importance of new research on human/ecology interaction in cities coupled with applications of this research to Public Participation in Science Research (PPSR) and local decisions and choices. It is driven by the future vision of the cities in which the target audience(s) is located. The work in Worcester will focus on reaching underserved audiences, which characterizes much of the city of Worcester, and will include partnerships with local schools and community groups.
DATE:
-
TEAM MEMBERS:
Robert RyanEric StraussColin PolskyAlexander GoldowskyPaige WarrenBetsy Loring
This full scale/collaborative research project targets underserved youth who will collaborate with STEM professionals to co-create community-relevant technology and media content creating a potentially scalable model. App Lab DIY is a collaboration between Youth Radio, the MIT Media Lab's Center for Mobile Learning, and the Mozilla Foundation. There are multiple and well integrated project strategies. Youth working with professionals will design, create, and disseminate original apps that engage users around community issues (e.g. urban wildlife mapping; Community DNA). They will work directly with the MIT Media Lab/Mobile Learning Center to improve App Inventor, an open-source tool. Youth participants will create media content for national on-air and online outlets including NPR. They will design digital badges to validate and document what they've learned creating media and apps. Curricular resources and tools for educators will be created and disseminated to advance STEM learning among underserved youth. Deliverables include: 1) creation of three apps (media-rich, STEM-relevant, community valued) that engage communities; 2) improvements in App Inventor, MIT's open-source tool that democratizes app develop for and by all; 3) radio stories that are integrated with the apps; 4) a multimedia toolkit for informal and formal educators to adapt in their programs; 5) a pilot badging system to mark mastery of skills associated with youth-driven media production and technological innovation; and 6) a research study focusing on the use of app development to drive STEM learning and engagement among underserved youth. Original research will be conducted by an embedded Scholar-in-Residence to inform and advance the field about driving STEM engagement via media/tech innovation. The Scholar-in-Residence will use Participant-Action-Research to inform and improve practice and study the big general questions about how the program works and why. The evaluation will leverage the instruments and methods established in Youth Radio's past NSF grants to study the impact on the youth's skills, knowledge and attitudes. They will also study impacts on two additional audiences: educators using the multimedia toolkit and users of the mobile apps. Approximate 1000 Youth Radio students will participate in the project over the three years through contributions to app development, radio production, and digital badges creation. The multimedia toolkit will be nationally disseminated to STEM educators with a large potential reach.
This research project led by the Exploratorium will use a combination of tracking and timing, cluster analysis, and focus groups to seek to answer the research question: To what extent and in what ways do female-responsive designs more effectively engage girls at STEM exhibits? This project addresses the need for more research in this area by pioneering the study of potential female-responsive design (FRD) principles for exhibits across a wide variety of STEM topics and exhibit types. This project includes four phases that will build from the work of the PI that developed an initial Female-Responsive Design (FRD) Framework regarding female engagement and learning in STEM -- based on extensive literature review and practitioner interviews. This project will expand on and validate this FRD Framework, with the ultimate goal of having a set of criteria for female-responsive designs (FRD) that effectively engage girls at STEM exhibits. The four phases of the research project are: Phase 1: Track 1000 boys and girls across three institutions using over 300 physics, engineering, and math exhibits to identify which exhibits engage boys and girls equally, and which are less engaging for girls. Phase 2: A panel of experts and girl advisors identify additional female-responsive design principles, expanding on those identified to date in literature and practice. Phase 3: Combining results from the first two phases, the third phase employs statistical analyses to reveal the most effective combinations of design principles for engaging girls across a variety of exhibits. Phase 4: This qualitative phase conducts focus groups with girls to explore how the final FRD Framework works to better engage them, and how their learning differs at exhibits that exemplify the principles in the Framework.
The conference, Indigenous Worldviews in Informal Science Education, is designed to advance research on the integration of Native and Western science in relation to informal science learning. The goals of the conference are to integrate and synthesize research and theory, formulate a research agenda, and share the results with the STEM education community. The conference is organized around six strands: Collaboration, Policy, Holistic Education, Next Generation Youth, and Evaluation. A six-week preconference online discussion of conference issues leads into the two-day conference, held at Imiloa Astronomy Center in Hilo, Hawaii. The meeting brings together sixty participants including educators, research scientists, learning researchers, policymakers, and Native youth. The conference includes keynotes, workshops and synthesis discussion groups, which will be synthesized and presented at a policy outcome meeting held in Washington, DC that follows the conference. Conference results will be further disseminated at relevant conferences, in publications, and through online discussions. A full evaluation process will inform the detailed planning of the conference and will evaluate the effectiveness of the conference, based on responses from conference participants.