Educational assessment systems are frequently challenged by divergent stakeholder needs. A major insight from experts who work on school assessment systems is the need to clearly articulate and evaluate assessment choices in relation to these distinct goals. The out-of-school STEM ecosystem faces similar challenges. This background paper presents ideas for new assessment methodologies that include biographical and narrative approaches, measures of sustained learning, and social network representations to complement more traditional approaches that capture average effects of a particular
Supported by a grant from the National Science Foundation (NSF), with additional support from the Giant Screen Cinema Association (GSCA) and the Association of Science-Technology Centers (ASTC), GSCA hosted the Setting the Agenda for Giant Screen Research Workshop on October 18, 2013, in Albuquerque, New Mexico. The one-day Workshop convened a group of 32 giant screen (GS) stakeholders, immersive practitioners, academic researchers and GS-industry affiliated experts to consider the key issues for a GS research roadmap. The Workshop goals, as outlined in the conference proposal submitted to the
DATE:
TEAM MEMBERS:
Giant Screen Cinema Association (GSCA)Mary Nucci
This report is a product of the Setting the Agenda for Giant Screen Research Workshop held October 18, 2013 in Albuquerque, NM, which grew out of many years of discussions about the potential of the giant screen (GS) format to educate, engage and entertain, and in response to the multiple calls for research on GS films. Over the course of one day, invited participant thought leaders representing GS filmmakers, marketers, exhibitors and distributors joined with immersive practitioners and academic researchers to identify the key research questions for a GS research agenda. However, as the term
DATE:
TEAM MEMBERS:
Giant Screen Cinema Association (GSCA)Mary Nucci
Fusion Science Theater (FST) uses elements of playwriting to make informal science education more engaging as well as educational. FST shows incorporate an overarching scientific question that is asked and then answered by a series of participatory exercises and demonstrations. The shows also use “embedded assessment” of learning, which asks children to “vote their prediction” both before and after these activities. The FST National Training and Dissemination Program had three major goals: (1) To develop and implement a Performance Training Program to train professional audiences to perform
DATE:
TEAM MEMBERS:
Madison Area Technical CollegeJoanne Cantor
Mythbusters: The Explosive Exhibition is a traveling exhibit based on the popular television show. When housed at the Museum of Science and Industry, Chicago, it included a traditional, interactive free flow exhibition space followed by a live facilitated show. This paper describes results from an experimental study about the effects of the Live Show on the learning of and attitudes towards science. A pre-test was given to 333 children entering the exhibit. A post-test was given to 80 children after they walked through the free-flow portion of the exhibit and to 191 children after they watched
DATE:
TEAM MEMBERS:
Museum of Science and IndustryAaron Price
More and more young people are learning about science, technology, engineering, and mathematics (STEM) in a wide variety of afterschool, summer, and informal programs. At the same time, there has been increasing awareness of the value of such programs in sparking, sustaining, and extending interest in and understanding of STEM. To help policy makers, funders and education leaders in both school and out-of-school settings make informed decisions about how to best leverage the educational and learning resources in their community, this report identifies features of productive STEM programs in
One challenge in scaling up effective educational programs is how to adjust implementation to local contexts. One solution that the authors Penuel, Fishman, Cheng, and Sabelli propose is “design-based implementation research,” (DBIR) in which researchers and practitioners collaboratively identify problems and strategies during implementation while learning from this process to support innovations in new contexts.
In the last two years SISSA Medialab designed, tested and evaluated two projects aiming at empowering children (in one case) and teenagers (in the other) to act as science journalists in order to promote a personal, critical attitude towards science and technology. The two groups produced a paper magazine and a blog, respectively, in a participatory process, in which adults acted as facilitators and experts on demand, but the youths were the leaders and owners of the products. Special care was taken to ensure inclusiveness, by involving in the project children and teenagers from any social
The Dimensions of Success (DoS) observation tool defines and provides rubrics (with levels 1-4) for 12 dimensions that were developed to measure STEM program quality in out-of-school time. This technical report summarizes the development of the instrument and findings from our initial study that included 284 observations in the field across 58 STEM programs in two geographic regions (New England and the Midwest). Data were collected by 46 trained observers who observed in pairs. This report is the initial step in developing a validity argument for the instrument.
DATE:
TEAM MEMBERS:
Ashima Mathur ShahCaroline WylieDrew Gitomer
The Dimensions of Success observation tool, or DoS, pinpoints twelve indicators of STEM program quality in out-of-school time. It was developed and studied with funding from the National Science Foundation (NSF) by the Program in Education, Afterschool and Resiliency (PEAR), along with partners at Educational Testing Service (ETS) and Project Liftoff. In 2014, a technical report was released, describing the tool and its psychometric properties (http://www.pearweb.org/research/pdfs/DoSTechReport_092314_final.pdf). The DoS observation tool focuses on understanding the quality of a STEM activity in an out-of-school time learning environment and includes an explanation of each dimension and its key indicators, as well as a 4-level rubric with descriptions of increasing quality. Today, over 700 people have been trained to use the DoS tool, and over 12 state networks have adopted DoS to measure the quality of their afterschool STEM programming.
DATE:
-
TEAM MEMBERS:
Program in Education, AfterschoolDr. Ashima ShahDrew Gitomer
Plum Landing (https://pbskids.org/plumlanding/) is produced by WGBH Educational Foundation (http://wgbh.org), the Public Broadcasting Service affiliate based in Boston, MA. The website, Plum Landing, follows the adventures of an animated space alien, named Plum, after her spaceship crash-lands on Earth. With funding from the National Science Foundation, the Corporation for Public Broadcasting, The Kendeda Fund, and the Northern Research Station, Forest Service, U.S. Department of Agriculture. WGBH worked closely with a panel of science advisors to create an “innovative, environmental science
This article explains the concepts of disruptive innovation and catalytic innovation, a subset of disruptive innovation. Disruptive innovations challenge industry incumbents by offering simpler, good-enough alternatives to an underserved group of customers, whereas catalytic innovations can surpass the status quo by providing good-enough solutions to inadequately addressed social problems.
DATE:
TEAM MEMBERS:
Clayton ChristensenHeather BaumannRandy RugglesThomas Sadtler