BISE’s NVivo database includes all of the coding applied by the BISE team based on the BISE Coding Framework. This includes codes that were applied to specific sections of a report (referred to as “nodes” in Nvivo) and codes that were applied to an entire report (referred to as “attributes” in Nvivo). For Mac or NVivo 9 versions, visit the VSA website at http://www.visitorstudies.org/bise.
Collaboration is a prerequisite for the sustainability of interagency programs, particularly those programs initially created with the support of time-limited grant-funding sources. From the perspective of evaluators, however, assessing collaboration among grant partners is often difficult. It is also challenging to present collaboration data to stakeholders in a way that is meaningful. In this article, the authors introduce the Levels of Collaboration Scale, which was developed from existing models and instruments. The authors extend prior work on measuring collaboration by exploring the
DATE:
TEAM MEMBERS:
Bruce FreyJill LohmeierStephen LeeNona Tollefson
Educational assessment systems are frequently challenged by divergent stakeholder needs. A major insight from experts who work on school assessment systems is the need to clearly articulate and evaluate assessment choices in relation to these distinct goals. The out-of-school STEM ecosystem faces similar challenges. This background paper presents ideas for new assessment methodologies that include biographical and narrative approaches, measures of sustained learning, and social network representations to complement more traditional approaches that capture average effects of a particular
More and more young people are learning about science, technology, engineering, and mathematics (STEM) in a wide variety of afterschool, summer, and informal programs. At the same time, there has been increasing awareness of the value of such programs in sparking, sustaining, and extending interest in and understanding of STEM. To help policy makers, funders and education leaders in both school and out-of-school settings make informed decisions about how to best leverage the educational and learning resources in their community, this report identifies features of productive STEM programs in
One challenge in scaling up effective educational programs is how to adjust implementation to local contexts. One solution that the authors Penuel, Fishman, Cheng, and Sabelli propose is “design-based implementation research,” (DBIR) in which researchers and practitioners collaboratively identify problems and strategies during implementation while learning from this process to support innovations in new contexts.
The Dimensions of Success (DoS) observation tool defines and provides rubrics (with levels 1-4) for 12 dimensions that were developed to measure STEM program quality in out-of-school time. This technical report summarizes the development of the instrument and findings from our initial study that included 284 observations in the field across 58 STEM programs in two geographic regions (New England and the Midwest). Data were collected by 46 trained observers who observed in pairs. This report is the initial step in developing a validity argument for the instrument.
DATE:
TEAM MEMBERS:
Ashima Mathur ShahCaroline WylieDrew Gitomer
The Dimensions of Success observation tool, or DoS, pinpoints twelve indicators of STEM program quality in out-of-school time. It was developed and studied with funding from the National Science Foundation (NSF) by the Program in Education, Afterschool and Resiliency (PEAR), along with partners at Educational Testing Service (ETS) and Project Liftoff. In 2014, a technical report was released, describing the tool and its psychometric properties (http://www.pearweb.org/research/pdfs/DoSTechReport_092314_final.pdf). The DoS observation tool focuses on understanding the quality of a STEM activity in an out-of-school time learning environment and includes an explanation of each dimension and its key indicators, as well as a 4-level rubric with descriptions of increasing quality. Today, over 700 people have been trained to use the DoS tool, and over 12 state networks have adopted DoS to measure the quality of their afterschool STEM programming.
DATE:
-
TEAM MEMBERS:
Program in Education, AfterschoolDr. Ashima ShahDrew Gitomer
Concord Evaluation Group (CEG) conducted an evaluation study to learn about the Future City’s impact on students as well as to discover ways to enhance Future City for future implementation. In addition to exploring the program’s impacts, with this study we also had an opportunity to explore potential differences between students who compete at their Regional competitions only versus students who make it to the National competition. In collaboration with DiscoverE, CEG developed four surveys to collect feedback from students, parents, educators, and engineer mentors. These data collection
National Engineers Week Foundation (EWeek) hired Concord Evaluation Group (CEG) in 2011 to conduct an independent evaluation of the Future City program (http://futurecity.org). Future City has been operating since 1992. According to EWeek, the Future City program is “a national, project-based learning experience where students in 6th, 7th, and 8th grade imagine, design, and build cities of the future. Students work as a team with an educator and engineer mentor to plan cities using SimCityTM 4 Deluxe software; research and write solutions to an engineering problem; build tabletop scale models
This article explains the concepts of disruptive innovation and catalytic innovation, a subset of disruptive innovation. Disruptive innovations challenge industry incumbents by offering simpler, good-enough alternatives to an underserved group of customers, whereas catalytic innovations can surpass the status quo by providing good-enough solutions to inadequately addressed social problems.
DATE:
TEAM MEMBERS:
Clayton ChristensenHeather BaumannRandy RugglesThomas Sadtler
The issue of “scale” is a key challenge for school reform, yet it remains undertheorized in the literature. Definitions of scale have traditionally restricted its scope, focusing on the expanding number of schools reached by a reform. Such definitions mask the complex challenges of reaching out broadly while simultaneously cultivating the depth of change necessary to support and sustain consequential change. This article draws on a review of theoretical and empirical literature on scale, relevant research on reform implementation, and original research to synthesize and articulate a more
In the paper I argue for a certain way of theorizing and studying learning. Learning is seen as situated in social practice, and in the pursuit of most learning persons are seen as moving around in social practice. They are involved in personal trajectories across various social contexts of practice. Even more so, these social contexts and the links between them, which persons learning draw on in their pursuit of learning, are institutionally arranged in various ways, and this affects the opportunities and nature of learning processes. These arguments about the nature of learning, theories of