This brief discusses the PLUM LANDING Explore Outdoors Toolkit, a new set of free, public media resources designed to help informal educators and parents infuse science learning into outdoor recreation. Developed by trusted media producer WGBH in partnership with researchers at Education Development Center (EDC), the Toolkit aims to get children (ages 6–9) from low-income, urban communities outside so they can explore the environment around them while debunking the myth that nature is something that only exists beyond city limits.
DATE:
TEAM MEMBERS:
Marion GoldsteinElizabeth PiersonJamie KynnLisa Famularo
Youth environmental education (EE) programs often serve as gateway experiences in which diverse audiences engage in informal science learning. While there is evidence that these programs can have positive impacts on participants, little empirical research has been conducted to determine what makes one program more successful than another. To be able to conduct such research, this Exploratory Pathways study will (1) develop and statistically validate ways to measure meaningful outcomes for participants across a variety of programs and (2) test observational methods that will enable research that can determine which elements of program delivery most powerfully influence participant engagement and learning outcomes in different contexts. These efforts will include consultations with diverse subject matter experts from the National Park Service, nature centers, and academia; survey research with participants in afterschool and free-choice EE programs; and observations of EE programs designed to fine tune the measurement of program delivery elements and student engagement. Developing valid and reliable outcomes measures and observational protocols will enable a larger investigation that will specifically address the following research question: What program characteristics lead to the best learning outcomes for program participants in different contexts? This research will result in empirically tested guidelines that will enable educators to design and deliver more effective programs for a wide range of audiences in a wide range of contexts. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This effort will refine methods necessary to undertake an unprecedented study (and future AISL Research in Service to Practice proposal) to examine the linkages between pedagogical approaches, participant engagement, and learning outcomes in informal STEM-focused youth EE programs. The larger study will involve systematically observing a large number of programs to assess the use of different approaches and to link those approaches to engagement and learning outcomes through both observation and survey research. In this current study the team will develop and refine crosscutting outcome measures to ensure validity, reliability, and sensitivity by drawing upon the literature and consultation with key stakeholders to develop suites of indicators for subsequent psychometric testing and revision. They will also refine observational techniques for assessing pedagogical approaches through extensive testing of inter-rater reliability. Finally, techniques for measuring participant engagement, incorporating both observational techniques and retrospective participant surveys will be refined. The work will be conducted by researchers at Clemson University and Virginia Tech, in partnership with the U.S. National Park Service, the North American Association for Environmental Education, and the American Association of Nature Center Administrators. This work represents the first step in a longer research process to determine the "best practices" most responsible for achieving outcomes in a wide range of contexts.
Scientific literacy is an important educational and societal goal. Measuring scientific literacy, however, has been problematic because there is no consensus regarding the meaning of scientific literacy. Most definitions focus on the content and processes of major science disciplines, ignoring social factors and citizens’ needs. The authors developed a definition of scientific literacy for the California 4-H Program from the citizen’s perspective, concentrating on real-world science-related situations. The definition includes four anchor points: science content; scientific reasoning skills
This technical report summarizes the statistical analyses used to determine how well the Measuring Activation (MA) instrument developed through the Science Learning Activation Lab project gathers appropriate information about the five dimensions of activation. The MA instrument was designed to evaluate the impact of science-learning programs and experiences on activation, and contains a series of survey items organized around five identified dimensions of activation. The five dimensions of activation are: fascination, values, perceived autonomy, competency beliefs, and scientific sensemaking.
Discusses the objectives of Outdoor Biology Instructional Strategies (OBIS), one aspect of the program (lawn communities) and the evaluation of this activity. Includes resultant recommendations. The evaluation criteria are suggested as a model to be used in either designing or in evaluating curricula.
DATE:
TEAM MEMBERS:
University of California-BerkeleyJohn H Falk
LOOP is a new multiplatform, environmental project designed to help young children, ages 6-8, explore ecosystems and understand the science and systems of the natural world. Built upon a curriculum that moves beyond the 3Rs (reduce, reuse, recycle), the goal is to help lay the foundation for a lifelong interest in the science of sustainability. Deliverables include: a 20-episode television series with animated stories and live-action segments which feature families and children; an online game to immerse players in the same ecosystems seen on television; Loop Live Missions (outdoor science activities); and an afterschool/camp curriculum designed to get children and families outside to explore natural systems. Promotion of LOOP's educational resources will be undertaken through a partner network including the U.S. Forest Service, Children & Nature Network, National Recreation and Park Association, American Camp Association, National Summer Learning Association, Girl Scouts of the USA, and the Boys & Girls Clubs of America. LOOP is produced by WGBH in Boston and intended for national distribution on PBS. The project design creates an "interactive learning loop" which cycles between the television series, the Website, and outdoor science activities. The intended impacts are to: (1) deliver educational media to the target audience that increases their understanding of science and sustainability issues; (2) model and teach science concepts and scientific habits of mind; and (3) connect children and their families to the natural world. Concord Evaluation Group will be responsible for conducting formative and summative evaluation of the project. The summative evaluation is designed to measure project impacts with respect to change in behavior and attitudes, as well as science learning. The results of the evaluation will inform the curriculum for the current and future seasons of LOOP and contribute to the growing knowledge base of how media can effectively promote and teach substantive science to the young.