As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This project will develop and research an integrated children's media and early childhood educator professional development strategy to prepare preschoolers with social-emotional skills that provide a foundation for later math learning success. The social-emotional skills include persistence, risk-taking, regulating anxieties, and collaborating to solve problems. Media components include Peg+Cat television episodes, videos, games and apps distributed through PBS broadcast and online. The integrated professional development model is designed to impact these educators' understanding of math and develop their skills for fostering in children a positive math mindset. Additional resources include a new Peg+Cat summer day camp at the Carnegie Science Center in Pittsburgh. The project partners include a media company, The Fred Rogers Company; researchers at the University of Pittsburgh and St. Vincent College; and the evaluator, Rockman et al. This project is unique in its focus on integrating social-emotional skills with early math learning and educator skill development. It will fill an important niche in the research literature and has the potential to impact media practice which is undergoing significant change as new digital tools and technologies become available for learning. Both standardized and researcher-developed measures will be used to assess learning outcomes, including early childhood educators' attitudes and quality of instruction, as well as children's interest and engagement in math. The research design includes iterative data collection to inform the development and refinement of the professional learning for teachers. The mixed methods approach will include classroom observations, interviews and focus groups with educators, and parent questionnaires. Key questions include: does exposure to Peg+Cat positively relate to children's use of social-emotional skills during math learning activities? Does educators' exposure to the professional development training improve their attitudes and abilities to infuse math instruction with social-emotional skills? Does having an educator who received Peg+Cat training impact children's engagement and interest in math?
The Next Generation Science Standards (NGSS) identify an ambitious progression for learning energy, beginning in elementary school. To help the nation's teachers address this challenge, this project will develop and investigate the opportunities and limitations of Focus on Energy, a professional development (PD) system for elementary teachers (grades 3-5). The PD will contain: resources that will help teachers to interpret, evaluate and cultivate students' ideas about energy; classroom activities to help them to identify, track and represent energy forms and flows; and supports to help them in engaging students in these activities. Teachers will receive the science and pedagogical content knowledge they need to teach about energy in a crosscutting way across all their science curricula; students will be intellectually engaged in the practice of developing, testing, and revising a model of energy they can use to describe phenomena both in school and in their everyday lives; and formative assessment will guide the moment-by-moment advancement of students' ideas about energy. This project will develop and test a scalable model of PD that will enhance the ability of in-service early elementary teachers to help students learn energy concepts by coordinating formative assessment, face-to-face and web-based PD activities. Researchers will develop and iteratively refine tools to assess both teacher and student energy reasoning strategies. The goals of the project include (1) teachers' increased facility with, and disciplined application of, representations and energy reasoning to make sense of everyday phenomena in terms of energy; (2) teachers' increased ability to interpret student representations and ideas about energy to make instructional decisions; and (3) students' improved use of representations and energy reasoning to develop and refine models that describe energy forms and flows associated with everyday phenomena. The web-based product will contain: a set of formative assessments to help teachers to interpret student ideas about energy based on the Facets model; a series of classroom tested activities to introduce the Energy Tracking Lens (method to explore energy concept using multiple representations); and videos of classroom exemplars as well as scientists thinking out loud while using the Energy Tracking Lens. The project will refine the existing PD and build a system that supports online implementation by constructing a facilitator's guide so that the online community can run with one facilitator.
DATE:
-
TEAM MEMBERS:
Sara LacyRoger TobinNathaniel BrownStamatis VokosRachel ScherrKara GrayLane SeeleyAmy Robertson
This is the final report of the Open University’s RCUK-funded Public Engagement with Research Catalyst, ‘An open research university’, a project designed to create the conditions in which engaged research can flourish. The report describes an evidence-based strategy designed to embed engaged research within the University’s strategic planning for research and the operational practices of researchers. This programme of organisational change was informed by action research, working collaboratively with researchers at all levels across the institution to identify and implement strategies that
DATE:
TEAM MEMBERS:
Richard HollimanAnne AdamsTim BlackmanTrevor CollinsGareth DaviesSally DibbAnn GrandRichard HoltiFiona McKerlieNick MahonyNick Mahony
There are a number of places evaluators can share their reports with each other, such as the American Evaluation Association’s eLibrary, the website informalscience.org, and organizations’ own websites. Even though opportunities to share reports online are increasing, the evaluation field lacks guidance on what to include in evaluation reports meant for an evaluator audience. If the evaluation field wants to learn from evaluation reports posted to online repositories, how can evaluators help to ensure the reports they share are useful to this audience? This paper explores this question through
Through "Addressing the Science of Really Gross Things: Engaging Young Learners in Biomedical Science Through a Fulldome Planetarium Show and Supporting Curricula," Morehead Planetarium and Science Center at the University of North Carolina at Chapel Hill, in close collaboration with NIH-funded researchers at the UNC and a leading children's book author, will develop an informal science education media project and a suite of hands-on, inquiry-based curricula based on the media project for use in science centers, museums and schools. This project will build the pipeline of future researchers and create awareness of NIH-funded research by generating interest and excitement among children age 9-13 in the health sciences and related careers and building their science content knowledge. To achieve the objective, the investigators will develop a fulldome planetarium show; create correlating curricula for summer camps, afterschool programs, scout programs, science center field trips, science clubs and schools; and produce a DVD highlighting careers in the health sciences. In addition, the project will use several methods to target populations traditionally underrepresented in the biomedical fields, including featuring professionals from underrepresented populations in the multimedia and curricula products, making outreach visits to counties with large populations traditionally underrepresented in health science research careers, and producing a Spanish-language version of the products. The use of a known brand, "Grossology," is an innovative way to connect to children in the target age range and to encourage the informal science education community to embrace health-science content in their fulldome theaters. In addition, the project's hub-and-spoke approach further encourages adoption of this programming by providing informal science venues with both an engaging experience (hub) and the supporting curricula (the spokes) that is necessary to extend the show's potential for having significant educational impact. A strong project team maximizes the project's likelihood for success. The team includes fulldome producers and educators from Morehead and NIH-funded researchers with expertise in appropriate science content areas. In addition, the investigators have created a network of consultants, advisory board members and evaluators that will create feedback loops designed to ensure high-quality, scientifically-accurate, educationally-effective products. The investigators will use a combination of free and revenue-based dissemination strategies to ensure that the products of this award are broadly distributed. These strategies hold significant promise for creating broad use of this project's products in the nation's science centers, museums and classrooms.
MEDMYST: Dissemination Phase II A Phase I grant, The Reconstructors Investigate Medical Mysteries, from the National Center for Research Resources (R25 RR15295) funded the creation and field-test of innovative web-based materials targeted for middle school students. The product has come to be known as MEDMYST.It is an episodic adventure series with accompanying classroom activities focusing on infectious diseases and the microbes that cause them. The MEDMYST materials consist of: a) web adventures; b) classroom activities; c) MEDMYST Magazine--all designed to engage students in problem-solving activities not likely to be encountered elsewhere. Each of these components is available free of charge on the web site (http://medmyst.rice.edu) and all components are aligned with the National Science Education Content Standards. An extensive field test involving over 700 students from 9 different schools tested the efficacy of these materials. The results, accepted for publication in American Society for Microbiology's Microbiology Education journal, indicated significant learning gains with exposure to the Internet component of the materials. In this Phase II application, the goals are: 1) To create a network of MEDMYST Dissemination Partners and Lead Teachers whose expertise and training will continue beyond the SEPA funding. 2) To amplify teaching of Infectious Disease related concepts though MEDMYST in middle school classrooms by training a minimum of 1200 teachers, who will teach approximately 150,000 students over a two-year period. 3) To evaluate the impact of MEDMYST teacher training and document the adoption process in classrooms. 4) To continue to promote MEDMYST in a variety of educational settings, such as homes, after-school programs, museums, and with links from other web sites. To accomplish these goals, we have formed partnerships with the University of Washington Educational Outreach, The Minnesota Science Museum, the John P. McGovern Museum of Health ad Medical Science, and the American Society for Microbiology.
KY-H.E.R.O.S. (Health Education Rural Outreach Scientists) is a health science education program that partners the largest science center in Kentucky with Science Heroes-- important regional biomedical research scientists. The Science Heroes, their stories and their studies serve as inspiration to our rural audience. The project objectives are to: (1) Convey the relevance of health science research to people's daily lives and promote awareness of healthy lifestyle choices and wellness; (2) Promote understanding of the fundamental principles of the scientifc process and inspire K-12 teachers to incorporate current research into their teaching of health science; and (3) Encourage students to pursue advanced science education and increase awareness of the wide range of health science related careers. The Science Center, working with the distinguished Science Heroes, their research teams and a group of 15 knowledgeable professional advisors will develop the new KY-H.E.R.O.S. science education program. The program will include new hands-on labs and demonstrations, teacher training workshops, career exploration activities, interactive videoconferencing distance learning links, and innovative public programs. Using museum-based exhibits and a wet lab, traveling exhibit components, telelinking (distance learning), an interactive website and printed and electronic materials, we will present information about the work of the Science Heroes and its relevance to the lives of participants. The focus of the program will change every two years to feature three different scientists and their work. A total of nine scientists will be included during the 5 year period covered by the SEPA grant. As the focus changes every two years to a different three scientists, all the programs and exhibits will be changed accordingly. KY-H.E.R.O.S. will be designed to serve audiences composed of school groups on field trips; teachers in workshops; classes in remote areas of the state participatng through videoconferencing; underserved groups including economically disadvantaged, minorities and young women; and the family audience that makes up about 60% of the Science Center's annual attendance. Formative and summative evaluation will be conducted by an outside firm to ensure effectiveness.
Children's Hospital Oakland Research Institute (CHORI), in collaboration with the Hall of Health, a hands-on health museum, proposes a two year, Phase II SEPA project entitled Health and Biomedical Science for a Diverse Community. The purpose of this project is to disseminate (1) "Your Genes and Your Choices," a unique, interactive exhibit on social and genetic factors in health, and (2) a 4th and 5th grade health and biomedical science curriculum. The exhibit and curriculum were developed during Phase I. "Your Genes and Your Choices, "which has eight interactive stations and has been piloted at the Hall of Health, is designed for small science museums and health education centers. It will travel to four venues nationwide during Phase II and remain available to other venues after the grant ends. The innovative, activity based curriculum consists of eight instructional units that introduce students to scientific concepts and investigation in the context of the study of diseases and health conditions that disproportionately affect minority populations. The topics are: Fourth Grade: Unit 1: Nutrition: Balance and Imbalance (Obesity); Unit 2. Traumatic Brain Injuries; Unit 3. Infectious Diseases and Immunity; Unit 4. Environmental Toxics: Poisoning Prevention. Fifth Grade: Unit 1. Nutrition: Diabetes; Unit 2. Asthma and Lung Disease; Unit 3. Heart Disease; and Unit 4. Sickle Cell Anemia and Genetics. Each unit consists of five one hour lessons. The curriculum was piloted during Phase I, both in the classroom and in an after school science club, at two elementary schools serving predominantly minority children in Oakland, California. Now we propose to: (1) disseminate the curriculum via science clubs to ten elementary schools in Oakland and Berkeley; (2) offer a series of educator workshops to enhance the skills of teachers and after school personnel to teach scientific investigation and to incorporate the latest findings in biomedical science across the curriculum; and 3) hold family science festivals at each participating school to introduce parents to the topics of the science clubs. The festivals will include hands-on activities, talks by CHORI researchers, and focused discussions with healthcare providers on issues relating to minority health. This project involves clinical as well as basic science investigators, healthcare providers, teachers and health educators, high school and college students, and faculty from San Francisco State University and the University of California at Berkeley. The ultimate goals are to make science interesting and relevant to children who come from ethnically diverse, low income environments; to help them meet state and national objectives for learning in health, science, and scientific inquiry; to help them and their parents understand the relationship between science and health; and to foster their interest in science, so that they may consider future careers related to biomedical science. All project activities will be assessed through formative and summative evaluation. The science clubs will remain in place at the ten participating schools after Phase II funding ends, and the curriculum and evaluation tools will be posted on the internet, and thereby available to others.
Children's Hospital Oakland Research Institute (CHORI), in collaboration with the Hall of Health, a hands-on health museum, proposes a three-year Phase I SEPA project entitled "Health and Biomedical Science for a Diverse Community." The project entails development of a novel, interactive biomedical science curriculum for 4th and 5th grade students in low socioeconomic environments. Complementary to the curriculum, a hands-on exhibit on social and genetic factors in health will be developed to enhance learning by students and families. The curriculum and exhibit will be pilot tested with students from two elementary schools in Oakland, California. The curriculum--which will specifically address minority health issues such as asthma, obesity, diabetes, and heart disease--will include four five-lesson instructional units for 4th grade, and four five-lesson instructional units for 5th grade. In addition to classroom activities, the project will include workshops for teachers, family health and biomedical science nights, field trips to the Hall of Health, and an annual health and biomedical science festival for families. The project will involve clinical as well as basic science investigators, patients and families, and high school and college students. It will draw on the talents of teachers and health educators from the Oakland Unified School District, directors of SEPA projects at the Exploratorium in San Francisco and Lawrence Hall of Science in Berkeley, faculty at San Francisco State University and the University of California at Berkeley, and employees of LeapFrog, Inc., a company located in Emeryville, California, that makes interactive educational products. The ultimate goals of the project are to make science interesting and relevant to children who come from ethnically diverse, low socio-economic environments, to help them and their parents understand the relationship between science and health, and to foster their interest in science so that they may consider future opportunities in careers related to biomedical science. All project activities will undergo front-end, formative, and summative evaluation.
As Kathleen Enright rightly stated in the opening article of this issue: “Until all participants in the evaluation chain embrace and support a learning focus, I think our ability to use evaluation results to increase impact will be limited.” As grantmakers, we arguably play the most important role in ensuring that all stakeholders receive the support they need to be full participants, contributors, learners and beneficiaries of an evaluation process. For evaluation to be worth the money and time we spend on it, everyone needs to be a full participant — funders, grantee organizations and even
This annotated bibliography provides selected references regarding multiculturalism and cultural competence in evaluation. It contains a section listing more recent publications dating beyond 2007.
CDC provides its funded programs with a wide range of evaluation resources and guides. State health departments, tribal organizations, communities, and partners working in a variety of public health areas may also find these tools helpful. The resources provide guidance on evaluation approaches and methods, relevant examples, and additional resources. The guides are intended to aid in skill building on a wide range of evaluation topics. Practical Strategies for Culturally Competent Evaluation is designed to complement the other evaluation resources offered by the Division for Heart Disease and
DATE:
TEAM MEMBERS:
Centers for Disease Control and Prevention (CDC)Derrick GervinRobin KuwaharaRashon LaneSarah GillRefilwe MoetiMaureen Wilce