There are a number of places evaluators can share their reports with each other, such as the American Evaluation Association’s eLibrary, the website informalscience.org, and organizations’ own websites. Even though opportunities to share reports online are increasing, the evaluation field lacks guidance on what to include in evaluation reports meant for an evaluator audience. If the evaluation field wants to learn from evaluation reports posted to online repositories, how can evaluators help to ensure the reports they share are useful to this audience? This paper explores this question through
Through "Addressing the Science of Really Gross Things: Engaging Young Learners in Biomedical Science Through a Fulldome Planetarium Show and Supporting Curricula," Morehead Planetarium and Science Center at the University of North Carolina at Chapel Hill, in close collaboration with NIH-funded researchers at the UNC and a leading children's book author, will develop an informal science education media project and a suite of hands-on, inquiry-based curricula based on the media project for use in science centers, museums and schools. This project will build the pipeline of future researchers and create awareness of NIH-funded research by generating interest and excitement among children age 9-13 in the health sciences and related careers and building their science content knowledge. To achieve the objective, the investigators will develop a fulldome planetarium show; create correlating curricula for summer camps, afterschool programs, scout programs, science center field trips, science clubs and schools; and produce a DVD highlighting careers in the health sciences. In addition, the project will use several methods to target populations traditionally underrepresented in the biomedical fields, including featuring professionals from underrepresented populations in the multimedia and curricula products, making outreach visits to counties with large populations traditionally underrepresented in health science research careers, and producing a Spanish-language version of the products. The use of a known brand, "Grossology," is an innovative way to connect to children in the target age range and to encourage the informal science education community to embrace health-science content in their fulldome theaters. In addition, the project's hub-and-spoke approach further encourages adoption of this programming by providing informal science venues with both an engaging experience (hub) and the supporting curricula (the spokes) that is necessary to extend the show's potential for having significant educational impact. A strong project team maximizes the project's likelihood for success. The team includes fulldome producers and educators from Morehead and NIH-funded researchers with expertise in appropriate science content areas. In addition, the investigators have created a network of consultants, advisory board members and evaluators that will create feedback loops designed to ensure high-quality, scientifically-accurate, educationally-effective products. The investigators will use a combination of free and revenue-based dissemination strategies to ensure that the products of this award are broadly distributed. These strategies hold significant promise for creating broad use of this project's products in the nation's science centers, museums and classrooms.
The primary purpose of the proposed grant is to support the dissemination and institutionalization of a model of educational partnerships among academic medical centers, undergraduate colleges, and local school systems. This model was created under the umbrella of AAMC's Project 3000 by 2000 . With support from SEPA, during 1994-1997 we will consolidate and extend the accomplishments we achieved under our original SEPA, 1991-1994 (SEPA-I). In 1991, the AAMC began Project 3000 by 2000 . The activities included in this proposal support Project 3000 by 2000 , but are not designed to only recruit students for medical school. Minority underrepresentation in medical schools largely is due to the same fundamental problem that causes minority underrepresentation in health-related Ph.D. programs: an insufficient number of minority students receive adequate academic preparation-especially in the sciences-prior to college. The projects proposed here are designed to address this basic problem and hence promote greater racial and ethnic diversity in all of the health sciences. Eight programmatic activities are proposed, five of which were initiated during SEPA I: (1) The annual publication of the Secondary School Science Minority Achievement Registry (S 3 MAR) , a directory of educational programs for minority students interested in the health sciences and a registry of the students participating in them; (2) NNHeSPA News , the quarterly newsletter of the National Network for Health Science Partnerships ( NNHeSPA) ; (4) An update of the Project 3000 by 2000 Technical Assistance Manual (Volume II); (5) Presentations to a wide variety of groups and strategically targeted customized data analysis. New projects include: (6) NNHeSPA On Line!, a computer bulletin board accessible through the Internet to facilitate ongoing communication among precollege, college and graduate health science educators in NNHeSPA ; (7) S 3 MAR Grapevine , a quarterly newsletter for high school stuents listed in the S 3 MAR ; (8) Intensive regional campaigns to promote health science partnerships in California, Texas, and the South-three areas of the country with large minority populations and severe problems of underrepresentation.
Goals: 1) Increase the number of Alaskans from educationally and/or economically disadvantaged backgrounds, particularly Alaska Natives, who pursue careers in health sciences and health professions and 2) Inform the Alaskan public about health science research and the clinical trial process so that they are better equipped to make healthier lifestyle choices and better understand the aims and benefits of clinical research. Objectives: 1) Pre-med Summer Enrichment program (U-DOC) at UAA (pipeline into college), 2) Statewide Alaska Student Scientist Corps for U-DOC, 3) students (pipeline into college), 4) Facility-based Student Science Guide program at Imaginarium Science Discovery Center, 5) Job Shadowing/Mentorship Program for U-DOC students and biomedical researchers, 6) Research-based and student-led exhibit, demonstration, and multi-media presentations, 7) Professional Development for educators, 8) North Star Website.
In January 2006, the Dolan DNA Learning Center launched its SEPA Phase I project: Inside Cancer, a media-rich internet site that examines the molecular genetic basis of cancer. We now propose a Phase II Project, which will employ a six-part strategy to broadly disseminate the site and evaluate its use as a resource in high school biology and health education. a) A partnership will disseminate the site to 800 secondary science teachers at one-day workshop held at 20 sites nationwide. This cost-effective program will focus on key concepts and relevant teaching standards, and also provide a dedicated base for conducting second-round training and evaluation activities. b) An online Teacher Center will allow teachers to develop custom multimedia lessons based on Inside Cancer materials. Key features will be a Concept Matrix, Lesson Exchange, and Atomizer, which will match content with teaching standards, facilitate a community approach to lesson plan development, and provide a searchable interface of over 3,000 multimedia content "atoms." c) Fellowships will allow three lead faculty to work directly with DNALC staff to develop the Teacher Center and model lesson plans (DNALC Fellows). Eighty workshop alumni will serve as Regional Fellows and receive stipends to conduct second-round training activities reaching 640 additional teachers. d) An annual review will assess fidelity to project objectives and analyze site logs to detect patterns of use. An online survey of 1,500 Inside Cancer users annually will assess differences in site use among teachers, students, science and medical professionals, and the general public. e) A longitudinal evaluation of 1,440 participants in workshops and second-round activities will gauge how teachers use Inside Cancer and the Teacher Center, and how their teaching behavior changes over time. f) A controlled study will compare attitudinal and learning effects among 280 high school students - half of whom use Inside Cancer in their classes an half who don't. Biology and health classes will be selected from a single school district that reflects the ethnic and racial distribution of the U.S. population.
MEDMYST: Dissemination Phase II A Phase I grant, The Reconstructors Investigate Medical Mysteries, from the National Center for Research Resources (R25 RR15295) funded the creation and field-test of innovative web-based materials targeted for middle school students. The product has come to be known as MEDMYST.It is an episodic adventure series with accompanying classroom activities focusing on infectious diseases and the microbes that cause them. The MEDMYST materials consist of: a) web adventures; b) classroom activities; c) MEDMYST Magazine--all designed to engage students in problem-solving activities not likely to be encountered elsewhere. Each of these components is available free of charge on the web site (http://medmyst.rice.edu) and all components are aligned with the National Science Education Content Standards. An extensive field test involving over 700 students from 9 different schools tested the efficacy of these materials. The results, accepted for publication in American Society for Microbiology's Microbiology Education journal, indicated significant learning gains with exposure to the Internet component of the materials. In this Phase II application, the goals are: 1) To create a network of MEDMYST Dissemination Partners and Lead Teachers whose expertise and training will continue beyond the SEPA funding. 2) To amplify teaching of Infectious Disease related concepts though MEDMYST in middle school classrooms by training a minimum of 1200 teachers, who will teach approximately 150,000 students over a two-year period. 3) To evaluate the impact of MEDMYST teacher training and document the adoption process in classrooms. 4) To continue to promote MEDMYST in a variety of educational settings, such as homes, after-school programs, museums, and with links from other web sites. To accomplish these goals, we have formed partnerships with the University of Washington Educational Outreach, The Minnesota Science Museum, the John P. McGovern Museum of Health ad Medical Science, and the American Society for Microbiology.
As Kathleen Enright rightly stated in the opening article of this issue: “Until all participants in the evaluation chain embrace and support a learning focus, I think our ability to use evaluation results to increase impact will be limited.” As grantmakers, we arguably play the most important role in ensuring that all stakeholders receive the support they need to be full participants, contributors, learners and beneficiaries of an evaluation process. For evaluation to be worth the money and time we spend on it, everyone needs to be a full participant — funders, grantee organizations and even
This annotated bibliography provides selected references regarding multiculturalism and cultural competence in evaluation. It contains a section listing more recent publications dating beyond 2007.
CDC provides its funded programs with a wide range of evaluation resources and guides. State health departments, tribal organizations, communities, and partners working in a variety of public health areas may also find these tools helpful. The resources provide guidance on evaluation approaches and methods, relevant examples, and additional resources. The guides are intended to aid in skill building on a wide range of evaluation topics. Practical Strategies for Culturally Competent Evaluation is designed to complement the other evaluation resources offered by the Division for Heart Disease and
DATE:
TEAM MEMBERS:
Centers for Disease Control and Prevention (CDC)Derrick GervinRobin KuwaharaRashon LaneSarah GillRefilwe MoetiMaureen Wilce
This statement of the American Evaluation Association (AEA) affirms the significance of cultural competence in evaluation. It also informs the public of AEA’s expectations concerning cultural competence in the conduct of evaluation.
DATE:
TEAM MEMBERS:
American Evaluation AssociationMelvin HallCindy CrustoKatrina BledsoeJenny JonesKaren KirkhartKatherine TibbettsElizabeth Whitmore
In this article Bell, Tzou, Bricker, and Baines describe how formal and informal educational experiences can merge through three case studies of youth engaged in science and technology. The theory of “cultural learning pathways” reframes our understanding of how, why, and where people learn over time and across spaces that have varying cultural values, everyday practices, and hierarchies of privilege and marginalization.
Many research interventions may show initial positive results, but studies show that these results tend to fade when research structures and supports are removed from the local contexts. In this paper, Gutierrez and Penuel make the case for rethinking what is meant by “rigor” in educational research. To drive truly meaningful and sustainable educational improvement efforts, there is a need for jointly negotiated research that integrates the perspectives, ideas, work, practical considerations, and analysis of educational practitioners. The authors argue that standards for rigorous research