This book is a deliverable (requisite) of an NSF (National Science Foundation) grant to share the project outcomes and what we learned from the NSF grant project. This four-year NSF project was funded to provide professional development to museum educators about Indigenous Knowledge and Western Science in museums, with the goal of providing a culturally relevant way for Indigenous communities to connect to science. The name of this grant was “Cosmic Serpent: Bridging Native Ways of Knowing and Western Science in Museum Settings.”
This book is also a snapshot in time of this work in
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
resourceprojectProfessional Development, Conferences, and Networks
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
Students in the U.S. educational system are increasingly diverse, and this diversity is reflected in science, technology, engineering, and mathematics (STEM) fields. Diversity in education encompasses students from many races, genders, and socioeconomic backgrounds; students who speak a variety of languages; and students from many cultures. For instance, ethnic diversity increased by 5% across primary and secondary public schools from 2000 to 2007 (Aud, Fox, & KewalRamani, 2010). Diversity is also evident in the socioeconomic make-up of students, with almost half of 4th graders in public
The University of Alaska Fairbanks will partner with the National Optical and Astronomy Observatory, the University of Alaska Museum of the North, and the University of Washington-Bothell to bring biomaterials, optics, photonics, and nanotechnology content, art infused experiences, and career awareness to art-interested girls. This full scale development project, Project STEAM, will explore the intersections between biology, physics, and art using advanced technologies at the nano to macro scale levels. Middle school girls from predominately underrepresented Alaskan Native, Native American (Tohono O'odham, Pascula Yaqui) and Hispanic groups, their families, teachers, and Girl Scout Troop Leaders in two site locations- Anchorage, Alaska and Tucson, Arizona will participate in the project. Centered on the theme "Colors of Nature," Project STEAM will engage girls in science activities designed to enhance STEM learning and visual-spatial skills. Using advanced technologies, approximately 240 girls enrolled in the Summer Academy over the project duration will work with women scientist mentors, teachers, and Girl Scout Troop Leaders to create artistic representations of natural objects observed at the nano and macro scale levels. Forty girls will participate in the Summer Academy in year one (20 girls per site- Alaska and Arizona). In consequent years, approximately180 girls will participate in the Academy (30 girls per site). Another 1,500 girls are expected to be reached through their Girl Scout Troop Leaders (n=15) who will be trained to deliver a modified version of the program using specialized curriculum kits. In addition, over 6,000 girls and their families are expected to attend Project STEAM Science Cafe events held at local informal science education institutions at each site during the academic year. In conjunction with the programmatic activities, a research investigation will be conducted to study the impact of the program on girls' science identity. Participant discourse, pre and post assessments, and observed engagement with the scientific and artistic ideas and tools presented will be examined and analyzed. A mixed methods approach will also be employed for the formative and summative evaluations, which will be conducted by The Goldstream Group. Ultimately, the project endeavors to increase STEM learning and interest through art, build capacity through professional development, advance the research base on girls' science identity and inspire and interest girls in STEM careers.
In 2012, Concord Evaluation Group (CEG) conducted an evaluation of the impact of Peep and the Big Wide World (Peep) resources on Spanish-speaking families with preschool-aged children. The three-pronged evaluation included a National Family Study in which 112 Spanish-speaking families who used the Peep resources were compared to Spanish-speaking families who did not use the Peep resources. It also included an In-Depth Family Study -- an experiment conducted in the metro Boston area in which 36 Spanish-speaking families who used the Peep resources were compared to Spanish-speaking families who
This bilingual study for the Against All Odds: Rescue at the Chilean Mine exhibition was conducted by the Institute for Learning Innovation (ILI) for the Smithsonian Institution's National Museum of Natural History (NMNH). The Against All Odds exhibition was a partnership between NMNH, the Chilean Embassy in Washington, DC, and the U.S. State Department, and tells the story of the 69-day saga that ended when 33 miners were lifted to the surface as heroes. Against All Odds was one of the first bilingual exhibitions at NMNH, and the interpretive team chose to use bilingual graphics for three
The Koshland Youth Research Lab (Research Lab) began as an eight-month pilot program funded by the DEK Family Fund at the San Francisco Foundation. The project (initially implemented in 2011) used frontend and formative evaluation to develop the program in line with the needs and interests of its target audience of Hispanic youth. The summative evaluation took place in the last month of the program (December 2011). Researchers from UXR Consulting, Inc. were engaged to conduct all phases of the evaluation. This report includes the interview protocol and surveys used in the study.
DATE:
TEAM MEMBERS:
Jes A. KoepflerKoshland Science Museum
The Natural History Museum of Los Angeles County (NHM) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a formative evaluation of two prototypes Mexican Era section and Model Table for the Becoming Los Angeles exhibition. RK&A designed this study, which was preceded by a front-end and earlier formative evaluation, to help NHM further refine the development of the exhibition. How did we approach this study? RK&A utilized open-ended interviews to evaluate visitors' responses to the two prototypes. In order to accurately assess these responses, the prototypes were evaluated separately
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Natural History Museum of Los Angeles County
Concord Evaluation Group (CEG) conducted an evaluation of the Spyhounds pilot test in October-December 2011. The goal of the evaluation was to assess the online resources for appeal and interest, as well as to provide WGBH with data on how a full-scale year-long project could be structured. CEG recruited a national sample of 5-8 year old children to participate in the pilot test. We conducted a pre-test survey to measure science-related knowledge (kids only), attitudes and interest (parents and kids). We then invited families to use the online resources during the pilot test and surveyed the
The proposed CAREER study uses a comprehensive mixed-methods design to develop measures of motivational beliefs and family supports for Spanish and English speaking Mexican-origin youth in high school physical science. The research examines a three-part model which may provide a deeper understanding of how Mexican families support youth through their general education strategies, beliefs about physical science, and science specific behaviors. This approach incorporates motivation and ecodevelopmental theories while pursuing an innovative line of research that examines how the contributions of older siblings and relatives complement or supplement parental support. The study has four aims which are to (1) to develop reliable, valid measures of Mexican-origin adolescent motivational beliefs and family supports in relation to high school chemistry and physics, (2) to test whether family supports predict motivational beliefs and course enrollment, (3) to test how indicators in Aim 2 vary based on gender, culture, English language skills and relationship quality, and (4) to examine how family supports strengthen or weaken the relationship between school-based interactions (teachers and peer support) and the pursuit of physical science studies. Spanish and English-speaking Mexican-origin youth will participate in focus groups to inform the development of a survey instrument which will be used in a statistical measurement equivalence study of 300 high school students in fulfillment of Aim 1. One hundred and fifty Mexican high school students and their families will participate in a longitudinal study while students progress through grades 9-12 to examine Aims 2- 4. Data to be collected includes information on science coursework, adolescent motivational beliefs, supports by mothers and older youth in the family, and family interactions. All materials will be in English and Spanish. The educational and research integration plan uses a three pronged approach which includes mentoring of doctoral students, teacher outreach, and the evaluation of the ASU Biodesign high school summer internship program using measures resulting from the research. It is anticipated that the study findings will provide research-based solutions to some of the specific behaviors that influence youth motivation in physical sciences. Specifically, the study will identify youth that might be most affected by an intervention and the age of maximum benefit, as well as valid, reliable measures of youths' motivation that can used in interventions to measure outcomes. The study will also identify family behaviors that may be influenced, including education strategies for school preparation, beliefs about physical science, and sciece-specific strategies such as engaging in science activities outside school. The findings will be broadly disseminated to science teachers, scholars, and families of Mexican-origin youth. This multi-tiered approach will advance current scholarship and practice concerning Mexican-origin adolescents' pursuit of physical science.
Engaging Latinos in Informal Science Education is designed to address the low participation rate of Latino youth and adults in activities conducted by parks, refuges, nature centers, and other informal science education venues. The project objectives are to expand upon existing studies that attempt to identify barriers to Latino participation, work with communities to identify the tools needed to overcome barriers, and utilize the tools in established programs. Surveys and interviews conducted with Latino communities are designed to identify key measures that will improve participation in informal learning programs which are then implemented in the International Migratory Bird Day (IMBD) program. Park Flight international interns from Mexico, Central America, the Caribbean, and the US will work in Latino communities near seven sites that host annual IMBD. Deliverables include a comprehensive technical report resulting from the analysis of surveys and a toolkit to promote the involvement of Latino communities in informal science education. The multi-stage evaluation includes the annual evaluation of participation levels at seven treatment and five control sites, pilot testing of the key strategies for family involvement identified in the survey results, and formative evaluation of the project toolkit. Project partners are the National Park (NPS) Service, NPS Park Flight Migratory Bird Program, Colorado State University, Rocky Mountain Bird Observatory, PRBO Conservation Services, and six national parks. Strategic impact will be realized through the development and national dissemination of the project toolkit to almost 1000 partner offices across the US.