The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
resourceprojectProfessional Development, Conferences, and Networks
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
The University of Alaska Fairbanks will partner with the National Optical and Astronomy Observatory, the University of Alaska Museum of the North, and the University of Washington-Bothell to bring biomaterials, optics, photonics, and nanotechnology content, art infused experiences, and career awareness to art-interested girls. This full scale development project, Project STEAM, will explore the intersections between biology, physics, and art using advanced technologies at the nano to macro scale levels. Middle school girls from predominately underrepresented Alaskan Native, Native American (Tohono O'odham, Pascula Yaqui) and Hispanic groups, their families, teachers, and Girl Scout Troop Leaders in two site locations- Anchorage, Alaska and Tucson, Arizona will participate in the project. Centered on the theme "Colors of Nature," Project STEAM will engage girls in science activities designed to enhance STEM learning and visual-spatial skills. Using advanced technologies, approximately 240 girls enrolled in the Summer Academy over the project duration will work with women scientist mentors, teachers, and Girl Scout Troop Leaders to create artistic representations of natural objects observed at the nano and macro scale levels. Forty girls will participate in the Summer Academy in year one (20 girls per site- Alaska and Arizona). In consequent years, approximately180 girls will participate in the Academy (30 girls per site). Another 1,500 girls are expected to be reached through their Girl Scout Troop Leaders (n=15) who will be trained to deliver a modified version of the program using specialized curriculum kits. In addition, over 6,000 girls and their families are expected to attend Project STEAM Science Cafe events held at local informal science education institutions at each site during the academic year. In conjunction with the programmatic activities, a research investigation will be conducted to study the impact of the program on girls' science identity. Participant discourse, pre and post assessments, and observed engagement with the scientific and artistic ideas and tools presented will be examined and analyzed. A mixed methods approach will also be employed for the formative and summative evaluations, which will be conducted by The Goldstream Group. Ultimately, the project endeavors to increase STEM learning and interest through art, build capacity through professional development, advance the research base on girls' science identity and inspire and interest girls in STEM careers.
Water for Life (WfL) is a full scale development youth and community based program; centered on freshwater literacy, water conservation and rainwater harvesting led by the Pacific Resources for Education Learning (PREL) in Hawaii. The goals of the project are to: (a) promote an understanding of water conservation and stewardship in areas lacking adequate quality water supplies and (b) build local capacity among rural communities to develop and employ site specific freshwater harvesting strategies proven to improve water quality. Rural communities within four Pacific Island entities in the U.S. affiliated Freely Associated States (FAS) will participate in WfL activities. PREL is collaborating with a host of organizations (such as the Federated States of Micronesia National Department of Education, Marshall Islands Conservation Society, and the Micronesian Conservation Trust, etc.) to develop and implement all phases of the initiative. This work is already improving the quality of life for hundreds of people in the FAS through water conversation education and improved water quality in local areas. Working closely with site-embedded PREL staff, Core Teams at each site - consisting of 4-6 local leaders from environmental agencies, water/sanitation systems, and education institutions - participated in a 5-day professional learning immersion in May, 2013, to buld capacities to develop and facilitate water conservation and catchment activities at the four target sites in the FAS. The Core Team members at each site now are recruiting and collaborating with local community members to implement site-specific projects that both educate and provide enhanced access to high quality drinking water. Both adults and youth are now engaging in a spectrum of proejcts that address loca needs and priorities through site-specific service learning activities. The site-specific focus in each locale, determined by the local Core Team, is distinct. In Palau, the Core Team has built broader community awareness of water conservation issues, raised the issue of water security in national conversations, engaged remote communities in improving natural rainwater drainage collection systems, and produced youth-oriented educational materials focused on local sites. In Yap, the Core Team members have collaborated with public utilities to install first-flush diverters into community rainwater catchment systems on Yap proper, and now are installing these devices in rainwater catchment systems on Yap's neighbor islands. In Chuuk, groundwater springs in remote communities are being upgraded for improved storage capacity, protection against contamination, and better public access. In Majuro (RMI), public school rainwater catchment systems are being repaired, repainted, cleaned, and upgraded so that schools can and will provide adequate drinking water to students (and to broader segments of the community during droughts). Broad segments of communities, including school classes and clubs, church and civic groups, etc. are becoming increasingly involved in building better water security and resilience for their communities, in preparation for a predicted drought, predicted to hit in the winter of 2014-2015, brought on by an El Nino event now edevelopig in the eastern Pacific. Water for Life has produced a range of locally relevant educational materials, including books, pamphlets, flyers, etc., some in English and others in local languages. Posters and billboards are being produced to enhance and maintain public awareness. Infrastructure projects are enabling better collection of more, higher quality water for drinking. A full-scale water handbook is under development, and this will serve as a basis for a self-contained water 'course' that will be offered through local community colleges. The experiences of project participants are being captured, analyzed, and reported in front-end, formative, and sumative evaluations conducted by David Heil & Associates. Thousands of individuals, comprising large segments of the participating countries' populations, will be directly impacted by the project. The results will be applicable to other remote and rural communities outside of the Pacific distressed by poor water quality and ineffective freshwater harvesting systems.
The University of Texas at El Paso will conduct a research project that implements and documents the impact of co-generative dialogues on youth learning and youth-scientist interactions as part of a STEM research program (i.e., Work with A Scientist Program). Co-generative dialogues seek to specifically assist with communication and understanding among collaborators. Over four years, 108 11th grade youth from a predominantly (90%) Hispanic high school will conduct STEM research with twelve scientists/engineers (e.g., chemist, civil engineer, geologist, biologist) and undergraduate/graduate students as part of 7 month-long after school program, including bi-weekly Saturday activities for 5 months followed by an intensive month-long, self-directed research project in the summer. Youth will be randomly assigned to experimental groups that include the co-generative dialogue treatment and control groups without the intervention. The scientists and their STEM undergraduate/graduate students will participate in both experimental and control groups, with different youth. Youth will receive high school credit to encourage participation and retention. The PI team hypothesizes that co-generative dialogues will result in improved learning, communication, and research experiences for both youth and scientists. Educational researchers will conduct co-generative dialogues, observations, interviews, and surveys using validated instruments to address the following research goals: (1) To investigate the impact of the treatment (co-generative dialogues) on youth knowledge, attitudes, perceptions of their experience, and their relationships with the scientists; (2) To investigate the impact of the treatment on scientists and graduate students; and (3) To identify critical components of the treatment that affect youth-scientist interactions. It is anticipated that, in addition to providing in-depth STEM research experiences for 108 youth from underrepresented groups at a critical time in their lives, the project will result in widely applicable understandings of how pedagogical approaches affect both youth learning and scientist experiences. The project also seeks to bridge learning environments: informal, formal, university and digital.
This full-scale project addresses the need for more youth, especially girls, to pursue an interest in engineering and eventually fill a critical workforce need. The project leverages museum-based exhibits, girls' activity groups, and social media to enhance participants' engineering-related interests and identities. The project includes the following bilingual deliverables: (1) Creative Solutions programming will engage girls in group oriented engineering activities at partner community-based organizations, where the activities highlight altruistic, personally relevant, and social aspects of engineering. Existing community groups will use the activities in their regular meeting structure. Visits to the museum exhibits, titled Design Your World will reinforce messages; (2) Design Your World Exhibits will serve as a community hub at two ISE institutions (Oregon Museum of Science and Industry and the Hatfield Marine Science Center). They will leverage existing NSF-funded Engineer It! (DRL-9803989) exhibits redesigned to attract, engage, and mobilize a more diverse population by showcasing altruistic, personally relevant, and social aspects of engineering; (3) Digital engagement through targeted use of social media will complement program and exhibit content and be an online portal for groups engaged in the project; (4) A community action group (CAG) will provide professional development opportunities to stakeholders interested in girls' STEM identity (e.g. parents, STEM-based business professionals) to promote effective engineering messaging throughout the community and engage them in supporting project participants; and (5) Longitudinal research will explore how girls construct and negotiate engineering-related identities through discourse across the project activities and over time.
The project is designed to engage Hispanic students in grades K-5 in STEM in afterschool programs within community-based organizations (CBOs). The project builds on the foundation of an NSF-supported afterschool science program--APEX (Afterschool Program Exploring Science). In collaboration with National Council of La Raza (NCLR), and ASPIRA, the project adapts APEX into a bilingual English/Spanish format and, using a train the trainer model, disseminates it nationally, using a train the trainer model. Each of the ten local project sites will build on a partnership between a science museum and a CBO affiliate of NCLR or ASPIRA. The project is designed to: (1) Build the organizational capacity of partner science museums to work with CBOs and the Hispanic community. (2) Strengthen links between science museums and Hispanic serving CBOs in their communities. (3) Engage the expertise, involvement, and collaboration of national Hispanic-serving organizations, NCLR and ASPIRA, in STEM education. (4) Increase the engagement of Hispanic children and families in STEM. The project evaluation will investigate how effectively the project builds the organizational capacity of partner museums and CBOs in engaging Hispanic children and families in STEM; the types and strength of science museum/CBO partnerships; the effectiveness of the project in increasing Hispanic student and family engagement in STEM, and the types of contributions the project makes to the field of informal STEM learning. The evaluation will use qualitative and quantitative methods, including surveys, interviews, case studies, social network and collaboration analysis, observations, activity tracking, embedded assessment, photo elicitation, and focus groups.
Techbridge has proposed a broad implementation project that will scale up a tested multi-faceted model that increases girls' interest in STEM careers. The objectives of this project are to increase girls' engineering, technology, and science skills and career interests; build STEM capacity and sustainability across communities; enhance STEM and career exploration for underrepresented girls and their families; and advance research on the scale-up, sustainability, and impact of the model with career exploration. The Techbridge approach is grounded in Eccles' expectancy value model, and helps bridge critical junctures as girls transition from elementary to middle school and middle school to high school, immersing participants in a network of peers and supportive adults. Techbridge targets girls in grades 5-12 with a model that includes five components: a previously tested and evaluated curriculum, career exploration, professional development for staff and teachers, family engagement, and dissemination. The inquiry-based curriculum introduces electrical engineering and computer science through engaging, hands-on units on Cars and Engines, Green Design, and Electrical Engineering. The Techbridge model will be enhanced to include a central repository for curriculum and support materials, electronic girl-driven career exploration resources, an online learning community and video tools for staff, and customized family guides. Project deliverables include the dissemination of the enhanced model to three cities, 24 school sites and teachers, 2,000 girls, and over 600 role models. A supplementary research component will study the broad implementation of the Techbridge model by examining the fidelity of implementation and the program's impact on girls' STEM engagement and learning. The research questions are as follows: (1) To what extent and how do new program sites demonstrate adherence to the Techbridge program model? (2) Do new sites experience similar or increased participant responsiveness to Techbridge programming with regard to scientific learning outcomes, career awareness, attitude and interest in engineering? (3)How are changes experienced by girls sustained over time, if at all? (4) To what extent and how do new sites balance instilling the Techbridge essentials, those critical components Techbridge identifies as essential for success, with the need for local adaptation and ownership of the program? and (5) Given the potential for customization in local communities, do new sites maintain programmatic quality of delivery experienced at the original site? If so, what are elements essential to success regarding quality delivery? The mixed-methods study will include document analysis, embedded assessments, participant survey scales, and observations. Qualitative data methods include interviews with teachers, role models, staff and focus groups with girls. A project evaluation will also be conducted which investigates project outcomes for participants (girls, teachers, role models, and families) and fidelity of the implementation and enhancements at expansion sites, using a quasi-experimental approach. Career and learning outcomes for girls will be determined using embedded assessments, portfolios, surveys, school data, and previously validated instruments such as the Career Interest Questionnaire and the Modified Attitudes towards Science Inventory. The Managing Complex Change model is used as a framework for the project evaluation for the purpose of examining factors related to the effectiveness of scaling. The dissemination of research and evaluation findings will be achieved through the use of publications, blogs, social media, and conferences. It is anticipated that this project will broaden the participation of Hispanic, African-American, and English language learner girls, build capacity for STEM programming and sustainability at the dissemination sites, and disseminate findings to over 1 million educators, researchers, and community members. Broader impacts include contributing to the field's understanding of how virtual role models and field trips can engage young women, increase corporate advocacy, and engage participants in research and dissemination efforts.
The proposed CAREER study uses a comprehensive mixed-methods design to develop measures of motivational beliefs and family supports for Spanish and English speaking Mexican-origin youth in high school physical science. The research examines a three-part model which may provide a deeper understanding of how Mexican families support youth through their general education strategies, beliefs about physical science, and science specific behaviors. This approach incorporates motivation and ecodevelopmental theories while pursuing an innovative line of research that examines how the contributions of older siblings and relatives complement or supplement parental support. The study has four aims which are to (1) to develop reliable, valid measures of Mexican-origin adolescent motivational beliefs and family supports in relation to high school chemistry and physics, (2) to test whether family supports predict motivational beliefs and course enrollment, (3) to test how indicators in Aim 2 vary based on gender, culture, English language skills and relationship quality, and (4) to examine how family supports strengthen or weaken the relationship between school-based interactions (teachers and peer support) and the pursuit of physical science studies. Spanish and English-speaking Mexican-origin youth will participate in focus groups to inform the development of a survey instrument which will be used in a statistical measurement equivalence study of 300 high school students in fulfillment of Aim 1. One hundred and fifty Mexican high school students and their families will participate in a longitudinal study while students progress through grades 9-12 to examine Aims 2- 4. Data to be collected includes information on science coursework, adolescent motivational beliefs, supports by mothers and older youth in the family, and family interactions. All materials will be in English and Spanish. The educational and research integration plan uses a three pronged approach which includes mentoring of doctoral students, teacher outreach, and the evaluation of the ASU Biodesign high school summer internship program using measures resulting from the research. It is anticipated that the study findings will provide research-based solutions to some of the specific behaviors that influence youth motivation in physical sciences. Specifically, the study will identify youth that might be most affected by an intervention and the age of maximum benefit, as well as valid, reliable measures of youths' motivation that can used in interventions to measure outcomes. The study will also identify family behaviors that may be influenced, including education strategies for school preparation, beliefs about physical science, and sciece-specific strategies such as engaging in science activities outside school. The findings will be broadly disseminated to science teachers, scholars, and families of Mexican-origin youth. This multi-tiered approach will advance current scholarship and practice concerning Mexican-origin adolescents' pursuit of physical science.
Making Connections, a three-year design-based research study conducted by the Science Museum of Minnesota in partnership with Twin Cities' communities, is developing and studying new ways to engage a broader audience in meaningful Maker experiences. This study draws and builds on existing theoretical frameworks to examine how community engagement techniques can be used to co-design and implement culturally-relevant marketing, activities, and events focused on Making that attract families from underrepresented audiences and ultimately engage them in meaningful informal STEM learning. The research is being done in three phases: Sharing and Listening - co-design with targeted communities; Making Activities Design and Implementation; Final Analysis, Synthesis and Dissemination. The project is also exploring new approaches in museums' cross-institutional practices that can strengthen the quality of their community-engagement. In recent years, Making - a do-it-yourself, grassroots approach to designing and constructing real things through creativity, problem-solving, and tool use - has received increasing attention as a fruitful vehicle for introducing young people to the excitement of science and engineering and to career skills in these fields. Maker Faires attract hundreds and thousands of people to engage in Making activities every year, and the popularity of these events, as well as the number of museums and libraries that are beginning to provide opportunities for the public to regularly engage in these types of activities, are skyrocketing. However, Maker programs tend to draw audiences that are predominantly white, middle class, male, well educated, and strongly interested in science, despite the fact that the practices of Making are as common in more diverse communities. Making Connections has the potential to transform how children begin to cultivate a lifelong interest in engineering at a young age, which may ultimately encourage more young people of color to pursue engineering careers in the future.
The Oregon Museum of Science and Industry (OMSI), in partnership with the J. Craig Venter Institute (JCVI), proposes to develop the Zoo in You: Exploring the Human Microbiome, a 2,000 square foot bilingual (English and Spanish) traveling exhibition for national tour to science centers, health museums, and other relevant venues. The exhibition will engage visitors in the cutting edge research of the National Institutes of Health's (NIH) Human Microbiome Project (HMP) and explore the impact of the microbiome on human health. To enrich the visitor experience, the Zoo in You project will also produce an interactive bilingual website and in-depth programs including science cafes and book groups for adult audiences. JCVI will provide its expertise and experience as a major site for HMP genomics research to the project. In addition, advisors from the Oregon Health & Science University, Multnomah County Library, the Multnomah County Health Department, ScienceWorks Hands-On Museum, Science Museum of Minnesota, and other experts will guide OMSI's development of exhibits and programs. The Institute of Learning Innovation in collaboration with OMSI will evaluate the exhibits, programs, and website. Front-end, formative, remedial, and summative evaluation will be conducted in English and Spanish at OMSI, ScienceWorks, and tour venues. The exhibition's target audience is families and school groups with children in grades 4-12. Latino families are a priority audience and the project deliverables will be developed bilingually and biculturally. The Zoo in You will tour to three venues a year for a minimum of eight years. We conservatively estimate that over two million people will visit the exhibition during the national tour. This project presents a powerful opportunity to inform museum visitors about new discoveries in genomic research, to invite families to learn together, and to present and interpret health-related research findings for diverse audiences. PUBLIC HEALTH RELEVANCE (provided by applicant): Our research education program, the Zoo in You (ZIY): Exploring the Human Microbiome, is relevant to public health because it will inform exhibition visitors and program participants about the significant new research of the NIH's Human Microbiome Project (HMP). Visitors will make connections between basic research, human health, and their own personal experiences. The bilingual (English and Spanish) ZIY exhibits and programs will present research finding and public health information in enjoyable and engaging ways to reach diverse family and adult audiences.