The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
resourceprojectProfessional Development, Conferences, and Networks
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
Water for Life (WfL) is a full scale development youth and community based program; centered on freshwater literacy, water conservation and rainwater harvesting led by the Pacific Resources for Education Learning (PREL) in Hawaii. The goals of the project are to: (a) promote an understanding of water conservation and stewardship in areas lacking adequate quality water supplies and (b) build local capacity among rural communities to develop and employ site specific freshwater harvesting strategies proven to improve water quality. Rural communities within four Pacific Island entities in the U.S. affiliated Freely Associated States (FAS) will participate in WfL activities. PREL is collaborating with a host of organizations (such as the Federated States of Micronesia National Department of Education, Marshall Islands Conservation Society, and the Micronesian Conservation Trust, etc.) to develop and implement all phases of the initiative. This work is already improving the quality of life for hundreds of people in the FAS through water conversation education and improved water quality in local areas. Working closely with site-embedded PREL staff, Core Teams at each site - consisting of 4-6 local leaders from environmental agencies, water/sanitation systems, and education institutions - participated in a 5-day professional learning immersion in May, 2013, to buld capacities to develop and facilitate water conservation and catchment activities at the four target sites in the FAS. The Core Team members at each site now are recruiting and collaborating with local community members to implement site-specific projects that both educate and provide enhanced access to high quality drinking water. Both adults and youth are now engaging in a spectrum of proejcts that address loca needs and priorities through site-specific service learning activities. The site-specific focus in each locale, determined by the local Core Team, is distinct. In Palau, the Core Team has built broader community awareness of water conservation issues, raised the issue of water security in national conversations, engaged remote communities in improving natural rainwater drainage collection systems, and produced youth-oriented educational materials focused on local sites. In Yap, the Core Team members have collaborated with public utilities to install first-flush diverters into community rainwater catchment systems on Yap proper, and now are installing these devices in rainwater catchment systems on Yap's neighbor islands. In Chuuk, groundwater springs in remote communities are being upgraded for improved storage capacity, protection against contamination, and better public access. In Majuro (RMI), public school rainwater catchment systems are being repaired, repainted, cleaned, and upgraded so that schools can and will provide adequate drinking water to students (and to broader segments of the community during droughts). Broad segments of communities, including school classes and clubs, church and civic groups, etc. are becoming increasingly involved in building better water security and resilience for their communities, in preparation for a predicted drought, predicted to hit in the winter of 2014-2015, brought on by an El Nino event now edevelopig in the eastern Pacific. Water for Life has produced a range of locally relevant educational materials, including books, pamphlets, flyers, etc., some in English and others in local languages. Posters and billboards are being produced to enhance and maintain public awareness. Infrastructure projects are enabling better collection of more, higher quality water for drinking. A full-scale water handbook is under development, and this will serve as a basis for a self-contained water 'course' that will be offered through local community colleges. The experiences of project participants are being captured, analyzed, and reported in front-end, formative, and sumative evaluations conducted by David Heil & Associates. Thousands of individuals, comprising large segments of the participating countries' populations, will be directly impacted by the project. The results will be applicable to other remote and rural communities outside of the Pacific distressed by poor water quality and ineffective freshwater harvesting systems.
The University of Texas at El Paso will conduct a research project that implements and documents the impact of co-generative dialogues on youth learning and youth-scientist interactions as part of a STEM research program (i.e., Work with A Scientist Program). Co-generative dialogues seek to specifically assist with communication and understanding among collaborators. Over four years, 108 11th grade youth from a predominantly (90%) Hispanic high school will conduct STEM research with twelve scientists/engineers (e.g., chemist, civil engineer, geologist, biologist) and undergraduate/graduate students as part of 7 month-long after school program, including bi-weekly Saturday activities for 5 months followed by an intensive month-long, self-directed research project in the summer. Youth will be randomly assigned to experimental groups that include the co-generative dialogue treatment and control groups without the intervention. The scientists and their STEM undergraduate/graduate students will participate in both experimental and control groups, with different youth. Youth will receive high school credit to encourage participation and retention. The PI team hypothesizes that co-generative dialogues will result in improved learning, communication, and research experiences for both youth and scientists. Educational researchers will conduct co-generative dialogues, observations, interviews, and surveys using validated instruments to address the following research goals: (1) To investigate the impact of the treatment (co-generative dialogues) on youth knowledge, attitudes, perceptions of their experience, and their relationships with the scientists; (2) To investigate the impact of the treatment on scientists and graduate students; and (3) To identify critical components of the treatment that affect youth-scientist interactions. It is anticipated that, in addition to providing in-depth STEM research experiences for 108 youth from underrepresented groups at a critical time in their lives, the project will result in widely applicable understandings of how pedagogical approaches affect both youth learning and scientist experiences. The project also seeks to bridge learning environments: informal, formal, university and digital.
This full-scale project addresses the need for more youth, especially girls, to pursue an interest in engineering and eventually fill a critical workforce need. The project leverages museum-based exhibits, girls' activity groups, and social media to enhance participants' engineering-related interests and identities. The project includes the following bilingual deliverables: (1) Creative Solutions programming will engage girls in group oriented engineering activities at partner community-based organizations, where the activities highlight altruistic, personally relevant, and social aspects of engineering. Existing community groups will use the activities in their regular meeting structure. Visits to the museum exhibits, titled Design Your World will reinforce messages; (2) Design Your World Exhibits will serve as a community hub at two ISE institutions (Oregon Museum of Science and Industry and the Hatfield Marine Science Center). They will leverage existing NSF-funded Engineer It! (DRL-9803989) exhibits redesigned to attract, engage, and mobilize a more diverse population by showcasing altruistic, personally relevant, and social aspects of engineering; (3) Digital engagement through targeted use of social media will complement program and exhibit content and be an online portal for groups engaged in the project; (4) A community action group (CAG) will provide professional development opportunities to stakeholders interested in girls' STEM identity (e.g. parents, STEM-based business professionals) to promote effective engineering messaging throughout the community and engage them in supporting project participants; and (5) Longitudinal research will explore how girls construct and negotiate engineering-related identities through discourse across the project activities and over time.
The project is designed to engage Hispanic students in grades K-5 in STEM in afterschool programs within community-based organizations (CBOs). The project builds on the foundation of an NSF-supported afterschool science program--APEX (Afterschool Program Exploring Science). In collaboration with National Council of La Raza (NCLR), and ASPIRA, the project adapts APEX into a bilingual English/Spanish format and, using a train the trainer model, disseminates it nationally, using a train the trainer model. Each of the ten local project sites will build on a partnership between a science museum and a CBO affiliate of NCLR or ASPIRA. The project is designed to: (1) Build the organizational capacity of partner science museums to work with CBOs and the Hispanic community. (2) Strengthen links between science museums and Hispanic serving CBOs in their communities. (3) Engage the expertise, involvement, and collaboration of national Hispanic-serving organizations, NCLR and ASPIRA, in STEM education. (4) Increase the engagement of Hispanic children and families in STEM. The project evaluation will investigate how effectively the project builds the organizational capacity of partner museums and CBOs in engaging Hispanic children and families in STEM; the types and strength of science museum/CBO partnerships; the effectiveness of the project in increasing Hispanic student and family engagement in STEM, and the types of contributions the project makes to the field of informal STEM learning. The evaluation will use qualitative and quantitative methods, including surveys, interviews, case studies, social network and collaboration analysis, observations, activity tracking, embedded assessment, photo elicitation, and focus groups.
Techbridge has proposed a broad implementation project that will scale up a tested multi-faceted model that increases girls' interest in STEM careers. The objectives of this project are to increase girls' engineering, technology, and science skills and career interests; build STEM capacity and sustainability across communities; enhance STEM and career exploration for underrepresented girls and their families; and advance research on the scale-up, sustainability, and impact of the model with career exploration. The Techbridge approach is grounded in Eccles' expectancy value model, and helps bridge critical junctures as girls transition from elementary to middle school and middle school to high school, immersing participants in a network of peers and supportive adults. Techbridge targets girls in grades 5-12 with a model that includes five components: a previously tested and evaluated curriculum, career exploration, professional development for staff and teachers, family engagement, and dissemination. The inquiry-based curriculum introduces electrical engineering and computer science through engaging, hands-on units on Cars and Engines, Green Design, and Electrical Engineering. The Techbridge model will be enhanced to include a central repository for curriculum and support materials, electronic girl-driven career exploration resources, an online learning community and video tools for staff, and customized family guides. Project deliverables include the dissemination of the enhanced model to three cities, 24 school sites and teachers, 2,000 girls, and over 600 role models. A supplementary research component will study the broad implementation of the Techbridge model by examining the fidelity of implementation and the program's impact on girls' STEM engagement and learning. The research questions are as follows: (1) To what extent and how do new program sites demonstrate adherence to the Techbridge program model? (2) Do new sites experience similar or increased participant responsiveness to Techbridge programming with regard to scientific learning outcomes, career awareness, attitude and interest in engineering? (3)How are changes experienced by girls sustained over time, if at all? (4) To what extent and how do new sites balance instilling the Techbridge essentials, those critical components Techbridge identifies as essential for success, with the need for local adaptation and ownership of the program? and (5) Given the potential for customization in local communities, do new sites maintain programmatic quality of delivery experienced at the original site? If so, what are elements essential to success regarding quality delivery? The mixed-methods study will include document analysis, embedded assessments, participant survey scales, and observations. Qualitative data methods include interviews with teachers, role models, staff and focus groups with girls. A project evaluation will also be conducted which investigates project outcomes for participants (girls, teachers, role models, and families) and fidelity of the implementation and enhancements at expansion sites, using a quasi-experimental approach. Career and learning outcomes for girls will be determined using embedded assessments, portfolios, surveys, school data, and previously validated instruments such as the Career Interest Questionnaire and the Modified Attitudes towards Science Inventory. The Managing Complex Change model is used as a framework for the project evaluation for the purpose of examining factors related to the effectiveness of scaling. The dissemination of research and evaluation findings will be achieved through the use of publications, blogs, social media, and conferences. It is anticipated that this project will broaden the participation of Hispanic, African-American, and English language learner girls, build capacity for STEM programming and sustainability at the dissemination sites, and disseminate findings to over 1 million educators, researchers, and community members. Broader impacts include contributing to the field's understanding of how virtual role models and field trips can engage young women, increase corporate advocacy, and engage participants in research and dissemination efforts.