EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
Students in the U.S. educational system are increasingly diverse, and this diversity is reflected in science, technology, engineering, and mathematics (STEM) fields. Diversity in education encompasses students from many races, genders, and socioeconomic backgrounds; students who speak a variety of languages; and students from many cultures. For instance, ethnic diversity increased by 5% across primary and secondary public schools from 2000 to 2007 (Aud, Fox, & KewalRamani, 2010). Diversity is also evident in the socioeconomic make-up of students, with almost half of 4th graders in public
The University of Alaska Fairbanks will partner with the National Optical and Astronomy Observatory, the University of Alaska Museum of the North, and the University of Washington-Bothell to bring biomaterials, optics, photonics, and nanotechnology content, art infused experiences, and career awareness to art-interested girls. This full scale development project, Project STEAM, will explore the intersections between biology, physics, and art using advanced technologies at the nano to macro scale levels. Middle school girls from predominately underrepresented Alaskan Native, Native American (Tohono O'odham, Pascula Yaqui) and Hispanic groups, their families, teachers, and Girl Scout Troop Leaders in two site locations- Anchorage, Alaska and Tucson, Arizona will participate in the project. Centered on the theme "Colors of Nature," Project STEAM will engage girls in science activities designed to enhance STEM learning and visual-spatial skills. Using advanced technologies, approximately 240 girls enrolled in the Summer Academy over the project duration will work with women scientist mentors, teachers, and Girl Scout Troop Leaders to create artistic representations of natural objects observed at the nano and macro scale levels. Forty girls will participate in the Summer Academy in year one (20 girls per site- Alaska and Arizona). In consequent years, approximately180 girls will participate in the Academy (30 girls per site). Another 1,500 girls are expected to be reached through their Girl Scout Troop Leaders (n=15) who will be trained to deliver a modified version of the program using specialized curriculum kits. In addition, over 6,000 girls and their families are expected to attend Project STEAM Science Cafe events held at local informal science education institutions at each site during the academic year. In conjunction with the programmatic activities, a research investigation will be conducted to study the impact of the program on girls' science identity. Participant discourse, pre and post assessments, and observed engagement with the scientific and artistic ideas and tools presented will be examined and analyzed. A mixed methods approach will also be employed for the formative and summative evaluations, which will be conducted by The Goldstream Group. Ultimately, the project endeavors to increase STEM learning and interest through art, build capacity through professional development, advance the research base on girls' science identity and inspire and interest girls in STEM careers.
The Learning and Youth Research and Evaluation Center (LYREC) is a collaboration of the Exploratorium, Harvard University, Kings College London, SRI International and UC Santa Cruz. LYREC provides technical assistance to NSF AYS projects, collects and synthesizes their impact data, and oversees dissemination of progress and results. This center builds on the Center for Informal Learning in Schools (CILS) that has developed a theoretical approach that takes into account the particular strengths and affordances of both Out of School Teaching (OST) and school environments. This foundation will permit strengthening the potential of the NSF AYS projects to develop strong local models that can generate valid and reliable data that can guide future investment, design and research aimed at creating coherence across OST and school settings. The overarching questions for the work are: 1. How can OST programs support K-8 engagement and learning in science, and in particular how can they contribute to student engagement with K-8 school science and beyond? 2. What is the range of science learning outcomes OST programs can promote, particularly when in collaboration with schools, IHE's, businesses, and other community partners? 3. How can classroom teachers and schools build on children's OST experiences to strengthen children's participation and achievement in K-12 school science Additionally, the data analysis will reveal: 1. How OST programs may be positioned to support, in particular, high-poverty, female and/or minority children traditionally excluded from STEM academic and career paths; and 2. The structural/organizational challenges and constraints that exist to complicate or confound efforts to provide OST experiences that support school science engagement, and conversely, the new possibilities which are created by collaboration across organizational fields. Data will be gathered from surveys, interviews, focus groups, evaluation reports, and classroom and school data.
Produced by Twin Cities Public Television, St. Paul, MN, and sponsored by the National Science Foundation, SciGirls (SG) is a multimedia project for upper grade-school and middle-school tweens. Weekly half-hour episodes are tied in with web and outreach activities in the fields of science, technology and engineering. Multimedia Research, an independent evaluation group implemented a summative evaluation of the SG Season Two multimedia project. Fifth grade girls (N = 87) viewed three shows over three weeks. They could visit the SG website at any time but were required to visit and play a Pick'm
DATE:
TEAM MEMBERS:
Barbara FlaggTwin Cities Public Television
"Human +" is a collaboration among the New York Hall of Science (NYSCI), NSF Quality of Life Technology Engineering Research Center (QoLT ERC) of the University of Pittsburgh and Carnegie Mellon University, Oregon Museum of Science and Industry (OMSI), and the Institute for Learning Innovation. The project will engage engineers, educators, designers, and people with disabilities in a process of participatory design to create a 2,500 square foot traveling exhibition entitled "Human +". The STEM content is engineering, specifically the extraordinary technological advances being made to enhance human abilities. The project is making three significant contributions to the Informal Science Education (ISE) field: 1) It is a model of close integration of an NSF-funded engineering research center into an ISE project. (2) It engages people with disabilities, both as participants and audiences. (3) It broadens engagement with engineering as a participatory, creative, and socially important ISE undertaking. Project deliverables are: (1) a model for participatory design of ISE activities to generate innovation among engineers, people with disabilities, ISE professionals, and designers; and 2) a 2,500 square-foot traveling exhibition engaging the public in the science, technology, and social issues of human enhancement. Front-end evaluation will be conducted by OMSI to explore pre-existing knowledge and attitudes, integrating significant numbers of people with disabilities including veterans, young people, and older people. Formative evaluation will likewise be integrated with the participatory design process, with prototypes being tested both by audiences and by the core "Human +" participatory design team. Summative evaluation by Institute for Learning Innovation will address both the effectiveness of the participatory design process and the effectiveness of the exhibition in addressing the National Academy for Engineering goals for public understanding of engineering as a creative and socially engaged field. An estimated 700,000 visitors will experience the "Human +" exhibition at OMSI and NYSCI. In addition, OMSI will tour the exhibition through its extensive and diverse network of science centers, with 24 science centers having expressed interest as potential host sites. The Science Friday webcast/podcast will reach an estimated 1.3 million listeners. Public audiences will engage in the topic of engineering and better understand its importance to human existence through experiencing one compelling research area. The project team will work with the Veterans Administration and DARPA to engage veterans with disabilities both as participants and as audiences. The exhibit with its human-focused content will also stimulate interest among older adults and promote the engineering field to groups underrepresented in engineering such as people with disabilities, girls, and minority youth. The project places cutting-edge technology and engineering practice in a profoundly personal context. "Human +" will contribute to the empowerment of the great majority of people who have, or will have, disabilities during their lifetime and for those of us who care for people with disabilities.
The Addressing Gender Barriers in STEM through Theatre of Social Engagement project responds to the need to educate the public about the careers in computer and information science and engineering (CISE) fields by educating high school students, parents, teachers and counselors about the barriers to participation that confront women and other underrepresented groups. In this Communicating Research to Public Audiences (CRPA) project, a dramatic play is used to communicate the findings from the PI's work which resulted in a theory about gender and IT to explain and predict gender (under)representation in IT fields. The play dramatizes constructs of the theory, particularly the ways in which gender, ethnicity, and class affect identity and career and life decisions. Drawing from life history interviews conducted as a part of the research, the storyline of the dramatic play centers on three young women who are graduating from high school and making decisions about their futures and possible careers in IT. Situated squarely in the realm and literature of "theatre of social engagement," this play, and its staged readings and ancillary website, extend access beyond the scientific community to new scientific research on gender barriers in CISE. Learning goals for the project include: 1. Awareness and knowledge about possible computer and information science and engineering careers; barriers and stereotypes that affect CISE career choice among women; and "significant others" such as partners, family members, mentors and teachers who can make a difference at key inflection points in career decision making. 2. Attitude change about the CISE fields being open to everyone regardless of gender, ethnicity, race or class; how one's individual characteristics can be used to resist barriers to inclusion in CISE careers. 3. Intended behavior about learning more about CISE careers and educational opportunities; and responding to negative stereotypes related to CISE. Evaluation of the proposed project will include observations, talk-back sessions (focus groups) after readings of the play, pre-post surveys administered at the showings, and a second post-performance survey to be administered a certain amount of time after the showing. Dissemination will be through readings of the play for audiences in New Jersey and Pennsylvania, with partnering informal learning venues, and through an associated website which will allow visitors to download and stage the play themselves. Advertisement for the play and the website will take place through websites such as Facebook, Twitter, and websites that promote diversity in computing. In addition, the PI intends to contribute to the scholarly literature on theatre as an informal learning approach and on the findings of how audiences respond to the play itself.
This project will be conducted by a team of investigators from North Carolina State University. The principal investigator proposes to examine the characteristics, motivations, in and out-of-school experiences, informal science activities, and career trajectories of 1000 science hobbyists and "master hobbyists." Master hobbyists are individuals who have developed science expertise and spend considerable free time engaging in science as a leisure activity. Master science hobbyists are found across most areas of science (e.g. birdwatchers, amateur astronomers). This research will determine who these individuals are, their career pathways, how they engage in science activities and what motivates, sustains, and defines their science interests. One of the particular goals of this research is to develop new understandings of how science hobby interests develop for women and underserved minorities. In the proposed research investigators will use the results of interviews and surveys to identify contextual factors that influence the motivational processes that, in turn, influenced choices of careers and contribute to ongoing choices in hobby and citizen science activities. Of interest in this study is how citizen scientists who are also serious hobbyists differ from master science hobbyists. Research on citizen scientists has shown that this group is highly motivated by collective motives (such as a desire to help others and further science), whereas this may not be the case with the master science hobbyist. Two groups will be sampled: a) birdwatchers and b) amateur astronomers. This sampling model will allow investigators to contrast their findings by: 1) those who have selected a science career versus those that did not select a science career, 2) those who participate in citizen science activities and those that do not, and 3) those who are birdwatchers (greater mathematical components) and those who are amateur astronomers (lesser mathematical components). Additional coding and analyses will examine any differences in the evolution of bird watching and astronomy hobbies. The results of this research will be examined in light of existing motivational and sociocultural models of career selection. This research will document differences in the perceived motivational elements that influenced master science hobbyists/citizen scientists to choose a science career or not. The results can inform federal, state, and local policies for supporting youth and adults engaged in free choice learning. Results of this research will inform the design of intervention/recruitment programs and ISE outreach initiatives. Potential audiences include ISE institutions (e.g. museums and science centers), organizations with links to STEM (e.g. scouts, boys/girls clubs) and pre- and college initiatives that seek to influence career choices and life-long science interests. The proposed cross-disciplinary approach will promote new understandings of complex issues related to motivation, retention, career selection, leisure activities, engagement with formal and informal educational environments, gender and ethnicity, communities of practice and changes in interests over time. Members of the advisory board have expertise in assessment and measurement and will work closely with the project team to conduct a detailed examination of methodologies and analyses at all phases of the project.