EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
The State University of New York (SUNY) and the New York Academy of Sciences (NYAS) are collaborating to implement the SUNY/NYAS STEM Mentoring Program, a full scale development project designed to improve the science and math literacy of middle school youth. Building upon lessons learned through the implementation of national initiatives such as NSF's Graduate STEM Fellows in K-12 Education (GK-12) Program, university initiatives such as the UTeach model, and locally-run programs, this project's goals are to: 1) increase access to high quality, hands-on STEM programs in informal environments, 2) improve teaching and outreach skills of scientists in training (graduate and postdoctoral fellows), and 3) test hypotheses around scalable program elements. Together, SUNY and NYAS propose to carry out a comprehensive, systemic science education initiative to recruit graduate students and postdoctoral fellows studying science, technology, engineering, and mathematics (STEM) disciplines at colleges and universities statewide to serve as mentors in afterschool programs. SUNY campuses will partner with a community-based organization (CBO) to place mentors in afterschool programs serving middle school students in high-need, low-resource urban and rural communities. Project deliverables include a three-credit online graduate course for mentor training, six pilot sites, a best practices guide, and a model for national dissemination. The online course will prepare graduate and postdoctoral fellows to spend 12-15 weeks in afterschool programs, introducing students to life science, earth science, mathematics and engineering using curriculum modules that are aligned with the New York State standards. The project design includes three pre-selected sites (College of Nanoscale Science & Engineering at the University of Albany, SUNY Institute of Technology, and SUNY Downstate Medical Center) and three future sites to be selected through a competitive process, each of which will be paired with a CBO to create a locally designed STEM mentoring program. As a result, a minimum of 192 mentors will provide informal STEM education to 2,880 middle school students throughout New York State. The comprehensive, mixed-methods evaluation will address the following questions: 1) Does student participation in an afterschool model of informal education lead to an increase in STEM content knowledge, attitudes, self-efficacy, and interest in pursuing further STEM education and career pathways? 2) Do young scientists who participate in the program develop effective teaching and mentoring skills, and develop interest in teaching or mentoring career options that result in STEM retention? 3) What are the attributes of an effective STEM afterschool program and the elements of local adaptation and innovation that are necessary to achieve a successful scale-up to geographically diverse locations? 4) What is the role of the afterschool model in delivering informal STEM education? This innovative model includes a commitment to scale across the 64 SUNY campuses and 122 Councils of the Girl Scouts of the USA, use an online platform to deliver training, and place scientists-in-training in informal learning environments. It is hypothesized that as a result of greater access to STEM education in an informal setting, participating middle school youth will develop increased levels of STEM content knowledge, self-efficacy, confidence in STEM learning, and interest in STEM careers. Scientist mentors will: 1) gain an understanding of the context and characteristics of informal science education, 2) develop skills in mentoring and interpersonal communication, 3) learn and apply best practices of inquiry instruction, and 4) potentially develop interest in teaching as a viable career option. It is anticipated that the project will add to the research literature in several areas such as the effectiveness of incentives for graduate students; the design of mentor support systems; and the structure of pilot site programs in local communities. Findings and materials from this project will be disseminated through presentations at local, regional, and national conferences, publications in peer-reviewed journals focused on informal science education, and briefings sent to more than 25,000 NYAS members around the world.
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
The University of Alaska Fairbanks will partner with the National Optical and Astronomy Observatory, the University of Alaska Museum of the North, and the University of Washington-Bothell to bring biomaterials, optics, photonics, and nanotechnology content, art infused experiences, and career awareness to art-interested girls. This full scale development project, Project STEAM, will explore the intersections between biology, physics, and art using advanced technologies at the nano to macro scale levels. Middle school girls from predominately underrepresented Alaskan Native, Native American (Tohono O'odham, Pascula Yaqui) and Hispanic groups, their families, teachers, and Girl Scout Troop Leaders in two site locations- Anchorage, Alaska and Tucson, Arizona will participate in the project. Centered on the theme "Colors of Nature," Project STEAM will engage girls in science activities designed to enhance STEM learning and visual-spatial skills. Using advanced technologies, approximately 240 girls enrolled in the Summer Academy over the project duration will work with women scientist mentors, teachers, and Girl Scout Troop Leaders to create artistic representations of natural objects observed at the nano and macro scale levels. Forty girls will participate in the Summer Academy in year one (20 girls per site- Alaska and Arizona). In consequent years, approximately180 girls will participate in the Academy (30 girls per site). Another 1,500 girls are expected to be reached through their Girl Scout Troop Leaders (n=15) who will be trained to deliver a modified version of the program using specialized curriculum kits. In addition, over 6,000 girls and their families are expected to attend Project STEAM Science Cafe events held at local informal science education institutions at each site during the academic year. In conjunction with the programmatic activities, a research investigation will be conducted to study the impact of the program on girls' science identity. Participant discourse, pre and post assessments, and observed engagement with the scientific and artistic ideas and tools presented will be examined and analyzed. A mixed methods approach will also be employed for the formative and summative evaluations, which will be conducted by The Goldstream Group. Ultimately, the project endeavors to increase STEM learning and interest through art, build capacity through professional development, advance the research base on girls' science identity and inspire and interest girls in STEM careers.
Science STARS (Stars Tackling Authentic & Relevant Science) is an after-school program that will engage approximately 400 urban middle school girls in authentic inquiry-based scientific investigations and the creation of a science documentary that extends their research and situates their findings. The project has been piloted in Rochester, NY and will be expanded to sites in Lansing, MI and Seattle, WA. New elements have been added to enhance the project experience including the documentary video component, partnerships with local community outreach organizations, mentoring by local female scientists, leveraging embedded assessments to enhance the measurement of learning, and a conference and presentations to local stakeholders to showcase the work of the participants. Participants will meet during the school year plus three intensive weeks during the summer for a total of about 65 hours per year. A unique feature of this project is the use of pre-service teachers from local teacher preparation programs to facilitate the investigations. This in turn develops the capacity of pre-service teachers to implement and leverage inquiry-based learning in their practice. Project-level research will address questions of how models such as this encourage the development of positive science identities in girls and how situating science investigations in their community affects their understanding of science and local issues. The project evaluation will be conducted by Horizon Research and will focus on the quality of project activities, the quality of the project\'s research plan, and the impact on participants and pre-service teachers. Science STARS thoughtfully bridges formal and informal learning environments. While Science STARS largely situates its home base in schools in order to increase access to those who may not self-identify with science, the program is designed to capitalize on the unique affordances of informal settings and contribute to understanding how informal science education can be used to nurture positive science identities for urban middle school girls.
Girlstart will implement a comprehensive suite of informal STEM education programs that directly reach 2,500 4th-8th grade girls and their parents. This project will increase interest in and understanding of STEM disciplines by inspiring and engaging girls and their parents; it will establish linkages between formal and informal STEM education; and it will stimulate parents to support girls’ STEM learning endeavors by becoming informed proponents for high-quality STEM education. Over the course of 48 months—from fall 2012 to fall 2016—Girlstart seeks to develop new, robust, NASA-rich curriculum for its nationally-replicated Girlstart Summer Camp program, as well as year-long curriculum for its recognized Girlstart After School program. Curricula will be prepared for a range of ages and abilities and include links to electives, higher education majors, and careers. Girlstart will also conduct public and community STEM education programs throughout the region in NASA content areas. In addition, Girlstart will develop relevant, hands-on exhibits at the Girlstart STEM Center in Austin, Texas. Through this project, Girlstart will: (1) Increase facility and mastery in STEM skills. (2) Increase participants’ interest in pursuing STEM subjects and careers. (3) Increase participants’ understanding and mastery of the scientific method and the engineering design process as systems for problem solving and scientific discovery. (4) Increase participants’ understanding that there are multiple applications of STEM in everyday life. (5) Increase participants’ understanding of higher education as key to expanding career options. (6) Increase participants’ confidence and interest in conducting STEM activities. (7) Increase participants’ awareness of STEM careers.
The National Girls Collaborative Project (NGCP) seeks to maximize access to shared resources within projects and with public and private sector organizations and institutions interested in expanding girls’ participation in science, technology, engineering, and mathematics (STEM). Funded primarily by the National Science Foundation, the NGCP is a robust national network of more than 3,000 girl-serving STEM organizations. Currently, 31 Collaboratives, serving 40 states, facilitate collaboration between more than 12,800 organizations who serve more than 7.7 million girls and 4.4 million boys. The NGCP occupies a unique role in the STEM community because it facilitates collaboration with all stakeholders who benefit from increasing diversity and engagement of women in STEM. These stakeholders form Regional Collaboratives, who are connected to local girl-serving STEM programs. Regional Collaboratives are led by leadership teams and advisory boards with representatives from K-12 education, higher education, community-based organizations, professional organizations, and industry. NGCP strengthens the capacity of girl-serving STEM projects by facilitating collaboration among programs and organizations and by sharing promising practice research, program models, and products through webinars, collaboration training, and institutes. This is accomplished through a tested comprehensive program of change that uses collaboration to expand and strengthen STEM-related opportunities for girls and women. In each replication state, the NGCP model creates a network of professionals, researchers, and practitioners, facilitating collaboration within this network, and delivering high-quality research-based professional development. Participating programs can also receive mini-grant funding to develop collaborative STEM-focused projects. To date, over 27,000 participants have been served in 241 mini-grant projects, and over 17,000 practitioners have been served through in-person events and webinars. The NGCP’s collaborative model changes the way practitioners and educators work to advance girls’ participation in STEM. It facilitates the development of practitioners in their knowledge of good gender equitable educational practices, awareness of the role of K-12 education in STEM workforce development, and mutual support of peers locally and across the United States.
SciGirls CONNECT is a broad national outreach effort to encourage educators, both formal and informal, to adopt new, research-based strategies to engage girls in STEM. SciGirls (pbskids.org/scigirls) is an Emmy award-winning television program and outreach program that draws on cutting-edge research about what engages girls in science, technology, engineering and math (STEM) learning and careers. The PBS television show, kids' website, and educational outreach program have reached over 14 million girls, educators, and families, making it the most widely accessed girls' STEM program available nationally. SciGirls' videos, interactive website and hands-on activities work together to address a singular but powerful goal: to inspire, enable, and maximize STEM learning and participation for all girls, with an eye toward future STEM careers. The goal of SciGirls is to change how millions of girls think about STEM. SciGirls CONNECT (scigirlsconnect.org) includes 60 partner organizations located in schools, museums, community organizations and universities who host SciGirls clubs, camps and afterschool programs for girls. This number is intended grow to over 100 by the end of the project in 2016. SciGirls CONNECT provides mini-grants, leader training and educational resources to partner organizations. Each partner training session involves educators from a score of regional educational institutions. To date, over 700 educators have received training from over 250 affiliated organizations. The SciGirls CONNECT network is a supportive community of dedicated educators who provide the spark, the excitement and the promise of a new generation of women in STEM careers. Through our partner, the National Girls Collaborative Project, we have networked educational organizations hosting SciGirls programs with dozens of female role models from a variety of STEM fields. The SciGirls CONNECT website hosts monthly webinars, a quarterly newsletter, gender equity resources, SciGirls videos and hands-on activities. SciGirls also promotes the television, website and outreach program to thousands of elementary and middle school girls and their teachers both locally and nationally at various events.
Based on nearly two decades of museum programming for low-income Hispanic and African American girls at the Miami Science Museum, this extension service project employs a train-the-trainers approach to build a network of museum-based Extension Agents dedicated to helping informal science educators attract the interest and support the persistence of minority girls, grades 6-12, currently underrepresented in STEM studies. Led by the Miami Science Museum, the collaboration brings together an experienced group of institutions with representation from the informal science, gender research, and engineering communities. In addition to the Museum, the Expert Project Team consists of key staff from the Association of Science-Technology Centers (ASTC), and SECME Inc. (formerly the Southeastern Consortium of Minorities in Engineering), who serve as the conduit for the participation of minority engineering professional organizations. An advisory/research panel of researchers in gender in STEM, whose work complements those of the project investigators, works closely with the Expert Project Team to prepare Extension Agents from ten geographically dispersed museums, who in turn provide a range of training and peer mentoring services to the practitioner community of informal science educators in science-rich institutions nationwide. Participating museums include: Connecticut Science Center (Hartford, CT), New York Hall of Science (New York, NY), Maryland Science Center (Baltimore, MD), Miami Science Museum (Miami, FL), COSI (Columbus, OH), St. Louis Science Center (St. Louis, MO), Louisville Science Center (Louisville, KY), Sci-Port (Shreveport, LA), Explora (Albuquerque, NM), and California Academy of Sciences (San Francisco, CA).
DATE:
-
TEAM MEMBERS:
Judy BrownLaura Huerta MigasMichele Williams