EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
This pathways project will design, develop and test Do-It-Yourself, (DIY), hands-on workshops to introduce and teach middle school females in underserved Latino communities computing and design by customizing and repurposing e-waste media technology, such as old cell phones or appliances -- items found in the students homes or neighborhoods. The major outcome of the project will be the creation of a workshop kit that covers the processes of DIY electronics learning taking place in the workshops for distribution of the curriculum to after school programs and other informal science venues. The PIs have implemented three pilot projects over the last three years that demonstrate the ability of hands-on DIY electronics curricula to motivate and encourage students and to enable them to acquire a deeper understanding of core engineering, mathematics and science concepts. This project would extend the approach to underserved Latino youth, particular girls of middle school age. This audience was identified because of the historically low rate of participation in STEM fields by people in this group and the particular challenges that females have in acquiring knowledge in technical STEM areas. The proposal suggests that the approach of using hands-on workshops that rely on low technical requirements -- essentially obsolete or discarded electronic equipment, primarily from homes of participants -- will encourage the target audience to experiment with items they are familiar with and that are culturally relevant. The hypothesis of the project is that this approach will lower barriers to experimenting with "circuit bending" - the hand-modifying of battery-powered children's toys to build custom electronic instruments and lead to greater participation and success of females in the target group. The project will provide free workshops in two neighborhood locations and be supported by undergraduate student mentors and volunteers and staff of two community groups that are part of the project, Machine Project and Girls, Inc. Participants will demonstrate the finished projects to the workshop group, mentors and parents. Each participant will receive a copy of the workshop handbook in both English and Spanish to take home so that parents, members of the community and caregivers can supervise and participate in future projects.
DATE:
-
TEAM MEMBERS:
Garnet HertzGillian HayesRebecca Black
Montana’s Big Sky Space Education: NASA ExplorationSpace at ExplorationWorks CP4SMP grant goal was to stimulate youth and adult interest in human space exploration and STEM careers in communities across Montana, through exhibits, field trips, STEM classes, and public presentations by ethnically diverse NASA women scientists and engineers.
Project partners included Dr. Dava Newman, MIT Professor of Aeronautics and Astronautics; Gui Trotti, Trotti and Associates; Dr. Angela DesJardins of the MT Space Grant Consortium at MT State University; the Montana Girl’s STEM Collaborative; the Montana Women’s Foundation ; Boeing; and the Oregon Museum of Science and Industry.
The grant’s objectives were:
stimulating general public interest in NASA’s human exploration of Space, facilitated through exhibits about space exploration and space careers, and
supporting STEM education, especially in robotics, computer science, and electro-mechanical inventions in elementary through high school students.
Outcomes included public awareness of this NASA mission, increased awareness of the role of the ISS, and increased interest of elementary girls in technology classes. This grant also led to the procurement/development of space-themed exhibits, including the national touring Black Holes exhibit, and exhibits on the ISS and the Mars rovers created by ExplorationWorks.
Four exhibits were produced: the Knowledge Station, MarsWalker, NASA Women in Aerospace (including Newman’s Biosuit) and “Women in Space,” a national touring exhibition showcasing Dr. Dava Newman’s prototype Mars BioSuit and NASA’s ethnically-diverse women scientists and engineers.
NASA CP4SMP grant support also opened the door to:
a Boeing Corporation investment in robotics systems appropriate for 1st through 8th graders,
expansion of our after-school Girl Tech for low-income girls,
the introduction of after-school and summer Sci Girls for 4th through 6th grade girls,
an annual Girl’s STEM Round-up STEM career immersion day for 5th through 12th grade girls, showcasing young Montana STEM career women as mentors
challenges in accommodating all the children and youth who wish to enroll in our year-round robotics classes.
the introduction of Girl Scout robotics-focused (“Bots and Bling”) Overnights at ExplorationWorks. Families travel 4 to 6 hours to participate in the Overnights, made possible by an ancillary grant from the Montana Women’s Foundation.
Girlstart will implement a comprehensive suite of informal STEM education programs that directly reach 2,500 4th-8th grade girls and their parents. This project will increase interest in and understanding of STEM disciplines by inspiring and engaging girls and their parents; it will establish linkages between formal and informal STEM education; and it will stimulate parents to support girls’ STEM learning endeavors by becoming informed proponents for high-quality STEM education. Over the course of 48 months—from fall 2012 to fall 2016—Girlstart seeks to develop new, robust, NASA-rich curriculum for its nationally-replicated Girlstart Summer Camp program, as well as year-long curriculum for its recognized Girlstart After School program. Curricula will be prepared for a range of ages and abilities and include links to electives, higher education majors, and careers. Girlstart will also conduct public and community STEM education programs throughout the region in NASA content areas. In addition, Girlstart will develop relevant, hands-on exhibits at the Girlstart STEM Center in Austin, Texas. Through this project, Girlstart will: (1) Increase facility and mastery in STEM skills. (2) Increase participants’ interest in pursuing STEM subjects and careers. (3) Increase participants’ understanding and mastery of the scientific method and the engineering design process as systems for problem solving and scientific discovery. (4) Increase participants’ understanding that there are multiple applications of STEM in everyday life. (5) Increase participants’ understanding of higher education as key to expanding career options. (6) Increase participants’ confidence and interest in conducting STEM activities. (7) Increase participants’ awareness of STEM careers.
Over the past 50 years, women in the United States have made great strides in education and entry into the work force in this country. However, despite these advances, women continue to be underrepresented in the fields of science, technology, engineering, and math, collectively referred to as “STEM.” Women’s representation is low at all levels of the STEM career “pipeline,” from interest and intent to majoring in a STEM field in college to having a career in a STEM field in adulthood. Studies show that girls lose interest in math and science during middle school, and STEM interest for girls
DATE:
TEAM MEMBERS:
Kamla ModiJudy SchoenbergKimberlee Salmond
Based on lessons learned from more than a decade of OST STEM programming for urban youth, Project Exploration proposes an alternative to the pipeline: Youth-Science Pathways. Youth-Science Pathways enable program providers to move beyond “pipeline” priorities to design for outcomes in which STEM learning experiences support young people’s social and emotional development. Changing the metaphor from a pipeline to pathway transforms the purpose of the educational effort: rather than an endeavor in which students’ experiences support STEM academic and workforce outcomes, STEM experiences are put
This presentation from the January 2012 Annual Meeting of the Association for Science Teacher Education examines identity formation in middle school science, presenting informal education programs as a way to change perceptions by exposing students to real scientists. The study focuses on middle school students' science identity formations before and after their participation in summer science camps.
The National Girls Collaborative Project (NGCP) seeks to maximize access to shared resources within projects and with public and private sector organizations and institutions interested in expanding girls’ participation in science, technology, engineering, and mathematics (STEM). Funded primarily by the National Science Foundation, the NGCP is a robust national network of more than 3,000 girl-serving STEM organizations. Currently, 31 Collaboratives, serving 40 states, facilitate collaboration between more than 12,800 organizations who serve more than 7.7 million girls and 4.4 million boys. The NGCP occupies a unique role in the STEM community because it facilitates collaboration with all stakeholders who benefit from increasing diversity and engagement of women in STEM. These stakeholders form Regional Collaboratives, who are connected to local girl-serving STEM programs. Regional Collaboratives are led by leadership teams and advisory boards with representatives from K-12 education, higher education, community-based organizations, professional organizations, and industry. NGCP strengthens the capacity of girl-serving STEM projects by facilitating collaboration among programs and organizations and by sharing promising practice research, program models, and products through webinars, collaboration training, and institutes. This is accomplished through a tested comprehensive program of change that uses collaboration to expand and strengthen STEM-related opportunities for girls and women. In each replication state, the NGCP model creates a network of professionals, researchers, and practitioners, facilitating collaboration within this network, and delivering high-quality research-based professional development. Participating programs can also receive mini-grant funding to develop collaborative STEM-focused projects. To date, over 27,000 participants have been served in 241 mini-grant projects, and over 17,000 practitioners have been served through in-person events and webinars. The NGCP’s collaborative model changes the way practitioners and educators work to advance girls’ participation in STEM. It facilitates the development of practitioners in their knowledge of good gender equitable educational practices, awareness of the role of K-12 education in STEM workforce development, and mutual support of peers locally and across the United States.
SciGirls CONNECT is a broad national outreach effort to encourage educators, both formal and informal, to adopt new, research-based strategies to engage girls in STEM. SciGirls (pbskids.org/scigirls) is an Emmy award-winning television program and outreach program that draws on cutting-edge research about what engages girls in science, technology, engineering and math (STEM) learning and careers. The PBS television show, kids' website, and educational outreach program have reached over 14 million girls, educators, and families, making it the most widely accessed girls' STEM program available nationally. SciGirls' videos, interactive website and hands-on activities work together to address a singular but powerful goal: to inspire, enable, and maximize STEM learning and participation for all girls, with an eye toward future STEM careers. The goal of SciGirls is to change how millions of girls think about STEM. SciGirls CONNECT (scigirlsconnect.org) includes 60 partner organizations located in schools, museums, community organizations and universities who host SciGirls clubs, camps and afterschool programs for girls. This number is intended grow to over 100 by the end of the project in 2016. SciGirls CONNECT provides mini-grants, leader training and educational resources to partner organizations. Each partner training session involves educators from a score of regional educational institutions. To date, over 700 educators have received training from over 250 affiliated organizations. The SciGirls CONNECT network is a supportive community of dedicated educators who provide the spark, the excitement and the promise of a new generation of women in STEM careers. Through our partner, the National Girls Collaborative Project, we have networked educational organizations hosting SciGirls programs with dozens of female role models from a variety of STEM fields. The SciGirls CONNECT website hosts monthly webinars, a quarterly newsletter, gender equity resources, SciGirls videos and hands-on activities. SciGirls also promotes the television, website and outreach program to thousands of elementary and middle school girls and their teachers both locally and nationally at various events.
Arizona State University (ASU) in collaboration with Arizona Science Center, Boeing, Intel, Microchip, Motorola, Salt River Project, AZ Foundation for Resource Education, AZ Game & Fish Department, US Partnership for the Decade of Education for Sustainable Development, Mesa Public Schools, and Boys & Girls Clubs of the East Valley, offer a three-year extracurricular project resulting in IT/STEM-related learning outcomes for 96 participants in grades 7, 8, and 9. The project targets and engages female and minority youth traditionally under-represented in IT/STEM fields in multi-year out-of-school technological design and problem solving experiences. These include summer internships/externships and university research in the science center and industrial settings where participants develop socially responsible solutions for challenging real world problems. The program includes cognitive apprenticeships with diverse mentors, opportunities to practice workplace skills such as leadership, teamwork, time management, creativity and reporting, and use of technological tools to gather and analyze complex data sets. Participants simulate desert tortoise behaviors, research and develop designs to mitigate the urban heat island, build small-scale renewable energy resources, design autonomous rovers capable of navigating Mars-like terrain, and develop a model habitat for humans to live on Mars. Together with their families participants gain first-hand knowledge of IT/STEM career and educational pathways. In addition to youth outcomes, the adults associated with this project are better prepared to positively influence IT/STEM learning experiences for under-represented youth. The evaluation measures participant content knowledge, attitudes and interest in IT/STEM subjects, workplace skills and intentions to pursue IT/STEM educational and career pathways to understand participant reactions, learning, transfer and results. Informal curricula developed through this project, field-tested with youth at Boys & Girls Clubs and youth at Arizona Science Center will be available on the project website.
DATE:
-
TEAM MEMBERS:
Tirupalavanam GaneshMonica ElserStephen KrauseDale BakerSharon Robinson-Kurplus
The Learning and Youth Research and Evaluation Center (LYREC) is a collaboration of the Exploratorium, Harvard University, Kings College London, SRI International and UC Santa Cruz. LYREC provides technical assistance to NSF AYS projects, collects and synthesizes their impact data, and oversees dissemination of progress and results. This center builds on the Center for Informal Learning in Schools (CILS) that has developed a theoretical approach that takes into account the particular strengths and affordances of both Out of School Teaching (OST) and school environments. This foundation will permit strengthening the potential of the NSF AYS projects to develop strong local models that can generate valid and reliable data that can guide future investment, design and research aimed at creating coherence across OST and school settings. The overarching questions for the work are: 1. How can OST programs support K-8 engagement and learning in science, and in particular how can they contribute to student engagement with K-8 school science and beyond? 2. What is the range of science learning outcomes OST programs can promote, particularly when in collaboration with schools, IHE's, businesses, and other community partners? 3. How can classroom teachers and schools build on children's OST experiences to strengthen children's participation and achievement in K-12 school science Additionally, the data analysis will reveal: 1. How OST programs may be positioned to support, in particular, high-poverty, female and/or minority children traditionally excluded from STEM academic and career paths; and 2. The structural/organizational challenges and constraints that exist to complicate or confound efforts to provide OST experiences that support school science engagement, and conversely, the new possibilities which are created by collaboration across organizational fields. Data will be gathered from surveys, interviews, focus groups, evaluation reports, and classroom and school data.