EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
This project takes an ethnographic and design-based approach to understanding how and what people learn from participation in makerspaces and explores the features of those environments that can be leveraged to better promote learning. Makerspaces are physical locations where people (often families) get together to make things. Some participants learn substantial amounts of STEM content and practices as they design, build, and iteratively refine working devices. Others, however, simply take a trial and error approach. Research explores the affordances are of these spaces for promoting learning and how to integrate technology into these spaces so that they are transformed from being makerspaces where learning happens, but inconsistently, into environments where learning is a consistent outcome of participation. One aim is to learn how to effectively design such spaces so that participants are encouraged and helped to become intentional, reflective makers rather than simply tinkerers. Research will also advance what is known about effective studio teaching and learning and advance understanding of how to support youth to help them become competent, creative, and reflective producers with technology(s). The project builds on the Studio Thinking Framework and what is known about development of meta-representational competence. The foundations of these frameworks are in Lave and Wengers communities of practice and Rogoff's, Stevens et al.'s, and Jenkins et al.'s further work on participatory cultures for social networks that revolve around production. A sociocultural approach is taken that seeks to understand the relationships between space, participants, and technologies as participants set and work toward achieving goals. Engaging more of our young population in scientific and technological thinking and learning and broadening participation in the STEM workplace are national imperatives. One way to address these imperatives is to engage the passions of young people, helping them recognize the roles STEM content and practices play in achieving their own personal goals. Maker spaces are neighborhood spaces that are arising in many urban areas that allow and promote tinkering, designing, and construction using real materials, sometimes quite sophisticated ones. Participating in designing and successfully building working devices in such spaces can promote STEM learning, confidence and competence in one's ability to solve problems, and positive attitudes towards engineering, science, and math (among other things). The goal in this project is to learn how to design these spaces and integrate learning technologies so that learning happens more consistently (along with tinkering and making) and especially so that they are accessible and inviting to those who might not normally participate in these spaces. The work of this project is happening in an urban setting and with at-risk children, and a special effort is being made to accommodate making and learning with peers. As with Computer Clubhouses, maker spaces hold potential for their participants to identify what is interesting to them at the same time their participation gives them the opportunity to express themselves, learn STEM content, and put it to use.
The Complex Adaptive Systems as a Model for Network Evaluations (CASNET) study was a four-year research project investigating evaluation capacity building (ECB) within a network using a complexity theory lens. The study used a case study approach to examine and understand evaluation capacity building within the Nanoscale Informal Science Education Network (NISE Net). NISE Net is a national community of researchers and informal science educators dedicated to fostering public awareness, engagement, and understanding of nanoscale science, engineering, and technology. Instituted in 2005 through NSF funding (DRL-0532536 and 0940143), NISE Net has continuously expanded and is currently comprised of close to 600 science museum and university partners. The intent of the CASNET project was to provide insights on (1) the implications of complexity theory for promoting widespread and systemic use of evaluation within a network, and (2) complex system conditions that foster or impede ECB within a network, i.e., in this case, within the NISE Net.
Discover NASA is the Discovery Museum’s endeavor to engage students in grades K through 12 as well as members of the general public in innovative space science and STEM-focused learning through the implementation of two modules: upgrades to the Challenger Learning Center, and the creation of K through 12 amateur rocketry and spacecraft design programming. The programming will be piloted at the Discovery Museum and Planetarium, and at the Inter-district Discovery Magnet School and the Fairchild-Wheeler Multi-Magnet High School, with an additional strategic partnership with the University of Bridgeport, which will provide faculty mentors to high school seniors participating in the rocketry program. Through these two modules, the Discovery Museum and Planetarium aims to foster an early interest in STEM, increase public awareness about NASA, promote workforce development, and stimulate an interest in the future of human space exploration. Both modules emphasize design methodologies and integration of more advanced space science into the STEM curriculum currently offered by Discovery Museum to visitors and public schools. The Challenger Learning Center upgrades will enable the Museum to deliver simulated human exploration experiences related to exploration of the space environment in Low Earth Orbit and simulated human exploration of Moon, Mars, and beyond, which will increase public and student awareness about NASA and the future of human space exploration. The development of an amateur rocketry and spacecraft development incubator for education, the general public, and commercial space will stimulate the development of key STEM concepts.
The University of Oklahoma will increase knowledge about how youths create information and how information professionals can help them become successful information creators by promoting their information and digital literacies and other 21st century skills. This Early Career research project builds on existing research and results of previously funded IMLS Learning Labs by investigating how twenty-four middle school students engaged in project-based, guided-inquiry STEM learning to create information in a school library Learning Lab/Makerspace. The project will result in a model of information-creating behavior that can help develop a groundbreaking approach to information literacy instructions and creative programs.
The New Children's Museum will launch the LAByrinth project to engage the community in the creation of a permanent art installation. The museum will convene a cross-disciplinary team to design and build the LAByrinth, a climbing structure that will serve 140,000 people annually. The museum will develop relationships with underserved families and current and future museum users, and also create an ongoing community-based exhibition development process to create sustainable mechanisms for continued community involvement. The project will introduce a new socially-engaged process for creating exhibitions, which will serve as a sustainable creative catalyst for San Diego families.
The Cyberlearning and Future Learning Technologies Program funds efforts that support envisioning the future of learning technologies and advance what we know about how people learn in technology-rich environments. In this Cyberlearning EAGER project, the project team is developing foundations for using "paper mechatronics" as a learning technology. Paper mechatronics makes possible a craft-oriented approach to engineering and computing education that integrates key concepts from mechanical engineering, electrical engineering, control systems, and computer programming, while using paper as the primary material for learner design, exploration, and inquiry. In this approach, learners will design foldable paper components and assemblies; program motors, sensors and controls; test their ideas iteratively; and share their designs on a website. This paper-based modeling approach to learning concepts in and practices of mechanical engineering, electrical engineering, control systems, and computer programming ultimately aims to make it possible for all learners to have exposure to and the opportunity to participate in creative engineering, design, and computer programming.
The approach to learning through designing and making through paper mechatronics is made possible by a convergence of many different technological factors -- the array of small computers, sensors, and actuators that are becoming available at low cost and a size that children can use; availability of a wide variety of manipulable conductive materials (threads, paints, fabrics); low-cost and precise desktop and laser cutters for paper and similar materials; a wide variety of novel paper-like materials; and new ways of interacting with the computer. The approach has its foundations in Papert's constructionism and in the current maker movement, but it has potential beyond constructionism itself, both in practice and with respect to what can potentially be learned about learning and development in in context of its use.
Pacific Science Center will expand its Science, Technology, Engineering and Math—Out-of-School Time (STEM-OST) model to new venues in the Puget Sound region to improve science literacy and increase interest in STEM careers for youth. STEM-OST brings hands-on lessons and activities in physics, engineering, astronomy, mathematics, geology, and health to elementary and middle school children in underserved communities throughout the summer months. The center will modify lessons and activities to serve students in grades K-2, align the curriculum with the Next Generation Science Standards, and increase the number of Family Science Days and Family Science Workshops offered to enhance parent involvement in STEM learning. The program will employ a tiered mentoring approach with outreach educators, teens, and education volunteers to increase interest in STEM content and provide direct links between STEM and workforce preparedness.
The Lawrence Hall of Science will implement the "Mobile Inventor's Lab," a project to extend the benefits of an ongoing outreach program into a model that can serve visitors at a variety of locations in communities underserved by local science education organizations. The museum will refine its engineering design experiences to be easily reconfigured and delivered in a variety of locations, and develop activities and kits for library and community partner staff. This project will expand the impact of the hall's educational resources and offer audiences the opportunity to interact with and learn about engineering design experiences in their own communities.
The Museum of Science and Industry (MOSI), in collaboration with the Tampa Community Development Corporation (CDC), will create a youth STEAM (science, technology, engineering, arts, and mathematics) program designed by East Tampa neighborhood participants for the neighborhood. The STEAM program will be a first of its kind in the area and will bring a continuum of experiences in STEAM fields to underserved middle and high school students, as well as volunteer participants, who come from the East Tampa neighborhood. Initial programming topics for career exploration include astronomy/cosmology and space exploration, environmental sciences, engineering, robotics, crime scene forensics, and medical explorations. The project will expand the museum's ability to create a STEAM continuum, increase interest in STEAM careers, and to increase awareness of skills necessary to be successful in STEAM careers.
The Museum of Science, Boston will prototype several exhibit elements to be included in the Charles River Gallery, a new 3,000-square-foot exhibition gallery atop the Charles River Dam that explores the connection between the science of the natural world and that of the engineered world. The exhibits will be fabricated using the concepts of universal design in an ongoing effort to make the museum's offerings available to the greatest number of people, regardless of age, background, and ability. Through a combination of surveys and observational studies, museum staff will evaluate the effectiveness of proposed gallery components and use the results to improve visitor experience and comprehension of the new exhibit themes. The prototyping activities will also allow the museum to investigate how cross-disciplinary studies enable better understanding of human interaction in complex environments.
The Free Library of Philadelphia Foundation will create on-the-floor makerspaces in libraries in underserved neighborhoods in North Philadelphia. These spaces will help local residents of all ages to gain access to technology and participatory education, and encourage creative applications and collaborative projects. Mentors will guide multigenerational community members as they create cross-disciplinary, interest-driven electronic art projects; build interest and knowledge in STEAM (Science, Technology, Engineering, Art, and Mathematics), and use tools and skills to create and share artifacts that reflect their identities and communities. Through the act of making, participants of all ages will have the opportunity to design meaningful digital and physical objects that capture the richness and diversity of their neighborhoods. These place-based, interest-driven, and mentor-guided makerspaces will provide a replicable, scalable model for libraries and museums nationally.