EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
This project takes an ethnographic and design-based approach to understanding how and what people learn from participation in makerspaces and explores the features of those environments that can be leveraged to better promote learning. Makerspaces are physical locations where people (often families) get together to make things. Some participants learn substantial amounts of STEM content and practices as they design, build, and iteratively refine working devices. Others, however, simply take a trial and error approach. Research explores the affordances are of these spaces for promoting learning and how to integrate technology into these spaces so that they are transformed from being makerspaces where learning happens, but inconsistently, into environments where learning is a consistent outcome of participation. One aim is to learn how to effectively design such spaces so that participants are encouraged and helped to become intentional, reflective makers rather than simply tinkerers. Research will also advance what is known about effective studio teaching and learning and advance understanding of how to support youth to help them become competent, creative, and reflective producers with technology(s). The project builds on the Studio Thinking Framework and what is known about development of meta-representational competence. The foundations of these frameworks are in Lave and Wengers communities of practice and Rogoff's, Stevens et al.'s, and Jenkins et al.'s further work on participatory cultures for social networks that revolve around production. A sociocultural approach is taken that seeks to understand the relationships between space, participants, and technologies as participants set and work toward achieving goals. Engaging more of our young population in scientific and technological thinking and learning and broadening participation in the STEM workplace are national imperatives. One way to address these imperatives is to engage the passions of young people, helping them recognize the roles STEM content and practices play in achieving their own personal goals. Maker spaces are neighborhood spaces that are arising in many urban areas that allow and promote tinkering, designing, and construction using real materials, sometimes quite sophisticated ones. Participating in designing and successfully building working devices in such spaces can promote STEM learning, confidence and competence in one's ability to solve problems, and positive attitudes towards engineering, science, and math (among other things). The goal in this project is to learn how to design these spaces and integrate learning technologies so that learning happens more consistently (along with tinkering and making) and especially so that they are accessible and inviting to those who might not normally participate in these spaces. The work of this project is happening in an urban setting and with at-risk children, and a special effort is being made to accommodate making and learning with peers. As with Computer Clubhouses, maker spaces hold potential for their participants to identify what is interesting to them at the same time their participation gives them the opportunity to express themselves, learn STEM content, and put it to use.
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
Portal to the Public: Expanding the National Network (PoP: ENN) is implementing around the county the successful NSF-funded Portal to the Public model in which researchers are trained to communicate and interact with the general public at informal science education (ISE) institutions about the research that they are conducting. The project, which follows on a thorough evaluation of the model at eight sites and current implementation at an additional fifteen sites, will incorporate twenty new ISE sites into the growing network, provide training and mentorship to ISE professionals on the use and adaptation of the PoP implementation manual and toolkits, and develop an enhanced network website that will serve as a communication and innovation hub. The work is responsive to the needs and activities of ISE organizations which continue to expand their missions beyond presenting to the public established science, technology, engineering and math (STEM) and are working to become places where visitors can also experience the process and promise of current research via face-to-face interactions with researchers. The project is expanding both the kind and number of institutions involved around the country and is facilitating their capacity to develop a knowledge base, share experiences and best practices.
The mission of the New Mexico Informal Science Education Network (NM ISE Net) is to provide opportunities and resources for informal educators to work together to impact science teaching, science learning, and science awareness throughout the state of New Mexico. The NM Museum of Natural History and Science leads NM ISE Net with support from NM EPSCoR.
DATE:
-
TEAM MEMBERS:
New Mexico Museum of Natural HistorySelena ConnealyCharlie Walter
Indianapolis / City as Living Laboratory (I/CaLL) is a city-wide civic collaboration engaging in cross-sector research that builds on prior research in informal science learning in public settings. It extends research in place-based and service learning traditions, and uses the city itself as an informal science learning (ISL) environment for Science and Engineering for Environmental Sustainability learning outcomes. This project is creating place-based science learning experiences as part of public spaces in Indianapolis and establishes the next generation of urban science museums that increase opportunities for learning. The project will develop a self-sustaining program for art/science collaborations as they inaugurate city-sanctioned changeable installations at I/CaLL sites. Data from the project will be used to inform ISL professionals at museums throughout the community and around the country. Thousands of volunteers and their families will help create I/CaLL spaces, engage with communities, and serve as research participants connecting with science learning through site development. The unprecedented scale of this project provides a full measure of informal science service learning at a city scale, offering data that can change how science learning is measured, how people from all walks of life develop science literacy as part of their social public experience, and embodying the concept of the city as a living science learning lab. Broader impacts include the development of the city as an informal science learning environment that will become a new standard for thinking about what cities as cultural units can become as we build a resilient Science and Engineering culture for Environmental Sustainability.
The University of Texas at El Paso will conduct a research project that implements and documents the impact of co-generative dialogues on youth learning and youth-scientist interactions as part of a STEM research program (i.e., Work with A Scientist Program). Co-generative dialogues seek to specifically assist with communication and understanding among collaborators. Over four years, 108 11th grade youth from a predominantly (90%) Hispanic high school will conduct STEM research with twelve scientists/engineers (e.g., chemist, civil engineer, geologist, biologist) and undergraduate/graduate students as part of 7 month-long after school program, including bi-weekly Saturday activities for 5 months followed by an intensive month-long, self-directed research project in the summer. Youth will be randomly assigned to experimental groups that include the co-generative dialogue treatment and control groups without the intervention. The scientists and their STEM undergraduate/graduate students will participate in both experimental and control groups, with different youth. Youth will receive high school credit to encourage participation and retention. The PI team hypothesizes that co-generative dialogues will result in improved learning, communication, and research experiences for both youth and scientists. Educational researchers will conduct co-generative dialogues, observations, interviews, and surveys using validated instruments to address the following research goals: (1) To investigate the impact of the treatment (co-generative dialogues) on youth knowledge, attitudes, perceptions of their experience, and their relationships with the scientists; (2) To investigate the impact of the treatment on scientists and graduate students; and (3) To identify critical components of the treatment that affect youth-scientist interactions. It is anticipated that, in addition to providing in-depth STEM research experiences for 108 youth from underrepresented groups at a critical time in their lives, the project will result in widely applicable understandings of how pedagogical approaches affect both youth learning and scientist experiences. The project also seeks to bridge learning environments: informal, formal, university and digital.
This full-scale project addresses the need for more youth, especially girls, to pursue an interest in engineering and eventually fill a critical workforce need. The project leverages museum-based exhibits, girls' activity groups, and social media to enhance participants' engineering-related interests and identities. The project includes the following bilingual deliverables: (1) Creative Solutions programming will engage girls in group oriented engineering activities at partner community-based organizations, where the activities highlight altruistic, personally relevant, and social aspects of engineering. Existing community groups will use the activities in their regular meeting structure. Visits to the museum exhibits, titled Design Your World will reinforce messages; (2) Design Your World Exhibits will serve as a community hub at two ISE institutions (Oregon Museum of Science and Industry and the Hatfield Marine Science Center). They will leverage existing NSF-funded Engineer It! (DRL-9803989) exhibits redesigned to attract, engage, and mobilize a more diverse population by showcasing altruistic, personally relevant, and social aspects of engineering; (3) Digital engagement through targeted use of social media will complement program and exhibit content and be an online portal for groups engaged in the project; (4) A community action group (CAG) will provide professional development opportunities to stakeholders interested in girls' STEM identity (e.g. parents, STEM-based business professionals) to promote effective engineering messaging throughout the community and engage them in supporting project participants; and (5) Longitudinal research will explore how girls construct and negotiate engineering-related identities through discourse across the project activities and over time.
This award continues funding of a Center to conduct research and education on the interactions of nanomaterials with living systems and with the abiotic environment. The goals of this Center are to develop a predictive understanding of biological and ecological toxicology for nanomaterials, and of their transport and transformation in the environment. This Center engages a highly interdisciplinary, multi-institutional team in an integrated research program to determine how the physical and chemical properties of nanomaterials determine their environmental impacts from the cellular scale to that of entire ecosystems. The research approach promises to be transformative to the science of ecotoxicology by combining high throughput screening assays with computational and physiological modeling to predict impacts at higher levels of biological organization. The Center will unite the fields of engineering, chemistry, physics, materials science, cell biology, ecology, toxicology, computer modeling, and risk assessment to establish the foundations of a new scientific discipline: environmental nanotoxicology. Research on nanomaterials and development of nanotechnology is expanding rapidly and producing discoveries that promise to benefit the nation?s economy, and improve our ability to live sustainably on earth. There is now a critical need to reduce uncertainty about the possible negative consequences of nanomaterials in the environment, while at the same time providing guidelines for their safe design to prevent environmental and toxicological hazards. This Center addresses this societal need by developing a scientific framework of risk prediction that is paradigm-shifting in its potential to keep pace with the commercial expansion of nanotechnology. Another impact of the Center will be development of human resources for the academic community, industry and government by training the next generation of nano-scale scientists, engineers, and regulators to anticipate and mitigate potential future environmental hazards of nanotechnology. Partnerships with other centers will act as powerful portals for the dissemination and integration of research findings to the scientific, educational, and industrial communities, both nationally and internationally. This Center will contribute to a network of nanotechnology centers that serve the national needs and expand representation and access to this research and knowledge network through programs directed at California colleges serving underrepresented groups. Outreach activities, including a journalist-scientist communication program, will serve to inform both experts and the public at large about the safety issues surrounding nanotechnology and how to safely produce, use, and dispose of nanomaterials.
DATE:
-
TEAM MEMBERS:
Andre NelYoram CohenHilary GodwinArturo KellerPatricia Holden
Techbridge has proposed a broad implementation project that will scale up a tested multi-faceted model that increases girls' interest in STEM careers. The objectives of this project are to increase girls' engineering, technology, and science skills and career interests; build STEM capacity and sustainability across communities; enhance STEM and career exploration for underrepresented girls and their families; and advance research on the scale-up, sustainability, and impact of the model with career exploration. The Techbridge approach is grounded in Eccles' expectancy value model, and helps bridge critical junctures as girls transition from elementary to middle school and middle school to high school, immersing participants in a network of peers and supportive adults. Techbridge targets girls in grades 5-12 with a model that includes five components: a previously tested and evaluated curriculum, career exploration, professional development for staff and teachers, family engagement, and dissemination. The inquiry-based curriculum introduces electrical engineering and computer science through engaging, hands-on units on Cars and Engines, Green Design, and Electrical Engineering. The Techbridge model will be enhanced to include a central repository for curriculum and support materials, electronic girl-driven career exploration resources, an online learning community and video tools for staff, and customized family guides. Project deliverables include the dissemination of the enhanced model to three cities, 24 school sites and teachers, 2,000 girls, and over 600 role models. A supplementary research component will study the broad implementation of the Techbridge model by examining the fidelity of implementation and the program's impact on girls' STEM engagement and learning. The research questions are as follows: (1) To what extent and how do new program sites demonstrate adherence to the Techbridge program model? (2) Do new sites experience similar or increased participant responsiveness to Techbridge programming with regard to scientific learning outcomes, career awareness, attitude and interest in engineering? (3)How are changes experienced by girls sustained over time, if at all? (4) To what extent and how do new sites balance instilling the Techbridge essentials, those critical components Techbridge identifies as essential for success, with the need for local adaptation and ownership of the program? and (5) Given the potential for customization in local communities, do new sites maintain programmatic quality of delivery experienced at the original site? If so, what are elements essential to success regarding quality delivery? The mixed-methods study will include document analysis, embedded assessments, participant survey scales, and observations. Qualitative data methods include interviews with teachers, role models, staff and focus groups with girls. A project evaluation will also be conducted which investigates project outcomes for participants (girls, teachers, role models, and families) and fidelity of the implementation and enhancements at expansion sites, using a quasi-experimental approach. Career and learning outcomes for girls will be determined using embedded assessments, portfolios, surveys, school data, and previously validated instruments such as the Career Interest Questionnaire and the Modified Attitudes towards Science Inventory. The Managing Complex Change model is used as a framework for the project evaluation for the purpose of examining factors related to the effectiveness of scaling. The dissemination of research and evaluation findings will be achieved through the use of publications, blogs, social media, and conferences. It is anticipated that this project will broaden the participation of Hispanic, African-American, and English language learner girls, build capacity for STEM programming and sustainability at the dissemination sites, and disseminate findings to over 1 million educators, researchers, and community members. Broader impacts include contributing to the field's understanding of how virtual role models and field trips can engage young women, increase corporate advocacy, and engage participants in research and dissemination efforts.
This CAREER proposal focuses on the development of teachers' identities, which are operationalized as beliefs and practices, behaviors, and pedagogical knowledge. The PI uses a qualitative approach, occurring over two phases, to investigate the impact of formal-informal collaborations on identity development over time. The study is grounded in an ecological theoretical approach that incorporates a view of informal learning settings as learner-driven and unique in providing opportunities for interaction with objects during meaning-making experiences among groups of learners. The longitudinal research design includes collection of an array of data, including observations of teaching and learning activities, interviews, survey responses, and archival documents such as student work and videos of classroom experiences. The PI uses a narrative analysis and a grounded theoretical approach to generate themes about beliefs and practices around behaviors and pedagogical knowledge informed by informal science education experiences. Research findings and related educational activities inform the field's understanding of best practices of integrating informal science activities into science teacher education, including determining appropriate kinds of support for STEM teachers who learn to teach in informal learning environments (ILE). The PI is integrating research findings in the revision of existing courses and the development of new courses and experiences for both new and experienced teachers. The project addresses the need for empirical evidence of impacts of ILE experiences on professional development, and will build capacity of informal science institution and university professionals to provide effective teacher education experiences and new teacher support.
CENTC's (Center for Enabling New Technologies Through Catalysis) outreach is focused on partnerships with science centers. Initially we worked with the Pacific Science Center (PSC) to train our students in effective communication of science concepts to public audiences. Later we developed a short-term exhibit, Chemist - Catalysts for Change in the Portal to Current Research space. As part of the CCI/AISL partnership program, we partnered with Liberty Science Center to create an activity on a multi-touch media table, "Molecule Magic." We are currently developing another exhibit with PSC.