EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
resourceresearchProfessional Development, Conferences, and Networks
The National Academies’ Science and Technology for Sustainability Program (STS) in the division of Policy and Global Affairs was established to encourage the use of science and technology to achieve long-term sustainable development. The goal of the STS program is to contribute to sustainable improvements in human well-being by creating and strengthening the strategic connections between scientific research, technological development, and decision-making. The program concentrates on activities with the following attributes:
• Cross-cutting in nature, requiring expertise from multiple
DATE:
TEAM MEMBERS:
National Academies of Sciences, Engineering, and Medicine
resourceprojectProfessional Development, Conferences, and Networks
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
The Balboa Park Cultural Partnership, in collaboration with several informal science education and other cultural and business organizations in San Diego, Chicago, and Worcester, MA are implementing a research and development project that investigates a range of possible approaches for stimulating the development of 21st Century creativity skills and innovative processes at the interface between informal STEM learning and methods for creative thinking. The goal of the research is to advance understanding of the potential impacts of creative thinking methods on the public's understanding of and engagement with STEM, with a focus on 21st Century workforce skills of teens and adults. The goal of the project's development activities is to experiment with a variety of "innovation incubator" models in cities around the country. Modeled on business "incubators" or "accelerators" that are designed to foster and accelerate innovation and creativity, these STEM incubators generate collaborations of different professionals and the public around STEM education and other STEM-related topics of local interest that can be explored with the help of creative learning methodologies such as innovative methods to generate creative ideas, ideas for transforming one STEM idea to others, drawing on visual and graphical ideas, improvisation, narrative writing, and the process of using innovative visual displays of information for creating visual roadmaps. Hosting the project's incubators are the Balboa Park Cultural Partnership (San Diego), the Museum of Science and Industry (Chicago) and the EcoTarium (Worcester, MA). National partners are the Association of Science-Technology Centers, the American Association for the Advancement of Science, and the Americans for the Arts. Activities will include: the formation and collaborative processes of three incubator sites, a research study, the development of a creative thinking curriculum infused into science education, professional development based on the curriculum, public engagement events and exhibits, a project website and tools for social networking, and project evaluation. A national advisory council includes professionals in education, science, creativity, and business.
Taking NPASS (National Partnerships for Afterschool Science) to Scale builds on a previously funded effort (DRL 0515549) designed to provide professional development for out-of-school time (OST) science trainers, administrators, and frontline staff in collaboration with the California School-Age Consortium, the Georgia Afterschool Investment Council, The After-School Institute, Minnesota School Age Child Care Alliance, University of Missouri-Columbia, University of New Hampshire, and the Ohio Child Care Resource and Referral Association. Rutgers University-New Brunswick. The primary target audiences for this project are OST science trainers, administrators of statewide OST networks and frontline staff as well as youth participating in afterschool programs, most of whom are from traditionally underserved and economically challenged groups. Deliverables include three-day, semi-annual train-the-trainer institutes; annual seminars for NPASS leaders; professional development tools; science kits; and the NPASS website. The project design consists of four levels of management and delivery. At Level 1, the NPASS2 primary partners, EDC and the Boston Children's Museum, provide three-day state-based OST Science Trainer Institutes on a semi-annual basis. The Science Trainer Institutes combine hands-on experience with pedagogical training in informal science learning, youth development, and the logistics of working with OST sites. During Level 2, the eight State Leadership Teams recruit two cohorts of OST practitioners to attend Science Trainer Institutes. The new Science Trainers then identify OST sites to attend a series of half-day science trainings in Level 3. Each session introduces and models new science projects for use in afterschool settings, including the NSF-funded Design It! or Explore It! materials. Finally, at Level 4, OST sites serving children from predominantly underserved and underrepresented populations are invited to join the NPASS2 initiative. OST sites receive a materials kit and guide for the activities at each training session. It is estimated that as many as 10 OST state leaders and 100 science trainers will be reached at 750 community sites serving 22,000 youth. The combined intervention has the potential to change the OST landscape. The project evaluation to be conducted by the Goodman Research Group (GRG) employs a longitudinal design to determine participants' growth over time and the magnitude of change among the variables. The formative evaluation is designed to assess the development of the project's deliverables while the summative evaluation focuses on professional audience impacts. The NPASS2 summative evaluation examines the OST science trainers, OST state network administrators, youth workers, and site administrators through a baseline survey, in addition to annual questionnaires and interviews of network administrators and OST site administrators. The pre-post design measures changes in trainers' understanding, attitudes, behavior, and skills related to informal STEM education research or practice. To maximize the efficiency and authenticity of the evaluation, GRG will use the SET/STEM Leader Competencies Rubric currently being developed jointly by EDC in collaboration with the National 4-H Council\'s SET PD Committee.
Portal to the Public: Expanding the National Network (PoP: ENN) is implementing around the county the successful NSF-funded Portal to the Public model in which researchers are trained to communicate and interact with the general public at informal science education (ISE) institutions about the research that they are conducting. The project, which follows on a thorough evaluation of the model at eight sites and current implementation at an additional fifteen sites, will incorporate twenty new ISE sites into the growing network, provide training and mentorship to ISE professionals on the use and adaptation of the PoP implementation manual and toolkits, and develop an enhanced network website that will serve as a communication and innovation hub. The work is responsive to the needs and activities of ISE organizations which continue to expand their missions beyond presenting to the public established science, technology, engineering and math (STEM) and are working to become places where visitors can also experience the process and promise of current research via face-to-face interactions with researchers. The project is expanding both the kind and number of institutions involved around the country and is facilitating their capacity to develop a knowledge base, share experiences and best practices.
The STAR Library Education Network: a hands-on learning program for libraries and their communities, (STAR_Net for short) is led by the National Center for Interactive Learning (NCIL) at the Space Science Institute (PI: Paul Dusenbery). STAR stands for Science-Technology, Activities and Resources. Team members include NCIL staff, the American Library Association (ALA), Lunar and Planetary Institute (LPI), and the National Girls Collaborative Project (NGCP). STAR_Net is developing two comprehensive, informal education programs: Discover Earth and Discover Tech. The project also includes a comprehensive evaluation plan and a research component that explores how public libraries can serve as a STEM learning center in rural, underserved communities. STAR_Net is supported through a grant from the National Science Foundation. The STAR_Net project includes two traveling library exhibits: Discover Earth: A Century of Change and Discover Tech: Engineers Make a World of Difference. The Discover Earth exhibition features interactive, multimedia displays that allow exhibit visitors to interact with digital information in a dynamic way, encouraging new perspectives on our planet. Discover Tech introduces the many extraordinary ways that engineers solve problems to help people and societies around the world. Similar to a science center experience, visitors and families will be able to explore and tinker with their own engineering solutions. A number of STEM activities and resources will be developed by project staff and by other organizations to help librarians and community partners offer a wide variety of programs for their patrons. Besides the traveling exhibits and programs, STAR_Net also includes library staff training (online and in-person) and a Community of Practice (CoP) for librarians (including non-host librarians) to interact and partner with STEM professionals and organizations. NCI's Kate Haley Goldman and staff from Evaluation and Research Associates are conducting the project's evaluation.
The Experiential Science Education Research Collaborative (XSci) at the University of Colorado Denver has established a museum educator/theater network of eight museums around the country, pairing larger with smaller institutions. The Association of Science-Technology Centers, the NASA Astrobiology Institute, and the Astronomical Society of the Pacific and several other organizations also are collaborators. The primary audience is informal science educators; secondary audiences are museum and science center visitors. The Science Theater Education Programming System (STEPS) is a technology the allows educators to create their own media-enhanced live theatrical presentations of science programs that include dynamic content, interactive virtual characters, and multiple plot-lines and endings to shows. The initial set of theater programs focus on astrobiology, along with a suite of training programs and communication formats for educators. The STEPS technology allows these programs to be delivered both on site and via outreach, depending on the goals of each organization. An in-depth research component is examining the impact of the project\'s designed community of practice structure utilizing team leadership theory in terms of professional identity construction for participating informal educators. Deliverables include: the museum partnership network, the STEPS system and programs, professional development tutorials and workshops, evaluation of the programs, and research products, among others.
The Ross Sea Project was a Broader Impact projects for an NSF sponsored research mission to the Ross Sea in Antarctica. The project, which began in the summer of 2010 and ended in May 2011, consisted of several components: (1) A multidisciplinary teacher-education team that included educators, scientists, Web 2.0 technology experts and storytellers, and a photographer/writer blogging team; (2) Twenty-five middle-school and high-school earth science teachers, mostly from New Jersey but also New York and California; (3) Weeklong summer teacher institute at Liberty Science Center (LSC) where teachers and scientists met, and teachers learned about questions to be investigated and technologies to be used during the mission, and how to do the science to be conducted in Antarctica; (4) COSEE NOW interactive community website where teachers, LSC staff and other COSEE NOW members shared lesson plans or activities and discussed issues related to implementing the mission-based science in their classrooms; (5) Technological support and consultations for teachers, plus online practice sessions on the use of Web 2.0 technologies (webinars, blogs, digital storytelling, etc.); (6)Daily shipboard blog from the Ross Sea created by Chris Linder and Hugh Powell (a professional photographer/writer team) and posted on the COSEE NOW website to keep teachers and students up-to-date in real-time on science experiments, discoveries and frustrations, as well as shipboard life; (7) Live webinar calls from the Ross Sea, facilitated by Rutgers and LSC staff, where students posed questions and interacted directly with shipboard researchers and staff; and (8) A follow-up gathering of teachers and scientists near the end of the school year to debrief on the mission and preliminary findings. What resulted from this project was not only the professional development of teachers, which extended into the classroom and to students, but also the development of a relationship that teachers and students felt they had with the scientists and the science. Via personal and virtual interactions, teachers and students connected to scientists personally, while engaged in the science process in the classroom and in the field.
This is a Broad Implementation proposal. Our goal is to create a vibrant, sustained community of practice around the established Café Scientifique New Mexico model for engaging high school teens in science, technology, engineering and math; scale-up will be accomplished via a national network of committed partners. The adult Cafe Scientifique model for engaging citizens in science has proven very effective and has been implemented widely. The interaction in a social setting with a scientist-presenter around a hot science topic is the key to the model’s success. With ISE funding, the model has been adapted by Science Education Solutions for the high school teen audience. Cafe Scientifique New Mexico, now starting its fifth year, has had documented success in providing teens with increased STEM literacy and a more realistic picture of scientists as real people leading interesting lives. Teens come to better understand the nature of science and are more likely to see the relevance of science to their lives. Scientists express strong satisfaction with the nature of our coaching and the resulting quality of their science communication. The program has been continually evaluated and improved, and is now ready for broad implementation. Intellectual Merit: Teenagers are the adult citizens and workforce of tomorrow. Teens are reaching a critical life juncture and are making choices that affect their future life style, life-long learning behaviors, and careers. Yet they are increasingly dropping out of the STEM pipeline in school. Even teens interested in STEM often know little about science and engineering careers and the nature of scientific research. Teen Cafés can play an important role in addressing these challenges. We have two major objectives: 1. Implement the Café Scientifique model of Teen Cafés in a national network of sites committed to adopting and adapting the program and validating its impacts with diverse audiences; and 2. Create a vibrant and sustainable community of practice comprised of ISE and STEM professionals interested in engaging teens in STEM through Teen Cafés. We have formed a core network of six initial partners: Southern Illinois University Edwardsville, Center for STEM Research, Education, and Outreach; The Florida Teen SciCafé Partnership; North Carolina Museum of Natural Sciences, Raleigh; Science Discovery, University of Colorado; The Pacific Science Center in Seattle; and The Missouri AfterSchool Network (MASN) – Project LIFTOF. We will add two more core partners in Year 3. The core partners will join the Teen Cafe Network in a staged fashion in years 1 - 3. Each will reach sustainability over a three-year funding period. Each node has a local area network of partners consisting of organizations that will host local Cafes; scientific organizations with potential presenters; schools and other organizations for recruiting teens; and entities capable of contributing to financial sustainability. The network will provide a structure for a dynamic, growing, and sustainable community of practice to implement the Teen Café model, in which high school teens will gain skills in scientific discourse, thought, and exploration. STEM professionals will gain improved skills for communicating with public audiences and a new perspective on their research from a broader societal perspective. ISE professionals will gain capacity to adapt, implement, test, and further disseminate the Teen Café model and increased capability for preparing STEM experts to communicate effectively with teen audiences, along with tools, resources, and expertise to help them do so. Science Education Solutions will manage the project and provide the resources to support the community of practice, while continuing Cafe Scientifique New Mexico as a ninth network node. We will stimulate intensive ongoing communication of lessons learned across the network as partners start up their Cafe programs; external observers will be able to watch the program unfold. Broader Impacts: We will build capacity for serving teens and effective communication of science in the broad ISE and STEM communities by encouraging and nurturing others wishing to start a Cafe program and join the network. We have partnered with 10 large science and science education organizations, each with its own extensive network, which will allow us to further propagate the Teen Cafe Network. They are: National Ecological Observatory Network (NEON). Nanoscale Informal Science Education Network (NISE Net), The American Institute of Physics (AIP), Science Cafés.org (to include NOVA), Science Festival Alliance, Consortium of Universities for the Advancement of Hydrologic Science (CUAHSI), Informalscience.org, Project Liftoff: Elevating Science Afterschool, ITEST Learning Resource Center, and The Center for Multiscale Modeling of Atmospheric Processes (CMMAP). Each partner will also target underserved and diverse teen audiences for their programs.
This MSP-Start Partnership, led by Widener University, in partnership with Bryn Mawr College, Delaware County Community College, Philadelphia University, Lincoln University, and Haverford Township School District, is developing the Greater Philadelphia Environment, Energy, and Sustainability Science (ES)2 Teacher Leader Institute. Additional partners include the Center for Social and Economic Research at West Chester University, Delaware Valley Industrial Resource Center, Energy Coordinating Agency, US EPA Region 3 Office of Innovation, National Center for Science and Civic Engagement and its SENCER program, Pennsylvania Campus Compact, Philadelphia Higher Education Network for Neighborhood Development, Project Kaleidoscope, Sustainable Business Network of Greater Philadelphia, and the 21st Century Partnership for STEM Education. Building on a base of relationships developed over the past five years by many partners in the Math Science Partnership of Greater Philadelphia, the project brings together faculty and resources from multiple institutions (a "Mega-University" model) to develop a coherent, innovative, and content-rich, multi-year curriculum in environment, energy, and sustainability science for an Institute that leads to a newly developed Master's degree. Teachers participating in the Institute (A) improve their STEM content knowledge in areas critical to human environmental sustainability, (B) improve their use of project based/service learning and scientific teaching pedagogies in their teaching, (C) engage in real-world sustainability problem solving in an externship with a local business, non-profit or government organization that is active in the newly emerging green economy, and (D) develop important leadership skills as change agents in their schools to improve student interest, learning, and engagement in STEM education. The Institute aims to serve as a regional hub, connecting educational, business, non-profit and government organizations to strengthen the STEM education and workforce development pipelines in the region and simultaneously support positive social change toward environmental sustainability and citizenship. The project's "Mega-University" and "Institute as a regional connector-hub" approaches are powerful models of collaboration that could have widespread and significant national applicability as organizations and systems adjust to the new challenges of our global economy and to the needed transition to sustainability.
DATE:
-
TEAM MEMBERS:
Stephen MadigoskyWilliam KeilbaughVictor DonnayBruce GrantThomas Schrand
Realizing the power of CyberLearning to transform education will require vision, strategy, and an engaged, talented community. Activities are needed to energize the community, refine and sharpen the path forward, and provide a more active and ongoing forum for clarifying the big ideas and challenging questions. In response to this need, SRI International, together with the Lawrence Hall of Science and with key support from the National Geographic Society, will organize a set of activities to advance a shared vision of the future of learning, encompassing the systems, people, and technology dimensions mutually necessary for any scalable and lasting advances in education. The innovative format for these activities is inspired by the TED talks, Wikipedia, and social networking. As in TED, a small set of leading researchers will be selected to give very short, very high quality, stimulating talks. These CyberLearning Talks will be featured at a 1-day summit meeting in Washington, DC, streamed so that local cyberlearning research communities may participate at a distance, and posted on a website. As in Wikipedia, CyberLearning Pages will be created, each page featuring a synopsis of a big idea in CyberLearning and the relevant research challenges. The 1-day conference will be followed by a small 1-day workshop focusing on how to evaluate cyberlearning efforts, identify progress, and identify important new directions. Finally, to disseminate and stimulate conversation about both the video talks and Wikipedia entries, a presence for the community will be created on social networking sites. The target outcomes of the effort will be (i) a cyberlearning research community with participants from across the many current constituent communities, and fostered awareness and appreciation of the broad range of expertise and interests across that wider community; (ii) foundations for sustained discussion of big ideas, insights, and challenges to help this new community define a more engaged, crisper vision of its own future, (iii) a community resource that can become a site for interconnecting stakeholders in the CyberLearning community and supporting investigators in improving field-generated proposals, and (iv) an emerging sense of direction for CyberLearning among a wider audience of leaders. Such community building and awareness is expected to foster collaborations that will lead to innovative and research-grounded ways of using technology to transform education -- formal and informal and across a lifetime.