Goodman Research Group, Inc. (GRG), a research firm in Cambridge, Massachusetts specializing in program evaluation, has been conducting external evaluation of ZOOM for WGBH-TV Boston since 1998. GRG's Season VI evaluation comprised a pilot test to investigate the effectiveness of the new online ZOOMSCITM TRAINING: LEARN TO LEAD SCIENCE ACTIVITIES (ZOOMsci Training), a self-directed, online tutorial designed to help afterschool educators learn how to lead hands-on science activities with kids ages 8 to 11. The goal of the training is to motivate leaders, help them develop science-teaching
The goals of this workshops project are: (1) to provide collaborative professional development opportunities for 24 early professional social science researchers, and science writers and communicators, and (2) to foster a stronger and durable "community of practice" between the fields of science policy research and science communications for the purposes of helping the general public better understand and become engaged with major issues of science and innovation policy. In addition to the PI and co-PI, involved in the work will be: twelve science policy scholars and twelve science communications professionals (writers, bloggers, museum educators, and others); mentors; editors of major science publications; several guest observers from university writing programs around the country; and graduate students who will help document and video record the activities. Project activities include a suite of opportunities: two, four-day workshops; mentorship support; publication in hard copy and online of their articles in a special edition of Creative Nonfiction magazine; and public engagement experiences at Science Cafes around the country. These workshops and accompanying activities will continue to develop a strong foundation for the establishment of nascent collaborations of science policy scholars, science communicators, and informal science education professionals, whose partnerships should position them better to inform and engage the public on important science policy issues of our times.
DATE:
-
TEAM MEMBERS:
Lee GutkindDavid Guston
resourceprojectProfessional Development, Conferences, and Networks
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
The State University of New York (SUNY) and the New York Academy of Sciences (NYAS) are collaborating to implement the SUNY/NYAS STEM Mentoring Program, a full scale development project designed to improve the science and math literacy of middle school youth. Building upon lessons learned through the implementation of national initiatives such as NSF's Graduate STEM Fellows in K-12 Education (GK-12) Program, university initiatives such as the UTeach model, and locally-run programs, this project's goals are to: 1) increase access to high quality, hands-on STEM programs in informal environments, 2) improve teaching and outreach skills of scientists in training (graduate and postdoctoral fellows), and 3) test hypotheses around scalable program elements. Together, SUNY and NYAS propose to carry out a comprehensive, systemic science education initiative to recruit graduate students and postdoctoral fellows studying science, technology, engineering, and mathematics (STEM) disciplines at colleges and universities statewide to serve as mentors in afterschool programs. SUNY campuses will partner with a community-based organization (CBO) to place mentors in afterschool programs serving middle school students in high-need, low-resource urban and rural communities. Project deliverables include a three-credit online graduate course for mentor training, six pilot sites, a best practices guide, and a model for national dissemination. The online course will prepare graduate and postdoctoral fellows to spend 12-15 weeks in afterschool programs, introducing students to life science, earth science, mathematics and engineering using curriculum modules that are aligned with the New York State standards. The project design includes three pre-selected sites (College of Nanoscale Science & Engineering at the University of Albany, SUNY Institute of Technology, and SUNY Downstate Medical Center) and three future sites to be selected through a competitive process, each of which will be paired with a CBO to create a locally designed STEM mentoring program. As a result, a minimum of 192 mentors will provide informal STEM education to 2,880 middle school students throughout New York State. The comprehensive, mixed-methods evaluation will address the following questions: 1) Does student participation in an afterschool model of informal education lead to an increase in STEM content knowledge, attitudes, self-efficacy, and interest in pursuing further STEM education and career pathways? 2) Do young scientists who participate in the program develop effective teaching and mentoring skills, and develop interest in teaching or mentoring career options that result in STEM retention? 3) What are the attributes of an effective STEM afterschool program and the elements of local adaptation and innovation that are necessary to achieve a successful scale-up to geographically diverse locations? 4) What is the role of the afterschool model in delivering informal STEM education? This innovative model includes a commitment to scale across the 64 SUNY campuses and 122 Councils of the Girl Scouts of the USA, use an online platform to deliver training, and place scientists-in-training in informal learning environments. It is hypothesized that as a result of greater access to STEM education in an informal setting, participating middle school youth will develop increased levels of STEM content knowledge, self-efficacy, confidence in STEM learning, and interest in STEM careers. Scientist mentors will: 1) gain an understanding of the context and characteristics of informal science education, 2) develop skills in mentoring and interpersonal communication, 3) learn and apply best practices of inquiry instruction, and 4) potentially develop interest in teaching as a viable career option. It is anticipated that the project will add to the research literature in several areas such as the effectiveness of incentives for graduate students; the design of mentor support systems; and the structure of pilot site programs in local communities. Findings and materials from this project will be disseminated through presentations at local, regional, and national conferences, publications in peer-reviewed journals focused on informal science education, and briefings sent to more than 25,000 NYAS members around the world.
WGBH Educational Foundation will create PEEP'S WORLD/EL MUNDO DE PEEP, a Web-based "Digital Hub," in both English and Spanish, to significantly increase the impact of the extensive collection of proven preschool science and math assets from the Emmy Award-winning TV show PEEP AND THE BIG WIDE WORLD®. This project will: (1) redesign the PEEP Web site, creating interactive media experiences that will contextualize existing content and take advantage of new Web design; (2) provide professional development for preschool educators; and (3) reach a new audience of family childcare educators, one that is woefully underserved when it comes to educational resources about science. Dissemination through a network of national organizations, including National Association of Family Child Care, National Association of Child Care Resource and Referral Agencies, National Head Start Association, National Education Association, AVANCE, and Committee for Hispanic Children and Families, will help engage the maximum number of educators and parents in the project. PEEP'S WORLD/EL MUNDO DE PEEP will provide resources for targeted audiences. Specifically these resources will provide: Children with multiple ways to engage with science or math content areas, including interactive games, animated stories, and live-action videos; Parents with guided experiences to facilitate their child's math and science play; Center-based preschool educators with a media-rich, year long science curriculum and professional development materials; and Family childcare educators with curriculum modules, integrated with media, focused on six science content areas, and professional development materials for home-care settings in English and in Spanish. The University of Massachusetts's Donahue Institute will conduct a formative evaluation of the family childcare educator resources: 200 Spanish-speaking and 200 English-speaking educators will pilot the curriculum modules and professional development videos. Concord Evaluation Group, Inc. will conduct a summative evaluation, consisting of a Family Web Site Experiment and a National Observational Study, to assess the extent to which the project is successful at achieving its intended impacts. A multifaceted national dissemination plan will include a robust social media strategy, implemented by a Spanish-speaking online community manager, to reach parents, and collaborations with early childhood education statewide systems to reach educators. The projects intended impacts are to: (1) help English- and Spanish-speaking preschoolers effectively apply science and mathematical inquiry and process skills; (2) empower English- and Spanish-speaking parents to feel more equipped and inclined to facilitate science and math exploration with their preschoolers; and, (3) provide center-based and family childcare educators with resources for incorporating math and science into their curricula and boosting their confidence in teaching these subjects. While many parents know how to read to their children, they do not typically know how to approach science or math investigations with their pre-schoolers. After parents, preschool educators are the most important promoters of a young child\'s learning. Yet, center-based and family childcare educators do not receive significant training in science, and thus lack confidence when conducting preschool science activities. By providing parents and educators resources for approaching preschool science and math, which meet their specific needs, PEEP will help alleviate these challenges.
The Balboa Park Cultural Partnership, in collaboration with several informal science education and other cultural and business organizations in San Diego, Chicago, and Worcester, MA are implementing a research and development project that investigates a range of possible approaches for stimulating the development of 21st Century creativity skills and innovative processes at the interface between informal STEM learning and methods for creative thinking. The goal of the research is to advance understanding of the potential impacts of creative thinking methods on the public's understanding of and engagement with STEM, with a focus on 21st Century workforce skills of teens and adults. The goal of the project's development activities is to experiment with a variety of "innovation incubator" models in cities around the country. Modeled on business "incubators" or "accelerators" that are designed to foster and accelerate innovation and creativity, these STEM incubators generate collaborations of different professionals and the public around STEM education and other STEM-related topics of local interest that can be explored with the help of creative learning methodologies such as innovative methods to generate creative ideas, ideas for transforming one STEM idea to others, drawing on visual and graphical ideas, improvisation, narrative writing, and the process of using innovative visual displays of information for creating visual roadmaps. Hosting the project's incubators are the Balboa Park Cultural Partnership (San Diego), the Museum of Science and Industry (Chicago) and the EcoTarium (Worcester, MA). National partners are the Association of Science-Technology Centers, the American Association for the Advancement of Science, and the Americans for the Arts. Activities will include: the formation and collaborative processes of three incubator sites, a research study, the development of a creative thinking curriculum infused into science education, professional development based on the curriculum, public engagement events and exhibits, a project website and tools for social networking, and project evaluation. A national advisory council includes professionals in education, science, creativity, and business.
Water for Life (WfL) is a full scale development youth and community based program; centered on freshwater literacy, water conservation and rainwater harvesting led by the Pacific Resources for Education Learning (PREL) in Hawaii. The goals of the project are to: (a) promote an understanding of water conservation and stewardship in areas lacking adequate quality water supplies and (b) build local capacity among rural communities to develop and employ site specific freshwater harvesting strategies proven to improve water quality. Rural communities within four Pacific Island entities in the U.S. affiliated Freely Associated States (FAS) will participate in WfL activities. PREL is collaborating with a host of organizations (such as the Federated States of Micronesia National Department of Education, Marshall Islands Conservation Society, and the Micronesian Conservation Trust, etc.) to develop and implement all phases of the initiative. This work is already improving the quality of life for hundreds of people in the FAS through water conversation education and improved water quality in local areas. Working closely with site-embedded PREL staff, Core Teams at each site - consisting of 4-6 local leaders from environmental agencies, water/sanitation systems, and education institutions - participated in a 5-day professional learning immersion in May, 2013, to buld capacities to develop and facilitate water conservation and catchment activities at the four target sites in the FAS. The Core Team members at each site now are recruiting and collaborating with local community members to implement site-specific projects that both educate and provide enhanced access to high quality drinking water. Both adults and youth are now engaging in a spectrum of proejcts that address loca needs and priorities through site-specific service learning activities. The site-specific focus in each locale, determined by the local Core Team, is distinct. In Palau, the Core Team has built broader community awareness of water conservation issues, raised the issue of water security in national conversations, engaged remote communities in improving natural rainwater drainage collection systems, and produced youth-oriented educational materials focused on local sites. In Yap, the Core Team members have collaborated with public utilities to install first-flush diverters into community rainwater catchment systems on Yap proper, and now are installing these devices in rainwater catchment systems on Yap's neighbor islands. In Chuuk, groundwater springs in remote communities are being upgraded for improved storage capacity, protection against contamination, and better public access. In Majuro (RMI), public school rainwater catchment systems are being repaired, repainted, cleaned, and upgraded so that schools can and will provide adequate drinking water to students (and to broader segments of the community during droughts). Broad segments of communities, including school classes and clubs, church and civic groups, etc. are becoming increasingly involved in building better water security and resilience for their communities, in preparation for a predicted drought, predicted to hit in the winter of 2014-2015, brought on by an El Nino event now edevelopig in the eastern Pacific. Water for Life has produced a range of locally relevant educational materials, including books, pamphlets, flyers, etc., some in English and others in local languages. Posters and billboards are being produced to enhance and maintain public awareness. Infrastructure projects are enabling better collection of more, higher quality water for drinking. A full-scale water handbook is under development, and this will serve as a basis for a self-contained water 'course' that will be offered through local community colleges. The experiences of project participants are being captured, analyzed, and reported in front-end, formative, and sumative evaluations conducted by David Heil & Associates. Thousands of individuals, comprising large segments of the participating countries' populations, will be directly impacted by the project. The results will be applicable to other remote and rural communities outside of the Pacific distressed by poor water quality and ineffective freshwater harvesting systems.
Taking NPASS (National Partnerships for Afterschool Science) to Scale builds on a previously funded effort (DRL 0515549) designed to provide professional development for out-of-school time (OST) science trainers, administrators, and frontline staff in collaboration with the California School-Age Consortium, the Georgia Afterschool Investment Council, The After-School Institute, Minnesota School Age Child Care Alliance, University of Missouri-Columbia, University of New Hampshire, and the Ohio Child Care Resource and Referral Association. Rutgers University-New Brunswick. The primary target audiences for this project are OST science trainers, administrators of statewide OST networks and frontline staff as well as youth participating in afterschool programs, most of whom are from traditionally underserved and economically challenged groups. Deliverables include three-day, semi-annual train-the-trainer institutes; annual seminars for NPASS leaders; professional development tools; science kits; and the NPASS website. The project design consists of four levels of management and delivery. At Level 1, the NPASS2 primary partners, EDC and the Boston Children's Museum, provide three-day state-based OST Science Trainer Institutes on a semi-annual basis. The Science Trainer Institutes combine hands-on experience with pedagogical training in informal science learning, youth development, and the logistics of working with OST sites. During Level 2, the eight State Leadership Teams recruit two cohorts of OST practitioners to attend Science Trainer Institutes. The new Science Trainers then identify OST sites to attend a series of half-day science trainings in Level 3. Each session introduces and models new science projects for use in afterschool settings, including the NSF-funded Design It! or Explore It! materials. Finally, at Level 4, OST sites serving children from predominantly underserved and underrepresented populations are invited to join the NPASS2 initiative. OST sites receive a materials kit and guide for the activities at each training session. It is estimated that as many as 10 OST state leaders and 100 science trainers will be reached at 750 community sites serving 22,000 youth. The combined intervention has the potential to change the OST landscape. The project evaluation to be conducted by the Goodman Research Group (GRG) employs a longitudinal design to determine participants' growth over time and the magnitude of change among the variables. The formative evaluation is designed to assess the development of the project's deliverables while the summative evaluation focuses on professional audience impacts. The NPASS2 summative evaluation examines the OST science trainers, OST state network administrators, youth workers, and site administrators through a baseline survey, in addition to annual questionnaires and interviews of network administrators and OST site administrators. The pre-post design measures changes in trainers' understanding, attitudes, behavior, and skills related to informal STEM education research or practice. To maximize the efficiency and authenticity of the evaluation, GRG will use the SET/STEM Leader Competencies Rubric currently being developed jointly by EDC in collaboration with the National 4-H Council\'s SET PD Committee.
Portal to the Public: Expanding the National Network (PoP: ENN) is implementing around the county the successful NSF-funded Portal to the Public model in which researchers are trained to communicate and interact with the general public at informal science education (ISE) institutions about the research that they are conducting. The project, which follows on a thorough evaluation of the model at eight sites and current implementation at an additional fifteen sites, will incorporate twenty new ISE sites into the growing network, provide training and mentorship to ISE professionals on the use and adaptation of the PoP implementation manual and toolkits, and develop an enhanced network website that will serve as a communication and innovation hub. The work is responsive to the needs and activities of ISE organizations which continue to expand their missions beyond presenting to the public established science, technology, engineering and math (STEM) and are working to become places where visitors can also experience the process and promise of current research via face-to-face interactions with researchers. The project is expanding both the kind and number of institutions involved around the country and is facilitating their capacity to develop a knowledge base, share experiences and best practices.
The Experiential Science Education Research Collaborative (XSci) at the University of Colorado Denver has established a museum educator/theater network of eight museums around the country, pairing larger with smaller institutions. The Association of Science-Technology Centers, the NASA Astrobiology Institute, and the Astronomical Society of the Pacific and several other organizations also are collaborators. The primary audience is informal science educators; secondary audiences are museum and science center visitors. The Science Theater Education Programming System (STEPS) is a technology the allows educators to create their own media-enhanced live theatrical presentations of science programs that include dynamic content, interactive virtual characters, and multiple plot-lines and endings to shows. The initial set of theater programs focus on astrobiology, along with a suite of training programs and communication formats for educators. The STEPS technology allows these programs to be delivered both on site and via outreach, depending on the goals of each organization. An in-depth research component is examining the impact of the project\'s designed community of practice structure utilizing team leadership theory in terms of professional identity construction for participating informal educators. Deliverables include: the museum partnership network, the STEPS system and programs, professional development tutorials and workshops, evaluation of the programs, and research products, among others.
DATE:
-
TEAM MEMBERS:
Brad McLain
resourceresearchProfessional Development, Conferences, and Networks
This is a recording of a NISE Network online brown-bag conversation held in December 2014 about the International Year of Light. In 2013, the United Nations proclaimed 2015 as the International Year of Light (IYL). More than 100 organizations from more than 85 countries are participating in IYL. During this conversation we discussed scientific organizations that would make great partners for IYL events, shared light-related activities and videos developed by the NISE Network, and talked about the science behind some of those activities.
Collaboration efforts between educator preparation programs and children's science museums are important in assisting elementary pre-service teachers connect the theory they have learned in their classrooms with the actual practice of teaching. Elementary pre-service teachers must not only learn the science content, but how to effectively deliver that science content to a group of students. One university provided their elementary pre-service teachers with the opportunity to prepare and deliver science lessons to students in a children's science museum in south Texas.