Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
The Math, Engineering, Science Achievement (MESA) outreach programs are partnerships between K-12 schools and higher education in eight states that for over forty years introduce science, mathematics and engineering to K-12 students traditionally underrepresented in the discipline. This exploratory study examines the influences that those MESA activities have on students' perception of engineering and their self-efficacy and interest in engineering and their subsequent decisions to pursue careers in engineering. The MESA activities to be studied include field trips, guest lecturers, design competitions, hands-on activities and student career and academic advisement.
About 1200 students selected from 40 MESA sites in California, Maryland and Utah are surveyed with instruments that build on those used in prior studies. Focus groups with a randomly selected subset of the students provide follow-up and probe the influence of the most promising activities. In the first year of the project the instruments, based on existing instruments, are developed and piloted. Data are taken in the second year and analyzed in the third year. A separate evaluation determines that the protocols are reasonable and are being followed.
The results are applicable to a number of organizations with similar aims and provide information for increasing the number of engineers from underrepresented populations. The project also investigates the correlation between student engagement in MESA and academic performance. This project provides insights on activities used in informal settings that can be employed in the classroom practice and instructional materials to further engage students, especially student from underrepresented groups, in the study of STEM.
DATE:
-
TEAM MEMBERS:
Christine HaileyCameron DensonChandra Austin
resourceprojectProfessional Development, Conferences, and Networks
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
'Be a Scientist!' is a full-scale development project that examines the impact of a scalable, STEM afterschool program which trains engineers to develop and teach inquiry-based Family Science Workshops (FSWs) in underserved communities. This project builds on three years of FSWs which demonstrate improvements in participants' science interest, knowledge, and self-efficacy and tests the model for scale, breadth, and depth. The project partners include the Viterbi School of Engineering at the University of Southern California, the Albert Nerken Engineering Department at the Cooper Union, the Los Angeles Museum of Natural History, and the New York Hall of Science. The content emphasis is physics and engineering and includes topics such as aerodynamics, animal locomotion, automotive engineering, biomechanics, computer architecture, optics, sensors, and transformers. The project targets underserved youth in grades 1-5 in Los Angeles and New York, their parents, and engineering professionals. The design is grounded in motivation theory and is intended to foster participants' intrinsic motivation and self-direction while the comprehensive design takes into account the cultural, social, and intellectual needs of diverse families. The science activities are provided in a series of Family Science Workshops which take place in afterschool programs in eight partner schools in Los Angeles and at the New York Hall of Science in New York City. The FSWs are taught by undergraduate and graduate engineering students with support from practicing engineers who serve as mentors. The primary project deliverable is a five-year longitudinal evaluation designed to assess (1) the impact of intensive training for engineering professionals who deliver family science activities in community settings and (2) families' interest in and understanding of science. Additional project deliverables include a 16-week training program for engineering professionals, 20 physics-based workshops and lesson plans, Family Science Workshops (40 in LA and 5 in NY), a Parent Leadership Program and social networking site, and 5 science training videos. This project will reach nearly one thousand students, parents, and student engineers. The multi-method evaluation will be conducted by the Center for Children and Technology at the Education Development Center. The evaluation questions are as follows: Are activities such as recruitment, training, and FSWs aligned with the project's goals? What is the impact on families' interest in and understanding of science? What is the impact on engineers' communication skills and perspectives about their work? Is the project scalable and able to produce effective technology tools and develop long-term partnerships with schools? Stage 1 begins with the creation of a logic model by stakeholders and the collection of baseline data on families' STEM experiences and knowledge. Stage 2 includes the collection of formative evaluation data over four years on recruitment, training, co-teaching by informal educators, curriculum development, FSWs, and Parent Leadership Program implementation. Finally, a summative evaluation addresses how well the project met the goals associated with improving families' understanding of science, family involvement, social networking, longitudinal impact, and scalability. A comprehensive dissemination plan extends the project's broader impacts in the museum, engineering, evaluation, and education professional communities through publications, conference presentations, as well as web 2.0 tools such as blogs, YouTube, an online social networking forum for parents, and websites. 'Be a Scientist!' advances the field through the development and evaluation of a model for sustained STEM learning experiences that helps informal science education organizations broaden participation, foster collaborations between universities and informal science education organizations, increase STEM-based social capital in underserved communities, identify factors that develop sustained interest in STEM, and empower parents to co-invest and sustain a STEM program in their communities.
Many of the biggest problems facing the United States and the world require engineering expertise to solve: climate change, feeding a growing population, energy independence, access to clean water, crumbling infrastructure, and others. And with global economic competitiveness inextricably linked to innovation, employers across a wide range of engineering and non-engineering fields such as health care, management, and marketing are seeking employees with engineering knowledge and related skills. These skills include the ability to creatively and systematically solve ill-defined problems
DATE:
TEAM MEMBERS:
Community for Advancing Discovery Research in Education (CADRE)
President Obama announced in April 2013 that the Corporation for National and Community Service (CNCS) would launch a STEM AmeriCorps initiative to build student interest in STEM. A RFA is currently being prepared to be released in the late fall of 2013. This project will engage in quick response research to identify an evaluation and research agenda that can begin to inform the program launch. Thus, the timeframe for informing the initial stages of STEM AmeriCorps is relatively short, and the creation of an evaluation and research agenda is very timely. The products from the RAPID proposal are: (1) a review of the evaluation and research literature on the use of volunteers and/or mentors to build students' interest in STEM; (2) to convene a workshop to identify evaluation and research priorities to guide the initiative; and (3) a summary evaluation agenda that identifies promising directions along with the strength of evidence around key issues.
This project supports the development of technological fluency and understanding of STEM concepts through the implementation of design collaboratives that use eCrafting Collabs as the medium within which to work with middle and high school students, parents and the community. The researchers from the University of Pennsylvania and the Franklin Institute combine expertise in learning sciences, digital media design, computer science and informal science education to examine how youth at ages 10-16 and families in schools, clubs, museums and community groups learn together how to create e-textile artifacts that incorporate embedded computers, sensors and actuators. The project investigates the feasibility of implementing these collaboratives using eCrafting via three models of participation, individual, structured group and cross-generational community groups. They are designing a portal through which the collaborative can engage in critique and sharing of their designs as part of their efforts to build a model process by which scientific and engineered product design and analysis can be made available to multiple audiences. The project engages participants through middle and high school elective classes and through the workshops conducted by a number of different organizations including the Franklin Institute, Techgirlz, the Hacktory and schools in Philadelphia. Participants can engage in the eCrafting Collabs through individual, collective and community design challenges that are established by the project. Participants learn about e-textile design and about circuitry and programming using either ModKit or the text-based Arduino. The designs are shared through the eCrafting Collab portal and participants are required to provide feedback and critique. Researchers are collecting data on learner identity in relation to STEM and computing, individual and collective participation in design and student understanding of circuitry and programming. The project is an example of a scalable intervention to engage students, families and communities in developing technological flexibility. This research and development project provides a resource that engages students in middle and high schools in technology rich collaborative environments that are alternatives to other sorts of science fairs and robotic competitions. The resources developed during the project will inform how such an informal/formal blend of student engagement might be scaled to expand the experiences of populations of underserved groups, including girls. The study is conducting an examination of the new types of learning activities that are multiplying across the country with a special focus on cross-generational learning.
EDC’s Center for Children and Technology (CCT), a nonprofit research and development organization (cct.edc.org), conducted the formative evaluation of the BAS project for the last three years. Iridescent has assisted CCT researchers in the successful implementation of the evaluation (e.g., organizing site visits and meetings with partners, administering surveys, collecting consent forms). As discussed in more details below, Iridescent has always taken seriously the evaluation findings and recommendations, and has acted upon them to make program improvements. This research partnership has led
This CRPA award addresses the issue of multidisciplinary science and the public's awareness of the ideas. The PIs believe that the prevalence of multidisciplinary science is high and growing fast. Thus, the public and particularly the younger generations need to understand these concepts and to begin thinking in those terms. Thus, they will derive hands-on modules for three age groups that are age appropriate. The project team includes 7 NSF funded researchers who do multidiscipline-based research in biology, mathematics and engineering. These modules will be tested at the Boy and Girls Club of Dane County prior to being exhibited at the Madison Children's Museum and the Aldo Leopold Nature Center. Further, the local PBS TV station (WPT) will air some of the demonstrations giving the project more visibility and impact. Each set of modules designed for the three age groups shall be evaluated separately using age specific goals and objectives. The project is a collaboration between 7 scientists and engineers, the Boys and Girls Club of Dane County, the Aldo Leopold Nature Center, the Madison Children's Museum, and the Wisconsin Institutes of Discovery of the University of Wisconsin.
WaterBotics is the underwater robotics curriculum and program that is being disseminated to four regions through a National Science Foundation grant, in collaboration with national and state partners. Its goal is to provide hands-on experiences for middle and high school age youth to engineering design, information technology tools, and science concepts, and to increase awareness and interest in engineering and IT careers. The curriculum, which can be used either in traditional classroom settings or in after-school and summer-camp situations, is problem-based, requiring teams of students to work together to design, build, test, and redesign underwater robots, or “bots” made of LEGO® and other components. Students use the NXT and LEGO Mindstorms® software to program their robots to maneuver in the water, thereby gaining valuable experience with computer programming. Teams must complete a series of increasingly sophisticated challenges which culminates with a final challenge that integrates learning from the prior challenges.
DATE:
-
TEAM MEMBERS:
Stevens Institute of TechnologyMercedes McKayPatricia Holahan
Stennis Space Center (SSC) Office of Education and Visitors Center provided relevant education activities and experiences for teachers, students, and the general public. Activities included partnerships with INFINITY Science Center, 4-H of Mississippi, the Boys & Girls Club of America, development and delivery of educator professional development workshops that meet national curriculum standards; inquiry-based activities that emphasized the International Space Station, robotics, aeronautics, and propulsion testing; and development and installation of an interactive exhibit at the Infinity Science Center. The opening of the Infinity Science Center at Stennis Space Center in April 2012 allowed a new opportunity for SSC to partner and expand NASA’s outreach. A commercial-grade playground was professionally installed at the Infinity Science Center, along with OSHA-approved safety matting. The goal of the project was to utilize a commercially available playground and add graphics and quiz-based activities modifications enabling young visitors to INFINITY at NASA Stennis Space Center, the official visitor center for Stennis Space Center, to have an interactive, yet educational, experience.