This annual report presents an overview of Saint Louis Science Center audience data gathered through a variety of evaluation studies conducted during 2015. This report includes information on the Science Center's general public audience demographics and visitation patterns, gives an overview of visitors' comments about their Science Center experience, summarizes major trends observed in the Science Center's tool for tracking educational programs, and presents highlights from a Membership study, a formative evaluation of a new Makerspace exhibition, and program evaluation of a workshop for the
The Cyberlearning and Future Learning Technologies Program funds efforts that will help envision the next generation of learning technologies and advance what we know about how people learn in technology-rich environments. Cyberlearning Exploration (EXP) Projects explore the viability of new kinds of learning technologies by designing and building new kinds of learning technologies and studying their possibilities for fostering learning and challenges to using them effectively. This project brings together two approaches to help K-12 students learn programming and computer science: open-ended learning environments, and computer-based learning analytics, to help create a setting where youth can get help and scaffolding tailored to what they know about programming without having to take tests or participate in rigid textbook exercises for the system to know what they know.
The project proposes to use techniques from educational data mining and learning analytics to process student data in the Alice programming environment. Building on the assessment design model of Evidence-Centered Design, student log data will be used to construct a model of individual students' computational thinking practices, aligned with emerging standards including NGSS and research on assessment of computational thinking. Initially, the system will be developed based on an existing corpus of pair-programming log data from approximately 600 students, triangulating with manually-coded performance assessments of programming through game design exercises. In the second phase of the work, curricula and professional development will be created to allow the system to be tested with underrepresented girls at Stanford's CS summer workshops and with students from diverse high schools implementing the Exploring Computer Science curriculum. Direct observation and interviews will be used to improve the model. Research will address how learners enact computational thinking practices in building computational artifacts, what patters of behavior serve as evidence of learning CT practices, and how to better design constructionist programming environments so that personalized learner scaffolding can be provided. By aligning with a popular programming environment (Alice) and a widely-used computer science curriculum (Exploring Computer Science), the project can have broad impact on computer science education; software developed will be released under a BSD-style license so others can build on it.
DATE:
-
TEAM MEMBERS:
Shuchi GroverMarie BienkowskiJohn Stamper
We asked science centers and museums to share their best pieces of advice and most important lessons learned regarding the following: 1) selecting topics and activities for out-of-school time programs, 2) partnering with afterschool providers and other community partners, 3) meeting the needs of underserved communities in out-of-school time programs, and 4) running successful camps or programs during school vacations.
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by producing empirical findings and/or research tools that contribute to knowledge about which models and interventions with K-12 students and teachers are most likely to increase capacity in the STEM and STEM cognate intensive workforce of the future.
The LinCT (Linking Educators, Youth, and Learners in Computational Thinking) project at the Science Museum of Minnesota (SMM) will engage female teachers-in-training and youth from underrepresented demographics in immersive technology experiences and STEM education. LinCT will guide teachers to develop their understanding and use of technology in the classroom, as well as prepare youth for a future where technology plays a key role in a wide range of professional opportunities. The project aims to inspire teachers and youth to see the possibilities of technological competencies, as well as why the incorporation of technology can build meaningful learning experiences and opportunities for all learners. The LinCT program model offers learning and application experiences for participating teachers and youth and provides an introduction of technological tools used in SMM educational programs and professional development on approaches for engaging all learners in STEM. Both groups will provide instruction in SMM technology-based Summer Camps, reaching 1,000 young people every year. In each following school year, project educators will develop and deliver technology-based programs to nearly 1,000 under-served and underrepresented elementary students. The project will allow teachers and youth to deliver exciting and engaging technology-based programs to nearly 4,000 diverse young learners. As a result, all participants in this project will be better equipped to incorporate technology in their future careers.
The LinCT project will investigate effective approaches for broadening the participation of underrepresented populations by providing female pre-service teachers and female youth with opportunities to lead programming at the Science Museum of Minnesota (SMM). Over three years, the LinCT project will employ 8-12 female teachers-in-training [Teacher Tech Cadres (TTC)] and 12-24 female youth [Youth Teaching Tech Crews (Y-TTC)] from demographics that are underrepresented in STEM fields. The integration of these groups will result in relationships fostered within an educational program, where all participants are learners and teachers, mentors and mentees. The results of this unique program model will be assessed through the experiences of this focused professional learning and teaching community. The LinCT research study will focus on three aspects of the project. First, it will seek to understand how the teachers-in-training and youth experience the project model's varied learning environments. Next, the study will explore how the TTC's and the Y-TTC's motivation, confidence, and self-efficacy with integrating technology across educational settings change because of the program. Finally, the study will seek to understand the lasting aspects of culture, training, and community building on SMM's internal teams and LinCT partner institutions (University of St. Catherine's National Center for STEM Elementary Education and Metropolitan State University's School of Urban Education).
Northern Michigan University's Center for Native American Studies and the Office of Diversity and Inclusion will lead this Design and Development Launch Pilot about culturally inclusive K-16 STEM education for American Indian and Native Alaskan (AIAN) students. This project was created in response to the NSF Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program solicitation (NSF 16-544). The INCLUDES program is a comprehensive national initiative designed to enhance U.S. leadership in science, technology, engineering and mathematics (STEM) discoveries and innovations focused on NSF's commitment to diversity, inclusion, and broadening participation in these fields. The INCLUDES Design and Development Launch Pilots represent bold, innovative ways for solving a broadening participation challenge in STEM.
The full participation of all of America's STEM talent is critical to the advancement of science and engineering for national security, health and prosperity. Our nation is advancing knowledge and practices to address the undergraduate STEM achievement and the graduation gap between NAAIs and non-native Americans. This project, the NSF INCLUDES: Indigenous Women Working Within the Sciences (IWWS), has the potential to advance knowledge, instructional pedagogy and practices to improve the performance of NAAI high school students and undergraduate students in STEM.
This project team will work to: (1) pilot activities and coursework to train K-16 STEM educators about American Indian inclusive methods and materials, (2) to provide AIAN high school students with STEM college preparatory experience using inclusive STEM practices, and (3) to provide a cohort of female AIAN high school students additional university experiences and mentors as these students transition to postsecondary education. Activities include a five-day summer educators institute for 40 K-16 STEM educators, an additional weekend workshop for 20 K-16 STEM educators, a summer STEM academy for 96 AIAN high school students, a STEM weekend workshop for female AIAN high school students, and a mentoring program for AIAN high school students.
DATE:
-
TEAM MEMBERS:
April LindalaJessica CruzMartin Reinhardt
A skilled workforce is critical in high-quality out-of-school time (OST) programs (Smith, Devaney, Akiva & Sugar, 2009). However, the workshops commonly used to train OST staff are not adequately preparing practitioners to deliver quality programs that can benefit youth(Durlak & Weissberg, 2007; Smith et al, 2009).
DATE:
TEAM MEMBERS:
Femi VanceEmily SalvaterraJocelyn Atkins MichelsenCorey Newhouse
Youth environmental education (EE) programs often serve as gateway experiences in which diverse audiences engage in informal science learning. While there is evidence that these programs can have positive impacts on participants, little empirical research has been conducted to determine what makes one program more successful than another. To be able to conduct such research, this Exploratory Pathways study will (1) develop and statistically validate ways to measure meaningful outcomes for participants across a variety of programs and (2) test observational methods that will enable research that can determine which elements of program delivery most powerfully influence participant engagement and learning outcomes in different contexts. These efforts will include consultations with diverse subject matter experts from the National Park Service, nature centers, and academia; survey research with participants in afterschool and free-choice EE programs; and observations of EE programs designed to fine tune the measurement of program delivery elements and student engagement. Developing valid and reliable outcomes measures and observational protocols will enable a larger investigation that will specifically address the following research question: What program characteristics lead to the best learning outcomes for program participants in different contexts? This research will result in empirically tested guidelines that will enable educators to design and deliver more effective programs for a wide range of audiences in a wide range of contexts. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This effort will refine methods necessary to undertake an unprecedented study (and future AISL Research in Service to Practice proposal) to examine the linkages between pedagogical approaches, participant engagement, and learning outcomes in informal STEM-focused youth EE programs. The larger study will involve systematically observing a large number of programs to assess the use of different approaches and to link those approaches to engagement and learning outcomes through both observation and survey research. In this current study the team will develop and refine crosscutting outcome measures to ensure validity, reliability, and sensitivity by drawing upon the literature and consultation with key stakeholders to develop suites of indicators for subsequent psychometric testing and revision. They will also refine observational techniques for assessing pedagogical approaches through extensive testing of inter-rater reliability. Finally, techniques for measuring participant engagement, incorporating both observational techniques and retrospective participant surveys will be refined. The work will be conducted by researchers at Clemson University and Virginia Tech, in partnership with the U.S. National Park Service, the North American Association for Environmental Education, and the American Association of Nature Center Administrators. This work represents the first step in a longer research process to determine the "best practices" most responsible for achieving outcomes in a wide range of contexts.
In this chapter we present the ways in which institutional cultural differences impact the development and implementation of learning activities in informal settings. Five university-based centers for the study of chemistry worked with informal learning professionals to re-envision educational and public outreach activities about science. The projects were part of a broader effort to catalyze new thinking and innovation in informal education and chemistry centers. The set of projects illustrates the broad possibilities for informal learning settings, with projects targeting diverse audiences
Science Club Summer Camp (SC2) is a practicum-based teacher professional development program for elementary school teachers, aligned to the recently released Next Generation Science Standards (NGSS). It seeks to address well-described gaps in the scientific training of elementary teachers that threaten the effective implementation of NGSS and interrupt development of early youth science skills. We offer that the best way to prepare a future STEM and biomedical workforce is to help improve NGSS-aligned instruction at the K-5 level.
SC2 uses an integrated approach to train Chicago Public School teachers and youth in the nature of science. An interdisciplinary team of scientists, master science teachers, NGSS experts, and youth development staff will collaborate to incorporate the NGSS Disciplinary Core Ideas (DCIs), Crosscutting Concepts, and science and engineering practices into both out-of-school time learning at a summer camp and academic year instruction. Program participants will also learn about NGSS connections to health and biomedicine through interactions with practicing scientists, visits to research labs, and inquiry into health phenomena.
Over the course of the program, we will train 64 teachers and more than 2000 youth in authentic science and health practices. A multi-faceted evaluation plan will assess the impact of our program on teacher beliefs, knowledge, and understanding of the NGSS, and the degree to which their training results in changes to their instructional practice. Additionally, we will help teachers design critical NGSS-aligned assessment tools as measures of student learning. These instruments will provide early evidence on the connections between NGSS-aligned instruction and deeper student learning.
In addition to addressing the acute need for NGSS-aligned teacher professional development strategies, and high quality summer learning opportunities for disadvantages youth, it is our expectation that this “dual use” approach will serve as a model for future teacher professional development programs that seek to bridge learning in formal and informal environments and strengthen academic-community partnerships.
The goal of the Hawaii Science Career Inspiration grant (HiSCI) is to enhance science education resources and training available to teachers and students in disadvantaged communities of Hawaii in order to ensure a maximally large and diverse workforce to meet the nation’s biomedical, behavioural and clinical research needs. The HiSCI Program will build on the knowledge gained from two past SEPA grants and the University of Hawaii Center for Cardiovascular Research and leverage resources from all corners of the state to accomplish four specific aims:
1) Increase student interest and exposure to health science careers by providing multiple science exposure opportunities and mentoring along the primary, intermediate, and secondary school experiences for at least 300 students a year and a printed and web-based STEM career resource guide and career posters to alert students, counsellors and teachers to all available opportunities;
2) Provide professional development for 20 middle and high school teachers a year, to include scientific content and foster an understanding of the scientific research process, in addition to medical students mentoring intermediate and high school students;
3) Listen, respond to, and connect the science teacher community in Hawaii by holding innovative listening groups for teachers across the state; and
4) Provide tools and supplies for at least twenty K-12 classrooms a year through a mini-grant process and alert teachers across the state to free resources both locally and nationally. The HiSCI Program is highly relevant to Hawaii’s public health and science infrastructure as it will provide an innovative way to gain knowledge of science training needs and will provide many of the resources to teachers and students across the state by leveraging, communicating and sharing existing resources.
From Intel to Facebook, Google and Apple, technology companies are joining other science, technology, engineering, and mathematics (STEM) industry leaders in a grand challenge to diversify their workforce. Finally, two sides of the diversity message can be heard simultaneously: expanding opportunities for women and girls is not just the right thing to do, investing in diversity is also a smart business opportunity. To meet workforce supply demands, improve innovation, and ensure social equity, STEM professions need the imaginations and talents of girls and underrepresented communities of color
Wallace and Brooks examined the culture of an elementary science education methods course conducted in a summer science camp, along with the professional identity development of the preservice teachers during their participation in the course.