The NIH Science Education Partnership Award (SEPA) program of Emory University endeavors to use an over-arching theme of citizen science principles to:
develop an innovative curriculum based on citizen science and experiential learning to evaluate the efficacy of informal science education in after-school settings;
promote biomedical scientific careers in under-represented groups targeting females for Girls for Science summer research experiences;
train teachers in Title I schools to implement this citizen science based curriculum; and
disseminate the citizen science principles through outreach.
This novel, experiential science and engineering program, termed Experiential Citizen Science Training for the Next Generation (ExCiTNG), encompasses community-identified topics reflecting NIH research priorities. The curriculum is mapped to Next Generation Science Standards.
A comprehensive evaluation plan accompanies each program component, composed of short- and/or longer-term outcome measures. We will use our existing outreach program (Students for Science) along with scientific community partnerships (Atlanta Science Festival) to implement key aspects of the program throughout the state of Georgia. These efforts will be overseen by a central Steering Committee composed of leadership of the Community Education Research Program of the Emory/Morehouse/Georgia Institute of Technology Atlanta Clinical Translational Science Institute (NIH CTSA), the Principal Investigators, representatives of each program component, and an independent K–12 STEM evaluator from the Georgia Department of Education.
The Community Advisory Board, including educators, parents, and community members, will help guide the program’s implementation and monitor progress. A committee of NIH-funded investigators, representing multiple NIH institutes along with experienced science writers, will lead the effort for dissemination and assure that on-going and new NIH research priorities are integrated into the program’s curriculum over time.
DATE:
-
TEAM MEMBERS:
Adam MarcusTheresa Gillespie
resourceevaluationProfessional Development, Conferences, and Networks
This report summarizes the evaluation outcomes of the Collaborative Project Management (CoPM) Institute project, a two-day convening centered on bringing proven project management skills and approaches in the for-profit world to the informal science education (ISE) community to support effective collaborations and successful outcomes. The CoPM Institute was conceptualized as a pilot effort to test the effectiveness of porting of tools and frameworks for collaborative project management from the business/for-profit environment to advance the following project goals:
Build the capacity of
This project in the Advancing Informal STEM (Science, Technology, Engineering and Mathematics) Learning program's Innovations in Development track aims to build professional capacity in Informal Science Education (ISE) institutions for effective engagement of Latinx audiences. A collaboration between The Exploratorium and the Children's Discovery Museum (CDM) of San Jose, Cambio is a professional development project based on the premise that developing cultural competence specific to Latinx communities and STEM learning, together with organizational change capacity, will enable ISE institutions to improve their ability to be inclusive of Latinx communities, cultures, and audiences. Cambio's ultimate aim is to broaden participation in STEM by building the ISE field's capacity to effectively engage Latinxs in informal STEM learning. ISE institutions and other out-of-school programs and organizations have an important role to play in inspiring and preparing the next generation of Latinx STEM students, employees, and educators. Cambio participants will deepen their engagement with the research and practice relevant to this role and build an understanding of what broadening Latinx engagement can and should look like in their institutions. Working with expert instructors and coaches, and together as peers, Cambio participants will apply what they learn to real-world strategic initiatives they implement at their home institutions.
The heart of the Cambio project is the creation of a professional development (PD) model for ISE institutions and their staff that synthesizes: (a) current knowledge about strategies for Latinx engagement in informal STEM learning; (b) previous NSF-funded projects that leveraged that knowledge to chart a way forward for the field; and (c) CDM's Cultural Competence Learning Institute professional development program for building cultural competence, inclusion, and organizational change in museums. This synthesis will form a robust professional development platform that has the potential to create a field-wide shift in the way informal science institutions approach working with Latinx audiences. The Cambio professional development program will include: a new professional development framework and curriculum that will reach 54 practitioners in 15 institutions; the development and dissemination of professional development tools and resources for use by ISE practitioners; a Community of Practice focused on Latinx engagement in informal STEM learning; evidence of the efficacy of the Cambio PD model; and knowledge generated by formative and summative evaluation that will inform other ISE efforts focused on increasing the participation of Latinxs in STEM. A STEM focus will be woven throughout the professional development experience that focuses explicitly on areas of intersection between Latinx culture and identities and STEM. Practitioners will increase their expertise in designing experiences that will invoke emotional engagement, spark curiosity and excitement, in ways that explicitly value Latinx identities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
The Teen Science Cafe Network is an adaptation for teens, of the popular adult science cafe model, which brings people together in a social setting to have an animated conversation with a scientist on some interesting and timely topic. Since its inception in 2012, the Network has grown at a rapid rate: it is now in 130 sites in 45 states, the District of Columbia, and British Columbia. Multiple evaluations have documented its impact. Teens are shown to have increased STEM literacy, a more realistic picture of scientists as real people leading interesting lives, and a better understanding of the nature of science. This two-and-a-half-day conference is designed to review the state of this model of teen engagement in science and science communication. Participants will examine lessons learned from this and similar networks to consider the features needed to expand this model to other audiences (e.g., rural teens, teenage college students, teenagers on military bases, and teens served by local chapters of professional societies based on ethnicity and gender).
Leaders of the Teen Science Cafe Network, along with an advisory committee comprised of individuals who are successfully managing networks, will explore these fundamental questions: 1) How can the field best take advantage of this large and growing network? 2) How can the current community of practice be leveraged for growth? 3) What are some of the most effective strategies for achieving and maintaining effective, long-term partnerships with organizations such as 4-H, science centers, networks of afterschool providers, science festivals, professional societies, and libraries? 4) What are possible outcomes for promoting discipline-specific cafes in areas such as ocean science, astrophysics, geoscience, and polar science? Outputs from the conference include a refined set of guiding principles for the current network and a white paper describing the features of strong and effective networks and recommendations for scaling.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Michelle HallJanice MokrosMichael Mayhew
Fostering greater inclusion in science creates benefits for both science and society. In this Innovations and Development project, the University of Utah will investigate how to sustain and scale the STEM Ambassador Program (STEMAP), begun in 2016 with AISL funding. STEMAP developed an innovative process to train scientists to engage members of the public, who cannot or do not gain access to science via conventional science education venues (such as museums, schools, zoos), by implementing activities in non-traditional settings. The 65 scientists trained by the initial STEMAP effort effectively engaged in over 45 settings including an affordable housing development, a youth residential treatment center, a state prison, a cooking class, a daycare facility, and several senior centers. The number of scientists applying to the program quickly exceeded STEMAP's capacity. Other institutions expressed interest in replicating the training. This project will explore strategies for scaling and sustaining public engagement training to support more scientists who can engage more people in more venues. Outcomes will serve to inform the broader implementation of STEMAP and the efforts of other public engagement programs, many of which face similar scaling and sustainability challenges.
Scaling and sustaining public engagement of science (PES) programs is a central challenge for many in the informal science learning community. This project will explore strategies to scale and sustain the STEM Ambassador Program. Research questions include: (1) How do different program formats increase or restrict program capacity and engagement outcomes? (2) What benefits accrue to scientists and their institutions by participating in public engagement in science activities that might serve as motivators to continue these activities? (3) Are funding and organizational models developed in business and other professional settings applicable to sustaining these programs? To address scalability, this project will explore the effectiveness of three dissemination formats: (1) the creation of a mentorship program for in-person trainees, (2) a train-the-trainer approach, and (3) online training with in-person mentorship. The project team will create an evaluation toolkit with participant surveys, rubrics for observers, and "on-the-spot" assessment tools developed under AISL Award 1811022 to assess the effectiveness of engagement activities delivered by trainees in each of the three formats. To address sustainability, the project team will document the values of public engagement training to both the participating scientists and their institutions via surveys and interviews. Consultants from the business sectors will create a PES Campus Council to explore possible financial, organizational, and leadership plans that will help sustain engagement efforts. Outcomes will be published in peer-reviewed journals and compiled into a dissemination framework to inform actions to scale and sustain STEMAP and other public engagement of science programs to engage more hard-to-reach audiences. Inverness Research will serve as the project's external evaluator.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Research on how museum staff are trained continues to emerge. Training varies considerably across institutions and typically includes observations, shadowing, and trial and error. While museum educators put high value on increasing visitor-centered participatory experiences, engagement based on acquisition-based theories of learning is still common among floor staff, even after training. Facilitating learning about science, technology, engineering, and mathematics (STEM) topics in ways that support visitors in constructing their own understanding is difficult, especially since floor staff/facilitators may be working simultaneously with children and adults of a range of ages, backgrounds, and goals. This project will advance understanding of how to facilitate open-ended learning experiences in ways that engage visitors in practices that align with the STEM disciplines. The project will result in an evidence-based facilitation framework and training modules for training informal science educators. The work is grounded in constructivist theories of learning and identity work and focuses on visitors constructing understanding of STEM topics through active engagement in the practices of STEM. This model also results in learning experiences in informal settings that are mutually reinforcing with the goals of schools. This research is being conducted through an established researcher-practitioner partnership between MOXI, the Wolf Museum of Exploration + Innovation and the University of California at Santa Barbara (UCSB).
The two primary goals of the work are to (1) enable visitors to better engage in STEM practices (practice-based learning) and (2) investigate the role of training in helping facilitators develop the practice-based facilitation strategies needed to support visitors' learning. STEM content in this study is physical science. Prior work resulted in two tools that constitute part of a facilitation framework (a practices-by-engagement matrix and three facilitation pathways) which help educators identify appropriate goals based on how the visitor is engaging with exhibits. The development of the final tool in the framework, facilitation strategies, and the refinement of the first two tools will be done using a design-based implementation research (DBIR) approach. Data collection and analysis will be directed and completed by research-practitioner teams of UCSB graduate students (researchers) and MOXI educators (practitioners); MOXI educators will be both participants and researchers. Data collection activities include: video data using point-of-view cameras worn by visitors and educators; interviews of educators and visitors; observations of the training program; and educator reflections. In the final year, a small field test will be done at six sites, representing different types of museums. Interviews and reflections comprise the data collection at the field sites.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Polar Literacy: A model for youth engagement and learning will foster public engagement with polar science. The project targets middle-school aged underserved youth and polar research scientists, with the goal to increase youth interest in and understanding of Polar Regions, and to hone researchers' science communication skills. The project will develop affordable and replicable ways of bringing polar education to informal learning environments, extend our understanding of how polar education initiatives can be delivered to youth with maximum effect, and design a professional development model to improve the capacity for Polar Region researchers to craft meaningful broader impact activities. Polar Literacy will create and test a model which combines direct participation by scientists in after-school settings, with the use of curated polar research data sets and data visualization tools to create participatory learning experiences for youth. Beyond the life of the project funding, many of the project deliverables (including kits, videos, and other resources) will continue to be used and disseminated online and in person through ongoing work of project collaborators.
Polar Literacy: A model for youth engagement and learning will advance the understanding of informal learning environments while leveraging the rich interdisciplinary resources from polar investments made by the National Science Foundation (NSF). The project's key audiences -- polar researchers, informal educators, and out-of-school time (OST) youth in grades 4-7 (ages 9-13) -- will connect through both place-based and internet-based experiences and work collaboratively to generate a flexible, scalable, and transferable education model. The project will 1) design OST kits and resource guides (focused on Polar Literacy Principles) and include "Concept in a Minute" videos designed to highlight enduring ideas, 2) provide professional development for informal educators, 3) synthesize a club model through adaptation of successful facets of existing informal learning programs, and 4) create Data Jam events for the OST Special Interest (SPIN) clubs and camp programs by modifying an existing formal education model. A research design, implemented at four nodes over three years, will answer three research questions to evaluate the impact of professional development on informal educators, as well as the impact of programs on youth, and the effectiveness of the model. In addition to the project team and collaborators who are informal education practitioners, an advisory board composed of experts in youth programming, informal education, and evaluation will guide the project to ensure that it advances the body of informal STEM learning research.
Polar Literacy is an Advancing Informal STEM Learning (AISL) Innovations in Development project in response to the Dear Colleague Letter: Support for Engaging Students and the Public in Polar Research (NSF 18-103). Polar Literacy is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM (Science, Technology, Engineering, Mathematics) learning in informal environments. This project has co-funding support from the Antarctic section of the Office of Polar Programs.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Janice McDonnellOscar SchofieldCharles LichtenwalnerJason Cervenec
resourceresearchProfessional Development, Conferences, and Networks
BioEYES is a K-12 science outreach program that develops self-sustaining teachers as a replication strategy to address high demand for the program while promoting long-term school partnerships. This paper explores the practices of “model teachers” from multiple grades, who are empowered over a three-year period to deliver BioEYES’ hands-on science content autonomously, as compared to the program’s standard co-teaching model (BioEYES educator + classroom teacher). The authors found that BioEYES’ professional development (PD) workshop, classroom co-teaching experience, and refresher trainings
Consideration of the needs of individuals with a wide range of disabilities is not always considered in the early design stages of an informal STEM learning (ISL) activity or program. The primary access approach for people with disabilities becomes the provision of accommodations once the ISL product or environment is created. In contrast, the Universal Design approach considers users with a wide range of characteristics throughout the design process and works to create products and environments that are accessible, usable, and inclusive. This project, called AccessISL, led by the University of Washington's DO-IT (Disabilities, Opportunities, Internetworking and Technology) Center and Museology Program, includes an academic museology program and local ISL sites, representing museums, zoos, aquariums, makerspaces, science centers, and other sites of informal STEM learning. Insights will be gained through the engagement of people with disabilities, museology graduate students and faculty, and ISL practitioners. The AccessISL project model, composed of a set of approaches and interventions, builds on existing research and theory in the fields of education science, change management, effective ISL practices, and inclusive design processes. The project will collect evidence of policies and practices (or lack thereof) that improve the inclusiveness of ISL with respect to a wide range of disabilities and considers approaches for the design and development of new strategies; explores what stakeholders need to make change happen; uncovers challenges to the adoption of inclusive practices in public ISL settings and explores ways to overcome them; and proposes relevant content that might be included in museology curriculum. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project addresses the following two objectives:
For ISL personnel and museology faculty: to increase knowledge, skills, and actions to make ISL programs, facilities, courses, and resources more welcoming and accessible to participants with disabilities and embed relevant practices within their work.
For postsecondary STEM students with disabilities and museology students: to increase knowledge and skills in advocating for ISL offerings that are welcoming and accessible to everyone, including those with a wide variety of disabilities, and to encourage individuals with disabilities to pursue careers in ISL.
The project employs a student-centered approach and a set of practices that embrace the social model of disability, social justice education, disability as a diversity issue, intersectionality, and Universal Design. A leadership team of interns--each member a STEM student with a disability or a museology graduate student--along with project staff will engage with the University of Washington's Museology Program to identify and implement strategies for making ISL activities and courses more welcoming and accessible to individuals with disabilities. An online community of practice will be developed from project partners and others nationwide. A one-day capacity building institute will be held to include presentations, student/personnel panels for sharing project and related experiences, and group discussions to explore issues and further identify systemic changes to make ISL programs more welcoming and accessible to individuals with disabilities. As prototypes of the AccessISL Model are developed, evaluation activities will primarily be formative (looking for strengths and weaknesses) and remedial (identifying/implementing changes that could be made to improve the model). The model will continue to be fine-tuned through formative evaluation. Evaluation of the model components will focus on the experience of a range of stakeholders in the project. Specifically, quantitative data collected will include levels and quality of engagement, accessibility recommendations and products developed, and delivery of ISL services. Qualitative data will be collected through observations, surveys, focus groups, interviews, and case studies.
AccessISL project products will include proceedings of an end-of-project capacity building institute, promising practices, case studies, a video, and other online resources to help ISL practitioners and museology faculty that will result in making future ISL opportunities more inclusive of people with disabilities. AccessISL will advance knowledge and ensure long-term impact using multiple strategies:
broadening the STEM participation of people with disabilities as well as women, racial/ethnic minorities, and other underrepresented groups through the application of universal design
strengthening associations and creating synergy and durable relationships among stakeholders,
encouraging teaching about disability, accessibility, and universal design in museology courses,
empowering students with disabilities and current and future ISL practitioners to advocate for accessible ISL and develops an infrastructure to promote accessible ISL programs nationwide, and
contributing to the body of promising practices with products that will (a) enhance understanding of issues related to the inclusion of people with disabilities in ISL programs and (b) promote inclusive practices.
Outcomes will benefit society by making STEM opportunities available to more people and enhancing STEM fields with the talents and perspectives of people with disabilities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by engaging in hands-on field experience, laboratory/project-based entrepreneurship tasks and mentorship experiences.
Twin Cities Public Television project on Gender Equitable Teaching Practices in Career and Technical Education Pathways for High School Girls is designed to help career and technical education educators and guidance counselors recruit and retain more high school girls from diverse backgrounds in science, technology, engineering and math (STEM) pathways, specifically in technology and engineering. The project's goals are: 1) To increase the number of high school girls, including ethnic minorities, recruited and retained in traditionally male -STEM pathways; 2) To enhance the teaching and coaching practices of Career and Technical Education educators, counselors and role models with gender equitable and culturally responsive strategies; 3) To research the impacts of strategies and role model experiences on girls' interest in STEM careers; 4) To evaluate the effectiveness of training in these strategies for educators, counselors and role models; and 5) To develop training that can easily be scaled up to reach a much larger audience. The research hypothesis is that girls will develop more positive STEM identities and interests when their educators employ research-based, gender-equitable and culturally responsive teaching practices enhanced with female STEM role models. Instructional modules and media-based online resources for Minnesota high school Career and Technical Education programs will be developed in the Twin Cities of Minneapolis and St. Paul and piloted in districts with strong community college and industry partnerships. Twin Cities Public Television will partner with STEM and gender equity researchers from St. Catherine University in St. Paul, the National Girls Collaborative, the University of Colorado-Boulder (CU-Boulder), the Minnesota Department of Education and the Minnesota State Colleges and Universities System.
The project will examine girls' personal experiences with equitable strategies embedded into classroom STEM content and complementary mentoring experiences, both live and video-based. It will explore how these experiences contribute to girls' STEM-related identity construction against gender-based stereotypes. It will also determine the extent girls' exposure to female STEM role models impact their Career and Technical Education studies and STEM career aspirations. The study will employ and examine short-form autobiographical videos created and shared by participating girls to gain insight into their STEM classroom and role model experiences. Empowering girls to respond to the ways their Career and Technical Education educators and guidance counselors guide them toward technology and engineering careers will provide a valuable perspective on educational practice and advance the STEM education field.
This annual report presents an overview of Saint Louis Science Center audience data gathered through a variety of evaluation studies conducted during 2015. This report includes information on the Science Center's general public audience demographics and visitation patterns, gives an overview of visitors' comments about their Science Center experience, summarizes major trends observed in the Science Center's tool for tracking educational programs, and presents highlights from a Membership study, a formative evaluation of a new Makerspace exhibition, and program evaluation of a workshop for the
Ruff Family Science is a project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. Building on the success of the PBS series FETCH! with Ruff Ruffman, the project leverages FETCH’s funny and charismatic animated host, along with its proven approach to teaching science, to inspire educationally disadvantaged families to explore science together. The project is utilizing a research and design process to create resources that meet the needs of families