In this final chapter, we reflect on four themes that cut across the preceding chapters on evaluating outcomes in informal STEM education (ISE): validity, context, technology, and evaluation capacity building. We also note several topics that we hope will be addressed more extensively in future conversations about evaluation in ISE. These include the ethical responsibilities of evaluators, theory‐based approaches to evaluation, formal training and professional development pathways for evaluators, and funding opportunities and the structural landscape of the field.
This worksheet provides a brief overview of the different types of goals and objectives that a science communicator might want to prioritize when think about the design of communication activities.
The New York Hall of Science (NYSCI) will develop, test, market, and disseminate an interactive graphic novel iBook that will use the interests of young people (ages 10–14) in animals and comics to engage them in learning about health and clinical research. Provisionally called “Transmission: Astonishing Tales of Human-Animal Diseases,” the project represents a new approach to engaging young people in biomedical science learning.
Graphic novels are one of the fastest growing categories in publishing and bookselling, and today, they are significantly more sophisticated than the comics that came before them. They are also enormously popular among young people. The proposed graphic novel iBook will focus on the diseases that humans and animals share and pass between them (sometimes to devastating consequences), from Ebola, bird flu, and West Nile disease to influenza, measles, and pneumonia. Moreover, like many other contemporary graphic novels, it will address a pressing issue of the day—amely, the growth of zoonotic and anthropozoonotic diseases.
The iBook will be developed in a digital, interactive format (a growing trend within the genre) and, like many graphic novel titles, will take a mystery and forensic crime approach to exploring its content. Ultimately, Transmission will become a national model for conveying biomedical understanding through the use of up-to-the-minute interactive iBook technologies and an engaging graphic novel format.
For public health to improve, all sectors of society much have access to the highest quality health science news and information possible. How that information is translated, packaged and disseminated is important: the stories matter. Our journalism and mentoring program will grow the health science literacy of the nation by building the next generation of science communicators, ensuring that cadre of youth from historically disadvantaged groups have the discipline, creativity and critical thinking skills needed to be successful health science-literate citizens and advocates within their own communities.
Using a combination of youth-generated videos, broadcast reporting and online curriculum resources, PBS NewsHour will engineer successful educational experiences to engage students from all backgrounds, and particularly underserved populations, to explore clinical, biomedical, and behavioral research. The PBS NewsHour’s Student Reporting Labs program, currently in 41 states, will create 10 health science reporting labs to produce unique news stories that view health and science topics from a youth perspective. We will incorporate these videos into lesson plans and learning tools disseminated to the general public, educators and youth media organizations. Students will be supported along the way with curricula and mentorship on both fundamental research and the critical thinking skills necessary for responsible journalism. This process will ensure the next generation includes citizens who are effective science communicators and self-motivated learners with a deep connection to science beyond the textbook and classroom.
PBS NewsHour will develop a STEM-reporting curriculum to teach students important research skills. The program will include activities that expose students to careers in research, highlight a diverse assortment of pioneering scientists as role models and promote internship opportunities. The resources will be posted on the PBS NewsHour Extra site which has 170,000 views per month and our partner sites on PBS Learning Media and Share My Lesson—the two biggest free education resource sites on the web—thus greatly expanding the potential scope of our outreach and impact.
NewsHour broadcast topics will be finalized through our advisory panel and the researchers interviewed for the stories will be selected for their expertise and skills as effective science communicators, as well as their diversity and ability to connect with youth. Finally, we will launch an outreach and community awareness campaign through strategic partnerships and coordinated cross promotion of stories through social media platforms.
Citizen science is a form of Public Participation in Scientific Research (PPSR) in which the participants are engaged in the scientific process to support research that results in scientifically valid data. Opportunities for participation in real and authentic scientific research have never been larger or broader than they are today. The growing popularity and refinement of PPSR efforts (such as birding and species counting studies orchestrated by the Cornell Lab of Ornithology) have created both an opportunity for science engagement and a need for more research to better implement such projects in order to maximize both benefits to and contributions from the public.
Towards this end, Shirk et al. have posted a design framework for PPSR projects that delineates distinct levels of citizen scientist participation; from the least to the highest level of participation, these categories are contract, contribute, collaborate, co-create, and colleagues. The distinctions among these levels are important to practitioners seeking to design effective citizen science programs as each increase in citizen science participation in the scientific process is hypothesized to have both benefits and obstacles. The literature on citizen science models of PPSR calls for more research on the role that this degree of participation plays in the quality of that participation and related learning outcomes (e.g., Shirk et al., 2012; Bonney et al., 2009). With an unprecedented interest in thoughtfully incorporating citizen science into health-based studies, citizen science practitioners and health researchers first need a better understanding of the role of culture in how different communities approach and perceive participation in health-related studies, the true impact of intended educational efforts from participation, and the role participation in general has on the scientific process and the science outcome.
Project goal to address critical barrier in the field: Establish best practices for use of citizen science in the content area of human health-based research, and better inform the design of future projects in PPSR, both in the Denver Museum of Nature & Science’s Genetics of Taste Lab (Lab), and importantly, in various research and educational settings across the field.
Aims
Understand who currently engages in citizen science projects in order to design strategies to overcome the barriers to participation that occur at each level of the PPSR framework, particularly among audiences underrepresented in STEM.
Significantly advance the current knowledge regarding how citizen scientists engage in, and learn from, and participate in the different levels of the PPSR framework.
Determine the impact that each stage of citizen science participation has on the scientific process.
The NIH Science Education Partnership Award (SEPA) program of Emory University endeavors to use an over-arching theme of citizen science principles to:
develop an innovative curriculum based on citizen science and experiential learning to evaluate the efficacy of informal science education in after-school settings;
promote biomedical scientific careers in under-represented groups targeting females for Girls for Science summer research experiences;
train teachers in Title I schools to implement this citizen science based curriculum; and
disseminate the citizen science principles through outreach.
This novel, experiential science and engineering program, termed Experiential Citizen Science Training for the Next Generation (ExCiTNG), encompasses community-identified topics reflecting NIH research priorities. The curriculum is mapped to Next Generation Science Standards.
A comprehensive evaluation plan accompanies each program component, composed of short- and/or longer-term outcome measures. We will use our existing outreach program (Students for Science) along with scientific community partnerships (Atlanta Science Festival) to implement key aspects of the program throughout the state of Georgia. These efforts will be overseen by a central Steering Committee composed of leadership of the Community Education Research Program of the Emory/Morehouse/Georgia Institute of Technology Atlanta Clinical Translational Science Institute (NIH CTSA), the Principal Investigators, representatives of each program component, and an independent K–12 STEM evaluator from the Georgia Department of Education.
The Community Advisory Board, including educators, parents, and community members, will help guide the program’s implementation and monitor progress. A committee of NIH-funded investigators, representing multiple NIH institutes along with experienced science writers, will lead the effort for dissemination and assure that on-going and new NIH research priorities are integrated into the program’s curriculum over time.
This project specifically addresses the SMRB’s imperative that “NIH’s pre-college STEM activities need a rejuvenated integrated focus on biomedical workforce preparedness with special considerations for under-represented minorities.”
Approximately one-third of CityLab’s participants are under-represented minority (URM) students, but we now have a unique opportunity to build a program that will reach many URM students and position them for undergraduate STEM success. We have partnered with urban squash education organizations in Boston (SquashBusters) and New York (CitySquash and StreetSquash) that recruit URM/low SES students to participate in after-school squash training and academic enrichment programs. We have also partnered with the Squash + Education Alliance (previously named the National Urban Squash and Education Association) to disseminate the new program—first from Boston to New York and later through its national network of affiliated squash education programs.
In order to bring this project to fruition, Boston University is joining forces with Fordham University in New York. Fordham is home to CitySquash so these organizations provide an ideal base for the New York activities. The proposed project will enable us to demonstrate feasibility and replicability within the 5-year scope of this grant. Our shared vision is to develop a national model for informal precollege biomedical science education that can be infused into a myriad of similar athletic/academic enrichment programs.
The squash education movement for urban youth has been highly successful in enrolling program graduates in college. Since the academic offerings of the squash education programs focus on English Language Arts and Mathematics, their students struggle with science and rarely recognize the tremendous opportunities for long- term employment in STEM fields.
This project will bring CityLab’s resources to local squash programs in a coordinated and sustained engagement to introduce students to STEM, specifically the biomedical sciences. Together with the urban squash centers, we will build upon the hands-on life science experiences developed and widely disseminated by CityLab to create engaging laboratory-based experiences involving athletics and physiology.
The specific aims of the proposed project are:
To develop, implement, and evaluate a new partnership model for recruiting URM/low SES students and inspiring them to pursue careers in STEM; and
To examine changes in the science learner identities (SLI) of the students who participate in this program and establish this metric as a marker for continued engagement in STEM.
With the involvement of the two urban research universities, three local squash education programs, and SEA, we see this new SEPA initiative as a unique way to pilot, refine, and disseminate an after-school/informal science education program that can have a significant impact on the nation’s production of talented STEM graduates from URM/low SES backgrounds.
DATE:
-
TEAM MEMBERS:
Carl FranzblauDonald DeRosaCarla Romney
RUFF FAMILY SCIENCE is a project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. The project is using a research and design process to create an implementation model and prototype resources (digital media, hands-on activities, and supports for educators) to build new knowledge about the potential for digital media to inspire and support intergenerational science learning among vulnerable families.
WGBH and Education Development Center, Inc. (EDC)
DATE:
TEAM MEMBERS:
Mary HaggertyHeather LavigneJessica AndrewsAlexia RaynalMarion GoldsteinJaime Gutierrez
Tinkering creates a bridging point between a learner’s personal interests and experiences and a broad range of possible learning outcomes. It offers valuable opportunities to engage all students in STEM and fosters a more inclusive STEM education. In this way, it is very much aligned with a Science Capital Teaching Approach: fundamentally, it is a highly personalised pedagogy, which allows the learner to follow their own interests and set their own goals.
This resource has been designed to help teachers integrate the Tinkering approach and the Science Capital framework in their practice
In 2018, the Croucher Foundation conducted its third annual mapping exercise for the out-of-school STEM learning ecosystem in Hong Kong.
The study reveals a rich and vibrant ecosystem for out-of-school STEM in Hong Kong with over 3,000 discrete activities covering a very wide range of science disciplines. This third report indicates extremely rapid growth in available out-of-school STEM activities compared to 2016 and an even larger increase in the number of organisations offering out-of-school STEM activities in Hong Kong.
STEM educators are eager to foster long term collaboration with each other, and with schools. At the same time, good working practice by schools, teachers, STEM educators and institutions that involves and engages local communities was discovered, showing the diversified modes of connection which could enhance the sustainability of STEM ecosystem.
We trust that this three-year study with its associated digital maps, provides a useful resource for schools, teachers, students, parents, STEM educators and education policy makers in Hong Kong.
In 2018, the Croucher Foundation conducted its third annual mapping exercise for the out-of-school STEM learning ecosystem in Hong Kong.
The study reveals a rich and vibrant ecosystem for out-of-school STEM in Hong Kong with over 3,000 discrete activities covering a very wide range of science disciplines. This third report indicates extremely rapid growth in available out-of-school STEM activities compared to 2016 and an even larger increase in the number of organisations offering out-of-school STEM activities in Hong Kong.
STEM educators are eager to foster long term collaboration with
DATE:
TEAM MEMBERS:
Siu Po LeeDavid FosterThe Croucher Foundation
This paper describes a follow‐up focus group study for the larger Exhibit Designs for Girls' Engagement (EDGE) project. Grounded in Culturally Responsive Pedagogical theory (CRP), the project aimed to understand the relationship between female responsive designs and girls' engagement at STEM exhibits. After developing a Female‐Responsive Design (FRD) Framework and conducting a large‐scale study to determine the most important design attributes for engaging girls at exhibits, the final step involved a qualitative investigation into those design attributes. Four focus groups with 22 girls aged 8