This guide gathers the ultimate reflections from the Erasmus+ project "Tinkering EU: Addressing the Adults." It was created for science centers, museums and other places of science education interested in exploring the potential of Tinkering for inclusive learning and engagement. It presents lessons learned about:
The co-design and the development of the activities.
Relevant elements to consider building meaningful relationships with the local communities.
The contribution the project has given to each partner’s institutional change at a wider level.
An interactive online
This book includes accounts going back to the 1970s of efforts to engage visitors as contributors to exhibitions and active participants in museum conversations. Included are 27 essays by practioners from children’s museums and science centers, natural history museums and art galleries, history museums and living collections. The book offers practical guidance and concludes with reflections on the value and meaning of visitor contributions to exhibitions. Co-editor Pollock poses a question that in retrospect seems prescient: "Finally, have we considered carefully enough the possible downsides
Each year, millions of Americans visit science centers and museums, children’s museums, zoos, aquariums, nature centers, planetariums, and similar institutions. Recognized as trusted and popular places for educational and leisure experiences, these institutions are uniquely capable of engaging people across a spectrum of beliefs, experiences, and identities on topics related to science, technology, engineering, and mathematics (STEM), as well as addressing pressing societal problems related to science, technology, and innovation. However, the potential impacts of these institutions are largely dependent on the skills, knowledge, and abilities of the professionals working at them. Following the onset of the COVID-19 pandemic and the need to shift the nature of work, the informal STEM learning workforce was dramatically impacted. The recent period of disruption is a time for innovation. The field is well-positioned to promote new models of professional learning and development that are grounded in the values and practices of informal learning. This project will benefit local communities across the United States and society at large by advancing the capacity of science-engagement professionals to respond to societal needs, concerns, and interests more effectively through their institutions’ exhibitions, education and learning programs, and various forms of public engagement (e.g., community outreach events, supports for teachers/educators and schools). Led by the Association of Science and Technology Centers in collaboration with the Center of Science and Industry’s Center for Research and Evaluation and Oregon State University’s STEM Research Center, this work will build on the Informal STEM Learning (ISL) Professional Competency Framework developed and validated with prior National Science Foundation funding. Competency frameworks are increasingly used across many sectors to identify the suite of skills, knowledge, and capabilities necessary to be successful in a particular area of work. Given dramatic changes to the ISL workplace in the last two years, there is an even stronger potential for the Framework, particularly if newly developed supports can link the Framework to the current, emerging, and continuing needs of the workforce.
Guided by a systematic process for designing training and instructional materials, this project will first capture changes in the ways diverse informal STEM learning professionals describe, pursue, and achieve competencies to produce a revised Framework. Next, the project will collaboratively develop companion resources with diverse professionals through a series of participatory design workshops, using a sequential and iterative approach. The resources are expected to include indicators of professional competencies, self-assessments, training tools, and other types of resources that have the potential to significantly advance the professional learning (as undertaken by individuals and institutions) and the professional development capacity (as provided by institutions, associations, and other organizations) of the informal STEM learning field. Next, the project will share final products–including a refreshed website that hosts the updated Framework and newly-developed suite of tools–with professional association and network partners who can disseminate directly to the institutions and professionals who are developing and practicing these competencies. The project will gather evidence from a small number of early adopters, providing data on specific use-case scenarios. Finally, the project will document the potential impact of the Framework on the field by measuring how the Framework is perceived by informal STEM learning professionals as usable, useful, and beginning to be “in-use." Over time—and with increased use—the Framework and its companion resources hold the promise of contributing to the opening of the field to professionals with identities currently underrepresented through more transparent expectation and clearer growth pathways.
Engineering is arguably one of the most critical skills in any society, from building bridges and homes, to designing cell phones and life-saving medical devices. Yet many Americans do not consider engineering to be essential or relevant to their everyday lives, and may even question its positive impact on society. While there have been gains in the number of women and underrepresented minorities in STEM professions over the past few decades, their numbers in the field remain disproportionately low. The Built World integrated multimedia and research project therefore aims to expand access to engineering content through the lens of “inclusive engineering,” which highlights how problem-solvers of all ages, genders, backgrounds, and perspectives approach and overcome challenges to innovate. The project applies this concept through the creation of Built World, a three-hour documentary series for broadcast on PBS stations nationwide, and a complementary interactive escape game streamed live on Twitch, where individuals of all ages and backgrounds can play and solve engineering challenges together. There is a need for effective remote and virtual interaction to support informal STEM learning, and live streaming game platforms present a promising approach to filling this need. Built World is poised to advance the field through: (1) content - creating high-quality inclusive engineering content across multiple platforms to reach a wide audience (Built World documentary, digital reporting and short form videos, community outreach campaign); (2) applied research - designing and studying how live-streaming, collaborative platforms can serve as safe and inclusive spaces for engineering learning; and (3) best practices - exploring how audiences engage with inclusive engineering on different platforms—a traditional documentary format (Built World) versus an interactive, collaborative space (Twitch game)—and identifying what learning outcomes might be expected on each.
A three-phase research design aims to understand what motivates users to engage with STEM content on Twitch; how to define and measure learning outcomes associated with the platform; and how to mitigate the risk of toxic environments in online communities by fostering safe spaces for a diversity of gamers. Phase 1 informs the initial design of the Twitch game and audience interaction strategies and seeks to answer: What is the best way to measure informal learning on Twitch? What is the best way to design a Twitch channel to create an inclusive space while optimizing learner engagement? Phase 2 is the core focus of the research and uses a semi-experimental design to answer questions such as: Is there evidence of learning on Twitch, and what type of learning is happening? What is the digital culture that emerges? Phase 3 assesses the pairing of the documentary series with the Twitch game to maximize informal STEM learning and is guided by questions such as: How does inclusive engineering content presented on two platforms (Twitch game and Built World series) mediate learning outcomes? How does inclusive engineering content presented on two platforms shape learners’ experiences of inclusivity and belonging? Knowledge generated through the Built World project will offer tools and best practices to other STEM media producers so that they may also leverage live streaming platforms for learning.
Mathematizing, Visualizing, and Power (MVP): Appalachian Youth Becoming Data Artists for Community Learning is a three-year Advancing Informal STEM Learning, Innovations and Development, project that focuses on community-centered data exploration catalyzed by youth. The project develops statistical artistry among young people in East Tennessee Appalachian communities and enables these youth to share their data visualizations with their communities to foster collective reflection and understanding. The creative work generated by the MVP project will be compelling in two ways, both as statistical art and as powerful statements giving voice to the experience of communities. Critical aspects of the MVP model include (1) youth learning sessions that position youth as owners of data and producers of knowledge and (2) Community Learning Events that support community learning as youth learning occurs. The MVP project has a primary focus on broadening the STEM participation of underrepresented communities of Appalachia. The project’s mission is to increase the learning and life outcomes of young people and communities of Appalachia by creating a meaningful foundation of data science and collective data exploration. The University of Tennessee partners with Pellissippi State Community College, Drexel University, and the Boys & Girls Club of the Tennessee Valley to bring together a convergent team of community members, practitioners, and professionals, with the expertise to carry out the project. The project will impact approximately 120 youth and 3800 of their East Tennessee community members. The research generated will inform how to engage community members in learning about community issues through the exploration of datasets relevant to participants.
The field of STEM education is in urgent need of knowledge about effective models to inspire community-based data exploration with young people as leaders in these efforts. The MVP project includes engaging youth with meaningful problems, building a discourse community with possibilities for action, re-positioning youth as knowledge producers within their own communities, leveraging linguistic and cultural resources of the youth participants and their communities, and implementing critical events that support substantial interaction between youth, community members, and the data visualizations. MVP builds on the idea that the design of data visualizations requires an understanding of both data science and artistic design. Research will inform the model of community engagement, examine data artists’ identities, and document community learning. The MVP model will be designed, developed, tested, and refined through three cycles of design-based research. The overarching research question guiding these cycles is: What affordances (and delimitations) related to identity and learning does the model provide for MVP Youth and community members? Data sources for the project include: fieldnotes, portfolios created by MVP Youth, youth pre/post interviews, observations of the learning sessions, a project documentary, surveys for youth and community members, interviews with community members, and audience feedback. The National Institute for STEM Evaluation and Research (NISER) will provide formative and summative evaluation about project activities. Formative feedback will be integrated into the ongoing research cycles. The research conducted will inform (1) the community learning model; (2) the integrated pedagogy and curriculum of the MVP Youth learning sessions that emphasize data science through design arts; and, (3) research on community learning and youth identity. Findings will be shared through conferences, academic and practitioner-focused journals, a video documentary, a Summit on Engaging Youth and Communities in Data, and a project website.
DATE:
-
TEAM MEMBERS:
Lynn HodgeElizabeth DyerJoy BertlingCarlye Clark
This Innovations in Development project explores radical healing as an approach to create after-school STEM programming that welcomes, values and supports African American youth to form positive STEM identities. Radical healing is a strength-based, asset centered approach that incorporates culture, identity, civic action, and collective healing to build the capacity of young people to apply academic knowledge for the good of their communities. The project uses a newly developed graphic novel as a model of what it looks like to engage in the radical healing process and use STEM technology for social justice. This graphic novel, When Spiderwebs Unite, tells the true story of an African American community who used STEM technology to advocate for clean air and water for their community. Youth are supported to consider their own experiences and emotions in their sociopolitical contexts, realize they are not alone, and collaborate with their community members to take critical action towards social change through STEM. The STEM Club activities include mentoring by African American undergraduate students, story writing, conducting justice-oriented environmental sciences investigations, and applying the results of their investigations to propose and implement community action plans. These activities aim to build youth’s capacity to resist oppression and leverage the power of STEM technology for their benefit and that of their communities.
Clemson University, in partnership with the Urban League of the Upstate, engages 100 predominantly African American middle school students and 32 African American undergraduate students in healing justice work, across two youth-serving, community-based organizations at three sites. These young people assume a leadership role in developing this project’s graphic novel and curriculum for a yearlong, after-school STEM Club, both constructed upon the essential components of radical healing. This project uses a qual→quant parallel research design to investigate how the development and use of a graphic novel could be used as a healing justice tool, and how various components of radical healing (critical consciousness, cultural authenticity, self knowledge, radical hope, emotional and social support, and strength and resilience) affect African American youths’ STEM identity development. Researchers scrutinize interviews, field observations, and project documents to address their investigation and utilize statistical analyses of survey data to inform and triangulate the qualitative data findings. Thus, qualitative and quantitative data are used to challenge dominant narratives regarding African American youth’s STEM achievements and trajectories. The project advances discovery and understanding of radical healing as an approach to explicitly value African Americans’ cultures, identities, histories, and voices within informal STEM programming.
DATE:
-
TEAM MEMBERS:
Renee LyonsRhondda ThomasCorliss Outley
Data is increasingly important in all aspects of people’s lives, from the day-to-day, to careers and to civic engagement. Preparing youth to use data to answer questions and solve problems empowers them to participate in society as informed citizens and opens doors to 21st century career opportunities. Ensuring equitable representation in data literacy and data science careers is critical. For many girls underrepresented in STEM, developing a "data science identity" requires personally meaningful experiences working with data. This project aims to promote middle school-aged girls’ interest and aspirations in data science through an identity-aligned, social game-based learning approach. The goals are to create a more diverse and inclusive generation of data scientists who see data as a resource and who are equipped with the skills and dispositions necessary to work with data in order to solve practical problems. The research team will run 10 social clubs and 10 data science clubs mentored by women in data science recruited through the University of Miami’s Institute for Data Science and Computing. Participants will be 250 middle school-aged girls recruited in Miami, FL, and Yolo County, CA, through local and national girls’ organizations. Youth will participate in a data science club and will learn key data science concepts and skills, including data structures, storage, exploration, analysis, and visualization. These concepts will be learned from working with their own data collected in personally meaningful ways in addition to working with data collected by others in the same social game eco-system. The project will also develop facilitator materials to allow adult volunteers to create game-based informal data science learning experiences for youth in their areas. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments and is co-funded by the Innovative Technology Experiences for Students and Teachers (ITEST), which seeks to engage underrepresented students in technology-rich learning environments, including skills in data literacy, and increase students’ knowledge and interest in information and communication technology (ICT) careers.
Researchers will focus on two primary research questions: 1) Across gameplay and club experiences, in what ways do participants engage with data to pursue personal or social goals? 2) How do gameplay and club experiences shape girls’ perceptions of data, data science, and their fit with data and data science? The project will use design-based research methods to iteratively design the game and social club experiences. To ensure that uses of data feel personally and socially meaningful to young girls, the virtual world’s goals, narratives, and activities will be co-designed with girls from groups underrepresented in data science. The project will research engagement with game data in two informal, game-based learning scenarios: organic, self-directed, social play club, and structured, adult-facilitated data science clubs. The research will use a combination of quantitative and qualitative methods including surveys, focus groups, interviews, and gameplay and club observations. Project evaluation will determine how gameplay and club experiences impact participants' attitudes toward and interest in data-rich futures. The project holds the potential for broadening participation and promoting interest in data science by blending game-based learning with the rich social and adult mentoring through club participation. The results will be disseminated through conference presentations, scholarly publications, and social media. The game and facilitator materials will be designed for dissemination and made freely available to the public.
DATE:
-
TEAM MEMBERS:
Lisa HardyGary GoldbergerJennifer Kahn
Artificial intelligence (AI) is in many of our everyday activities—from unlocking phones to running Internet searches to parking cars. Yet, most instruction on how AI works is only in computer science courses. The unique role that AI plays in making decisions that affect human lives heightens the need for education approaches that promote public AI literacy. Little research has been done to understand how we can best teach AI in informal learning spaces. This project will engage middle school age youth in learning abouts AI through interaction with museum exhibits in science and technology centers. The exhibits employ embodied interactions and creative making activities that involve textiles, music making, and interactive media. The research will build on three exhibit prototypes that teach about concepts including bias in data in machine learning, AI decision-making processes, and how AI represents knowledge. Female-identifying and Title 1 youth will be recruited as participants during the exhibit design iterations and testing. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments
Researchers will explore two key research questions: 1) How can the design of interactive museum exhibits encourage interest development in and learning about AI among learners without a Computer Science background by using embodiment and creative making? and 2) How do embodied interaction and creative making mediate learning about AI in informal learning environments? The project will take a design-based research approach, iteratively building on existing exhibit prototypes and testing them in-situ with learners. Data sources and modes of analysis will include retrospective surveys to assess interest, content knowledge gain, creativity, learning talk analysis of audio recordings, and coding of embodied movements in video recordings. Learning talk analysis will identify instances of joint sensemaking during naturalistic interactions with our exhibit to reveal connections between sensemaking talk; learners' behaviors and embodied actions during real-time collaborative knowledge building; and outcomes in knowledge, interest, and creativity measures as elicited in retrospective surveys. The final set of exhibits will be rigorously evaluated with over 500 museum visitors. The key contributions of this work will include a set of rigorously tested exhibits, publicly available exhibit designs, a set of design guidelines for developing AI literacy museum exhibits, and an improved understanding of the relationship between AI-related learning and interest development, embodiment, and creativity.
DATE:
-
TEAM MEMBERS:
Brian MagerkoDuri LongJessica Roberts
resourceprojectProfessional Development, Conferences, and Networks
Centering Native Traditional Knowledge within informal STEM education programs is critical for learning for Native youth. In co-created, place-based learning experiences for Native youth, interweaving cultural traditions, arts, language, and community partnerships is vital for authentic, meaningful learning. Standardized STEM curricula and Western-based pedagogies within the mainstream and formal education systems do not reflect the nature of Native STEM knowledge, nor do they make deep connections to it. The absence of this knowledge base can reinforce a deficit-based STEM identity, which can directly impact Native youths’ participation and engagement in STEM. Reframing STEM education for Native youth to prioritize the vitality of community and sustainability requires active consideration of what counts as science learning and who serves as holders and conduits of STEM knowledge. As highly regarded holders of traditional and western STEM knowledge, Native educators and cultural practitioners are critical for facilitating Native youths’ curiosity and engagement with STEM. This Innovations in Development project is Native-led and centers Native knowledge, voice, and contributions in STEM through a culturally based, dual-learning approach that emphasizes traditional and western STEM knowledge. Through this lens, a network of over a dozen tribal nations across 20 U.S. states will be established to support and facilitate the learning of Traditional and Western STEM knowledge in a culturally sustaining manner. The network will build on existing programs and develop a set of unique, interconnected, and synchronized placed-based informal STEM programs for Native youth reflecting the distinctive cultural aspects of Native American and Alaska Native Tribes. The network will also involve a Natives-In-STEM Role Models innovation, in which Native STEM professionals will provide inspiration to Native youth through conversations about their journeys in STEM within cultural contexts. In addition, the network will cultivate a professional network of STEM educators, practitioners, and tribal leaders. Network efforts and the formative evaluation will culminate in the development and dissemination of a community-based, co-created Framework for Informal STEM Education with Native Communities.
Together with Elders and other contributors of each community, local leads within the STEM for Youth in Native Communities (SYNC) Network team will identify and guide the STEM content topics, as well as co-create and implement the program within their sovereign lands with their youth. The content, practitioners, and programming in each community will be distinct, but the community-based, dual learning contextual framework will be consistent. Each community includes several partner organizations poised to contribute to the programming efforts, including tribal government departments, tribal and public K-12 schools, tribal colleges, museums and cultural centers, non-profits, local non-tribal government support agencies, colleges and universities, and various grassroots organizations. Programmatic designs will vary and may include field excursions, summer and after school STEM experiences, and workshops. In addition, the Natives-In-STEM innovation will be implemented across the programs, providing youth with access to Native STEM professionals and career pathways across the country. To understand the impacts of SYNC’s efforts, an external evaluator will explore a broad range of questions through formative and summative evaluations. The evaluation questions seek to explore: (a) the extent to which the culturally based, dual learning methods implemented in SYNC informal STEM programs affect Native youths’ self-efficacy in STEM and (b) how the components of SYNC’s overall theoretical context and network (e.g., partnerships, community contributors such as Elders, STEM practitioners and professionals) impact community attitudes and behaviors regarding youth STEM learning. Data and knowledge gained from these programs will inform the primary deliverable, a Framework for Native Informal STEM Education, which aims to support the informal STEM education community as it expands and deepens its service to Native youth and communities. Future enhanced professional development opportunities for teachers and educators to learn more about the findings and practices highlighted in the Framework are envisioned to maximize its strategic impact.
DATE:
-
TEAM MEMBERS:
Juan ChavezDaniella ScaliceWendy Todd
resourceprojectProfessional Development, Conferences, and Networks
Diversity, equity, access, inclusion, and belonging-related change is often difficult to achieve in organizations. In the context of Informal STEM Learning (ISL), this results in inequitable opportunities for both ISL professionals and learners to engage in STEM environments and experiences. For people to thrive in these settings, creative and innovative approaches that address historical and current realities of intersectional marginalization and inequitable norms within informal STEM institutions are necessary to disrupt conventions, institutional barriers, and patterns of inequities. TERC and the Detroit Zoological Society will develop and implement an ISL Equity Resource Center (the Center). The Center will advance equity within the ISL field by cultivating a multi-sector, diverse learning community that designs and conducts evidence-based research and practice, including but not limited to equity-focused leadership, decision-making, theory, methods, project topic selection and design, and budget management.
The Center will cultivate lasting change in the ISL and broader STEM learning ecosystem via (a) sharing more inclusive, culturally relevant, and responsive ISE research and practice; (b) identifying scalable, equity-focused research findings useful in ISL programming; and (c) promoting greater public awareness of the importance of broadening participation in STEM. The Center's primary stakeholders are ISL professionals, including researchers, practitioners, and evaluators. The Center will maintain and expand a digital infrastructure to support innovation and sharing across the ISL field. Through its combined efforts, the Center will raise the visibility and impact of ISL equity-focused research and practice and its contributions to the overall STEM endeavor. The Center will also organize and host the biennial AISL Awardee Meeting. The Center is funded by the Advancing Informal STEM Learning program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Stephen AlkinsDiane MillerLisette Torres-GeraldPati Ruiz
In both the STEM media and entertainment sectors women are significantly unrepresented. Women account for only 21% of the upper-level positions in film (directors, writers, executive producers, cinematographers, etc.) according to a recent study. This small conference directly addresses how to expand the volume of STEM focused media and entertainment content centered on women and girls. The Creative Workforce Summit: Women Storytellers Explore STEM will be held in New York City and online (hybrid) in September 2022. The goal of the conference is to 1) encourage an infrastructure of support for the creation and distribution of informal STEM educational film, digital, and television content that is centered on women and girls and 2) to strengthen ties between women in media, entertainment, and women in STEM fields. The agenda includes keynote addresses by thought leaders in STEM disciplines and media, panels of industry leaders, a youth journalist interviews, and film screenings with filmmaker and scientist Q&As. The conference will be a hybrid event to allow for the greatest access to a broader audience. The projected 300 in-person and 1000+ virtual attendees will be drawn from New York Women in Film and Television’s extensive membership and 100+ partner organizations in entertainment and media, including Black Public Media, Brown Girls Doc Mafia, Firelight Media, ReelAbilities, and the National Association of Latino Independent Producers. The conference will be followed by a publication based on the convening featuring the keynotes, abridged panel discussions, additional interviews, and industry representation data analysis. In addition, a curriculum guide for high schools and colleges focused on STEM and film collaborations will be developed and distributed.
A post conference quantitative survey will be conducted with conference participants to gather data on the impacts of the conference. Questions to be asked include: What new professional connections were made by women attending the conference? What was learned related to the craft of STEM related media production and distribution? Were new and meaningful connections made with participants outside the participant’s current field/networks? Additional analysis will be done by the organizers of the conference in planning post-conference strategies for supporting and building the women in STEM infrastructure.
DATE:
-
TEAM MEMBERS:
Cynthia Lopez
resourceprojectProfessional Development, Conferences, and Networks
The New York Hall of Science (NYSCI) will convene a two-day participatory design conference of to identify research and education opportunities in informal settings for supporting literacy concerning Artificial Intelligence (AI), especially for diverse and underserved youth whose communities are impacted by the bias in some AI processes. AI uses computer systems that simulate human intelligence. AI systems impact nearly every aspect of daily living, performing tasks underlying navigation apps, facial recognition, e-payments, and social media. AI can perpetuate inequities and biased outcomes in the culture at large. The conference will explore how to promote engagement and conceptual learning among youth about how AI works and what skills are needed to critically use and apply AI. The conference will also explore ways to support the interests of diverse and underserved children and youth in shaping AI and joining the growing STEM workforce that will use AI in their professions.
The conference will identify key features and needs with respect to AI literacy and explore the specific roles that informal learning can play in advancing AI literacy for youth in diverse and underserved communities. Participants in the conference will include designers, learning scientists, researchers, informal and formal educators, and science center professionals. Attendees will work in separate teams and as a group to explore and critique existing AI tools and learning frameworks, discuss lessons learned from promising AI literacy programs, and identify design principles and future directions for research. Specific attention will be paid to informal mechanisms of engagement, promising networks, and research-practice partnerships that take advantage of the unique affordances of informal learning and community services to accelerate AI literacy for historically excluded youth. The insights gained from this work will result in a set of research and programmatic priorities for informal institutions to promote AI literacy in culturally responsive ways. The resulting published guide and community events will broadly disseminate priorities and design principles generated by this convening to help informal learning institutions and community learning organizations identify both assets and priorities for addressing diversity, equity, access, and inclusion issues related to AI literacy.