This is a compilation of front-end, formative, and a partial summative evaluations, and an exploratory study using the xMacroscope, a data visualization technology developed for generating data from an exhibit using data captured from visitor actions.
The "Exhibit appraisal and diverse populations: Pilot research about intersectional and science identities in science exhibits" (APPRAISE) project team worked extensively with minoritized youth between the ages of 9 and 17, including youth of color, girls and non-binary youth, and youth with disabilities, to create a research protocol
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
The Northwest Passage Project explored the changing Arctic through an innovative expedition aboard the Swedish Icebreaker Oden to conduct groundbreaking ocean science research, while it actively engaged 22 undergraduate and graduate students from the project’s five Minority Serving Institution (MSI) partners and 2 early career Inuit researchers in the research at sea. Over 35 hours of training in Arctic research techniques, polar science, and science communication was provided to these participants, who were engaged in the Northwest Passage expedition and worked with the onboard science team
Artificial intelligence (AI) is in many of our everyday activities—from unlocking phones to running Internet searches to parking cars. Yet, most instruction on how AI works is only in computer science courses. The unique role that AI plays in making decisions that affect human lives heightens the need for education approaches that promote public AI literacy. Little research has been done to understand how we can best teach AI in informal learning spaces. This project will engage middle school age youth in learning abouts AI through interaction with museum exhibits in science and technology centers. The exhibits employ embodied interactions and creative making activities that involve textiles, music making, and interactive media. The research will build on three exhibit prototypes that teach about concepts including bias in data in machine learning, AI decision-making processes, and how AI represents knowledge. Female-identifying and Title 1 youth will be recruited as participants during the exhibit design iterations and testing. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments
Researchers will explore two key research questions: 1) How can the design of interactive museum exhibits encourage interest development in and learning about AI among learners without a Computer Science background by using embodiment and creative making? and 2) How do embodied interaction and creative making mediate learning about AI in informal learning environments? The project will take a design-based research approach, iteratively building on existing exhibit prototypes and testing them in-situ with learners. Data sources and modes of analysis will include retrospective surveys to assess interest, content knowledge gain, creativity, learning talk analysis of audio recordings, and coding of embodied movements in video recordings. Learning talk analysis will identify instances of joint sensemaking during naturalistic interactions with our exhibit to reveal connections between sensemaking talk; learners' behaviors and embodied actions during real-time collaborative knowledge building; and outcomes in knowledge, interest, and creativity measures as elicited in retrospective surveys. The final set of exhibits will be rigorously evaluated with over 500 museum visitors. The key contributions of this work will include a set of rigorously tested exhibits, publicly available exhibit designs, a set of design guidelines for developing AI literacy museum exhibits, and an improved understanding of the relationship between AI-related learning and interest development, embodiment, and creativity.
DATE:
-
TEAM MEMBERS:
Brian MagerkoDuri LongJessica Roberts
RK&A conducted prototype testing for the Game Changers exhibition with three audiences: adults, female youth 10-17 years old, and male youth 13-14 years old. The Game Changers exhibition is being developed by the Lemelson Center for the Study of Invention and Innovation at the National Museum of American History.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Programming includes
Neighborhood Walks led by teams of scientists/engineers and artists
Community Workshops, Local Artist Projects, and Youth Mentorship focused on neighborhood and citywide water issues
Intergenerational participation, from seniors and adult learners to young adults, teens, and middle schoolers
This poster was presented at the 2021 NSF AISL Awardee Meeting.
What do you think?
How do you connect with youth audiences?
What assumptions do you have about how identity relates to exhibit engagement?
How do factors that shape your identity impact your life? Has this shifted over time?
This poster was presented at the 2021 NSF AISL Awardee Meeting.
This project employs youth (ages 16-21) from frontline communities to work in paid positions as purveyors of climate science, develop communication and leadership skills, and engage in timely conversations with members of the public about climate change impacts in their own communities. The youth work in small groups to develop an educational tool based in personal narrative and current climate science as a way to raise public understanding and awareness about local climate impacts. They also act as advisors and colleagues in
This project engages families in engineering design challenges through a sustainability and biomimicry lens. Families advance their engineering proficiencies while learning from nature to create a livable future.
This poster was presented at the 2021 NSF AISL Awardee Meeting.