The purpose of this paper is to explore results from a qualitative study of how high school aged BLV youth used spatial language during a virtual engineering experience administered by the National Federation of the Blind (NFB). Findings from this study can provide recommendations to enhance language in curricula that better reflects BLV students' content and may ultimately encourage more BLV students to pursue careers in STEM fields.
DATE:
TEAM MEMBERS:
Gary TimkoNatalie ShaheenWade GoodridgeTheresa GreenDaniel Kane
This paper describes the development and preliminary validation of a new spatial ability instrument that is designed to be accessible non-visually. Although additional work is needed to finalize the test, preliminary analysis indicates that the test has high reliability and validity.
DATE:
TEAM MEMBERS:
Sarah LopezWade GoodridgeIsaac GouglerDaniel KaneNatalie Shaheen
This paper seeks to illustrate the first steps in a process of adapting an existing, valid, and reliable spatial ability instrument – the Mental Cutting Test (MCT) – to assess spatial ability among blind and low vision (BLV) populations. To adapt the instrument, the team is developing three-dimensional (3-D) models of existing MCT questions such that a BLV population may perceive the test tactilely with their hands.
DATE:
TEAM MEMBERS:
Tyler AshbyWade GoodridgeBJ CallSarah LopezNatalie Shaheen
This paper discusses the development of the Tactile Mental Cutting Test (TMCT), a non-visually accessible spatial ability instrument, developed and used with a blind and low vision (BLV) population. Data was acquired from individuals participating in National Federation of the Blind (NFB) Conventions across the United States as well as NFB sponsored summer engineering programs. The paper reports on a National Science Foundation funded effort to garner initial research findings on the application of the TMCT. It reports on initial findings of the instrument’s validity and reliability, as well
DATE:
TEAM MEMBERS:
Natalie ShaheenAnn HuntDaniel KaneWade Goodridge
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
This Innovations in Development project aims to foster the development of STEM identity among a diverse group of middle school students and, in turn, motivate them to pursue in STEM interests and careers. Vegas STEM Lab, led by a team of investigators from the University of Nevada, Las Vegas, will employ a mix of online and on-site activities to introduce students to engineering methods in the context of the entertainment and hospitality (E&H) industry that is the lifeblood of Las Vegas. Investigators will collaborate with local resorts, multimedia designers, and arts institutions to offer field experiences for students to interview, interact with, and learn from local experts. The Lab will help youth overcome prevailing beliefs of STEM as boring and difficult, boost their confidence as STEM-capable individuals, and expose them to the exciting STEM careers available in their hometown. UNLV engineering undergrads will serve as near-peer mentors to the middle school students, guiding them through Lab activities and acting as role models. Investigators will measure student learning and engagement over the course of the Vegas STEM Lab experience with the aim of understanding how the Lab model—with its rich set of activities and interpersonal interactions set in the local E&H industry—can cultivate STEM identity development and encourage students to pursue STEM pathways. Despite the project’s hyperlocal focus on the Las Vegas community, if successful, other cities and towns may learn from and adapt the Lab model for use in their youth development programs.
Vegas STEM Lab will provide online materials for students’ STEM learning during the academic year followed by on-site visits and hands-on project development during a three-week summer experience. The Lab will run for three years with cohorts of 40 students each (N=120) with the aim of iteratively improving its activities and outcomes from year to year. The local school district will help recruit middle school students who have demonstrated low interest in STEM to participate in the Lab, ensuring that participants reflect the demographic makeup of the Las Vegas community in terms of race and ethnicity, socio-economic status, and gender. Summer activities will take students behind the scenes of the city’s major E&H venues; investigate the workings of large-scale displays, light shows, and “smart hospitality” systems; and then build their own smaller scale engineering projects. Investigators will employ the Dynamic Systems Model of Role Identity (DSMRI) framework to study how intentionally designed Lab experiences shape students’ understanding of themselves, their future aspirations, and their grasp of the scientific enterprise. Summer activities will be integrated into the online learning platform at the end of each year of Vegas STEM Lab, and in the final year of the project, workshops will train local educators to use the platform in either formal or informal learning settings. Materials and research findings produced through this work will be disseminated to middle school teachers and afterschool care providers, and shared with researchers through academic publications and conferences.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Emma RegentovaVenkatesan MuthukumarJonathan HilpertSi Jung Kim
resourceprojectProfessional Development, Conferences, and Networks
Millions of Latinx youth, aged 14 to 18, work formal or informal jobs to provide income for themselves or their families. In the context of these workplaces, Latinx youth demonstrate numerous skills that are essential to industrial engineering, such as minimizing workplace injuries or optimizing processes to maximize efficiency. However, their workplace ingenuity and skills are often underrecognized by educational systems. To counter this lack of recognition, the purpose of this project is to iteratively develop and research an out-of-school engineering program for working Latinx youth. This program is designed to recognize and build from youths’ workplace experiences by connecting them with industrial engineering concepts and practices, such as those used to promote worker safety. This program is also designed for youth to articulate transformational visions of industrial engineering, which expand current goals, values, and methods commonly embraced within this discipline. This year-long program will be facilitated by educators of existing out-of-school programs (e.g., Mathematics, Engineering, and Science Achievement), in partnership with undergraduate mentors from the Society for Professional Hispanic Engineers and other local organizations that serve Latinx youth (e.g., Latinos in Action). Approximately 220 youth are expected to participate in the programming. Researchers will explore whether and how youth participants develop identities in engineering, as well as how the educators and mentors understand and enact assets-based, out-of-school engineering education grounded in youths’ experiences. Researchers will also identify the individual, institutional, and systemic factors that support or inhibit sustained implementation of the program over time in different sites and contexts. This project will result in a set of empirically tested, bilingual program materials that will be disseminated widely to professional organizations dedicated to out-of-school programming and to serving Latinx youth.
This project will result in a localizable, transferable, and sustainable model for an out-of-school time program that recognizes and amplifies Latinx youths’ workplace funds of knowledge and leverages them toward youth-driven visions and applications of engineering. This program, which will connect with other people and sites in youths’ learning ecosystems, is grounded in principles of translanguaging, transformational mentorship, and educational dignity and recognition. In partnership with youth participants, researchers will use a social design experiment to explore the following research questions: What are the engineering identity trajectories of working high school youth, and how do specific moments of identity negotiation and recognition relate to broader patterns across program sessions and identity trajectories for individual participants over time? To answer these questions, a pre-, mid- and post-program Engineering Identity Scale; recordings of program implementations; interviews; and youth artifacts will be analyzed using various methods such as critical multimodal discourse analysis. After implementations of the program across multiple sites, researchers will use design-based implementation research to answer the following questions: How do educators and mentors understand and enact assets-based pedagogies designed to foster recognition across sites? What institutional and systemic features (designed or naturalistic) support or inhibit productive adaptations and implementations of the program? These questions will be answered using constant comparative analyses of data sources such as interviews with the program educators and mentors, observations of program implementations, observations of professional development sessions, and public documents. Culturally responsive, educative evaluation will be used to iteratively improve the program. The resulting research and program materials will be disseminated widely through professional organizations dedicated to Latinx youth, engineering education, and out-of-school learning.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Amy Wilson-LopezAlfonso Torres-RuaMarisela Martinez-ColaColby Tofel-GrehlAlfonso Torres-Rua
Informal STEM education spaces like museums can intentionally serve surrounding communities and support sustainable and accessible engagement. Building from this base, the project takes a stance that the intersection of the museum, home/family life and the youth’s internal practices and disciplinary sense of self are rooted in history and culture. Thus, this CAREER work builds on the following principles: Black families and youth have rightful presence in STEM and in STEM learning environments; Black families are valuable learning partners; and Black youths need counterspaces to explore STEM as one mechanism for creating future disciplinary agency. In partnership with the Henry Ford Museum and the Detroit-Area Pre-College Engineering Program, the project seeks to (a) expand the field's understanding of how Black youth engineer and innovate; (b) investigate the influence of a culturally relevant curriculum on their engineering practices and identity, knowledge, and confidence; and (c) describe the ways Black families and museums support youth in engineering learning experiences. The work will center on the 20-hour “Innovate” curriculum which was designed by the museum to bridge design, innovation, and creation practices with the artifacts of innovators throughout time. The project comprises six weekend “Innovate” sessions and an at-home innovation experience plus participation in an annual Invention Convention. By focusing on these aims, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
The main research questions of this multiphase CAREER award are: (1) What practices do Black youths and families engage in as they address engineering, design, and innovation challenges? (2) In what ways does a culturally relevant museum-based innovation program influence the design and innovation practices and assessment performance of Black youths and families as they engage in engineering, design, and innovation across learning settings? (3) How does teaching innovation, design, and engineering through historical re-telling and reconstruction influence a youth’s perception of their own identities, abilities, and practices? and (4) How do Black families engage with informal STEM learning settings and what resources best support their engineering, design, and innovation exploration? Youth in sixth grade are the focus of the research. The work is guided by ecological systems, sociocultural learning, culturally relevant pedagogy, and community cultural wealth theories. During phase one, the focus will be to refine the curriculum and logistics of the study implementation. The investigator will enhance the curriculum to include narratives of Black innovators and engineers. Fifteen families will be recruited to participate in the program enhancement pilot and initial research cycle for phase two. In phase three another cohort of families will be recruited to participate. Survey research, narrative inquiry and digital ethnography will comprise the approaches to explore the research questions. The evaluation has a two-pronged focus: to assess (1) how well the enhanced Innovate curriculum and museum/home learning experience supports Black families’ participation and (2) how well the separate phases of the study connect and operate together to meet the research aims. The study’s findings can help families and informal practitioners leverage evidence-based approaches to support Black youth in making connections between history and out-of-school contexts to model and develop their innovative engineering practices. Additionally, this work has implications for Black undergraduate students who will develop skills through their mentorship and researcher roles, studying cultural practices and learning experiences. The research study and findings can inform the design of future museum/home learning programs and research opportunities for Black learners in informal learning spaces.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
One way to motivate young people from diverse backgrounds to pursue engineering careers is to enlist them as educators who can help the general public understand how engineers help respond to the challenges of everyday life. The New York Hall of Science, which serves a large and diverse audience, is an ideal setting for testing the promise of this strategy. Youth educators and curators of public programs at the Hall of Science will mentor two groups of high school- and early college-aged youth, who will contribute to the design and facilitation of engineering-focused events and activities for museum visitors. They will work together to develop engineering programming for the public that emphasizes the cultural and interpersonal dimensions of engineering practices. This group of young people will be recruited from the Hall of Science's more than 100 Explainers, a very diverse group of young people who work part-time at the Hall of Science and engage with visitors as they explore the museum. Researchers will track participants' experiences and document their impact on museum visitors' perceptions of engineering. The expectation is that creating and delivering these experiences for visitors will have a positive impact on the youth participants' understanding of the engineering disciplines, and on visitors' perceptions of engineering and its relationship to everyday life.
The project will use observations, interviews, journaling, and the Engineering Professional Skills Assessment to explore youth experience, and visitor exit surveys and interviews to probe visitor perceptions. Both the skills assessment and visitor surveys are NSF-funded instruments. Data coding will be grounded in the engineering habits of mind defined by the National Research Council's Committee on Understanding and Improving K-12 Engineering Education in the United States (2009). The project will capture evidence regarding which habits of mind the Fellows are most frequently engaged with. The effort will also explore how interactions with peers (as colleagues), with experts (as learners, such as with Designers in Residence) and with visitors (as teachers and leaders) may be associated with different combinations of the habits of mind over the course of the project. Visitor data and assessment data will allow the project to begin to make analytic connections between participating young people's increased understanding of culturally-situated engineering challenges, and their impact on the experiences of museum visitors who engage with engineering programming at the Hall of Science.
The Math, Engineering, Science Achievement (MESA) outreach programs are partnerships between K-12 schools and higher education in eight states that for over forty years introduce science, mathematics and engineering to K-12 students traditionally underrepresented in the discipline. This exploratory study examines the influences that those MESA activities have on students' perception of engineering and their self-efficacy and interest in engineering and their subsequent decisions to pursue careers in engineering. The MESA activities to be studied include field trips, guest lecturers, design competitions, hands-on activities and student career and academic advisement.
About 1200 students selected from 40 MESA sites in California, Maryland and Utah are surveyed with instruments that build on those used in prior studies. Focus groups with a randomly selected subset of the students provide follow-up and probe the influence of the most promising activities. In the first year of the project the instruments, based on existing instruments, are developed and piloted. Data are taken in the second year and analyzed in the third year. A separate evaluation determines that the protocols are reasonable and are being followed.
The results are applicable to a number of organizations with similar aims and provide information for increasing the number of engineers from underrepresented populations. The project also investigates the correlation between student engagement in MESA and academic performance. This project provides insights on activities used in informal settings that can be employed in the classroom practice and instructional materials to further engage students, especially student from underrepresented groups, in the study of STEM.
DATE:
-
TEAM MEMBERS:
Christine HaileyCameron DensonChandra Austin