The National Building Museum (NBM) contracted RK&A, Inc. to conduct a summative evaluation of the Why Engineering? distance learning program. The goal of the evaluation was to assess program operations and explore the extent to which the program achieved its intended outcomes for students and teachers.
How did we approach this study?
RK&A used three methodologies for the study: online program observations; student assessments administered immediately after the program; and telephone interviews with teachers. Observations were primarily used to gain a holistic understanding of how the
This poster shows an overview of the The Designing Our Tomorrow (DOT) project. The project aims to develop a framework for creating exhibit-based engineering design challenges and expand an existing model of facilitation for use in engineering exhibits. DOT seeks to broaden participation in engineering and build capacity within the informal science education (ISE) field while raising public awareness of the importance of sustainable engineering design practices.
This poster was presented at the 2019 AISL PI Meeting, and describes the the ongoing research questions and goals of the Ute STEM Project, which explores the integration of the traditional ecological knowledge (TEK) of the Ute Indians of Colorado and Utah and Western science, technology, engineering and math (STEM).
This poster was presented as part of the 2019 AISL PI Meeting. In this project, the New York Hall of Science, in collaboration with the Amazeum (Bentonville, AR), the Tech (San Jose, CA), and the Creativity Labs (Indiana University), is conducting a design-based research study to develop evidence-based guidance about how museums can use narratives to create more equitable and effective engineering experiences for girls. Through iterative activity development, the project team is exploring ways of using narrative elements (such as characters, settings, and problem frames) to communicate a story
The National Federation of the Blind (NFB), in partnership with scholars from Utah State University and educators from the Science Museum of Minnesota (SMM), has developed the Spatial Ability and Blind Engineering Research (SABER) project to assess and improve the spatial ability of blind teens in order to broaden the participation of blind students in STEM fields.
Activities began this summer (2018) with a week-long, residential engineering design program for thirty blind high school students at NFB headquarters in Baltimore. The evaluation focused on perceptions of process and measures of
This poster was presented at the 2019 AISL PI Meeting in Washington, DC. It provides an overview of a project designed to broaden participation of blind students in engineering fields through the development of spatial ability skills and the showcasing of nonvisually accessible teaching methods and techniques.
Casual games are everywhere. People play them throughout life to pass the time, to engage in social interactions, and to learn. However, their simplicity and use in distraction-heavy environments can attenuate their potential for learning. This experimental study explored the effects playing an online, casual game has on awareness of human biological systems. Two hundred and forty-two children were given pretests at a Museum and posttests at home after playing either a treatment or control game. Also, 41 children were interviewed to explore deeper meanings behind the test results. Results show
The maker movement has evoked interest for its role in breaking down barriers to STEM learning. However, few empirical studies document how youth are supported over time, in STEM-rich making projects or their outcomes. This longitudinal critical ethnographic study traces the development of 41 youth maker projects in two community-centered making programs. Building a conceptual argument for an equity-oriented culture of making, the authors discuss the ways in which making with and in community opened opportunities for youth to project their communities’ rich culture knowledge and wisdom onto
This poster was created for the Advancing Informal STEM Learning (AISL) program Primary Investigator (PI) meeting. The research presented here is a summary of the various informal STEM learning opportunities offered as part of the collaboration between university researchers and museum practionners. We were interested in how museums can advance parent-child engagment in STEM-rich tinkering and reflection. The participants were able to take part of a few different activities that allowed for informal reflection and tinkering at the Tinkering Lab, a musuem exhibit that invites families to take
This poster, which was presented in Alexandria, VA at the CAISE AISL PI meeting in February 2019, summarizes the All Together Now project and research goals.
DATE:
TEAM MEMBERS:
Mizuko ItoTiera TanksleyOshin KhachikianAmanda Wortman
This exploratory learning research and design project will study how to use emerging technologies to help document practices in maker-based learning experiences. Despite its established potential for consolidating learning and sense-making, project documentation is often overlooked, not prioritized or seen as burdensome and therefore not integrated into the learning experiences. The project team seeks to understand and address with practice partners the barriers to documentation by systematically exploring how to physically embed and incorporate smart tools and documentation practices into learning environments, specifically creative hands-on learning spaces, like makerspaces. The goal is to understand how to scaffold learners to become more aware, reflective and attentive to their progress towards learning outcomes by embedding supportive tools physically in space as the actions unfold. Making and maker-based learning experiences offer tremendous opportunities to more fully engage diverse learners in STEM education and build a workforce prepared for innovation. Documentation of these learning experiences, both as an authentic practice that professionals engage in as well as an assessment practice for instruction, is often not supported. The project will create open source documentation for solutions and develop supporting case studies, web resources and guides to facilitate easy uptake and adoption of promising approaches.
This proposal will make significant research contributions in three ways: (1) develop and iteratively test a suite of embedded "smart" tools designed to scaffold, manage and trace process documentation practices; (2) study the integration of these tools in formal and informal activities and programs settings and characterize their influence on instruction and the assessment of learning outcomes; (3) establish a set of rubrics based on learner data streams to aid instruction and mark learner progress. Improving documentation practices and the assessment of learning outcomes will advance making as a core STEM educational activity. Through a better understanding of why and how to place networked documentation tools sensitive to space, time and context cues, the threshold for enactment and scaffolded usage can be lowered in a broader range of settings. Ultimately, this exploratory project will not only develop an integrated set of situated documentation tools, but also help us develop hypotheses for how documentation as a mediating process productively supports learning.
The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. The Multimedia Immersion (MI) project is will develop, pilot, and evaluate a nine-week STEM-rich multimedia production course for high school students. MI will make important contributions to the field through its efforts to design and evaluate the promises and challenges of a nine-week multimedia curriculum in multiple urban high schools. The MI course will engage teams of students to develop a personally and socially relevant storyline that guides their use of accessible audio and video technologies to create a five-minute animated video. To develop student STEM experience and provide technical support, the project will provide guidance and learning experiences in engineering (e.g., criteria, constraints, optimization, tradeoffs), science (e.g. sound, light, energy, mechanics) and multimedia technologies (e.g., computer based audio production, video editing and visualizations through animatics (i.e., shooting a succession of storyboards with a soundtrack). animatics).
Because the curriculum situates engineering and science learning in the context of multimedia production, there are natural synergies with several existing high school courses including engineering design, audio/video media production, and multimedia technology. Although these courses are typically electives in high school, developing a 5-minute animated short on a topic of interest may encourage girls and students from underrepresented groups to select this course over other electives. MI will impact 10 teachers and approximately 250 high school students per year. The project will result in the following resources: nine-week curricular unit (multimedia, science, engineering); assessments to monitor student learning of science, engineering and technology (design logs); and research on changes in student knowledge, interest, and a nine-week curricular unit (multimedia, science, engineering). Project resources will be disseminated to teachers, researchers, and curriculum and professional development providers via conference presentations, publications, and online webinars.
The MI project builds on student familiarity and interest in music, video and technology to promote an: (1) understanding of engineering design and physics and an (2) an appreciation of the fundamental role of STEM in popular culture. Project evaluation will be conducted using student surveys and an examination of work products in conjunction with implementation challenges and successes to generate evidence for the feasibility and utility of a high school multimedia course that explicitly addresses science and engineering learning. Project evaluation will use student design logs as a window into student design processes and conceptual understanding. Student design logs are an essential feature of MI curriculum design. With an appropriate structure, these design logs can inform teaching, afford an opportunity for students to reflect on their own work, and provide evidence of student thinking and learning for assessment purposes. Using student design logs as a window into students? design process and conceptual understanding is an important contribution to the engineering education community which has few options for measuring student knowledge in ways that are consistent with the hands-on, iterative nature of the design process.
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by bringing together youth (grades 2-5), their families, librarians, and professional engineers in an informal environment centered on engaging youth with age-appropriate, technology-rich STEM learning experiences fundamental to the engineering design process. The overarching aim is to better understand how youth's learning preferences or dispositions relate to their STEM learning experiences. It also seeks to build community members' capacity to inspire and educate youth about STEM careers. The project team includes the Space Science Institute's (SSI) National Center for Interactive Learning (NCIL), the University of Virginia (UVA) and the American Society of Civil Engineers (ASCE). This team builds on the scope and reach of a prior NSF-funded project called the STAR Library Education Network (STAR_Net). As an extension of this prior work, Project BUILD will collaborate with 6 public libraries (3 urban and 3 rural) and their local ASCE Branches. Two libraries have been selected to serve as pilots: High Plains Public Library in Colorado and the African-American Research Library and Cultural Center in Florida. All partner libraries will develop a plan for recruiting participants from groups currently underrepresented in STEM professions. Project BUILD's specific aims are to 1) Engage underserved audiences, 2) Build the capacity of participating librarians and ASCE volunteers, 3) Increase interest and engagement in STEM activities for youth in grades 2-5 and their families, and 4) Conduct a comprehensive education research project. Program components include the following: 1) Community Dialogue Events, 2) a Professional Development Program for partner librarians and ASCE volunteers, and 3) Development of a Technology-rich Programming Kit and Circulating STEM Kit program. Two research questions will be addressed: 1) What common factors might identify youth who engage in project activities and what factors might differentiate between youth who continue with program engagement and those who do not? and 2) What programmatic factors (i.e. design and composition of program activities, library recruitment, librarian engagement, professional engineer engagement, etc.) might influence youth's initial and continued engagement in project activities as well as youth's reported future career interests? An external evaluation will investigate the quality of the project's process as well as its impact and effectiveness. Benefits to the participating libraries' communities, library and engineering professionals, and the education community will be achieved through 1) Community Dialogue events; 2) Library and Librarian Outreach; 3) ASCE Outreach; and 4) Publication of Research and Evaluation results.