The data collection procedure and process is one of the most critical components in a research study that affects the findings. Problems in data collection may directly influence the findings, and consequently, may lead to questionable inferences. Despite the challenges in data collection, this study provides insights for STEM education researchers and practitioners on effective data collection, in order to ensure that the data is useful for answering questions posed by research. Our engineering education research study was a part of a three-year, NSF funded project implemented in the Midwest
DATE:
TEAM MEMBERS:
Ibrahim YeterAnastasia Marie RynearsonHoda EhsanAnnwesa DasguptaBarbara FagundesMuhsin MeneskeMonica Cardella
Computational Thinking (CT) is an often overlooked, but important, aspect of engineering thinking. This connection can be seen in Wing’s definition of CT, which includes a combination of mathematical and engineering thinking required to solve problems. While previous studies have shown that children are capable of engaging in multiple CT competencies, research has yet to explore the role that parents play in promoting these competencies in their children. In this study, we are taking a unique approach by investigating the role that a homeschool mother played in her child’s engagement in CT
Given the growth of technology in the 21st century and the growing demands for computer science skills, computational thinking has been increasingly included in K-12 STEM (Science, Technology, Engineering and Mathematics) education. Computational thinking (CT) is relevant to integrated STEM and has many common practices with other STEM disciplines. Previous studies have shown synergies between CT and engineering learning. In addition, many researchers believe that the more children are exposed to CT learning experiences, the stronger their programming abilities will be. As programming is a
Informal learning environments such as science centers and museums are instrumental in the promotion of science, technology, engineering, and mathematics (STEM) education. These settings provide children with the chance to engage in self-directed activities that can create a of lifelong interest and persistence in STEM. On the other hand, the presence of parents in these settings allows children the opportunity to work together and engage in conversations that can boost understanding and enhance learning of STEM topics. To date, a considerable amount of research has focused on adult-child
The National Federation of the Blind (NFB), in partnership with scholars from Utah State University and educators from the Science Museum of Minnesota (SMM), has developed the Spatial Ability and Blind Engineering Research (SABER) project to assess and improve the spatial ability of blind teens in order to broaden their participation in STEM fields. The goals of the project include:
Contribute to the knowledge base of effective practices regarding informal STEM education for the blind, particularly relating to the development of spatial reasoning abilities.
Educate families, blind
Computational Thinking (CT) is a relatively new educational focus and a clear need for learners as a 21st century skill. This proposal tackles this challenging new area for young learners, an area greatly in need of research and learning materials. The Principal Investigators will develop and implement integrated STEM+C museum exhibits and integrate CT in their existing engineering design based PictureSTEM curriculum for K-2 students. They will also pilot assessments of the CT components of the PictureSTEM curriculum. This work will make a unique contribution to the available STEM+C learning materials and assessments. There are few such materials for the kindergarten to second grade (K-2) population they will work with. They will research the effects of the curriculum and the exhibits with a mixed methods approach. First, they will collect observational data and conduct case studies to discover the important elements of an integrated STEM+C experience in both the formal in-school setting with the curriculum and in the informal out-of-school setting with families interacting with the museum exhibits. This work will provide a novel way to understand the important question of how in- and out-of-school experiences contribute to the development of STEM and CT thinking and learning. Finally, they will collect data from all participants to discover the ways that their activities lead to increases in STEM+C knowledge and interest.
The Principal Investigators will build on an integrated STEM curriculum by integrating CT and develop integrated museum exhibits. They base both activities on engineering design implemented through challenge based programming activities. They will research and/or develop assessments of both STEM+C integrated thinking and CT. Their research strategy combines Design Based Research and quantitative assessment of the effectiveness of the materials for learning CT. In the first two years of their study, they will engage in iterations on the design of the curriculum and the exhibits based on observation and case-study data. There will be 16 cases that draw from each grade level and involve data collection for the case student in both schools and museums. They will also use this work to illuminate what integrated STEM+C thinking and learning looks like across formal and informal learning environments. Based in some part on what they discover in this first phase, they will conduct the quantitative assessments with all (or at least most) students participating in the study
Engineering is a critical yet understudied topic in early childhood. Previous research has shown that even young children can engage in (versions of) engineering design practices and processes that are similar to those of adult engineers and designers. In this session, we will share and discuss current research projects to explore how different in-school and out-of-school contexts and activities support 3- to 8-year-old children as they engage in engineering design. We will consider ways that the different characteristics of the activities and spaces, as well as the practices of teachers
Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
In this article we explore how activity design and learning contexts can influence youth failure mindsets through a case study of five youth who described failure as sometimes a good thing and sometimes a bad thing (a perspective we characterize as Failure as Mosaic, described in the article). These youth and their descriptions of failure-positive and failure-negative experiences offer a unique opportunity to identify how experiences can be designed to support learning and persistence. In order to understand differing views of failure among youth, we researched the following questions:
One way to motivate young people from diverse backgrounds to pursue engineering careers is to enlist them as educators who can help the general public understand how engineers help respond to the challenges of everyday life. The New York Hall of Science, which serves a large and diverse audience, is an ideal setting for testing the promise of this strategy. Youth educators and curators of public programs at the Hall of Science will mentor two groups of high school- and early college-aged youth, who will contribute to the design and facilitation of engineering-focused events and activities for museum visitors. They will work together to develop engineering programming for the public that emphasizes the cultural and interpersonal dimensions of engineering practices. This group of young people will be recruited from the Hall of Science's more than 100 Explainers, a very diverse group of young people who work part-time at the Hall of Science and engage with visitors as they explore the museum. Researchers will track participants' experiences and document their impact on museum visitors' perceptions of engineering. The expectation is that creating and delivering these experiences for visitors will have a positive impact on the youth participants' understanding of the engineering disciplines, and on visitors' perceptions of engineering and its relationship to everyday life.
The project will use observations, interviews, journaling, and the Engineering Professional Skills Assessment to explore youth experience, and visitor exit surveys and interviews to probe visitor perceptions. Both the skills assessment and visitor surveys are NSF-funded instruments. Data coding will be grounded in the engineering habits of mind defined by the National Research Council's Committee on Understanding and Improving K-12 Engineering Education in the United States (2009). The project will capture evidence regarding which habits of mind the Fellows are most frequently engaged with. The effort will also explore how interactions with peers (as colleagues), with experts (as learners, such as with Designers in Residence) and with visitors (as teachers and leaders) may be associated with different combinations of the habits of mind over the course of the project. Visitor data and assessment data will allow the project to begin to make analytic connections between participating young people's increased understanding of culturally-situated engineering challenges, and their impact on the experiences of museum visitors who engage with engineering programming at the Hall of Science.
This three-year research and implementation project empowers middle school LatinX youth to employ their own assets and funds of knowledge to solve community problems through engineering. Only 7% of adults in the STEM job cluster are of Hispanic/Latino origin. There is a continuing need for filling engineering jobs in our current and future economy. This project will significantly broaden participation of LatinX youth in engineering activities at a critical point as they make career decisions. Design Squad Global LatinX expands on a tested model previously funded by NSF and shown to be successful. It will enable LatinX youth to view themselves as designers and engineers and to build from their strengths to expand their skills and participation in science and engineering. The project goals are to: 1) develop an innovative inclusive approach to informal engineering education for LatinX students that can broaden their engineering participation and that of other underrepresented groups, (2) to galvanize collaborations across diverse local, national, and international stakeholders to create a STEM learning ecosystem and (3) to advance knowledge about a STEM pedagogy that bridges personal-cultural identity and experience with engineering knowledge and skills. Project deliverables include a conceptual framework for a strength-based approach to engineering education for LatinX youth, a program model that is asset based, a collection of educational resources including a club guide for how to scaffold culturally responsive engineering challenge activities, an online training course for club leaders, and a mentoring strategy for university engineering students working with middle school youth. Project partners include the global education organization, iEARN, the Society of Women Engineers, and various University engineering programs.
The research study will employ an experimental study design to evaluate the impact on youth participating in the Design Squad LatinX programs. The key research questions are (1) Does participation increase students' positive perceptions of themselves and understanding of engineering and global perspectives? (2) To what extent do changes in understanding engineering vary by community (site) and by student characteristics (age, gender, ethnicity)? (3) Do educators and club leaders increase their positive perceptions of youths' funds of knowledge and their own understanding of engineering? and (4) Do university mentors increase their ability to lead informal engineering/STEM education with middle school youth? A sample from 72 local Design Squad LatinX clubs with an enrollment of 10-15 students will be drawn with half randomly assigned to the participant condition and half to the control condition. Methods used include pre and post surveys, implementation logs for checks on program implementation, site visits to carry out observations, focus groups with students and interviews with adult leaders. Data will be analyzed by estimating hierarchical linear models with observations. In addition, in-situ ethnographically-oriented observations as well as interviews at two sites will be used to develop qualitative case studies.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Informal learning institutions, such as science centers and museums, are well-positioned to broaden participation in engineering pathways by providing children from underrepresented groups with motivational, self-directed engineering design experiences. Though many informal learning institutions offer opportunities for young visitors to engage in engineering activities, little is known about the specific features of these activities that support children's motivation in engineering design processes such as problem scoping, testing, and iteration. This project will address this gap and advance foundational knowledge by identifying features of engineering design activities, as implemented within an informal setting, which support underrepresented children's engineering motivation and persistence in engineering tasks. Researchers at New York Hall of Science (NYSCI) will observe children interacting with families and museum educators as they engage in different engineering design activities in NYSCI's Design Lab, an exhibition space devoted to hands-on exploration of engineering design. They will also survey and interview the children and their caregivers about these experiences. Analyses of these data sources will result in a description of features of design activities foster motivation and task persistence in engineering design. Findings will be disseminated nationally to other informal learning institutions, which in turn can use the knowledge generated from this project to create motivational, research-based, field-tested engineering design experiences for young visitors, especially for children from underrepresented groups. The experiences may encourage children to further pursue engineering pathways, resulting in a diversified engineering workforce with the potential to drive and sustain national innovation and global technological leadership.
This project uses the framework of goal orientation, defined as learners' self-reflection of why and how they engage in tasks, to understand whether, how, and why underrepresented 7-12-year-olds engage in engineering design activities in an informal learning institution. Though previous research has suggested that goal orientation is strongly, positively related to learning and motivation in formal settings such as schools, research in informal settings has not robustly accounted for the role of goal orientation in participants' engagement with learning tasks in these unique learning environments. To better understand how children's goal orientations contribute to their motivation in engineering in informal learning institutions, researchers will answer the following research questions: (1) What are underrepresented children's goals and goal orientations while participating in engineering design activities in an informal setting? (2) What contextual factors--including facilitation strategies, materials, task relevance, and social interactions with family members--may support or discourage the adoption of different goal orientations? (3) How do goal orientations relate to children's learning experience in the engineering design activities and the likelihood that they will test and iterate their solutions? These questions will be answered through a mixed-method research study conducted with approximately 200 families, with children aged 7-12, recruited from underrepresented groups. Semi-structured clinical interviews, conducted with 20% of the children and their caregivers, as well as observations and surveys gathered from all families, will provide information on the children's goal orientation and engagement as they relate to specific engineering design activities. Qualitative content analyses and multilevel structural equation modeling will result in findings that will be disseminated widely to other institutions of informal learning. Ultimately, this project will generate new empirical knowledge regarding the features of engineering design activities in informal learning environments that increase engineering engagement and motivation among underrepresented children, thereby broadening participation in engineering pathways.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.