The data collection procedure and process is one of the most critical components in a research study that affects the findings. Problems in data collection may directly influence the findings, and consequently, may lead to questionable inferences. Despite the challenges in data collection, this study provides insights for STEM education researchers and practitioners on effective data collection, in order to ensure that the data is useful for answering questions posed by research. Our engineering education research study was a part of a three-year, NSF funded project implemented in the Midwest
DATE:
TEAM MEMBERS:
Ibrahim YeterAnastasia Marie RynearsonHoda EhsanAnnwesa DasguptaBarbara FagundesMuhsin MeneskeMonica Cardella
Computational Thinking (CT) is an often overlooked, but important, aspect of engineering thinking. This connection can be seen in Wing’s definition of CT, which includes a combination of mathematical and engineering thinking required to solve problems. While previous studies have shown that children are capable of engaging in multiple CT competencies, research has yet to explore the role that parents play in promoting these competencies in their children. In this study, we are taking a unique approach by investigating the role that a homeschool mother played in her child’s engagement in CT
Informal learning environments such as science centers and museums are instrumental in the promotion of science, technology, engineering, and mathematics (STEM) education. These settings provide children with the chance to engage in self-directed activities that can create a of lifelong interest and persistence in STEM. On the other hand, the presence of parents in these settings allows children the opportunity to work together and engage in conversations that can boost understanding and enhance learning of STEM topics. To date, a considerable amount of research has focused on adult-child
Computational Thinking (CT) is a relatively new educational focus and a clear need for learners as a 21st century skill. This proposal tackles this challenging new area for young learners, an area greatly in need of research and learning materials. The Principal Investigators will develop and implement integrated STEM+C museum exhibits and integrate CT in their existing engineering design based PictureSTEM curriculum for K-2 students. They will also pilot assessments of the CT components of the PictureSTEM curriculum. This work will make a unique contribution to the available STEM+C learning materials and assessments. There are few such materials for the kindergarten to second grade (K-2) population they will work with. They will research the effects of the curriculum and the exhibits with a mixed methods approach. First, they will collect observational data and conduct case studies to discover the important elements of an integrated STEM+C experience in both the formal in-school setting with the curriculum and in the informal out-of-school setting with families interacting with the museum exhibits. This work will provide a novel way to understand the important question of how in- and out-of-school experiences contribute to the development of STEM and CT thinking and learning. Finally, they will collect data from all participants to discover the ways that their activities lead to increases in STEM+C knowledge and interest.
The Principal Investigators will build on an integrated STEM curriculum by integrating CT and develop integrated museum exhibits. They base both activities on engineering design implemented through challenge based programming activities. They will research and/or develop assessments of both STEM+C integrated thinking and CT. Their research strategy combines Design Based Research and quantitative assessment of the effectiveness of the materials for learning CT. In the first two years of their study, they will engage in iterations on the design of the curriculum and the exhibits based on observation and case-study data. There will be 16 cases that draw from each grade level and involve data collection for the case student in both schools and museums. They will also use this work to illuminate what integrated STEM+C thinking and learning looks like across formal and informal learning environments. Based in some part on what they discover in this first phase, they will conduct the quantitative assessments with all (or at least most) students participating in the study
To reach its full potential in science, technology, engineering, and mathematics (STEM), the United States must continue to recruit, prepare and maintain a diverse STEM workforce. Much work has been done in this regard. Yet, underrepresentation in STEM fields persists and is especially pronounced for Hispanic STEM professionals. The Hispanic community is the youngest and fastest growing racial/ethnic group in the United States but comprises only seven percent of the STEM workforce. More evidence-based solutions and innovative approaches are required. This project endeavors to address the challenges of underrepresentation in STEM, especially among individuals of Hispanic descent, through an innovative approach. The University of San Diego will design, develop, implement, and test a multilayered STEM learning approach specific to STEM learning and workforce development in STEM fields targeting Hispanic youth. The STEM World of Work project will explore youth STEM identity through three mechanisms: (1) an assessment of their individual interests, strengths, and values, (2) exposure to an array of viable STEM careers, and (3) engagement in rigorous hands-on STEM activities. The project centers on a youth summer STEM enrichment program and a series of follow-up booster sessions delivered during the academic year in informal contexts to promote family engagement. Paramount to this work is the core focus on San Diego's Five Priority Workforce Sectors: Advanced Manufacturing, Information and Communications Technology, Clean Energy, Healthcare, and Biotech. Few, if any, existing projects in the Advancing Informal STEM learning portfolio have explored the potential connections between these five priority workforce sectors, informal STEM learning, and identity among predominately Hispanic youth and families engaged in a year-long, culturally responsive STEM learning and workforce focused program. If successful, the model could provide a template for the facilitation of similar efforts in the future.
The STEM World of Work project will use a mixed-methods, exploratory research design to better understand the variables influencing STEM learning and academic and career choices within the proposed context. The research questions will explore: (1) the impacts of the project on students' engagement, STEM identity, STEM motivation, and academic outcomes, (2) factors that moderate these outcomes, and (3) the impact the model has on influencing youths' personal goals and career choices. Data will be garnered through cross-sectional and longitudinal surveys and reflective focus groups with the students and their parents/guardians. Multivariate analysis of variance, longitudinal modeling, and qualitative analysis will be conducted to analyze and report the data. The findings will be disseminated using a variety of methods and platforms. The broader impacts of the findings and work are expected to extend well beyond the project team, graduate student mentors, project partners, and the estimated 120 middle school students and their families from the predominately Hispanic Chula Vista Community of San Diego who will be directly impacted by the project.
This exploratory pathways project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
Perla MyersVitaliy PopovOdesma DalrympleYaoran LiJoi Spencer
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
This project supports the development of technological fluency and understanding of STEM concepts through the implementation of design collaboratives that use eCrafting Collabs as the medium within which to work with middle and high school students, parents and the community. The researchers from the University of Pennsylvania and the Franklin Institute combine expertise in learning sciences, digital media design, computer science and informal science education to examine how youth at ages 10-16 and families in schools, clubs, museums and community groups learn together how to create e-textile artifacts that incorporate embedded computers, sensors and actuators. The project investigates the feasibility of implementing these collaboratives using eCrafting via three models of participation, individual, structured group and cross-generational community groups. They are designing a portal through which the collaborative can engage in critique and sharing of their designs as part of their efforts to build a model process by which scientific and engineered product design and analysis can be made available to multiple audiences. The project engages participants through middle and high school elective classes and through the workshops conducted by a number of different organizations including the Franklin Institute, Techgirlz, the Hacktory and schools in Philadelphia. Participants can engage in the eCrafting Collabs through individual, collective and community design challenges that are established by the project. Participants learn about e-textile design and about circuitry and programming using either ModKit or the text-based Arduino. The designs are shared through the eCrafting Collab portal and participants are required to provide feedback and critique. Researchers are collecting data on learner identity in relation to STEM and computing, individual and collective participation in design and student understanding of circuitry and programming. The project is an example of a scalable intervention to engage students, families and communities in developing technological flexibility. This research and development project provides a resource that engages students in middle and high schools in technology rich collaborative environments that are alternatives to other sorts of science fairs and robotic competitions. The resources developed during the project will inform how such an informal/formal blend of student engagement might be scaled to expand the experiences of populations of underserved groups, including girls. The study is conducting an examination of the new types of learning activities that are multiplying across the country with a special focus on cross-generational learning.
The National Federation of the Blind (NFB), with six science centers across the U.S., will develop, implement, and evaluate the National Center for Blind Youth in Science (NCBYS), a three-year full-scale development project to increase informal learning opportunities for blind youth in STEM. Through partnerships and companion research, the NCBYS will lead to greater capacity to engage the blind in informal STEM learning. The NCBYS confronts a critical area of need in STEM education, and a priority for the AISL program: the underrepresentation of people with disabilities in STEM. Educators are often unaware of methods to deliver STEM concepts to blind students, and students do not have the experience with which to advocate for accommodations. Many parents of blind students are ill-equipped to provide support or request accessible STEM adaptations. The NCBYS will expose blind youth to non-visual methods that facilitate their involvement in STEM; introduce science centers to additional non-visual methods that facilitate the involvement of the blind in their exhibits; educate parents as to their students' ability to be independent both inside and outside the STEM classroom; provide preservice teachers of blind students with hands-on experience with blind students in STEM; and conduct research to inform a field that is lacking in published material. The NCBYS will a) conduct six regional, two-day science programs for a total of 180 blind youth, one day taking place at a local science center; b) conduct concurrent onsite parent training sessions; c) incorporate preservice teachers of blind students in hands-on activities; and d) perform separate, week-long, advanced-study residential programs for 60 blind high school juniors and seniors focused on the design process and preparation for post-secondary STEM education. The NCBYS will advance knowledge and understanding in informal settings, particularly as they pertain to the underrepresented disability demographic; but it is also expected that benefits realized from the program will translate to formal arenas. The proposed team represents the varied fields that the project seeks to inform, and holds expertise in blindness education, STEM education, museum education, parent outreach, teacher training, disability research, and project management. The initiative is a unique opportunity for science centers and the disability population to collaborate for mutual benefit, with lasting implications in informal STEM delivery, parent engagement, and teacher training. It is also an innovative approach to inspiring problem-solving skills in blind high school students through the design process. A panel of experts in various STEM fields will inform content development. NCBYS advances the discovery and understanding of STEM learning for blind students by integrating significant research alongside interactive programs. The audience includes students and those responsible for delivering STEM content and educational services to blind students. For students, the program will demonstrate their ability to interface with science center activities. Students will also gain mentoring experience through activities paired with younger blind students. Parents and teachers of blind students, as well as science center personnel, will gain understanding in the experiences of the blind in STEM, and steps to facilitate their complete involvement. Older students will pursue design inquiries into STEM at a more advanced level, processes that would be explored in post-secondary pursuits. By engaging these groups, the NCBYS will build infrastructure in the informal and formal arenas. Society benefits from the inclusion of new scientific minds, resulting in a diverse workforce. The possibility for advanced study and eventual employment for blind students also reduces the possibility that they would be dependent upon society for daily care in the future. The results of the proposed project will be disseminated and published broadly through Web sites; e-mail lists; social media; student-developed e-portfolios of the design program; an audio-described video; and presentations at workshops for STEM educators, teachers of blind students, blind consumer groups, researchers in disability education, and museum personnel.
Roto, an exhibition design and production firm, contracted Randi Korn & Associates, Inc. (RK&A) to conduct a front-end evaluation of Speed, an exhibition being developed for The Science Museum of Virginia (SMV) in Richmond, Virginia. RK&A explored visitors’ thoughts, perceptions, and understandings of exhibition concepts related to speed, defined as change over time. How did we approach this study? RK&A worked closely with Roto to identify the goals and objectives for the Speed exhibition. Findings from the front-end evaluation were designed to help Roto and SMV find common ground between
Maker Corps increases the capacity of youth-serving organizations nationwide to engage youth and families in making. Diverse Maker Corps Members expand the current network of makers, mentors, and community leaders poised to lead creative experiences for youth. In the Maker Corps' second year evaluation report, we address the following questions: 1. How does Maker Corps impact the Maker Corps Members, participating Host Sites, and the audiences they serve? 2. In what ways can the Maker Corps program improve to better serve these participants and their audiences? We developed an evaluation plan with two primary methods: surveys and case studies. We surveyed all Maker Corps Members and Host Sites at multiple points during their service year. This method allowed us to get a broad look at Maker Ed's impact across the Maker Corps program. We balanced this approach by conducting case studies at three Host Sites, which allowed us to get a deeper, more specific look at Maker Ed's impact.