The purpose of this proposal is to convene scholars at a two-day conference to closely examine validity-related measurement issues, create a guidelines for the field of mathematics education research that addresses key ideas (e.g., validity, validity arguments, evidence for validity and measurement at-scale), and set a clear pathway for scholars to discuss quantitative measurement within mathematics education. Invitees will include a mix of young, older and diverse scholars in mathematics education research. Products include refereed journal articles along with a website.
The workshop will engage the Mathematics Education, Policy, Statistical, Psychometrics and other education research communities in examining and critiquing measurement validity evidence of mathematics education research with the long-term goal of increasing the quality of quantitative inference in mathematics education research (to include improvements in the training of doctoral students).
DATE:
-
TEAM MEMBERS:
Jonathan BosticMichele Carney
resourceprojectProfessional Development, Conferences, and Networks
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds efforts that seek to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will achieve these aims by identifying and closely evaluating critical factors and processes that are necessary to effectively broaden access and sustain professional learning (PL) for educational professionals working within informal STEM learning (ISL) settings. The context for this work builds on an evidence-based and nationally field tested professional learning model, Reflecting on Practice (RoP). This model will be refined to provide ISL educators with increased access to a proven PL curriculum via an in-person or blended approach, enhanced localized support, and cultivated regional professional learning communities. There is still little known about the effectiveness of blended PL within informal contexts. The emphasis on greater accessibility to PL is particularly important to the ISL field, given the significant number of informal STEM educators and institutions in underserved and remote locations, often facing disparate and insurmountable challenges in access to high quality STEM professional development. This modular program will not only target a broad range of informal institutions; varying in size, STEM content foci, geographic location and communities served but it is also uniquely designed for institutional customization and adoption, further increasing the likelihood of wide-spread uptake, participation, and engagement. If successful, this broad implementation effort will directly impact over 3,000 informal science educators and professionals in nearly 350 informal STEM learning institutions across the country. The intended theory of action and iterative, design-based implementation approach will be closely monitored, documented and analyzed by an experienced team of external evaluators, using formative and summative evaluative methods. A mixed methods approach will be employed to: (a) examine the effectiveness and accessibility of blended PL and regional PLCs for the ISL field, (b) identify critical design features in blended PL and regional PLCs for impacting educators' practice, (c) determine how PLCs can develop and continue in ISL through looking at what system of support is needed, and (d) ascertain the effective role of the Leaders and Leadership Sites. Data will be collected at all levels - from the RoP directors and PIs, document reviews, interviews and observations with RoP leaders at the six partnering institutions, and surveys with the RoP facilitators (n=700) and informal STEM educator participants (n=2,000). The results of the findings could be instrumental in the development of future frameworks and models designed to broadly disseminate similar professional learning models effectively within ISL contexts.
This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of Science, Technology, Engineering, and Mathematics (STEM) learning in informal environments. Roughly one million refugees resettled in the United States in the past decade, many of whom are school-aged youth. During secondary school, resettled refugee youth are often still developing English language literacy and STEM skills needed for successful postsecondary experiences in the United States. At the same time, these youth bring rich cultural and linguistic resources that they can use as an asset as they grow their STEM skill sets, prepare for future success, and make positive impacts on U.S. society. To promote these assets and engage youth in developing STEM literacy, this after-school program engages these youth in critical STEM literacy development. The project focuses on STEM learning, specifically the relationship between human life and climate, as well as developing youths' STEM identities and agency.
The project will develop and implement a community-based afterschool program that provides resettled Burmese refugee youth with STEM learning experiences. By drawing upon youths' experiences, the program will engage youth in learning about climate science and developing digital stories to communicate with broader audiences. To do so, the team will implement a program that builds on principles of responsive teaching, funds of knowledge, and English literacy development in authentic meaning-making contexts. The project will examine how youth expand their STEM knowledge, develop STEM identities and agency, and develop their expertise in communicating about STEM within and beyond their participation in the after-school program. The research team will explore existing and innovative data collection and analysis methods by drawing on principles of ethnography, video ethnography, mediated discourse analysis, and phenomenological and ethnomethodological analysis of interviews. These analyses will document learning over time in informal STEM learning settings. As there is very little prior research on STEM learning in this population, this project will generate knowledge about how to support STEM sense-making and critical STEM literacy. Furthermore, by testing the designed curriculum and building a partnership with a local community organization, the project will build capacity for broadening participation in informal STEM learning practices.
This project had three objectives to build knowledge with respect to advancing Informal STEM Education:
Plan, prototype, fabricate, and document a game-linked design-and-play STEM exhibit for multi-generational adult-child interaction utilizing an iterative exhibit design approach based on research and best practices in the field;
Develop and disseminate resources and models for collaborative play-based exhibits to the informal STEM learning community of practice of small and mid-size museums including an interactive, tangible tabletop design-and-play game and a related tablet-based game app for skateboarding science and technology design practice;
Conduct research on linkages between adult-child interactions and game-connected play with models in informal STEM learning environments.
Linked to these objectives were three project goals:
Develop tools to enable children ages 5-8 to collaboratively refine and test their own theories about motion by exploring fundamental science concepts in linked game and physical-object design challenge which integrates science (Newton’s Laws of Motion) with engineering (iterative design and testing), technology (computational models), and mathematics (predictions and comparisons of speed, distance, and height). [Linked to Objectives 1 & 3]
Advance the informal STEM education field’s understanding of design frameworks that integrate game environments and physical exhibit elements using tangibles and playful computational modeling and build upon the “Dimensions of Success” established STEM evaluation models. [Linked to Objectives 1 & 2]
Examine methods to strengthen collaborative learning within diverse families through opportunities to engage in STEM problem-based inquiry and examine how advance training for parents influences the extent of STEM content in conversations and the quality of interactions between caregivers and children in the museum setting. [Linked to Objectives 1 & 3]
The exhibit designed and created as a result of this grant project integrates skateboarding and STEM in an engaging context for youth ages 5 to 8 to learn about Newton’s Laws of Motion and connect traditionally underserved youth from rural and minority areas through comprehensive outreach. The exhibit design process drew upon research in the learning sciences and game design, science inquiry and exhibit design, and child development scholarship on engagement and interaction in adult-child dyads.
Overall, the project "Understanding Physics through Collaborative Design and Play: Integrating Skateboarding with STEM in a Digital and Physical Game-Based Children’s Museum Exhibit" accomplished three primary goals. First, we planned, prototyped, fabricated, and evaluated a game-linked design-and-play STEM gallery presented as a skatepark with related exhibits for adult-child interaction in a Children's Museum.
Second, we engaged in a range of community outreach and engagement activities for children traditionally underserved in Museums. We developed and disseminated resources for children to learn about the physics of the skatepark exhibit without visiting the Museum physically. For example, balance board activities were made portable, the skatepark video game was produced in app and web access formats, and ramps were created from block sets brought to off-site locations.
Third, we conducted a range of research to better understand adult-child interactions in the skatepark exhibit in the Children's Museum and to explore learning of physics concepts during physical and digital play. Our research findings collectively provide a new model for Children's Museum exhibit developers and the informal STEM education community to intentionally design, evaluate, and revise exhibit set-up, materials, and outcomes using a tool called "Dimensions of Success (DOS) for Children's Museum Exhibits." Research also produced a tool for monitoring the movement of children and families in Museum exhibit space, including time on task with exhibits, group constellation, transition time, and time in gallery. Several studies about adult-child interactions during digital STEM and traditional pretend play in the Museum produced findings about social positioning, interaction style, role, and affect during play.
DATE:
-
TEAM MEMBERS:
Deb DunkhaseKristen MissallBenjamin DeVane
As part of an overall strategy to enhance learning within maker contexts in formal and informal environments, the Innovative Technology Experiences for Students and Teachers (ITEST) and Advancing Informal STEM Learning (AISL) programs partnered to support innovative models for making in a variety of settings through the Enabling the Future of Making to Catalyze New Approaches in STEM Learning and Innovation Dear Colleague Letter. This Early Concept Grant for Exploratory Research (EAGER) will test an innovative approach to bringing making from primarily informal out-of-school contexts into formal science classrooms. While the literature base to support the positive outcomes and impacts of design-based making in informal settings at the K-12 level is emerging, to date, minimal studies have investigated the impacts of making design principles within formal contexts. If successful, this project would not only add to this gap in the literature base but would also present a novel model for bridging the successful engineering design practices of making and tinkering primarily found in informal science education into formal science education classrooms. The model would also demonstrate an innovative, highly interactive way to engage high school students and their teachers in engineering based design principles with immediate real-world applications, as the scientific instruments developed in this project could be integrated directly into science classrooms at relatively minimal costs.
Through a multi-phased design and implementation model, high school students and their teachers will engage deeply in making design principles through the design and development of their own scientific instruments using Arduino-compatible hardware and software. The first phase of the project will reflect a more traditional making experience with up to twenty high school students and their teachers participating in an after-school design making club, in this case, focused on the development and testing of scientific instrument prototypes. During the second phase of the project, the first effort to transpose the after school making experience to a more formalized experience will be tested with up to eight students selected to participate in two week summer research internships focused on scientific instrument design and development through making at Northwestern University. A two-day summer teacher workshop will also be held for high school teachers participating in the subsequent pilot study. The collective insights gleaned from the after school program, student internships, and teacher workshop will culminate to inform the full implementation of the formal classroom pilot study. The third and final phase will coalesce months of iterative, formative research, design and development, resulting in a comprehensive pilot investigation in up to seven high school physics classrooms.
Using a multi-phased, mixed methods exploratory design-based research approach, this 18-month EAGER will explore several salient research questions: (a) How and to what extent does the design & making of scientific instrumentation serve as useful tasks for learning important science and engineering knowledge, practices, and epistemologies? (b) How engaging is this making activity to learners of diverse abilities and prior interests? What can be generalized to other types of making activities? (c) How accessible is the Arduino hardware and coding environment to learners? What combination of hardware and software materials and tools best support accessibility and learning in this type of digital making activity? and (d) What types of scaffolding (for students and teachers) are required to support the effective use of maker materials and activities in a classroom setting? Structured interviews, artifacts, video recordings from visor cameras, student design logs, logfiles, and ethnographic field notes will be employed to garner data and address the research questions. Given the early stage of the proposed research, the dissemination of the findings will be limited to a few select journals, teacher forums and workshops, and professional conferences.
This EAGER is well-poised to directly impact up to 125 high school physics students (average= 25 students/class), approximately 7 high school physics teachers, 6-8 high school summer interns, nearly 20 high school students participating in the after-school design making club, and indirectly many more. The results of this EAGER could provide the basis and evidence needed to support a more robust, expanded future investigation to further substantiate the findings and build the case for similar efforts to bring making into formal science education contexts.
As part of an overall strategy to enhance learning within maker contexts in formal and informal environments, the Innovative Technology Experiences for Students and Teachers (ITEST) and Advancing Informal STEM Learning (AISL) programs partnered to support innovative models in Making poised to catalyze new approaches in STEM learning and innovation. Employing a novel design and development approach, this Early Concept Grant for Exploratory Research (EAGER) will test the feasibility of integrating Making concepts with real world micro-manufacturing engineering principles within the context of intense, multi-year team apprenticeship experiences for high school students. The apprenticeship model is particularly novel, as current Making research and experiences predominately take place in afterschool and summer programs for up to 25 youth. The proposed apprenticeships will require a two year commitment by a small cohort of Texas high school students, which will provide an opportunity to examine the feasibility and impact of the effort longitudinally. The cohort will learn to think critically, solve problems, and work together as a Making Production Team (MPT) in a customized makerspace in their high school, constructing engineering-based science kits for implementation in a local elementary school. Not only will the students enhance their content knowledge while developing design and development skills but the students will also receive stipends which will address two very practical needs for the targeted high need population - employment and workforce development. Few, if any, efforts currently serve the targeted population through the contextualization of Making within a supply chain management and micro-manufacturing framework that extends the Making experience by integrating the student designed products into elementary classrooms. As such, this project will contribute to essentially unexplored areas of Making research and development.
Six high school students from high poverty, underserved Texas communities along the Texas-Mexico border (colonias) will be selected for the Making Production Team (MPT). In Years 1 and 2, the students will meet regularly during the academic school year and over the summer with Texas A & M University undergraduates, graduate students, and the project team to learn key aspects of Making and manufacturing (i.e., ideation, prototyping, design, acquisition, personnel, and production) through hands-on making activities and direct instruction. Concurrently, a research study will be conducted to explore: (a) the actualization of the model in an underserved community, (b) the effectiveness of problem-based learning to train students in the model, and (c) STEM knowledge and self-concept. Data will be collected from multiple sources. An adapted version of the Academic Self-Description Questionnaire will be administered to the students to assess their STEM technical knowledge and skills as well as their self-concept in relation to STEM domains. Remote and in person interviews will be conducted with the students to track the evolution of the primary dependent variables, STEM learning and self-concept, over time. Program facilitators and partners will be interviewed to examine the feasibility of the making experience within the given context and for the targeted students. Finally, the students' diary reflections, products, and video recordings of their work sessions will also be examined. Time-series quantitative tests and in-depth qualitative methods will be used to analyze the data.
DATE:
-
TEAM MEMBERS:
Francis QuekSharon Lynn ChuMalini NatarajarathinamMathew Kuttolamadom
resourceprojectProfessional Development, Conferences, and Networks
The Center for Advancement of Informal Science Education (CAISE) is a National Science Foundation (NSF) funded resource center, working in cooperation with the NSF Advancing Informal STEM Learning (AISL) program to build and advance the informal STEM education field. CAISE continues the work it began in 2007--serving professional audiences in informal STEM learning, which includes those working in science centers and museums, zoos and aquariums, parks, botanical gardens and nature centers, events and festivals, libraries, making and tinkering spaces, media (TV, radio, film, social), cyberlearning and gaming, and youth, community, and out-of-school time programs.
What We Do:
CAISE seeks to characterize, highlight, and connect quality, evidence-based informal STEM learning work supported by a diversity of federal, local, and private funders by providing access to over 8,000 (and growing) resources that include project descriptions, research literature, evaluation reports and other documentation on the InformalScience.org website. In addition, CAISE convenes inquiry groups, workshops and principal investigator meetings designed to facilitate discussion and identify the needs and opportunities for informal STEM learning.
In this award, CAISE is also tasked with advancing and better integrating the professional fields of informal STEM learning and science communication by (1) broadening participation in these fields, (2) deepening links between research and practice, and (3) building capacity in evaluation and measurement. These activities are being undertaken by cross-sector task forces of established and emerging who will be responsible for conducting field-level analyses, engaging stakeholders, and creating roadmaps for future efforts. CAISE is also building on existing communication channels for dissemination to the larger field, and through the InformalScience.org website. An External Review Board and Inverness Research are providing oversight of CAISE's program activities and evaluation of the center.
Who We Are:
CAISE operates as a network of core staff housed at the Association of Science-Technology Centers (ASTC) in Washington, D.C. and co-principal investigators and other collaborators at academic institutions and informal STEM education (ISE) organizations across the U.S. Other key collaborators are the American Association for the Advancement of Science's Center for Public Engagement with Science, the National Informal STEM Education Network, and Arizona State University.
The NISE Network Professional Impacts Summative Evaluation is a longitudinal examination of individual professionals over the final three years of NISE Net funding. This investigation is based on the NISE Network goals for professionals and explores how involvement with NISE Net impacts an individual professional’s sense of community, learning about nano, and use of nano educational products and practices. This evaluation primarily included professional partners who were: (1) Informal Science Educators (ISE): Professionals from science museums and children’s museums implementing informal
Computer Science (CS) education at the middle school level using educational games has seen recent growth and shown promising results. Typically these games teach the craft of programming and not the perspectives required for computational thinking, such as abstraction and algorithm design, characteristic of a CS curriculum. This research presents a game designed to teach computational thinking via the problem of minimum spanning trees to middle school students, a set of evaluation instruments, and the results of an experimental pilot study. Results show a moderate increase in minimum spanning
Games that help players develop an understanding of computer science concepts are a promising alternative to the current emphasis on programming. This workshop will introduce participants to digital and analog games that demonstrate how CS concepts can be integrated with game play and engaging story contexts. Relevant issues such as the use of player data for assessment of learning, the role of narrative in educational games, and the challenges of identifying appropriate concepts for game-based learning will also be addressed.
Computer science and its related fields are rapidly growing. However, there is a significant and rising shortage of women in this career domain. To combat this shortage, we explored the potential of coupling analog and digital games teaching computer science concepts to educate, interest, and engage female youth. For our purposes we created and used an analog and digital game both teaching the same computer science principle, image representation, in an after school program setting with middle school-aged females. Assessments were completed by the girls before and after the analog game version
DATE:
TEAM MEMBERS:
Stephanie EordanidsElisabeth GeeGail Carmichael
The Department of Computer Science and Engineering and DO-IT IT (Disabilities, Opportunities, Internetworking and Technology) at the University of Washington propose to create the AccessComputing Alliance for the purpose of increasing the participation of people with disabilities in computing careers. Alliance partners Gallaudet University, Microsoft, the NSF Regional Alliances for Persons with Disabilities in STEM (hosted by the University of Southern Maine, New Mexico State University, and UW), and SIGACCESS of the Association for Computing Machinery (ACM) and collaborators represent stakeholders from education, industry, government, and professional organizations nationwide.
Alliance activities apply proven practices to support persons with disabilities within computing programs. To increase the number of students with disabilities who successfully pursue undergraduate and graduate degrees, the alliance will run college transition and bridge, tutoring, internship, and e-mentoring programs. To increase the capacity of postsecondary computing departments to fully include students with disabilities in coursers and programs, the alliance will form communities of practice, run capacity-building institutes, and develop systemic change indicators for computing departments. To create a nationwide resource to help students with disabilities pursue computing careers and computing educators and employers, professional organizations and other stakeholders to develop more inclusive programs and share effective practices, the alliance will create and maintain a searchable AccessComputing Knowledge Base of FAQs, case studies, and effective/promising practices.
These activities will build on existing alliances and resources in a comprehensive, integrated effort. They will create nationwide collaborations among individuals with disabilities, computing professionals, employers, disability providers, and professional organizations to explore the issues that contribute to the underrepresentation of persons with disabilities and to develop, apply and assess interventions. In addition, they will support local and regional efforts to recruit and retain students with disabilities into computing and assist them in institutionalizing and replicating their programs. The alliance will work with other Alliances and organizations that serve women and underrepresented minorities to make their programs accessible to students with disabilities. Finally they will collect and publish research and implementation data to enhance scientific and technological understanding of issues related to the inclusion of people with disabilities in computing.
DATE:
-
TEAM MEMBERS:
Richard LadnerLibby CohenSheryl BurgstahlerWilliam McCarthy