Rural communities across the Nation are, in general, underserved in terms of the various forms of STEM education. Clearly, they are under-represented in the realm of contemporary STEM subjects often because they are geographically isolated and cannot travel to cities where there are Science and Museum Centers for informal education opportunities. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This award will, in a collaborative effort within the community, bring STEM activities to selected communities in Arizona. Among the initial activities, there will be a STEM festival highlighting aspects of the community and its assets in an effort to gather support and begin to give perspective on identity for an extended effort of longevity. Further, these communities will be networked to facilitate discussion and to enhance effectiveness.
This project will develop STEM activities and STEM learning within a selected community by giving the community and its residents identity and opportunities for youth development and career choices. The selected communities in Arizona represent a diverse group that includes Native Americans and Latinos. In collaboration with community residents, a designed plan will be established that satisfies the needs and opportunities that can be derived from the extant community assets whether it is mining, tourism, or government facilities. Evaluation efforts are set to determine what the key features and methodologies are that facilitate STEM knowledge acquisition for each rural community. This project represents seminal and foundational work in the area of rural informal STEM education. Researchers will explore the following questions: 1) understanding how rural communities currently perceive, access, and engage in informal science learning, and the extent to which they identify themselves and/or their community in relation to science; and 2) the extent to which relevant, place-based networks can increase public awareness of local STEM assets, resources, and opportunities, and foster a science-related identity at both the personal and community level. These data will be compared to data on other rural community projects in the AISL portfolio. The partners in this effort include the Arizona Science Center, community leaders from four rural regions in Arizona, Arizona State University, and the Center of Science and Industry.
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. This Broad Implementation project would scale up the CryptoClub Project, an afterschool and online program designed to engage middle school youth in mathematics and cryptography. The project builds on previous successful work and evaluation that is ready for scale up using a train-the-trainer model implemented through a partnership with the National Girls Collaborative. The project will train 160 new CryptoClub leaders who will then train 800 new leaders at 20 hub sites reaching 9600 students. In addition, professional development modules and webinars will continue to refresh leader skills. Other project components include an online multiplayer cryptography game, weekly challenges through social media, and digital cryptology badges for students.
The research uses a think-aloud method with students as they actually attempt to solve the cryptology problems using mathematical thinking. Three think-aloud studies will be performed during the Project. The research team will code transcripts of the interviews for evidence of the mathematical thinking intended to be addressed by each activity, as well as capturing unexpected kinds of thinking. Tasks will also be rated according to the type of knowledge elicited. A written report will include statistical analyses of the think-aloud and interview responses, interpreted in light of the overall CryptoClub goals. The findings will contribute to both future research efforts and practice. The evaluation by EDC uses a quasi-experimental design, which assesses project outcomes for trainers, leaders, students, and Internet users. EDC will also investigate the fidelity to the CryptoClub model as it is scaled up. These studies have strong potential for informing numerous other projects that are at a stage where scale up is under consideration.
This project formed a partnership between a research team with experience in computer science (CS) education and learning sciences research and a newly fashioned practitioner team focused on building a grassroots, informal, volunteer group created to help women help themselves and others learn to write computer code. This research-practitioner partnership had a two-pronged focus, first on improving the program offered to learners through making adjustments based on research findings, and second on investigating the phenomenon of how women in the workforce informally learn CS skills that enable them to rewrite their career paths to contribute to what we know from research. The context of the study was situated in the virtual community that has formed around the phenomenally successful Salesforce Customer Relationship Management software platform.
This Exploratory Pathways project aimed to fill a gap in the research; we know little about the phenomenon of adult women in the workforce who are patching together resources to learn CS skills with a goal of job enhancement or job change. This project took an ethnographic approach to studying the informal learning (both through online, written resources and through sharing of knowledge with others) of the women involved in a 10-week, virtual Women’s Coaching and Learning group. The organization of this group consisted of learners—novice coders in the Apex language that is used on the Salesforce software platform, of coaches—more knowledgeable coders, and of a steering committee that ran the group and created the informal curriculum followed in the 10-week course.
Our overarching research question in this study was: In what ways are informal CS learning opportunities being used and created by adult women, what are their experiences with those opportunities, and how does this suggest ways to enhance those opportunities in the future to increase effectiveness in broadening access to and engagement in informal CS learning experiences for women?
We broke the question down into a number of sub questions, including:
Sociocultural context: What past gendered interactions do women report that discouraged (or encouraged) them from learning to code? What do interactions look like in female-only coaching and learning groups? In what ways does a coaching and learning group support persistence? What social barriers and supports outside the group affect persistence?
Personal context: What are the characteristics and backgrounds of female administrators who seek out resources to teach themselves to code? What are the motivations for these women to teach themselves to code? What motivates them to seek out and join all-women coding groups?
Physical context: How are women learning to code both through written resources and in virtual, informal coaching and learning classes? What are the conceptual barriers and supports that they encounter, and what works for women in these classes to overcome barriers? What conceptual barriers and supports affect persistence?
Persistence and identity: In what ways does participating in a learning group with female coaching motivate (or not) women to persist in learning to code? How do their goals or reasons for learning to code change through their participation? How does their identity as a “coder” change or shift as they participate?
Our findings for these subquestions are summarized in the “project products” linked to below.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program supports new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This project will meet this goal through rigorous research and the broad implementation of an environmental science literacy professional development and learning program for informal educators and youth engaged in outdoor science programs (OSP). With growing support from the literature and the Next Generation Science Standards (NGSS), much attention has been placed on creating and leveraging interdisciplinary science learning opportunities beyond science classrooms. As such, an estimated 300 residential OSPs currently exist in the United States. Unfortunately, the informal educators often charged with facilitating these deep and impactful science learning experiences often lack robust formal training in evidenced-based, age-appropriate environmental science content knowledge and pedagogy specific for the youth in their programs. This issue is often more pronounced in under-resourced and under-served programs and communities. This project will directly address these pervasive challenges in the field by not only providing much needed science focused professional development and resources to informal educators but also by specifically targeting and training informal leaders and educators serving youth in predominately rural areas, low-income communities, and underrepresented communities.
Approximately 200 OSP leaders at 100 OSPs around the country will participate in a week-long, intensive training in the professional development model at one of five regional residential leadership institutes. OSP leaders will then redeliver the training to the approximately 1,500 OSP educators/field instructors in their home institutions. The OSP educators/field instructors will then use what they learn through the professional development to facilitate the environmental science learning program (i.e., curriculum, field experiences, resources, pedagogy) to over 1 million youth (grades 3-8) enrolled in their residential outdoor science programs. In addition, a rigorous implementation study, efficacy study and evaluation will be conducted. The implementation study will investigate: (a) Which of the professional learning model practices were implemented and (b) What successes and challenges the programs faced implementing the model. The mixed methods efficacy study will explore: (a) if outdoor science programs contribute to the development of science learning activation and environmental literacy? and (b) what are the features of these experiences that are correlated with increases in science learning activation and environmental literacy. Approximately 25-35 youth will be randomly selected from each of 50 randomly selected sites to participate in the efficacy study. The data and findings from the research and evaluation produced by this project will contribute to a relatively sparse knowledge and research base specific to youth efficacy and implementation processes and practices across nearly 1/3 of the estimated 300 existing residential outdoor science programs in the United States.
The connections between technology applications of all sorts and human users that are ubiquitous in informal learning and assume a great deal about how the technology is used and how learning takes place. Much of the research in this area has been focused on game design and interaction. This project will examine this interaction involving the use of gestures that represent how individuals work with systems and large data sets that represent complex systems like the oceans, to understand how basic elements of a project with a 3-D type of design might enhance the user experience and increase the utility and learning that takes place by understanding the cognitive elements of these game like interactions in specific STEM related settings like museums.
This exploratory pathways project will investigate the use of interactive, gesture-enabled, multi-touch spheres for teaching about ocean systems in science centers and museums. The gesture-enabled aspect of the project will improve on interactive table-top installations which can frustrate users who use unexpected gestures and receive no response leading to brief interaction and abandonment without significant interaction or learning. The project will investigate ways in which unsupported gestures would still produce a system response which would encourage the user to remain at the installation and continue to investigate. The effect of multiple gestures will be supported by using natural mappings between gestures and interactions with the on-sphere data.
The project investigates theories of embodied cognition that support the notion that by engaging with global-scale datasets on a spherical display more effectively models the earth in a non-distorted manner and therefore will be more natural and allow users to develop a more accurate conceptual model of how data relates to itself and the globe. In this way, the project shares some aspects of understanding about learning through game play. The sphere will not be a fully developed game but will share characteristics of game play.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Chemistry is an important and widely relevant field of science. However, when compared with other STEM content areas, chemistry is under-represented in U.S. science museums and other informal educational environments. This project will build, and build knowledge about, innovative approaches to delivering informal science learning activities in chemistry. The project will not only increase public interest and understanding of chemistry but also increase public perception of chemistry's relevance and increase the public's self-efficacy with respect to chemistry. This project outcomes will include a guide for practitioners along with activity materials that will be packaged into a kit, distributed, and replicated for use by informal science educators, chemists, and chemistry students at 250 sites across the U.S. The project team will reach out to organizations that serve diverse audiences and diverse geographic locations, including organizations in rural and inner-city areas. The kits will provide guidance on engaging girls, people with various abilities, Spanish speakers, and other diverse audiences, and include materials in Spanish. Written guides, training videos, and training slides will be included to support training in science communication in general, as well as chemistry in particular. This project is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.
This project will take an innovative approach to develop informal educational activities and materials about chemistry. Rather than starting with content goals, the project will start with a theoretical framework drawn from research about affecting attitudes about science related to interest, relevance, and self-efficacy. A design-based research approach (DBR) will be used to apply that framework to the development of hands-on educational activities about chemistry, while also testing and modifying the framework itself. (DBR blends empirical educational research with the theory-driven design of learning environments.) Existing or new educational activities that appear to embody key characteristics defined in the framework will be tested with public audiences for their impact on visitors. Researchers and educators will determine how different characteristics of the educational activities defined in the framework affect the outcomes. The activities will be modified and tested iteratively until the investigators achieve close alignment between framework and impacts.. The project team will continue the design-based research approach both to examine groups of activities in which synergies can have impacts beyond single interactions as well as to examine varied ways of training facilitators who can also significantly affect outcomes. In this way, the project will generate knowledge about how kits of hands-on informal learning activities can stimulate attitudes of interest, relevance, and self-efficacy with respect to the neglected field of chemistry. The project teams will broadly disseminate project outcomes within the educational research, science and informal Science, Technology, Engineering and Mathematics (STEM) education communities. While this project will focus on chemistry, the strategies it will develop and test through a design-based research process will provide valuable insight into effective approaches for informal STEM education more broadly.
As part of its National Science Foundation (NSF) grant, the Conservation Trust of Puerto Rico (the Trust) hired Randi Korn & Associates, Inc. (RK&A) to evaluate its Citizen Science Project. The goal of the study was to measure the project’s success against an Impact Framework, the organizing framework NSF requires for evaluation. During the life of the project, an Impact Framework serves several functions, including to (1) articulate the project goals for the NSF proposal; (2) act as a roadmap for the Trust to align project practices with the impact it intends to achieve on specific
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. The National Association of Math Circles (NAMC) will convene the Math Circle-Mentor and Partnership (MC-MAP) Workshop in late 2016. The proposed MC-MAP workshop will build the field's understanding of the training content and mechanisms that enhance the knowledge and skill development of participants in Math Circles. The workshop will bring mentors from experienced Math Circle leaders together with novice Math Circle leaders to develop the expertise of the notice leaders and their group to develop their expertise in facilitating math circle activities and in organizing related events. The approximately 180 Math Circles currently operating across the nation enlist mathematics professionals to share their passion for mathematics with K-12 students, teachers, and the general public in contexts that emphasize exploration, problem solving and discovery. This initial conference and Math Circle trainings informed by this conference will help build a community of practice around Math Circles through which novice and existing leaders are connected, encouraged and inspired.
The MC-MAP workshop will include structured planning as well as guided observation and structured debriefing of a demonstration Math Circle sessions. The workshop design will be grounded in research related to effective adult learning and to discovery-based mathematics. The workshop will serve as a training prototype that will assist the National Association of Math Circles to identify effective training formats and materials for both experienced and novice Math Circle leaders. Pre- and post- conference surveys of Math Circle leaders will produce data to be used in planning and designing future trainings. The NAMC will share key findings from the workshop evaluation and workshop resources not only with its membership, but also with other mathematics K-12 outreach programs. Workshop materials will address recruiting and serving diverse participants in Math Circles, including girls and women, persons with disabilities, students from varied socioeconomic backgrounds and underrepresented minorities in STEM.
Youth environmental education (EE) programs often serve as gateway experiences in which diverse audiences engage in informal science learning. While there is evidence that these programs can have positive impacts on participants, little empirical research has been conducted to determine what makes one program more successful than another. To be able to conduct such research, this Exploratory Pathways study will (1) develop and statistically validate ways to measure meaningful outcomes for participants across a variety of programs and (2) test observational methods that will enable research that can determine which elements of program delivery most powerfully influence participant engagement and learning outcomes in different contexts. These efforts will include consultations with diverse subject matter experts from the National Park Service, nature centers, and academia; survey research with participants in afterschool and free-choice EE programs; and observations of EE programs designed to fine tune the measurement of program delivery elements and student engagement. Developing valid and reliable outcomes measures and observational protocols will enable a larger investigation that will specifically address the following research question: What program characteristics lead to the best learning outcomes for program participants in different contexts? This research will result in empirically tested guidelines that will enable educators to design and deliver more effective programs for a wide range of audiences in a wide range of contexts. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This effort will refine methods necessary to undertake an unprecedented study (and future AISL Research in Service to Practice proposal) to examine the linkages between pedagogical approaches, participant engagement, and learning outcomes in informal STEM-focused youth EE programs. The larger study will involve systematically observing a large number of programs to assess the use of different approaches and to link those approaches to engagement and learning outcomes through both observation and survey research. In this current study the team will develop and refine crosscutting outcome measures to ensure validity, reliability, and sensitivity by drawing upon the literature and consultation with key stakeholders to develop suites of indicators for subsequent psychometric testing and revision. They will also refine observational techniques for assessing pedagogical approaches through extensive testing of inter-rater reliability. Finally, techniques for measuring participant engagement, incorporating both observational techniques and retrospective participant surveys will be refined. The work will be conducted by researchers at Clemson University and Virginia Tech, in partnership with the U.S. National Park Service, the North American Association for Environmental Education, and the American Association of Nature Center Administrators. This work represents the first step in a longer research process to determine the "best practices" most responsible for achieving outcomes in a wide range of contexts.
The Wayne State University Math Corps is a mathematics enrichment and mentoring program that operates during summers and on Saturdays. The curriculum and the teach pedagogies in this informal learning program have documented success of supporting youths' mathematics learning as well as raising achievement levels in school. Through rigorous research and evaluation, this project seeks to analyze and understand the nature, extent, and reasons for Math Corps' success with youth learning in Detroit as well as the processes of program replication in three sites: Cleveland, OH; Utica, NY; and Philadelphia, PA. As such, this project will deepen understandings of program replication and of addressing the needs of youth in economically-challenged communities in order to promote mathematics learning.
The project's research studies will assess the multiple factors that make Math Corps successful with youth in Detroit and document the implementation of the program to the three replication sites. Research methods include discourse analyses, surveys, interviews, and pre/post-tests. The project will also conduct a retrospective evaluation of Math Corps based on quantitative datasets regarding both near-term and long-term youth outcomes.
This projects is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Steve KahnStephen ChrisomalisTodd KubicaCarol Philips-BeyFrancisca Richter
In this chapter we present the ways in which institutional cultural differences impact the development and implementation of learning activities in informal settings. Five university-based centers for the study of chemistry worked with informal learning professionals to re-envision educational and public outreach activities about science. The projects were part of a broader effort to catalyze new thinking and innovation in informal education and chemistry centers. The set of projects illustrates the broad possibilities for informal learning settings, with projects targeting diverse audiences