This practitioner reflection was provided to stimulate conversation at the June 20-21, 2013 CAISE Evaluation Convening. It discusses improving practice through reflection.
Finding inclusive approaches to broaden the participation of underrepresented communities in the sciences is the focus of this project. The team will create pathways for Native American students from the development of new partnerships between tribal communities and STEM institutions that promote the participation and inclusion of Native American scientists in the geosciences. Each partner brings a successful program, based on good practices from the research literature in improving outcomes for underrepresented students and scientists. Together, the researchers will create scientific collaborations that support a pipeline for Native American students from middle school through to graduate school and beyond. In addition, the project will work on building welcoming workplace climates for indigenous researchers within ?traditional Western? organizations. The approach will integrate indigenous and Western knowledge in research collaborations to create more creative, innovative, and culturally relevant science research programs.
This project, Integrating Indigenous and Western Knowledge to Transform Learning and Discovery in the Geosciences, uses the principles of collective impact to create new partnerships between tribal communities and STEM institutions that promote the participation and inclusion of Native American scientists in the geosciences. The project collaborators will more strongly integrate indigenous and Western knowledge into collectively-developed research projects. The project partners the Rising Voices: Collaborative Science for Climate Solutions (Rising Voices) and member tribal colleges and communities with Haskell Indian Nations University, the National Center for Atmospheric Research (NCAR), the University of Arizona?s Biosphere 2, and National Center for Atmospheric Research?s Significant Opportunities in Atmospheric Research and Science (SOARS) internship and Global Learning and Observation to Benefit the Environment (GLOBE) citizen science programs. Together, they will build research partnerships between Native American and traditional Western scientists, provide professional development for NCAR and Biosphere 2 scientists on how to engage appropriately with tribal communities, and provide pathways for NA students from middle school through college, to grad school and beyond. The project will connect community-based citizen science programs for middle- and high school youth with undergraduate programs at Haskell Indian Nations University and University of Arizona, and with summer research internship experiences for undergraduates and graduate students that address topics of interest across tribal communities, tribal college faculty, traditional science institutions, and community-based citizen science. This project also enhances the research capacity of all partners, and brings together diverse perspectives, which have been shown to lead to greater innovation, creativity, and higher impact research. The project has the potential to provide a tried and tested model for building similar partnerships at other institutions, including content and methods for professional development for mainstream scientists, ways to create more welcoming spaces for Native American students and scientists, promising practices for improving how research in the geosciences carried out, and an increase in the representation of Native American students and scientists in that vital research enterprise.
Libraries across the country have been reimagining their community role and leveraging their resources and public trust to strengthen community-based learning and foster critical thinking, problem solving, and engagement in STEM. What started some years ago as independent experiments has become a national movement. The Space Science Institute's National Center for Interactive Learning (NCIL), in partnership with the Lunar and Planetary Institute (LPI), received funding from the National Science Foundation for the first-ever Public Libraries & STEM conference, at the Sheraton Denver Downtown
The purpose of this national survey was to connect with librarians to determine: (1) What STEM programming is currently in place? How do libraries approach and implement these programs? (2) What obstacles prevent libraries from incorporating more STEM programming? (3) What kind of training and resources would be most helpful to librarians? Additionally, we sought the following information from STEM professionals, for the purpose of establishing and maintaining a Community of Practice: (4) What factors influence and enhance the success of Communities of Practice?
This is a two-year "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot targeting high school students in the Hudson Valley, including the New York Metropolitan Area. It will support a network of institutional partners that are committed to providing internship and mentoring opportunities to youths interested in authentic research projects. The proposed work will build on a current research immersion program--the Secondary School Field Research Program (SSFRP) at Columbia University's Lamont-Doherty Earth Observatory. SSFRP serves high school students, mainly from underrepresented and underserved communities, who work with college students, science teachers, and researchers around a specific science problem. Over the past decade, the program has had demonstrable impact, including attendance to college, and students' selection of STEM majors. Tracking data indicates that retention rates of its alumni in four-year colleges are well above the norm, and a significant fraction of early participants are now in graduate programs in science or engineering. The program has surpassed all expectations in its effectiveness at engaging underserved populations in science and promoting entry into college, recruitment into STEM majors, and retention through undergraduate and into graduate studies. Hence, the project's overall goal will be to extend and adapt the research-immersive summer internship model through an alliance with peer research institutions, school districts and networks, public land and resource management agencies, private funding agencies, informal educational institutions, and experts in pedagogical modeling, metrics, and evaluation. Focused on earth and environmental sciences, the summer and year-round mentoring model will allow high school students to work in research teams led by college students and teachers under the direction of research scientists. The mentoring model will be multilayered, with peer, near-peer, and researcher-student relationships interweaving throughout the learning process.
The project has formulated a set of testable explanatory hypotheses: (1) Beyond specific subject knowledge, success rests on increased student engagement in a community of practice, with near-peer mentors, teachers, and scientists in the context of scientific research; (2) The intensity of engagement also shifts the students' vision of their future to include higher education, and specifically to imagine and move toward a STEM career; and (3) Early engagement, before students attend college, is critical because high school is where students form patterns of engagement and capacities related to science learning. Thus, the immediate goal of the two-year plan will be to create approximately 11 research internship programs focused on earth and environmental sciences, and to build the networks for growth through engagement with a wider community of educational partners. The main focus of this approach will be removing barriers between high school students and STEM organizations, and adapting the current mentoring model at Columbia University to the specific cultures of other research groups and internship programs throughout the lower Hudson Valley. The team has already assembled a diverse set of partners committed to broadening participation in STEM using a collective impact approach to early engagement in project-based learning. Research partners will provide the mentors, research projects, and laboratory facilities. The educational network partners will provide access for students, particularly those from under-resourced communities to participate, as well as participation opportunities for interested teachers. Informal learning organizations will provide access to field and research sites, along with research dissemination opportunities. In Year 1, the project will conduct a series of development workshops for partners already in place and foster the formation of new partnership clusters according to shared interest, complementary resources and geographic proximity. The workshops will provide a forum for partners to learn about each other's visions, values, challenges, and existing structures, while working through theoretical and practical issues related to STEM engagement for young investigators. In Year 2, the project will target the implementation of the internship programs at various sites according to the agreed-upon goals, program model, research projects, recruitment and retention strategy, staff training, data collection, and evaluation plans. An external evaluator will address both the formative and summative evaluation of the effort directed toward examining the three project's hypotheses concerning the educational impacts of scientific research on student engagement, extent of the immersion, and overall effectiveness of the programs.
DATE:
-
TEAM MEMBERS:
Robert NewtonLuo Cassie XuMargie TurrinEinat LevMatthew Palmer
resourceprojectProfessional Development, Conferences, and Networks
The Museum of Science (MOS) will conduct a conference and associated activities to consider ways to foster the STEM workforce via both science research and science communications experiences for students at the high school level. The work will draw on and expand the scope in the USA of the NSF-funded National Living Laboratory Network which currently involves more than 350 institutions across 48 states and 21 countries. The National Living Laboratory initiative involves university researchers and museum professionals in co-implementing research and science communications activities in museum settings with the public, primarily families with young children. The research and communications focus is on cognitive science pertaining to the development of young children. While many scientists and museum professionals are interested in integrating high school research experiences into their practices, particularly for under-represented youth, existing infrastructure at museums and universities limits the quality of experiences and quantity of students that institutions can support. Current academic and museum members of the National Living Laboratory community have identified an opportunity to advance shared interests and knowledge in engaging youth in STEM by leveraging the Living Laboratory framework.
This project involves pre- and post- conference activities and will convene a group of science research and museum professionals at a workshop in Boston, MA to: 1) document current opportunities and challenges in engaging high-school aged youth in cognitive science research activities; 2) outline strategies to engage youth in research and science communication through Living Laboratory, with particular emphasis on cognitive sciences; and 3) create and disseminate a report on workshop outcomes through existing communication channels in both fields. The project includes pre-conference surveys of professionals about the topic and an evaluation of the project activities and outcomes. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Since its completion in 1937, the Golden Gate Bridge has become one of the world’s most recognized landmarks as both an iconic public works accomplishment and a popular tourist destination. In 2008, the National Science Foundation (NSF) awarded a $3 million grant to the Golden Gate Bridge Highway & Transportation District to leverage this status in developing informal education resources to interpret the science, engineering and history of the bridge. Through this initiative the Golden Gate Bridge would become a model for other public works venues for providing informal science education and
This summative evaluation report details the Broad Implementation of the Living Laboratory model--an initiative to promote partnership between museums and cognitive science researchers in order to promote professional learning and involve the public in scientific research. The evaluation investigated the extent of the dissemination effort’s depth, spread, sustainability, and shift in ownership, based on Coburn’s criteria for scale-up (2003). Evaluators collected data from surveys, interviews, focus groups, document review, and observations. Findings about depth suggest that adopters fully
The project will conduct a nation wide study to address three broad questions:
(1) How does the public view zoos and aquariums and how do these institutions affect STEM (Science Technology Engineering Mathematics) learning outside their walls?
(2) How do visitors experience zoos at different stages in their lives and how do zoo visits affect their knowledge and perspectives concerning environmental issues and conservation?
(3) What are the entry characteristics of visitors and how do those characteristics play out in behaviors during a visit?
The project is designed to advance understanding of how informal STEM learning emerges through the intersection of institutional pedagogy and learning goals and the characteristics of individuals and their social and cultural backgrounds. As the first institutional study that advances a field-wide research agenda, the project will map how to implement a national collaborative effort that can help refine program delivery and cooperation between zoos, aquariums and other STEM learning institutions.
The study will describe zoo and aquarium visitors based on a broad understanding of demographics, group, and individual perspectives to expand understanding of how these factors influence visitor learning and how they view the relevance of educational messages presented by zoos and aquariums. The project will result in reports, workshops and a handbook presenting findings of practical value for educators, a research platform and research tools, online discussion forums, and directions for future research. The project, led by New Knowledge Organization (NKO), will be carried out through the collaboration of NKO with other informal research organizations and the Association of Zoos and Aquariums (AZA) with its 230 informal science learning institutional members. This project is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.
Informal Science, Techology, Engineering, and Mathematics (STEM) institutions seek to contribute to a scientifically literate culture, which includes new and innovative learning opportunities, a diverse community of scientists and science educators, equitable treatment for all, and the development of a well-trained workforce. In order to achieve these goals, informal STEM institutions must provide learning experiences that are welcoming and productive for all learners. The iPAGE model is a comprehensive program that prepares teams within informal STEM institutions to work with their colleagues to make their institutions more inclusive learning environments in which to learn, engage in, and identify with STEM. The project incorporates learning modules, workshops, site visits, and institution-specific activities all geared to build knowledge, awareness, and capacity related to creating inclusive environments at informal STEM institutions. The core iPAGE model is based on the US Department of Agriculture's agricultural extension service. It includes a Knowledge-to-Action approach, in which individuals adapt what they learn to local contexts by assessing barriers to knowledge use, selecting and implementing interventions, evaluating outcomes, and sustaining ongoing efforts. Through cycles of design-based iteration, the project will improve its practice, learning modules, and theory of action. Through surveys, interviews, and case studies, the research team will document learning, barriers to implementation, and culture change as teams and institutions seek to become more welcoming, diverse, and inclusive institutions. This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. This Broad Implementation project would scale up the CryptoClub Project, an afterschool and online program designed to engage middle school youth in mathematics and cryptography. The project builds on previous successful work and evaluation that is ready for scale up using a train-the-trainer model implemented through a partnership with the National Girls Collaborative. The project will train 160 new CryptoClub leaders who will then train 800 new leaders at 20 hub sites reaching 9600 students. In addition, professional development modules and webinars will continue to refresh leader skills. Other project components include an online multiplayer cryptography game, weekly challenges through social media, and digital cryptology badges for students.
The research uses a think-aloud method with students as they actually attempt to solve the cryptology problems using mathematical thinking. Three think-aloud studies will be performed during the Project. The research team will code transcripts of the interviews for evidence of the mathematical thinking intended to be addressed by each activity, as well as capturing unexpected kinds of thinking. Tasks will also be rated according to the type of knowledge elicited. A written report will include statistical analyses of the think-aloud and interview responses, interpreted in light of the overall CryptoClub goals. The findings will contribute to both future research efforts and practice. The evaluation by EDC uses a quasi-experimental design, which assesses project outcomes for trainers, leaders, students, and Internet users. EDC will also investigate the fidelity to the CryptoClub model as it is scaled up. These studies have strong potential for informing numerous other projects that are at a stage where scale up is under consideration.
This project formed a partnership between a research team with experience in computer science (CS) education and learning sciences research and a newly fashioned practitioner team focused on building a grassroots, informal, volunteer group created to help women help themselves and others learn to write computer code. This research-practitioner partnership had a two-pronged focus, first on improving the program offered to learners through making adjustments based on research findings, and second on investigating the phenomenon of how women in the workforce informally learn CS skills that enable them to rewrite their career paths to contribute to what we know from research. The context of the study was situated in the virtual community that has formed around the phenomenally successful Salesforce Customer Relationship Management software platform.
This Exploratory Pathways project aimed to fill a gap in the research; we know little about the phenomenon of adult women in the workforce who are patching together resources to learn CS skills with a goal of job enhancement or job change. This project took an ethnographic approach to studying the informal learning (both through online, written resources and through sharing of knowledge with others) of the women involved in a 10-week, virtual Women’s Coaching and Learning group. The organization of this group consisted of learners—novice coders in the Apex language that is used on the Salesforce software platform, of coaches—more knowledgeable coders, and of a steering committee that ran the group and created the informal curriculum followed in the 10-week course.
Our overarching research question in this study was: In what ways are informal CS learning opportunities being used and created by adult women, what are their experiences with those opportunities, and how does this suggest ways to enhance those opportunities in the future to increase effectiveness in broadening access to and engagement in informal CS learning experiences for women?
We broke the question down into a number of sub questions, including:
Sociocultural context: What past gendered interactions do women report that discouraged (or encouraged) them from learning to code? What do interactions look like in female-only coaching and learning groups? In what ways does a coaching and learning group support persistence? What social barriers and supports outside the group affect persistence?
Personal context: What are the characteristics and backgrounds of female administrators who seek out resources to teach themselves to code? What are the motivations for these women to teach themselves to code? What motivates them to seek out and join all-women coding groups?
Physical context: How are women learning to code both through written resources and in virtual, informal coaching and learning classes? What are the conceptual barriers and supports that they encounter, and what works for women in these classes to overcome barriers? What conceptual barriers and supports affect persistence?
Persistence and identity: In what ways does participating in a learning group with female coaching motivate (or not) women to persist in learning to code? How do their goals or reasons for learning to code change through their participation? How does their identity as a “coder” change or shift as they participate?
Our findings for these subquestions are summarized in the “project products” linked to below.