This document contains the following Appendices that provide information for the I/CaLL Community Science Learning study.
Appendix A: StreamLines Events
Appendix B: StreamLines Events Survey Instrument
Appendix C: Art + Science Brainstorm Coding Themes
Appendix D: Art + Science Brainstorm Flyer
I/CaLL is a four-year project that explores art as conduits for informal science learning on a citywide scale. The project attempts to transform the city of Indianapolis into an informal science-learning museum through the use of sculpture, dance, music, and poetry as educational tools in creating awareness and understanding of the city’s waterways. Specifically, I/CaLL addresses five sites located near and around waterways in impoverished or underserved communities, where art interventions created by artists in collaboration with scientists address topics around water sustainability
DATE:
TEAM MEMBERS:
John FraserNezam ArdalanChristina Shane-Simpson
This set of appendices represent all research instruments related to study presented in the I/CaLL Art Experiences and Advancing Science Literacy report (NewKnowledge Publication #NSF.097.115.07).
Appendix A: Installation Site Intercept Interview Instrument
Appendix B: Artists-Scientists Walk & Talks Instrument
Appendix C: Post-Performance Event Survey Instrument
Note that researchers did not use an instrument for the fourth aspect of the study, the post-performance event reflection sessions. Instead, they allowed the discussions to be directed by the reflection participants.
DATE:
TEAM MEMBERS:
John FraserRebecca Joy NorlanderSophie SwansonNezam ArdalanKate FlinnerJoanna Laursen BruckerNicole LaMarca
A mixed-methods series of surveys were used to explore public literacy related to environmental science and sustainability in Indianapolis. Surveys also explored predictive variables including environmental identity, nature affinity, use of nature places as learning opportunities, and motivations for visiting nature spaces. An online, citywide consumer survey was distributed alongside a parallel identical survey of employees at a major science-based corporation to assess variation in knowledge, attitudes, and learning behaviors. This science-based corporation provides substantial support to
DATE:
TEAM MEMBERS:
John FraserSu-Jen RobertsNezam Ardalan
This report describes the results from an exploratory study of how artists approached collaboration with earth scientists to foster the public’s science learning and engagement with a city’s waterways. Data from phone interviews, surveys, and reflection on the artwork produced for this collaboration were compared with observations of roundtable discussions with community-based artists and scientists grappling with these ideas in a dialogue format.
The researchers found that personal connections with the waterway sites and professional interest in and experience with art–science
The Indianapolis / City as Living Laboratory (I/CaLL) project was a civic collaboration that used the city of Indianapolis as an informal science learning (ISL) environment. The 21 Urban Water Science Concepts Resource Handbook is designed for all people who are interested in exploring science topics related to urban waterways, particularly in Indianapolis. Specifically, educators, artists, and community members in Indianapolis may find this publication useful. With a small amount of extra research for examples in their area of interest, urban environmental educators across the country will
Supported by the National Science Foundation, the Global Soundscapes! Big Data, Big Screens, Open Ears project employs a variety of informal learning experiences to present the physics of sound and the new science of soundscape ecology. The interdisciplinary science of soundscape ecology analyzes sounds over time in different ecosystems around the world. The major components of the Global Soundscapes project are an educator-led interactive giant-screen theater show, group activities, and websites. All components are designed with both sighted and visually impaired students in mind. Multimedia
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
Many urban universities offer precollege STEM programs aimed at broadening participation in STEM. These programs are designed to increase students' scientific content knowledge and skills, promote STEM engagement, increase self-efficacy, and prepare underserved and underrepresented minority high school students for success in undergraduate programs. However, even after demonstrating significant knowledge gains and success in these programs, students are often unable to authenticate their knowledge gains to receive favorable consideration on college applications. In fact, there is currently no systematic credentialing mechanism to assess and validate the scientific rigor of and competency gains within STEM precollege programs for college admissions purposes. This NSF INCLUDES Design and Development Launch Pilot seeks to address this gap by developing and testing credentialing and badging processes for four STEM precollege programs. Working with College Admissions Officers and project partners, the University of Pittsburgh endeavors to employ a collaborative impact approach to build and document the collaborative infrastructure needed to support STEM precollege program authentication processes. This will seed the development of a networked improvement community that supports all aspects of the work from participant support to the collaborative impact to the greater network of urban education university ecosystems involved in the pilot.
Over a two-year period, this pilot will examine a mechanism to strengthen the STEM pathway for disadvantaged and underrepresented minority students to enter postsecondary STEM programs and eventually STEM careers. Building on two social innovation theories, the technical approach will focus on four specific aims: (1) create a community engagement framework to recruit underserved and underrepresented high school students to STEM precollege programs, (2) develop a STEM Success Matrix that identifies student competencies acquired in precollege programs that prepare students for collegiate success in STEM, (3) credential precollege programs using the STEM Success Matrix, and (4) develop a student badging system for precollege program participants using the STEM Success Matrix. Four University of Pittsburgh STEM precollege programs will serve as the context for development and testing with support from a range of partners representing the broader Pittsburgh STEM ecosystem. Approximately 300 high school students are expected to participate in the pilot, across the four precollege programs. Data will be collected via participant surveys and interviews. Formative and summative evaluations will be conducted by an experienced, external evaluator. Shareable metrics, tools, and processes will be developed and disseminated using various platforms and mechanisms. If successful, this pilot could be transformative - changing admissions considerations by credentialing STEM precollege programs and increasing student interest and motivation in STEM through student badging. It would also transform the STEM ecosystem of underserved and underrepresented minority students by creating an important STEM pathway from precollege to undergraduate admissions and ultimately, STEM Careers. This pilot could serve as a baseline for a more expansive alliance with other urban education ecosystems or assisting others interested in establishing their own collaborative infrastructure and networked improvement community model to achieve similar results.
DATE:
-
TEAM MEMBERS:
Alison Slinskey LeggJennifer IritiDavid BooneAlaine AllenLori Delale-O'Connor
resourceprojectProfessional Development, Conferences, and Networks
Aligning for Impact: Computer Science Pathways Across Contexts [CS-PAC] is an NSF INCLUDES Design and Development Launch Pilot. It broadens participation of students who are underrepresented in computer science by using the convening and policy-making power of the Georgia State Department of Education to coalesce school district leaders to implement K-12 computer science education. The project provides a national model for how to work toward systemic change. With the State Department of Education's coordination, several school districts will collaboratively seek improvements in their own student participation rates. The coordination of data reporting and analysis, resources, communications, and policy promote more equitable participation in computer science education. Research emerging from this project informs other states about how to collaboratively shape computer science education policy and policy implementation.
Using a Collective Impact approach to systemic change, the project creates sustainable institutional change at the community, state, and national levels. Qualitative and quantitative data provide descriptions about how to utilize alignment strategies within Collective Impact in three different contexts: rural, suburban, and urban. Outcomes utilize a regression discontinuity analysis to justify successful implementation as well as qualitative analysis of implementation efforts that were deemed most effective by all stakeholders. The project outputs directly affect over 88,000 students across five districts and indirectly affect over 1.7 million in Georgia alone. The culminating project goal is the development of a coherent framework for aligning K-12 computer science education pathways.
DATE:
-
TEAM MEMBERS:
Caitlin DooleyBryan CoxShawn Utley
resourceprojectProfessional Development and Workshops
This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie