Your Learning Partners
Our Approach
We see ourselves as your learning partners — We come to the table as thought partners to help you reflect and learn about your program, challenge, or project. We are thoughtful about who is included and how to support those involved. We seek to foster capacity building so that you develops the structures and skills you need to internalize ongoing evaluative functions and ongoing cycles of improvement.
We prioritize relationships — The better we know our partners’ needs, constraints, priorities, history, and hopes, the better we can direct our inquiry and surface useful insights. We strive to “do no harm” and uphold the highest standards of ethics while remaining open to generative challenges and dialogue.
the We focus on intended use and users — We design our evaluations by considering how our work will be used by specific users. This can include making real-time adjustments to respond to formative data and/or to changes in circumstance. We work to be flexible and responsive to the needs of our partners and we are committed to conducting work that has real-world value and use.
Social justice and equity are at the core of what we do — We integrate the principles of social justice and equity into our partnership building, evaluation, and design work. We work to learn about and employ people-centered, culturally responsive learning and evaluation tools, and we often partner with our colleagues on the Joy and Justice team to bring a highly skilled and racially diverse facilitation team to the work.
Experience
We have provided evaluation support across the state and nationally to programs, organizations, foundations, businesses, non-profits, and school districts for their work in early childhood, special education, vocational-technical education, community engagement and participatory grantmaking, positive behavioral intervention and supports, social-emotional learning, and curriculum assessment across multiple subject areas.
Specialized Evaluation Projects: Recent Specialized Evaluation projects have included evaluation for Recovery High Schools in Massachusetts, evaluation for Special Education for Students in Institutional Settings, the evaluation of virtual reality in secondary education, and literacy instructional practices.
Services
Broad Range of Skills and Methodologies: Our team’s depth and breadth of experience in a variety of skills and methods allows us to approach each evaluation in a way that is tailored to the specific needs of your project.
Designing and Implementing Tailored Evaluation Processes
- Designing and implementing evaluation processes that will determine program efficacy and evaluate outcomes, including survey development and administration, focus groups, interviews, and document review
- Conducting extensive literature reviews and landscape analyses; building evidence-based frameworks
Developing, Analyzing, and Presenting Data
- Developing data-informed recommendations
- Data presentations and reports that are designed for a broad audience and use visuals as well as texts to explain findings
- Social network analysis
- Quantitative and qualitative analyses of data generated by evaluation processes
Innovative Research Approaches
- Participatory and community-based approaches
- Curriculum evaluations and backwards planning
- Equity audits and inquiry cycles
- Working with partners to develop or further alignment with logic models and theories of action
Examples of Past Projects
The Hartford Foundation for Public Giving
The R&E department worked with the Hartford Foundation for Public Giving as they implemented their Greater Together Community Funds program, which involved giving funding to communities in their service area and supporting them in developing inclusive and participatory processes for awarding the funds to local nonprofits. The R&E department tracked community progress, attended meetings in selected communities, interviewed funding committees in each community, and consulted with the Hartford Foundation about the program’s progress, and provided memos, visualizations, and summary reports to the Hartford Foundation that summarized our learnings.
Winchester Public Schools
Commissioned by the Winchester Public Schools superintendent, the study was designed to answer the question: What is the current state of the district’s literacy program, and how do educators and parents experience it? This project team brought together CES specialists from Research and Evaluation, Joy and Justice, and multiple literacy experts.
The team began their data collection in early April. CES supported the district by creating a design team that consisted of parents, administrators, and educators. This group guided the process, offered essential insights regarding data collection, and helped interpret findings. We developed data collection methods that offered these stakeholders several ways to share their experience and perspectives on elementary literacy. The final findings were complex and nuanced, and highlighted a few critical issues for the district to address. The district convened several meetings to share the findings with their community members, and CES continues to work with the district on forward moving plans in response to the findings.
Smith College and Springfield Technical Community College
As external evaluators, we supported our partners at Smith College and Springfield Technical Community College to conduct formative and summative investigation on the effectiveness of an innovative narrative engineering curriculum for middle school learners. We used a mixed methods approach that included custom assessment instruments, interviews, focus groups, and direct observation in schools. Over the course of the four-year project, we supported the curriculum team by providing ongoing qualitative and quantitative data tailored to respond to the evolving needs of the project.
DESE Safe and Supportive Schools
Since fall of 2017, we have conducted an ongoing evaluation of the Massachusetts Department of Elementary and Secondary Education (DESE)’s Safe and Supportive Schools grantmaking program, which has included site visits, interviews, focus groups, consultation with DESE and the Safe and Supportive Schools Commission around the direction and goals of the program, and an annual summary report to DESE. We have worked with program implementers at DESE to help shape the program and improve its utility for districts.
Recent Learning Partners
- Holyoke Community College
- Manchester Early Learning Center
- Manchester Public Schools
- Massachusetts Department of Public Health
- Winchester Public Schools
- Meta
- Public Health Institute of Western Massachusetts
- The Lego Community Fund US
- The Imagine Institute
Research and Evaluation Resources
Here you will find a curated collection of useful and reliable resources of interest to our Research and Evaluation work.
Research and Evaluation Team
Kate Lytton, M.S.
Kate Lytton brings over 20 years of experience in social research, including needs assessment, strategic planning, evaluation design, survey research, and qualitative methods, to her program evaluation work at CES. She has designed and led studies of educator professional development, teacher preparation, child abuse prevention, interagency and community collaborations, and truancy prevention initiatives, among many other education, social service, and community health projects.
Kate brings a passion for participatory approaches that engage stakeholders in identifying and addressing questions that are critical for program improvement and that keep family and child needs at the center. She facilitates collaborative efforts that focus on collecting and using data to understand an educational challenge and to assess program effectiveness and outcomes. She has a BS in mathematics from Williams College and an MS in Science and Technology Studies from Rensselaer Polytechnic Institute.
Position: Director of Research and Evaluation
Email: klytton@collaborative.org
Catherine Brooks
Catherine Brooks has extensive experience with leading evaluation projects; designing, administering, and analyzing evaluation plans; conducting participant surveys, telephone interviews, and focus groups; analyzing primary and secondary data, and summarizing and presenting findings to internal and external stakeholders. She brings a strong background in synthesizing data into narratives that explicate lessons learned, with embedded graphs for visual effect. Catherine holds a B.A. in political science from Swarthmore College, and a Master of Public Policy degree from Duke University.
Position: Senior Research Evaluation Specialist
Email: cbrooks@collaborative.org
Rebecca Mazur Ph.D.
Rebecca Mazur, PhD is an educational researcher and evaluator, and a former high school librarian. She has designed and conducted studies investigating a variety of educational phenomena including system factors that support or constrain student learning outcomes, teacher support networks, instructional interventions for adolescent learners, and organizational collaboration. Her scholarship has been published in a number of respected peer-reviewed journals including Educational Administration Quarterly, Evaluation and Program Planning, and Educational Management Administration and Leadership.
Rebecca is part of a CES team that has completed extensive work to research emerging educational technologies including virtual reality and artificial intelligence, and provides consultation, professional development to K-12 educators, administrators, schools, and districts.
Position: Senior Evaluation Research Specialist
Email: rmazur@collaborative.org
Itza Martínez
Dr. Martínez is a Professional Services Learning Specialist at CES. She has a B.F.A. in Visual Arts Education from Manhattanville College, a master’s degree in teaching from Manhattanville College, and a doctoral degree in educational leadership with a graduate certificate in Teaching for Diversity and Social Justice. She has worked in K-12, graduate, and adult learning environments. Her work is focused on collaboration, leadership, critical dialogue, and social justice in curriculum development, design, and evaluation. She is a former middle and high school art teacher and administrator. Additionally, she has experience presenting at national conferences, and several publications, and conducted national and international work in English and Spanish.
Position: Professional Services Learning Specialist
Email: imartinez@collaborative.org
Sahara Pradhan M.Ed.
Sahara Pradhan is an experienced researcher and evaluator with a focus on qualitative methods and applied social research. She is currently completing a PhD at the College of Education at UMass-Amherst, and just completed a term as managing editor of Comparative Education Review. She is also pursuing a graduate certificate in feminist studies and draws on interdisciplinary theories and methodologies to inform her research.
Sahara is part of a CES team that has completed extensive work to research emerging educational technologies including virtual reality and artificial intelligence, and provides consultation, professional development to K-12 educators, administrators, schools, and districts.
Position: Research and Evaluation Specialist
Email: spradhan@collaborative.org
Louise Ebbeson
Louise Ebbeson conducts social science research, primarily in the fields of economic and social development. She holds three degrees, a MSc. in Gender and Development, a M.A. in International Administration and a B.A. in International Studies.Louise Ebbeson conducts social science research, primarily in the fields of economic and social development. She holds three degrees, a MSc. in Gender and Development, a M.A. in International Administration and a B.A. in International Studies.
Position: Research Associate
Email: lebbeson@collaborative.org