The following comments from Principal Investigators and Program Leaders describe how evaluation findings informed their research and implementation decisions.
Kristin Dana Professor of Electrical and Computer Engineering at Rutgers University
"I want to take a moment to give a heartfelt thank you for your work and dedication to SOCRATES in your role as external evaluator. Your feedback that pointed out our weaknesses and applauded our successes was tremendously valuable. You were truly a mentor to us all. I am very proud of our success in building this scientific community. It is now a gem with many different facets, as an interdisciplinary program should be. When we first began our journey in 2020, I didn't fully appreciate what the role of the external evaluator would be. I could not have done my job as a PI without your support as the evaluator, and I am very grateful. I think we are both most excited about the successes of our students. I do hope that we have the opportunity to work together again in the future."
Jeff Gray Distinguished Professor in Computer Science at the University of Alabama
"Haynie Research and Evaluation is a vital collaborator on our NSF CE21 grant in Alabama. Kathy and her colleagues have provided a level of detailed analysis and deep reporting of our project at a level that far exceeds any experience that I have had with previous evaluators. Her team has constant interaction with the participants in our project to the degree that many of our teachers view her as an integral part of our 'Alabama family'; yet, Kathy has maintained a level of objectivity that has provided us very useful feedback to help drive the evolution of our project each year."
Dan Garcia Teacher Professor, Electrical Engineering + Computer Science UC Berkeley
"I've worked with Kathy as the evaluator for four (two that I hired her directly) projects -- the initial AP CS Principles pilot, the phase II AP CS Principles pilot, and two of our NSF-funded PD projects for high school teachers. Kathy continues to impress me with her diligence, her expertise, and her ability to provide an outstanding evaluation from across the country. I would hire her again in an instant -- if you have a grant and are doing work related to computing education (specifically broadening participation), Kathy and her team are incredible!"
Jerry Gorham Vice President, Psychometrics at Ascend Learning
"I have known Kathleen Haynie for many years and worked with her both as a colleague and as a contracted educational research consultant. Kathy's work is very logically planned and articulated, comprehensive in scope, and in-depth at the critical points for decision-making. Her company has done an excellent job defining problems and proposing research solutions for those difficult problems. I can highly recommend her work as thorough, thoughtful, and an excellent value in the areas of educational consulting, research, and program evaluation."
Anders Hedberg President, Hedberg Consulting, LLC
"While responsible for education philanthropy at Bristol-Myers Squibb, I contracted Kathleen Haynie as an independent evaluator of an in-house developed Kindergarten program for stimulation of children's interest in science. KH performed a highly detailed and carefully analyzed data collection, specifically focused on outcomes and opportunities for scale-up. Her company developed a strong professional relationship both with the evaluation subjects (day-care centers) and the client (BMS). The evaluation product was delivered on-time and the report significantly contributed to the value of the company's (BMS') corporate social responsibility program."
Kristin Dana Professor of Electrical and Computer Engineering at Rutgers University
"I want to take a moment to give a heartfelt thank you for your work and dedication to SOCRATES in your role as external evaluator. Your feedback that pointed out our weaknesses and applauded our successes was tremendously valuable. You were truly a mentor to us all. I am very proud of our success in building this scientific community. It is now a gem with many different facets, as an interdisciplinary program should be. When we first began our journey in 2020, I didn't fully appreciate what the role of the external evaluator would be. I could not have done my job as a PI without your support as the evaluator, and I am very grateful. I think we are both most excited about the successes of our students. I do hope that we have the opportunity to work together again in the future."
Jeff Gray Distinguished Professor in Computer Science at the University of Alabama
"Haynie Research and Evaluation is a vital collaborator on our NSF CE21 grant in Alabama. Kathy and her colleagues have provided a level of detailed analysis and deep reporting of our project at a level that far exceeds any experience that I have had with previous evaluators. Her team has constant interaction with the participants in our project to the degree that many of our teachers view her as an integral part of our 'Alabama family'; yet, Kathy has maintained a level of objectivity that has provided us very useful feedback to help drive the evolution of our project each year."
Dan Garcia Teacher Professor, Electrical Engineering + Computer Science UC Berkeley
"I've worked with Kathy as the evaluator for four (two that I hired her directly) projects -- the initial AP CS Principles pilot, the phase II AP CS Principles pilot, and two of our NSF-funded PD projects for high school teachers. Kathy continues to impress me with her diligence, her expertise, and her ability to provide an outstanding evaluation from across the country. I would hire her again in an instant -- if you have a grant and are doing work related to computing education (specifically broadening participation), Kathy and her team are incredible!"
Jerry Gorham Vice President, Psychometrics at Ascend Learning
"I have known Kathleen Haynie for many years and worked with her both as a colleague and as a contracted educational research consultant. Kathy's work is very logically planned and articulated, comprehensive in scope, and in-depth at the critical points for decision-making. Her company has done an excellent job defining problems and proposing research solutions for those difficult problems. I can highly recommend her work as thorough, thoughtful, and an excellent value in the areas of educational consulting, research, and program evaluation."
Anders Hedberg President, Hedberg Consulting, LLC
"While responsible for education philanthropy at Bristol-Myers Squibb, I contracted Kathleen Haynie as an independent evaluator of an in-house developed Kindergarten program for stimulation of children's interest in science. KH performed a highly detailed and carefully analyzed data collection, specifically focused on outcomes and opportunities for scale-up. Her company developed a strong professional relationship both with the evaluation subjects (day-care centers) and the client (BMS). The evaluation product was delivered on-time and the report significantly contributed to the value of the company's (BMS') corporate social responsibility program."
