The Program Evaluation Specialist contributes to the success of the Chicago Zoological Society’s mission and vision by performing program and exhibit evaluation of our award-winning conservation, education, and training programs and initiatives that take place both on site at Brookfield Zoo and off site in communities; conducts evaluation of CZS conservation education programs, such as educator professional development, King Conservation Science Scholars (our teen volunteer program), and community-based outreach programs for youth and families;  collects, analyzes, and interprets evaluation data using quantitative and qualitative techniques; conducts descriptive and inferential statistical analyses; and communicates program evaluation results.

Primary duties and responsibilities include the following: Designs and manages the implementation of evaluation plans for exhibits, education, and outreach programs, for programs onsite and offsite in various Chicagoland communities.

Develop and implement front-end, formative, summative, and process evaluation protocols and instruments, such as questionnaires and survey forms (online, electronic, and paper), interview protocols, focus group protocols, observation forms/protocols, and artifact review rubrics. 

Recruits evaluation and research participants using sampling techniques appropriate for the studies and follows informed consent procedures.  Collects, analyzes, and interprets front-end, formative, summative, and process evaluation data using quantitative, qualitative, and/or mixed methods techniques. Conducts descriptive and inferential statistical analyses.

Communicates program evaluation results through manager reports, quarterly and annual reports, presentations, and publications, as needed; disseminates key findings, including through journal publications and conference presentations.

Manages qualitative and quantitative datasets, including proper de-identification of data as needed. Manages filing systems for consent forms, participant key codes, and instruments. Develops evaluation and research protocol documents for the Institutional Review Board and the Chicago Public Schools Research Review Board that includes protocol descriptions, consent and assent forms, information sheets, and instruments.  Develops educational program logic models in collaboration with education and outreach program staff members.  Develops measures of success and writes evaluation plans for grant proposals originating from the Conservation, Education, and Training department. 

Assists with writing of grant narratives as needed and assists in the on-time submission of grant reports to funding agencies.  Other related duties as assigned.

Position requirements include a Master’s degree in social science or relevant science field such as psychology, sociology, education, biology and environment education, communications, audience research, anthropology, museum studies, biology, or environmental science.  In lieu of a Master’s degree, a Bachelor’s degree with one year of graduate school and three years of full-time relevant experience in a research or evaluation capacity in an informal learning institution, museum, science center, zoo, botanic garden, or related setting.

Two years of full-time educational program evaluation and/or educational program research experience in an informal learning institution, museum, science center, zoo, botanic garden, or related setting; experience creating and implementing program evaluation or research protocols, including development and usage of a variety of qualitative and quantitative methods such as questionnaires/survey forms, interview protocols, focus group protocols, observation forms/ protocols, and artifact review rubrics; experience collecting data through qualitative and quantitative techniques such as surveys (online, electronic, and paper), interviews, focus group, observations, and artifact collection; experience analyzing, and interpreting qualitative and/ or quantitative evaluation or research data; and preparing reports of findings; and experience in conducting evaluation or research under guidelines for the ethical treatment of human research participants. Current Certification of Training for the ethical treatment of human research participants from the National Institutes of Health Office of Extramural Research or Collaborative Institutional Training Initiative required within 30 days of hire. 

One year experience conducting educational program evaluation and/or educational program research in communities with underserved audiences and/or audiences under-represented in Science, Technology, Engineering, and Mathematics (STEM); experience recruiting research participants and obtaining informed consent; experience conducting descriptive and inferential statistical analyses; and experience managing qualitative and quantitative datasets.

Proficiency in conducting descriptive and inferential statistical analyses. Strong computer skills, proficient with Microsoft Excel, Outlook, Word, PowerPoint, Access and SPSS statistical software.   Ability to produce clear attractive graphics that convey information effectively required.

Strong qualitative and quantitative skills; creative problem-solving skills; good interpersonal skills; and exceptional organizational, time management, and communications skills are required.  English fluency at a full professional level required. Experience and/or ability to work and interact effectively with a diverse, multicultural audience. A valid driver’s license is required.  Illinois residents must possess a valid Illinois driver’s license or must obtain one within 90 days of hire.  A valid out-of-state driver’s license is required for out-of-state residents.

Preferred qualifications include three years of full-time educational program evaluation and/or educational program research experience in an informal learning institution, museum, science center, zoo, botanic garden, or related setting;

experience creating and implementing program evaluation or research protocols, including development and usage of a variety of qualitative and quantitative methods such as questionnaires/survey forms, interview protocols, focus group protocols, observation forms/ protocols, and artifact review rubrics; experience collecting data through qualitative and quantitative techniques such as surveys (online, electronic, and paper), interviews, focus group, observations, and artifact collection; and experience analyzing, and interpreting qualitative and/ or quantitative evaluation or research data; and preparing reports of findings.

Two years of experience conducting educational program evaluation and/or educational program research in communities with underserved audiences and/or audiences underrepresented in Science, Technology, Engineering, and Mathematics (STEM); experience recruiting research participants and obtaining informed consent; experience creating online surveys using SNAP or other similar software packages; experience conducting descriptive and inferential statistical analyses; and experience managing qualitative and quantitative datasets.

One year of experience in Culturally Responsive Evaluation practices.

Six months experience preparing and submitting evaluation or research protocols for Institutional Review Board review; experience preparing and submitting evaluation or research protocols for Chicago Public Schools Research Review Board review; and exhibit evaluation experience in an informal learning institution, museum, science center, zoo, botanic garden, or related setting.

Multilingual ability, Spanish fluency a plus.