Annual Report 2020-2021: Juvenile Case Management System Definitions and Data Fidelity Project
Implementation research is “the scientific study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice, and, hence, to improve the quality and effectiveness” of programs (Eccles & Mittman, 2006). Most implementation science is based on principles of implementing a program’s activities with fidelity; however, the implementation fidelity framework and resources can also be utilized to develop tools and a process to evaluate CBAfunded programs’ adherence to common definitions and data entry practices. The quality of the Evidence-based Nebraska juvenile justice program evaluations rely on the assumption that program staff are utilizing common definitions when gathering and entering data, and that the data entered is accurate. All data are subject to quality limitations such as missing values, bias, measurement error, and human errors in data entry and computation. During site visits to assist programs with data collection and entry, the Juvenile Justice Institute staff have observed instances where programs have misunderstood common definitions or are using their own definitions when entering data into the Juvenile Case Management System (JCMS). Furthermore, while generating reports we have seen large amounts of missing data. To this end, we have taken several measures to ensure data is accurate and employed methods to improve the quality of the data. Data quality assessments should be undertaken to understand how much confidence can be placed in the data that are used to assess program performance and to understand the relative strengths and weaknesses of the data (WHO, 2017a). This project evaluates the fidelity with which CBA-funded programs are adhering to EB-Nebraska common definitions (see jjinebraska.org and definitions within each program type) and data entry recommendations.
Wylie, Lindsey; Wasserburger, Erin; Hobbs, Anne M.; and Juvenile Justice Institute, University of Nebraska at Omaha, "Annual Report 2020-2021: Juvenile Case Management System Definitions and Data Fidelity Project" (2021). Reports. 16.