In June 2006, PEPFAR/South Africa commissioned Khulisa to conduct performance monitoring and evaluation services specifically to determine if the data submitted by PEPFAR partners meets minimum acceptable data quality standards.

The Khulisa methodology for conducting Data Quality Assessments is designed to triangulate the (1) ISO 9001 standards for internal quality audits and the (2) data quality criteria established by the client, with (3) the data management processes and the data management system of the organization being audited.  The PEPFAR/South Africa DQAs are structured to be a learning process (rather than a strict performance audit) for both the selected PEPFAR partners as well as the USG – with a goal to building M&E capacity and systems among PEPFAR partner organizations.

Khulisa’s DQA process involves 3 phases:  (1) a self-assessment phase, (2) an on-site audit phase, and a (3) follow-up phase for those organizations that receive compliance notes during Phase 2.  The combination of the three phases allows Khulisa to:

  • Review Data Quality at a Process Level:  involving the evaluation of data validity, reliability, integrity, precision and timeliness at each stage of the data management systems.  This also involves a review of the data quality systems and the ability of the reporting party to create and maintain appropriate audit trails.
  • Determine the Level of Risk to Data Quality:  so that appropriate controls can be implemented to minimize the impact of the risk.

Khulisa also delivers a 1-day Data Quality training to PEPFAR partners as part of a larger M&E training workshop that is held each quarter for new PEPFAR partners.