The evaluation was undertaken from January 2007 until June 2008. The methodology used in the evaluation was user-focused, responsive and collaborative. Feedback was obtained from participants and key departmental staff on evaluation data, case studies, and draft checklists, guidelines and reports to increase the trustworthiness and accuracy of the
analysis and the usefulness of the guidelines to NGOs and others.
Multiple methods were used in the evaluation including:
- Literature searches and reviews.
- Participation in teleconferences with DoC staff and meetings with DoC staff and consortium members at the pilot sites.
- Analysis of information from group discussions and interviews with participants in the pilot sites.
- Analysis of questionnaire responses from DoC staff and consortium members.
- Examining the business cases for the three pilot MTSCs, their draft governance documents, and other materials.
- Preparing detailed case studies of the three pilot sites.
- Following the introduction of new Right to Information and Information Privacy legislation by the Queensland Government in June 2009, written approval to make these case studies publicly available was sought and obtained from a representative of each of the ten agencies involved in the Pilot Project in August 2009.
Further details of the evaluation methods and number of consortia members and DoC staff who completed questionnaires and participated in group discussions in each location are provided in Appendix A. A full list of the organisations and committees which contributed to the evaluation is provided in Appendix B.
The evaluation process was guided by the Australasian Evaluation Society’s Guidelines for the Ethical Conduct of Evaluations and the following principles:
- Adopting an inclusive, responsive, collaborative and flexible approach.
- Respecting the rights, privacy and sensitivity of those affected by or taking part in the evaluation.
- Respecting the confidentiality of participants in all documents and reports, unless participants agreed otherwise. Using open, ethical and transparent methods, with the consent of all participants.
- Encouraging participants to see the evaluation as a learning process and to critically and openly reflect on their experiences.
- Feeding back learnings and results from the evaluation to participants for validation, shared understanding, and information.
See videos from StudioQ related to this topic