Batu na 24 cikin 64· Ƙimar zamantakewa da auna tasiri
Kimanta Tasiri da Kimanta Tsari
Kimanta tasiri (impact evaluation) tana tambaya ko shiri ne ya haifar da sakamakon da aka nufa. Kimanta tsari (process evaluation) tana tambaya ko an isar da shirin kamar yadda aka tsara — ga wa, a wane ƙarfi, kuma da waɗanne cikas ko masu taimako a hanya. Waɗannan tambayoyi ne daban masu buƙatar hanyoyi daban, kuma Magenta Book na HM Treasury yana ɗaukar ba da umarnin duka biyun tare a matsayin al'ada ta ƙa'ida, domin raunin sakamakon tasiri ko wanda ba komai ba ba za a iya fassara shi shi kaɗai ba: ba zai iya gaya maka ko ka'idar shirin ce ta kasance kuskure ba, ko kuma ingantacciyar ka'ida ce kawai ba a taɓa isar da ita yadda ya kamata ba.
Dalilin da ya sa yake da muhimmanci
Kimantawar gwamnati sun sha gano rashin tasirin da ake iya aunawa daga shiri ba tare da kimanta tsari don bayyana dalili ba — yana barin masu ba da umarni ba su iya bambance "wannan ra'ayin ba ya aiki" (gazawar ka'ida) da "ba a taɓa gwada wannan ra'ayin yadda ya kamata ba" (gazawar aiwatarwa). Jagorar Medical Research Council kan kimanta tsarin shiga tsakani masu sarƙaƙiya, da aka wallafa a BMJ a 2015 kuma ake ambatonta sosai tare da Magenta Book, ta kafa amincin aiwatarwa (fidelity), ƙarfin ɗiban (dose), da isa (reach) a matsayin ainihin abubuwan da kimanta tsari dole ta auna. Ba da umarnin kimanta tasiri ba tare da kimanta tsari ba yana haɗarin watsi da ƙirar shiri mai kyau da gaske saboda an isar da shi ga rabin jama'ar da aka nufa a ɗan ƙaramin ƙarfin da aka nufa — kuskuren da mai gina tsarin yana da kyakkyawan matsayi don hanawa, domin amincin isarwa shi ne daidai abin da tsarin bayanan aiki ke iya ɗauka kusan a lokacin gaske.
Lissafi
Process evaluation asks:
- Was it delivered to the target population, at the planned dose/intensity?
- Did delivery match the logic model / theory of change design?
- What barriers or facilitators affected delivery?
Methods: fidelity checks against pre-specified thresholds, case studies, interviews,
administrative delivery data.
Impact evaluation asks:
- What changed, and how much of that change is attributable to the programme?
Methods: RCT, DiD, PSM, RDD — see impact-evaluation-methods — against a counterfactual.
Combined diagnosis:
No effect + high fidelity → theory failure: the model itself did not produce the outcome
No effect + low fidelity → implementation failure: the model was never properly tested
Effect found + high fidelity → replicate with confidence
Effect found + low fidelity → investigate further: the effect may be fragile or site-specific
Misali aiki
Ƙaramar hukuma (shirin renon yara): kimantawar tasiri ta amfani da bambanci-cikin-bambance-bambance ta gano canjin +maki 2 na kashi a ma'aunin jin daɗin yaro — ba mai muhimmancin ƙididdiga ba. Kimanta tsarin da aka gudanar tare ta gano shirin ya isa iyalai 210 kawai cikin 500 da aka nufa (isa 42%), kuma daga cikinsu, 95 ne kawai suka cika ƙofar amincin aiwatarwa da aka riga aka ƙayyade na 75%+ na zaman da aka halarta — 19% na ainihin isar da aka tsara. Ƙarshe: raunin sakamakon tasirin ya yi daidai da gazawar aiwatarwa, ba shaidar cewa ƙirar shirin ba ta aiki ba; martanin da ya dace shi ne gyara hanyar turawa da ta haifar da faɗuwar 58%, ba watsi da ƙirar shirin ba.
Ƙungiyar agaji (shirin ilimin dijital): kimantawar tasiri ta gano tasiri mai ƙarfi (+maki 18 na kashi a maki na kwarin gwiwa na dijital), kuma kimanta tsari da aka gudanar tare ta tabbatar da amincin aiwatarwa 92% ga tsarin karatun da aka tsara a duka wuraren isarwa 12. Idan aka haɗa, mai ba da kuɗi zai iya faɗaɗa shirin da kwarin gwiwa, domin an nuna tasirin yana dorewa a daidaitacce maimakon zama sakamakon wuri ɗaya mai kyau da ba a saba gani ba.
Alaƙa da injiniyancin manhaja
Bayanan kimanta tsari su ne daidai abin da tsarin isarwa ke da kyakkyawan matsayi don ɗauka: halarta idan aka kwatanta da shiri, ƙarfin zaman, da faɗuwa a kowane mataki na hanyar turawa ko rajista — daidai nazarin hanyar da injiniyoyi suka riga suka gina don fasalolin samfur, wanda aka yi amfani da shi ga bututun isar da shirin zamantakewa maimakon. Ciyar da ma'aunin amincin aiwatarwa da isa ga manajojin shiri kusan a lokacin gaske, maimakon jiran kimantawa ta ƙarshen tallafi, yana ba da damar gyara hanyar turawa da ta lalace a tsakiyar shirin maimakon gano ta bayan lokacin kuɗi ya ƙare. Duba hanyoyin kimanta tasiri don tsare-tsaren dalili da kimanta tsari ke haɗuwa da su, ka'idar canji da tsarin dabaru don ƙirar da kimanta tsari ke duba amincin aiwatarwa a kanta, da cimma fa'idodi don bin diddigin isarwa har zuwa sakamakon da aka yi alƙawari.
Tarkuna
- Ba da umarnin kimanta tasiri kaɗai. Sakamako maras komai ko mai rauni ba za a iya fassara shi a matsayin gazawar ka'ida ko gazawar aiwatarwa ba, wanda shi ne daidai bambancin da ke da muhimmanci wajen yanke abin da za a yi na gaba.
- Ɗaukar kimanta tsari a matsayin ƙari mai sauƙi. Tana buƙatar tsauri iri ɗaya da ma'auni na amincin aiwatarwa da aka riga aka ƙayyade kamar ƙirar tasiri, ko ta rushe zuwa labari ɗan kasuwa idan sakamako ya zo.
- Rikita "a kan lokaci da cikin kasafi" da "an isar kamar yadda aka tsara". Kimanta tsari tana duba amincin aiwatarwa ga ƙira — ƙarfi, ƙungiyar manufa, abun ciki — ba matsayin RAG na gudanar da aikin ba.
- Rashin yin rajista kafin lokaci na ƙofofin amincin aiwatarwa. Yanke shawara bayan lamari abin da ke ƙidayuwa a matsayin "isasshen ƙarfi" yana sa duk bayanin sakamakon tasiri mai ban takaici ya zama kamar uzuri bayan-lamari.
Majiyoyi
- HM Treasury, Magenta Book (2020). https://www.gov.uk/government/publications/the-magenta-book
- Moore G, et al., "Process evaluation of complex interventions: Medical Research Council guidance." BMJ 2015;350:h1258. https://www.bmj.com/content/350/bmj.h1258
- National Audit Office, programme evaluation reports. https://www.nao.org.uk/