In Italy, in the past few years, the approach to evaluating the impact of initiatives carried out in the socio-educational context has not been adequately accompanied by an in-depth reflection on the meaning of this practice, its supposedly innovative nature and its implications in relation to the elements it is applied to. With the aim of contributing to the ongoing Italian debate on the topic, this paper presents the results of a critical analysis of the main definitions concerning the practice of evaluating impact that are to be found in the international landscape. Behind each definition - impact evaluation, assessment and measurement – different interpretations emerge on how impact can be understood (with regard to merit) and measured (with regard to method), which in turn refer to different causal models, temporal perspectives and work processes. This heterogeneity, which not only concerns the linguistic aspect but also to the very idea and meaning of “evaluating impact”, is lost with the use in the Italian context of the umbrella term “valutazione di impatto”, under which all three approaches are included. In the face of the rush to impact evaluation prompted also by external and contingent factors, the invitation is to stop and reflect on what kind of impact assessment is really intended to be carried out, thinking about the “why” and not just the “how”.
In Italia, negli ultimi anni, l’orientamento al fare valutazione di impatto nel contesto socio-educativo non è stato adeguatamente accompagnato da una riflessione approfondita sul senso di questa pratica valutativa, sul suo presunto carattere innovativo, sulle sue implicazioni in relazione agli oggetti cui è riferita. Con l’obiettivo di alimentare il dibattito in corso nel nostro Paese e di fornire un contributo utile anche a quanti operano sul campo il testo restituisce gli esiti della disamina critica di alcune principali definizioni di valutazione di impatto rintracciate in ambito internazionale. Dietro alle diverse espressioni – impact evaluation, assessment e measurement – emergono modi diversi di intendere l’impatto (nel merito) e di misurarlo (nel metodo), i quali rimandano a differenti modelli causali, prospettive temporali, funzioni e processi di lavoro. Tale eterogeneità che non riguarda perciò soltanto l’aspetto linguistico ma l’idea stessa di valutazione di impatto e il senso ad essa attribuito “si perde” nel termine ombrello “valutazione di impatto” in uso nel contesto italiano generando talvolta confusione. Di fronte alla corsa alla valutazione di impatto sollecitata anche da fattori esterni e contingenti l’invito è a fermarsi e riflettere su quale valutazione di impatto si intenda davvero portare avanti ragionando sul “perché” e non soltanto sul “come”.
Orizio, E., Montalbetti, K., La valutazione di impatto nel contesto socio-educativo: un ibrido tra evaluation, assessment e measurement?, <<RIV. RASSEGNA ITALIANA DI VALUTAZIONE>>, 2020; (77): 33-49. [doi:10.3280/RIV2020-077003] [https://hdl.handle.net/10807/196002]
La valutazione di impatto nel contesto socio-educativo: un ibrido tra evaluation, assessment e measurement?
Orizio, Enrico
;Montalbetti, Katia
2020
Abstract
In Italy, in the past few years, the approach to evaluating the impact of initiatives carried out in the socio-educational context has not been adequately accompanied by an in-depth reflection on the meaning of this practice, its supposedly innovative nature and its implications in relation to the elements it is applied to. With the aim of contributing to the ongoing Italian debate on the topic, this paper presents the results of a critical analysis of the main definitions concerning the practice of evaluating impact that are to be found in the international landscape. Behind each definition - impact evaluation, assessment and measurement – different interpretations emerge on how impact can be understood (with regard to merit) and measured (with regard to method), which in turn refer to different causal models, temporal perspectives and work processes. This heterogeneity, which not only concerns the linguistic aspect but also to the very idea and meaning of “evaluating impact”, is lost with the use in the Italian context of the umbrella term “valutazione di impatto”, under which all three approaches are included. In the face of the rush to impact evaluation prompted also by external and contingent factors, the invitation is to stop and reflect on what kind of impact assessment is really intended to be carried out, thinking about the “why” and not just the “how”.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.