Evaluation United

⛶ Full screen

Welcome to the Evaluation United project page!

We are Bilal, Charlotte, Feras, Irina, Marcia, and Michaela and we dug deep into challenge #7


07.07.2020 It's the first day, after the introductory Design Thinking class, the group members come together and discuss their respective backgrounds:

  • Marcia DE JESUS is an emerging evaluator working in the USA
  • Charlotte d'ELLOY implements M&E migration projects from her duty station in Austria
  • Irina LONEAN focuses on youth policy evaluation and is based in Romania
  • Feras KHAIR is an M&E professional currently active in Jordan
  • Bilal QURESHI works on humanitarian programms and M&E in Pakistan 
  • Michaela RAAB is an evaluator working from Germany

08.07.2020 The team is organising organically around interests and availabilities: we adopted the name "Evaluation united" to replace "2_group_7_i" and shared our group picture. 

We worked on figuring out our commonalities, for example, why have we all chosen challenge #7? Because those who commission evaluations want to know whether their resources have been put to the best possible use, and evaluators need a viable method to come up with useful information that also helps to make sure no-one is left behind.

-:- DRUMROLLS, please: we have a challenge definition -:-

How can we assess the efficiency of interventions in order to strengthen social cohesion in a migrant context?

09.07.2020 Off to conduct some interviews! We are in contact with civil servants from international organisations such as UNICEF, or national agencies like DFID, but also reached out to freelancers and consultants. Check out our documents in the resources!

10.07.2020 Brain dumps are being shared and three ideas are taking shape. Ideally, we would have more time to refine but those are not the rules of the hackathon! 

-:- Time for a TEASER -:-

It's either going to be a cost-utility tool, a mathematical formula, or a set of warm data indicators.

11.07.2020 After a team poll, we are moving towards the loop of prototyping-testing-prototyping. What do we propose? 

A roadmap for a participatory process that evaluators can follow to generate decent quality findings – numbers and compelling case stories – for funders and programme managers, in an iterative, short process that highlights the perspectives of those most in need of social cohesion. We’re inspired by existing approaches and methods – realist evaluation (that emphasize the importance of understanding how interventions work in their specific context), participatory approaches to evaluation and existing methods to assess value for money.

-:- New HACKS up our sleeves -:-

  • How to dial a call in Slack (yes, small beginnings)  
  • How to brainstorm on "Murals" 
  • How to poll via Kyber
  • How to record on "Ice Cream Screen recorder"
  • How to be patient with one another and help each other catch-up 

-:- Competition beware, we have a LOGO now! -:-


12.07.2020 Frantically testing our prototype in conversation with a range of experts and matching it against the IPDET assessment criteria.

So you're wondering what makes our roadmap innovative?
It makes the social utility more apparent, focussing on those whose voices tend to be ignored – the most marginalised members of migrant communities (and possibly of their host communities). This is very much inspired by the central Agenda 2030 principle “leave no-one behind”. Also, we are looking into reversing the more common order by gathering data on the utility of the intervention before looking into the cost side. This is to make sure that our findings on resource allocation are related to “real” utility in the local context.

13.07.2020 It's shooting day !!! We are recording our pitch. The real question behind the scenes is: who should do the voice over? Which accent are we going to go for since no-one is a native speaker XD !


-:- ET VOILA -:-

Our pitch is uploaded, we hope you like it.

We think the added benefits and scope of the impact of our roadmap are definitely a major aspect: part of the process we propose is to understand the dimensions of social cohesion as perceived by those who are most in need of social cohesions. That is, the first set of focus groups is also likely to generate important data for assessing the social relevance and effectiveness of the intervention. 
Our roadmap can also be applied in evaluations of other processes that aim for social cohesion and/or social inclusion of marginalised groups. 
Last but not least, after applying the proposed process to a wide range of contexts, it may be possible to tease out common patterns – e.g. dimensions of social cohesion that tend to rank highly in very different contexts, or even types of activities that tend to yield high utility at relatively low costs, to build the knowledge base in this field.

-:- OVER AND OUT -:-

This is it for us. T.H.A.N.K.S. for this great opportunity IPDET. We are going for coffee and in a perfect world for a day at the spa to release all the adrenaline you've gifted us with. See you next time around!

Launched at Evaluation Hackathon by

belalqureshy charlotte_delloy irina_lonean marciacj feras_khair michaela_raab binta_moustapha

Maintainer hackathons-ftw

Updated 13.07.2020 09:32

  • charlotte_delloy / update / 13.07.2020 09:32
  • charlotte_delloy / update / 13.07.2020 09:31
  • charlotte_delloy / update / 13.07.2020 09:29
  • charlotte_delloy / update / 13.07.2020 07:51
  • charlotte_delloy / update / 13.07.2020 07:50

Measuring efficiency

Measuring efficiency in evaluations

Evaluating efficiency is weaker and not substantive enough compared to assessing effectiveness, sustainability and relevance in most project, programme and policy evaluations. What are ways of assessing efficiencies?

All attendees, sponsors, partners, volunteers and staff at our hackathon are required to agree with our Code of Conduct. Organisers will enforce this code throughout the event. We expect cooperation from all participants to ensure a safe environment for everybody.

Creative Commons LicenceThe contents of this website, unless otherwise stated, are licensed under a Creative Commons Attribution 4.0 International License.