HOLO. is a research hub that connects experts with knowledge and experience about impact assessment. HOLO.
- is a professional community that was established by social scientists in order to bridge the gap between research and practice.
- is a network that ensures a place for everybody who is interested in the social, economic or environmental impacts of various initiatives. We work together with economists, statisticians, experts of social policy, social workers, organisational and community developers, social workers, mediators and psychologists.
- is an interface where customers can meet consultants and research experts.
- The Artemisszio Foundation initiated a training program aimed at developing intercultural competencies of health workers. Our research program analysed the main structural problems of the Hungarian health care system and the challenges health workers face. Taking the findings of the research program into consideration, the Foundation was able to set up a training curriculum that fully met the needs of the target group.
- The Utopia Civic Association wished to tailor messages about equal opportunities to specific target groups. Slogans of a nationwide campaign were tested with focus groups. The results supported the Association to fine-tune the slogans and taglines and to initiate a successful cross-media campaign.
- Our consultants conducted a research program that aimed at analysing the living conditions of young drug users and at-risk inhabitants of the Magdolna District (Budapest) youth. The results supported our costumer, the Megálló Group, to gain reliable information about specific subcultures and thus provide needs-responsive services.
- Since 2013, the Community Foundation Support Programme’s (CFSP) mission is to promote the concept of community foundations in Hungary, to inspire a national community foundation movement and to provide support in developing community foundations across Hungary. As of 2017, three foundations graduated from the CFSP’s set-up process. Achievements of this period was evaluated by HOLO. in spring 2017. The research report is available here.
- HOLO. was responsible for the mid-term evaluation of the OSIFE-funded program that seeks to build constituency of NGOs in Hungary. The empirical exploration, that was supported by qualitative and quantitative research methods, identified the strengths and weaknesses of the program. Consultants of HOLO. were responsible for the preparation and implementation of the field work and for high level recommendations resulting from the findings.
- We worked for the Foresee Research Group within the framework of the ALTERNATIVE program. The exploration aimed at identifying the factors that hinder and support the establishment of trust-based relationship between the mediators and those who are involved in specific conflicts. The program was implemented in close cooperation with universities and research institutions from Belgium, Norway, Serbia and the United Kingdom.
- The Speak Out Association initiated the first Hungarian prison radio, Radio B. The aim of the radio is to provide information and a communication forum for prisoners that helps them to deal with conflicts, decrease tension and prepare inmates reintegrate into society after release. Within the framework of the assessment, we measured the level of radio-listening, gathered feedback from the audience of the radio and evaluated the outreach plan of the Association.
- We evaluated the Lakmusz program that supported young orphans leaving the state-care system by mentoring and housing services in the cities of Pécs and Komló. We successfully identified the factors that hindered the achievement of the program’s initial goals and the way the cooperation between the various actors of the initiative should be developed.
- On behalf of the Decade of Roma Integration Program Secretariat, we gathered and analysed information about grass-root initiatives that aimed at strengthening the integration of the Roma people in the field of education, work, housing and health. Based on the results, effective and transparent good practices from Hungary were selected.
Educational and state-run institutions
- A formative evaluation was conducted before the implementation of the „Promoting early childhood education” program (that was financed by the European Social Fund). Due to the evaluation, we gained insight about the institutions and services that are available for the parents of 0-3 years children. The findings supported the development of the care-system.
- Within the framework of the COREPOL program, we collected information about the conflicts that arise between the Roma people and police officers and about their possible solutions. The two-year-long project, that was implemented with German and Austrian universities and research institutions, contributed to the development of the curriculum of the Faculty of Law Enforcement at the National University of Public Service.
- We contributed to the EFOP 1.2.4 coded program (“Improving the National Crisis Telephone Information Service”) by analysing the strengths and weaknesses of the Hungarian child-protection system. The findings supported the development of the training-curriculum that are available for the members of the care-system.
- We provided an overall view about the structure and operation of the Hungarian National Talent Program by conducting a qualitative and quantitative based evaluation. The exploration was entrusted by the National Institute for Family, Youth and Population Policy. The findings assisted in the development and modification of the program.
- On behalf of the Commissioner for Educational Rights, we examined whether universities perform their legal obligations regarding the integration of disabled students. The findings and our recommendations contributed to changes in legalisation.
- We were responsible for the interim evaluation of the Asylum, Migration and Integration Fund for Hungary. During the assessment, not project but program-level evaluation was realized. The research report analyses the social, political and legal context and discusses the efficiency, relevance, coherence, complementarity and sustainability of the Fund.
- On behalf of the Ministry of Interior, we evaluated the results and impacts of actions co-financed by the European Refugee Fund and European Integration Fund concerning the period 2011 to 2013. The findings supported our entruster in developing its management procedures and to bring process simplifications for the beneficiaries of the Fund.
- Our colleagues supported the evaluation of the TÁMOP 5.6.3 coded program (“Multi-stage prisoner re-integration in communities and in the labour force market, including intensive aftercare”).
- We evaluated the IHM-ITP-12 program that supported the IT development of 120 Minority Self-Governments. Due to the evaluation, we gained insight about the efficiency, weaknesses and strengths of the program.
- On behalf of the Ministry of Interior, members of HOLO. supported the evaluation of the „Multilevel community policing network for the cooperation based crime prevention” program that was financed by the Swiss Contribution. We conducted two surveys before (n=2000) and after (n=2000) the implementation in order to measure the progress that was achieved by the program.
- Several educational programs (e.g. TÁMOP 5.3.8, TÁMOP 5.3.10) were monitored at different times during their implementation phases. These long-term research and data-collection processes aimed at identifying the needs of the target group, at evaluating the services and the results that were achieved by the program.
Members of HOLO. supported the impact assessment of for-profit organisations as well. In the past few years, we have cooperated with Alstom Hungary, Café PR, Coca-Cola Hungary, dm-drogierie markt, Dreher Breweries, E.ON Hungary, Magyar Posta, OTP Bank, Raiffeisen Bank, SPAR Hungary, Videoton.
WHAT IS IMPACT ASSESSMENT?
Impact assessment can be applied
- before the implementation of projects; when we usually aim at identifying the characteristics of the target group in order to set up a needs-responsive and effective program.
- during the implementation of projects; when we are generally interested to see whether the program is indeed carried out according to the original plans. Taking the findings into consideration, priorities/activities/timelines could be changed for the sake of achieving the initial goals of the program.
- after the implementation of projects; when we collect information about the efficiency, effectiveness, experiences and impacts of the program.
Not only projects but organisations as whole entities themselves can be in the focal point of impact assessment. In this case, we primarily aim at answering the questions: what are the societal impacts of the organisation? How successful are they in achieving their defined goals? What are the changes that have been made by the organisation? In order to answer these questions, information about the organisation (e.g. strategy, missions, goals, activities, stakeholders etc.) are analysed, appropriate research methods are applied and data is collected in order to provide evidence-based feedback.
About impact assessment, free workshops are held for NGOs in close cooperation with Mozaik Hub. About the dates of the next workshops information is available here.
WHY IS IT NECESSARY?
Due to impact assessment
- evidence-based feedback is provided to the management of entities about the work and impact of the organisation,
- it is ensured that change-efforts produce successful results in meeting sustainability goals,
- evidence based information support the setting up of cost-efficient and effective interventions/services
- the outcomes and impacts of the organisations are proved by data, thereby the results can be easily communicated within the organisation and to stakeholders,
- trust and engagement of the colleagues, donors and partners is strengthened,
- the credibility of the organisation increases.
WHO CAN PROFIT FROM IMPACT ASSESSMENT?
- if you work at an NGO and you are interested in the social impact of the organisation and the changes that have been achieved by your projects.
- if you are a responsible person at a state-run institution and would like to make an evidence-based decision before the development/modification of institutions/legalisation.
- if you are a manager at a for-profit organisation and would like to conduct concept tests, stakeholder-mapping or strategy development.
We aim at supporting our partners in
- needs assessment,
- planning and implementing data collection,
- analysis of the findings,
Primarily independent experts has joined HOLO. but universities, research institutions, NGOs and colleagues of market research companies also support our work. Gabor Hera is the person responsible for the coordination and implementation of impact assessments.
You can get in contact with HOLO. by filling out this form. Please, do not hesitate to write us if you have any questions!
Email address (required):