Developing Feedback Surveys for the Estonian Academy of Security Sciences

Background

The Estonian Academy of Security Sciences needs to update its principles and procedures for collecting and considering feedback; the current process does not support the goal of improving the quality of education as desired. There are too many feedback surveys, they are conducted in different environments, and the analysis of the results is not consistent or evidence-based.

Objective

The goal is to develop a comprehensive feedback system and update the feedback surveys aimed at learners. The results of the work serve as the basis for the development and implementation of a new feedback collection and evaluation procedure for the Estonian Academy of Security Sciences.

Methodology

To develop the solution, a business analysis will be conducted, including interviews. Subsequently, prototypes of questionnaires will be developed, followed by the methodology for surveys, including a process description, research calendar, analysis methodology, technical implementation of data processing, and visualization solution.

Benefits

The developed solution supports the goal of improving the quality of education, being part of a broader internal and external assessment system. It will be web-based (secure and user-friendly), allowing clear visualization of results and their dissemination to different target groups. Participation in surveys will be limited to students of the Estonian Academy of Security Sciences.

Project contracting institution: Estonian Academy of Security Sciences
Project implementer: LevelLab
Duration: 12/2023 ‍– 03
/2024

Developing Feedback Surveys for the Estonian Academy of Security Sciences

Background

The Estonian Academy of Security Sciences needs to update its principles and procedures for collecting and considering feedback; the current process does not support the goal of improving the quality of education as desired. There are too many feedback surveys, they are conducted in different environments, and the analysis of the results is not consistent or evidence-based.

Objective

The goal is to develop a comprehensive feedback system and update the feedback surveys aimed at learners. The results of the work serve as the basis for the development and implementation of a new feedback collection and evaluation procedure for the Estonian Academy of Security Sciences.

Methodology

To develop the solution, a business analysis will be conducted, including interviews. Subsequently, prototypes of questionnaires will be developed, followed by the methodology for surveys, including a process description, research calendar, analysis methodology, technical implementation of data processing, and visualization solution.

Benefits

The developed solution supports the goal of improving the quality of education, being part of a broader internal and external assessment system. It will be web-based (secure and user-friendly), allowing clear visualization of results and their dissemination to different target groups. Participation in surveys will be limited to students of the Estonian Academy of Security Sciences.

Project contracting institution: Estonian Academy of Security Sciences
Project implementer: LevelLab
Duration: 12/2023 ‍– 03
/2024

The processing tool for admission statistics at the Estonian Academy of Security Sciences

Background

The Estonian Academy of Security Sciences wanted to implement an automated tool for processing admission statistics queries in the SAIS information system, which simplifies the processing of admission statistics, presenting them as compact data tables and visualizations.

Objective

The aim of the proposed solution was to create an Excel workbook, which takes as input structured data tables (for example, .csv extracts from the SAIS admission information system) or PowerQuery data queries from SAIS.

Methodology

The structure and functionality of the solution were designed during the requirements gathering process, which involved document analysis and interviews with representatives from the Estonian Academy of Security Sciences. During the interviews, the structure of the output worksheets, the formatting of tables, charts, and diagrams, as well as other necessary information, were clarified.

Benefits

The tool helps reduce the time spent on compiling and analyzing admission statistics at the Estonian Academy of Security Sciences, thereby ensuring a faster and more efficient process.

Project contracting institution: Estonian Academy of Security Sciences
Project implementer: LevelLab
Duration: 10/2023 ‍– 12
/2023

Analysis of the Process of Reorganization of Ministries

Background

The coalition agreement signed in April 2023 carried out extensive reorganization of ministries, affecting a total of five ministries and their subordinate institutions. The aim was to better align the thematic areas of ministries with government priorities and to increase coherence between different policy domains. While the changes have not yet come into effect from the perspective of the state budget, most of the practical steps have been taken. As a result of the process, it has become clear that implementing changes in some areas was more challenging. Therefore, it is important to analyze the lessons learned from this process and how to implement such large-scale changes more efficiently in the future while emphasizing openness, transparency, and knowledge-based decision-making.

Objective

The aim of the study was to analyze the process of reorganization of ministries that took place in 2023 and to highlight its lessons learned.

Methodology

During the study, individual interviews, focus group interviews, and a questionnaire survey were conducted. Interviews   were conducted with the chancellors and deputy chancellors of related ministries, as well as with chancellors and deputy chancellors who were required to leave their positions as a result of the reorganization. Also with the heads of agencies within the ministries’ areas of governance. Seven focus group interviews were conducted, addressing topics according to the affected areas of reorganization, and one focus group interview was conducted with various government agencies and departments that centrally supported the reorganization process. The aim of the survey was to identify the challenges related to the reorganization, officials’ opinions on opportunities to improve the process and prevent future obstacles, and to explore the impact of the reorganization on daily operations, inter-ministerial cooperation, and resulting changes.

Benefits

The study helped identify the obstacles and success stories in implementing the reorganization, and proposals will be made for conducting similar processes in the future. In addition, it was determined what prerequisites need to be established, developed, and ensured in government agencies and their subordinate institutions to ensure that such processes are efficient, smooth, and as trouble-free as possible for all stakeholders.

Project contracting institution: Government Office
Project implementer: LevelLab and Baltic Research Institute
Duration: 10/2023 ‍–
02/2024

The startup ecosystem of Ida-Viru: looking back and forward

Background

Startup Estonia implemented a three-year pilot program in Ida-Viru County aimed at creating a favorable environment for the development of startups in the region. The program involved 23 organizations and attracted nearly 21,000 participants. Significant interest and the registration of 14 new startups indicate the region’s potential. The follow-up project for the years 2022-2025 focuses on sustaining the entrepreneurial environment in Ida-Virumaa, aiming to create more new startups and promote collaboration with the creative industries sector.

Objective

The aim of the study is to gather necessary input regarding the current state and challenges of the Ida-Viru startup ecosystem, which could be used for planning future ecosystem development activities. Evaluation of the impact and quality of the project activities since 2019.

Methodology

The work will involve using multiple data collection and analysis methods. Document analysis will help assess the impact and quality of the previous pilot project, providing input for evaluating the current status and future development opportunities of the Ida-Viru startup ecosystem. Surveys will assess the awareness and readiness of Ida-Viru residents for entrepreneurship, and analyze the views of participants in events organized by startup support organizations on the Ida-Viru startup ecosystem. Focus group interviews will be conducted with providers of all types of services (such as incubators, accelerators, coworking spaces, and event/conference organizers) as well as representatives of startups operating in various sectors.

Benefits

The results of the study will help to understand the current situation and challenges in the Ida-Viru startup ecosystem and provide input for planning and improving future development activities and projects.

Project contracting authority: Estonian Ministry of Economic Affairs and Communications
Project implementer: LevelLab
Duration:
10/2023 ‍– 03/2024

Evaluation of the Performance-Based Round for Labour Market Services

Background

Population aging is currently the main demographic trend in both Estonia and Europe, which, coupled with deepening labor shortages, requires effective measures to integrate older adults into the workforce. Through European Union support measures, the Results-Based Call Measure 3.2 was implemented, focusing on enhancing the employability of individuals aged 55 and older. Prior to announcing the call for proposals, the funding scheme for supported activities targeting the older age group was also amended, implementing simplified reimbursement methods – fixed-sum payments and standardized unit costs.

Objective

The aim of the study was to assess the relevance, effectiveness, impact, cost-effectiveness, and sustainability of the approach/funding scheme used, and to provide recommendations for organizing call for proposals in the future.

Methodology

The study employed both qualitative and quantitative data collection and analysis methods, including document analysis, quantitative data analysis, interviews, and a validation seminar. The purpose of the interviews was to gather in-depth input for evaluating the relevance and effectiveness of the program. The interviewees included grant recipients, project participants, representatives from the Ministry of Social Affairs, and representatives from the State Support Services Centre.

Benefits

As a result of the study, the justification for the results-based approach in open call tenders for employment policy implementation was identified, and suggestions were made for future improvements in organizing results-based grant schemes in the field of employment policy.

Project ordering institution: Ministry of Economic Affairs and Communications
Project executor: LevelLab
Duration:
04/2023 ‍– 12/2023


Study on the Impact and Effectiveness of Interreg Projects

Background

Interreg is an EU cohesion policy instrument aimed at addressing cross-border challenges and unlocking territorial potential by promoting cooperation between countries and regions. Estonia joined the Interreg cross-border cooperation programs in 1994 and became a full-fledged partner upon joining the European Union in 2004. Interreg programs have supported over a thousand projects involving Estonia, fostering joint solutions across various policy areas. The EU member states and institutions have begun preparations for the new post-2027 programming period, initiating discussions on the future of cohesion policy.  

Objective

To map and consolidate the knowledge and experiences of Estonian organizations participating or previously involved in Interreg programs, assess the effectiveness, sustainability, and impact of Interreg projects implemented in Estonia, and provide recommendations for planning the post-2027 programming period.

Methodology

The study will utilize both qualitative and quantitative data collection and analysis methods, including document analysis, surveys, individual interviews, and focus group discussions.

Benefits

The study results will contribute to ensuring the sustainability of Interreg project outcomes and implementing effective measures to enhance their long-term impact and value. Furthermore, the study will support the formulation of Estonia’s positions in negotiations for the post-2027 programming period with the European Commission and other EU member states, aiding in the planning of new European Territorial Cooperation programs and the preparation of legislative frameworks governing cohesion policy.

Project contracting institution: Ministry of Regional Affairs and Agriculture
Project implementer: LevelLab
Duration: 10/24-03/25

Study on the Impact and Effectiveness of Interreg Projects

Background

Interreg is an EU cohesion policy instrument aimed at addressing cross-border challenges and unlocking territorial potential by promoting cooperation between countries and regions. Estonia joined the Interreg cross-border cooperation programs in 1994 and became a full-fledged partner upon joining the European Union in 2004. Interreg programs have supported over a thousand projects involving Estonia, fostering joint solutions across various policy areas. The EU member states and institutions have begun preparations for the new post-2027 programming period, initiating discussions on the future of cohesion policy.  

Objective

To map and consolidate the knowledge and experiences of Estonian organizations participating or previously involved in Interreg programs, assess the effectiveness, sustainability, and impact of Interreg projects implemented in Estonia, and provide recommendations for planning the post-2027 programming period.

Methodology

The study will utilize both qualitative and quantitative data collection and analysis methods, including document analysis, surveys, individual interviews, and focus group discussions.

Benefits

The study results will contribute to ensuring the sustainability of Interreg project outcomes and implementing effective measures to enhance their long-term impact and value. Furthermore, the study will support the formulation of Estonia’s positions in negotiations for the post-2027 programming period with the European Commission and other EU member states, aiding in the planning of new European Territorial Cooperation programs and the preparation of legislative frameworks governing cohesion policy.

Project contracting institution: Ministry of Regional Affairs and Agriculture
Project implementer: LevelLab
Duration: 10/24-03/25

Developing Feedback Surveys for the Estonian Academy of Security Sciences

Background

The Estonian Academy of Security Sciences needs to update its principles and procedures for collecting and considering feedback; the current process does not support the goal of improving the quality of education as desired. There are too many feedback surveys, they are conducted in different environments, and the analysis of the results is not consistent or evidence-based.

Objective

The goal is to develop a comprehensive feedback system and update the feedback surveys aimed at learners. The results of the work serve as the basis for the development and implementation of a new feedback collection and evaluation procedure for the Estonian Academy of Security Sciences.

Methodology

To develop the solution, a business analysis will be conducted, including interviews. Subsequently, prototypes of questionnaires will be developed, followed by the methodology for surveys, including a process description, research calendar, analysis methodology, technical implementation of data processing, and visualization solution.

Benefits

The developed solution supports the goal of improving the quality of education, being part of a broader internal and external assessment system. It will be web-based (secure and user-friendly), allowing clear visualization of results and their dissemination to different target groups. Participation in surveys will be limited to students of the Estonian Academy of Security Sciences.

Project contracting institution: Estonian Academy of Security Sciences
Project implementer: LevelLab
Duration: 12/2023 ‍– 03
/2024

Developing Feedback Surveys for the Estonian Academy of Security Sciences

Background

The Estonian Academy of Security Sciences needs to update its principles and procedures for collecting and considering feedback; the current process does not support the goal of improving the quality of education as desired. There are too many feedback surveys, they are conducted in different environments, and the analysis of the results is not consistent or evidence-based.

Objective

The goal is to develop a comprehensive feedback system and update the feedback surveys aimed at learners. The results of the work serve as the basis for the development and implementation of a new feedback collection and evaluation procedure for the Estonian Academy of Security Sciences.

Methodology

To develop the solution, a business analysis will be conducted, including interviews. Subsequently, prototypes of questionnaires will be developed, followed by the methodology for surveys, including a process description, research calendar, analysis methodology, technical implementation of data processing, and visualization solution.

Benefits

The developed solution supports the goal of improving the quality of education, being part of a broader internal and external assessment system. It will be web-based (secure and user-friendly), allowing clear visualization of results and their dissemination to different target groups. Participation in surveys will be limited to students of the Estonian Academy of Security Sciences.

Project contracting institution: Estonian Academy of Security Sciences
Project implementer: LevelLab
Duration: 12/2023 ‍– 03
/2024