The Ludwig Boltzmann Gesellschaft seeks to conduct qualitative research in its institutes. This requires both comprehensible and workable decisions both in calls for proposals and evaluations. Adequate assessment procedures are carried out for these decisions at different points in time:

1. Ex-ante evaluation of applications in the course of calls for proposals
2. Interim evaluation of Ludwig Boltzmann Institutes und clusters

Ex-ante evaluation

The whole process of calls for proposals and evaluation is supported by a high-ranking jury. Their most important task is to evaluate the applications on the basis of expert opinions and to submit a recommendation to the Board of the Ludwig Boltzmann Gesellschaft for the selection of new Institutes. The jury comprises both experts in the relevant subjects of the applications and also research managers. Care is taken to ensure that the majority of the jury members do not come from Austria. The tasks of the jury are governed by rules of procedure. This guarantees, among other things, that the jury members reach their decisions independently, that there is no bias and that strict confidentiality is respected in relation to the documents obtained and the processes of which they become aware in their capacity as jury members.

The applications received within the scope of a call for proposals are firstly checked by the head office for compliance with all form-related criteria. If they are in accordance with the relevant provisions, an evaluation is carried out by external, foreign experts. Experts are appointed by the jury members according to the requirements of the individual applications, whereby the applicants are allowed to exclude up to three experts. The absence of prejudice or bias is also a decisive factor, alongside subject expertise, in the selection of experts. It is for this reason that the Ludwig Boltzmann Gesellschaft uses experts exclusively from foreign countries. Both the experts and the LBG undertake to respect strict confidentiality.

The evaluation is carried out by means of several individual written opinions for each application, which are produced by reference to an evaluation sheet. The experts use the guidelines for the call for proposals as a basis for assessing the applications. In the second stage of the call for proposals, following the assessment, the jury evaluation and the decision on the short applications, the extended application phase takes place. In this stage, the authors of positively evaluated applications are now invited to submit detailed extended applications. The jury is again responsible for selecting experts, whereby on the one hand a certain continuity is to be ensured through the use of existing experts in the extended application process and on the other hand additional opinions are to be obtained. The written opinions on the extended applications and the hearing with the applicants allow the jury to recommend the best applications for setting up a Ludwig Boltzman Institute to the Board of the Ludwig Boltzmann Gesellschaft.

Interim evaluation

Interim evaluations are carried out at all Ludwig Boltzmann Institutes after three to four years. They have two aims: on the one hand to look back over the services provided and prepare a summary thereof and on the other hand to look ahead and identify potential. The interim evaluation also provides useful input for the Management of the Institute relating to the adaptation of contents, dealing with intellectual property and changes in management.

The evaluation procedure comprises two parts, namely the formulation of a self-analysis report and the evaluation by external experts. The self-analysis report is formulated on the basis of an evaluation guide. This is then assessed by independent, informed and exclusively foreign experts who provide a written opinion. In addition, the LBG reserves the right to carry out an on-site visit to larger Institutes and clusters. Within the scope of this visit, evaluation issues can be discussed in depth with the Management of the Institute as well as employees and partners.