Database of Precedents

Application	Initial
Review	Full, coordinated by ENQA
Decision of	19/06/2019
Standard	3.4 Thematic analysis
Keywords	thematic analysis not conducted on a regular basis
Panel conclusion	Partial compliance
Clarification request(s)	–
RC decision	Partial compliance

“The Register Committee noted that thematic analysis is not a regular activity performed by NQA, and that only a limited number of thematic analyses have been carried out in the past following requests from higher education institutions. The Register Committee underlined the recommendation of the panel to include thematic analysis as part of NQA’s regular planned activities and to make use of the experience and knowledge of internal and external secretaries in order to conduct such analyses. In its additional representation the agency stated that it concurs with the review panel’s analysis and that the agency has put in place an improvement plan which it will realised in the following four years.. The Register Committee welcomed the steps taken by NQA but noted that presently the agency has not yet implemented its plans to carry out systematic analysis. The Committee therefore concurred with the panel that NQA is only partially compliant with standard 3.4.”

Full decision: see agency register entry

Application	Initial
Review	Full, coordinated by ENQA
Decision of	13/06/2018
Standard	2.1 Consideration of internal quality assurance
Keywords	Issues in aligning EQA activities to ESG Part 1
Panel conclusion	Partial compliance
Clarification request(s)	–
RC decision	Partial compliance

“The Register Committee noted that the review panel's analysis that the approach adopted by EAEVE for aligning the ESEVT SOP to the ESG 2015 Part 1 might be based on some misconceptions and lead to overlaps or omissions. The Committee understood that this was due to the fact that the ESG Part 1 standards are “added on” to the existing standards, which, however, also cover a number of issues covered by ESG Part 1. The Committee also took note of the panel's analysis that the ESG elements are not always addressed fully consistently in reports.”

Full decision: see agency register entry

Application	Initial
Review	Full, coordinated by ENQA
Decision of	13/06/2018
Standard	2.5 Criteria for outcomes
Keywords	consistency in decision making
Panel conclusion	Partial compliance
Clarification request(s)	–
RC decision	Partial compliance

“The Register Committee took note of the panel's analysis that the evidence in the report body does not always match the conclusion as to compliance with certain standards, and that it was not always possible to track all the information required by the standards in the text of the reports. The Register Committee understood that this might in part be a result of the duplication caused by the “add-on” way of incorporating the ESG.”

Full decision: see agency register entry

Application	Initial
Review	Full, coordinated by ENQA
Decision of	13/06/2018
Standard	2.6 Reporting
Keywords	No publication of consultative visitation reports.
Panel conclusion	Substantial compliance
Clarification request(s)	Panel (02/06/2018)
RC decision	Partial compliance

“The Register Committee understood from the panel's report that all reports except those so-called “consultative visitations” are made accessible on the EAEVE website. The Register Committee sought clarification from the panel on the nature of consultative visitations. Based on the report and the panel's additional clarification the Committee understood that “consultative visitations” should be regarded as an additional step as part of the full/regular visitation. As EAEVE membership is an eligibility requirement and a “consultative visitation” is a prerequisite for non-EU establishments to become members, it is thus a prerequisite step for non-EU establishments seeking EAEVE accreditation. The Register Committee therefore considered that these reports are a part of the reasons underlying the final accreditation decision following the full visitation.”

Full decision: see agency register entry

Application	Initial
Review	Full, coordinated by ENQA
Decision of	13/06/2018
Standard	3.1 Activities, policy and processes for quality assurance
Keywords	Involvement of students in agency’s decision making
Panel conclusion	Full compliance
Clarification request(s)	Panel (02/06/2018)
RC decision	Compliance

“The Register Committee understood that the reference to “consultative services” in the report in fact referred to so-called “consultative visitations”. These are, however, not consultancy activities, but a step in EAEVE's external quality assurance scheme. […] The Register Committee underlined the panel’s suggestion that EAEVE should involve students in the ECOVE and the appeals panels, even though students do not request membership at the moment.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	11/09/2018
Standard	2.1 Consideration of internal quality assurance
Keywords	OK. Part 1 reflected in one of the agency’s external QA
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“In the last review of ANECA, the Register Committee flagged for attention the processes and criteria used in the ACCREDITA programme and how they take into account the existence and effectiveness of internal quality assurance in line with Part 1 of the ESG. The Register Committee considered the panel’s detailed accounts of how ANECA ensures the meeting of this criterion in all its procedures, including the international projects it has engaged in and noted that the regular review and assessment of the effectiveness of the procedures provided re-assurance and certainty to stakeholders on the quality of higher education in Spain”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	11/09/2018
Standard	2.3 Implementing processes
Keywords	EQA processes that include: self-assessment, site visit,
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“In ANECA’s last review, the Register Committee flagged for attention the implementation of the key elements of the standard i.e. self-evaluation, site visit in the development and implementation of the ACCREDITA programme. The panel’s evidence and analysis show that since its last review ANECA has revised the ACREDITA procedure, which now includes: a self-evaluation stage, a revision by an assessment committee during a site-visit, and a report providing guidance for the actions taken by the institution.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	11/09/2018
Standard	2.6 Reporting
Keywords	No publication of initial reports and only publication of summary reports for programme accreditation
Panel conclusion	Substantial compliance
Clarification request(s)	Panel (09/06/2018)
RC decision	Partial compliance

“The panel stated that ANECA does not publish initial review reports prepared by the assessment panels (of 50-60 page long) and that the agency only publishes a final summary report (of 10 pages). he panel stated that publication of summary reports from programme accreditations is a national characteristic and that the panel confirmed during interviews that the AUDIT and DOCENTIA activities include full reports when published. The Register Committee could only verify the panel’s statement regarding the full publication of institutional evaluation reports for DOCENTIA, but not in case of AUDIT procedures. While the Register Committee understands the usefulness of providing summary reports, the Committee saw no reasons why ANECA would not be able to also publish the full results for all its external quality assurance procedures.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	11/09/2018
Standard	2.7 Complaints and appeals
Keywords	Availabily of appeals for monitoring procedures
Panel conclusion	Full compliance
Clarification request(s)	Panel (09/06/2018)
RC decision	Compliance

“The Register Committee also noted that appeals are not made available in case of MONITOR procedure […]. The review panel stated as the activity has a supportive /developmental nature and that no decisions are taken on its basis no appeals can be issues. The panel noted that it had discussed the complaints (and appeals) procedures with key stakeholders, who expressed their satisfaction with the functioning of the processes and confirmed that the agency considered all appeals and complaints according to its policy and within a reasonable time-frame.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	11/09/2018
Standard	3.1 Activities, policy and processes for quality assurance
Keywords	separation of consultancy and EQA activities, addressing international activities as activities within the scope of the ESG
Panel conclusion	Full compliance
Clarification request(s)	Agency (31/07/2018) Panel (09/06/2018)
RC decision	Partial compliance

“The panel noted that in its understanding all international activities of ANECA were advisory in nature whereby ANECA acted essentially as a consultant/project partner and did not carry out external quality assurance activities (evaluation, accreditation, audits) abroad. The panel did not provide any further information on how the agency ensures a clear distinction between external quality assurance and its other fields of work. The agency provided a detailed report on its international activities, explained and that they follow similar procedures to that of the AUDIT and ACCREDITA evaluations carried out in Spain and confirmed they are within the scope of the ESG. Tthe Register Committee could now verify the publication of criteria for evaluation and the publication of all (summary) reports of the international activities. The Committee acknowledged the steps taken by ANECA to clarify the nature of its international activities, but noted that these activities were not considered by an external review panel (in particular in considering compliance with ESG Part 2). The Register Committee further noted that it could not analyse with full certainty how the agency separates its external QA activities within the scope of the ESG from the consultancy projects it carries out.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	11/09/2018
Standard	3.3 Independence
Keywords	Organisational independence
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“The Register Committee noted that since its last evaluation, ANECA has strengthened its independence i.e. becoming an autonomous public body, ensuring a more balanced representations in its Governing Council, appointing of its own director and operating with full fiscal autonomy. The Register Committee further noted that “the operation of ANECA’s policies and procedures surrounding the design, implementation and reporting on all the evaluation processes takes place in a fully independent and autonomous manner” (Review report, p. 26).”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	13/06/2018
Standard	2.3 Implementing processes
Keywords	Consistency and transparency in decision making
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“ Having evaluated the procedures for decision making by Quality Assessment Council for Higher Education (HEQAC), the panel concluded that the standard for consistency and transparency in decision-making has received considerable attention and improvement since the last review.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	16/11/2017
Standard	2.4 Peer-review experts
Keywords	Involvement of students in external review process
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“In its decision of inclusion, the Register Committee flagged the involvement of students in all external review expert groups.The panel’s findings showed that students participate in all SKVC’s expert teams for all types of evaluations, whether in Lithuania or abroad. In its interviews the panel also learned that students were not always involved equally in the external review process, an issue that was mostly depended on the chair of the team (Review report pg. 36).The Register Committee noted that SKVC involved students in all its reviews and has therefore addressed the flag. he Committee nevertheless underlined the panel’s recommendation that SKVC could play a more supportive role in ensuring that students participate as equal members in all panels.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	16/11/2017
Standard	2.5 Criteria for outcomes
Keywords	decision making
Panel conclusion	Substantial compliance
Clarification request(s)	–
RC decision	Compliance

“In its decision of inclusion, the Register Committee flagged the decision-making processes of the agency for accreditation and the practice in which accreditation decisions are taken by a single person (the Director).The panel noted that accreditation decisions are taken by the SKVC director upon advice of one of the two advisory commissions. In the view of the panel the role of the advisory commission should be limited to checking the reliability of the outcomes of the evaluation, leaving the final decision to the director to avoid unnecessary costly and complicated processes.The Committee nevertheless underlined the panel’s recommendation concerning the improvement of the agency’s criteria for programme accreditation with more elaborate definitions of its scores.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	16/11/2017
Standard	2.6 Reporting
Keywords	Publication of reports
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“In its decision of inclusion, the Register Committee flagged the publication of reports corresponding to applications by new programmes and new licensing requests. The panel’s finding show that the evaluation reports for programme and institutional evaluations are published and accessible on the SKVC website, including the accreditation decisions (p. 40).”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	16/11/2017
Standard	2.7 Complaints and appeals
Keywords	Absence of a complaints procedure
Panel conclusion	Substantial compliance
Clarification request(s)	–
RC decision	Partial compliance

“While the Register Committee noted that appeals’ procedures are well defined, accessible and handled adequately, the Register Committee noted that SKVC’s methodologies and principles do not cover complaints.The panel did not find how higher education institutions can raise issues of concerns or how they are handled by SKVC in a professional and consistent manner.The Committee underlined the recommendation of the panel for the development of a specific complaints procedure that should be made easily accessible to higher education institutions.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	16/11/2017
Standard	3.1 Activities, policy and processes for quality assurance
Keywords	Separation of external QA and consultancy activities
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“The Register Committee noted that SKVC provides consulting to both the government and higher education institutions. While the panel found that SKVC’s methodologies and guidelines clearly delineate its tasks and responsibilities, the panel stated that SKVC could benefit from reducing its guidance role in producing self-evaluation reports and in offering detailed and demanding rules and regulations for higher education. the Committee underlined that SKVC is expected to demonstrate a clear separation between its external quality assurance and its consulting and guidance role, in particular considering the agency’s assistance in producing self-evaluation reports. The Committee drew SKVC's attention to the guiding principles set out in Annex 5 to the Policy on the Use and Interpretation of the ESG.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	16/11/2017
Standard	3.5 Resources
Keywords	financial sustainability
Panel conclusion	Substantial compliance
Clarification request(s)	–
RC decision	Partial compliance

“In its decision of inclusion, the Register Committee flagged the financial arrangements and sustainability of SKVC’s overall activity.The panel’s analysis showed that these concerns remain due to a wavering financial situation and decrease of project funds.The Register Committee noted the panel’s analysis that the financial arrangements remain uncertain and have not been adequately addressed within a realistic financial plan”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	16/11/2017
Standard	2.5 Criteria for outcomes
Keywords	decision making
Panel conclusion	Substantial compliance
Clarification request(s)	–
RC decision	Compliance

“In its last renewal decision (of 1/12/2012), the Register Committee flagged for attention the criteria for outcomes on the accreditation of existing programmes and in particular the consistency of decisions based on reviews undertaken by different agencies.The panel stated that NVAO has taken a number of steps to improve the decision-making process and found that there has been good progress in clarifying criteria for outcomes. The panel further underlined the difficulty of grading outcomes from insufficient to excellent on which further reflection by NVAO will be needed.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	16/11/2017
Standard	2.6 Reporting
Keywords	Readability and publication of reports
Panel conclusion	Substantial compliance
Clarification request(s)	–
RC decision	Partial compliance

“The Register Committee flagged for attention the readability of NVAO’s published reports considering its defined target audience (decision of renewal of 1/12/2012).The panel’s analysis show that NVAO does not have specific guidelines for organizing the content of the report. Whilst these reports can be considered clear by an expert readership, readability is generally hindered by the heterogeneity of style, which is less “user friendly” to a large public, in particular by students and employers.The Committee underlined the recommendation of the panel that NVAO should analyse the actual and potential readership of its reports and their needs, and to develop new means to reach its target readership among students and employers.The panel also noted that at least 10 percent of the reports and decisions made in 2016 were not publicly available. The agency explained that the publication of reports was delayed due to a temporary lack of personnel and that this issue has been fixed. ”

Full decision: see agency register entry