Did submission rules affect the submission sizes of the units to the UK’s Research Excellence Framework in 2014?

Figures & data

Table 1. Number of case studies required in submissions.

Number of staff submitted (FTE)	Required number of case studies
Up to 14.99	2
15–24.99	3
25–34.99	4
35–44.99	5
45 or more	6, plus 1 further case study per additional 10 FTE

Obtained from REF (2011).

Figure 1. Total number of submissions, submissions with size just below and just above the threshold for panels A, B, C and D.

Figure 2. Total number of submissions, submissions with size just below and just above the threshold for UoAs in panel A.

Figure 3. Total number of submissions, submissions with size just below and just above the threshold for UoAs in panel B.

Figure 4. Total number of submissions, submissions with size just below and just above the threshold for UoAs in panel C.

Figure 5. Total number of submissions, submissions with size just below and just above the threshold for UoAs in panel D.

Table A1. Test statistics for panels.

Panel	Panel name	Average size (x4-x5.99)	Test statistic	Significance
Panel A	Medicine, health and life sciences	4.504	−11.827	1%
Panel B	Physical sciences, engineering and mathematics	4.492	−14.564	1%
Panel C	Social sciences	4.636	−7.006	1%
Panel D	Arts and humanities	4.621	−7.147	1%

Notes: The submissions with submission sizes ranging between 14 and 15.99, 24 and 25.99, 34 and 35.99, and so on, are considered. 10, 20, 30, and so on are subtracted from these submission sizes, respectively. Average size presents the average submission size for these submissions.

Table A2. Test statistics for different UoAs.

UoA no	UoA name	Average size (x4-x5.99)	Test statistic	Significance
1	Clinical Medicine	4.308	−13.842	1%
2	Public Health, Health Services and Primary Care	4.503	−4.655	1%
3	Allied Health Professions, Dentistry, Nursing and Pharmacy	4.543	−6.130	1%
4	Psychology, Psychiatry and Neuroscience	4.566	−4.040	1%
5	Biological Sciences	4.499	−4.666	1%
6	Agriculture, Veterinary and Food Science	4.487	−2.455	5%
7	Earth Systems and Environmental Sciences	4.734	−2.544	5%
8	Chemistry	4.405	−5.869	1%
9	Physics	4.566	−5.418	1%
10	Mathematical Sciences	4.378	−7.045	1%
11	Computer Science and Informatics	4.472	−8.252	1%
12	Aeronautical, Mechanical, Chemical and Manufacturing Engineering	4.380	−4.881	5%
13	Electrical and Electronic Engineering, Metallurgy and Materials	4.392	−3.801	1%
14	Civil and Construction Engineering	4.450	−3.939	1%
15	General Engineering	4.458	−5.895	1%
16	Architecture, Built Environment and Planning	4.664	−1.903	5%
17	Geography, Environmental Studies and Archaeology	4.812	−1.506	10%
18	Economics and Econometrics	4.575	−2.979	5%
19	Business and Management Studies	4.649	−2.408	5%
20	Law	4.667	−1.456	10%
21	Politics and International Studies	4.485	−3.013	1%
22	Social Work and Social Policy	4.726	−1.639	10%
23	Sociology	4.804	−0.696	NS
24	Anthropology and Development Studies	5.014	0.053	NS
25	Education	4.481	−4.268	1%
26	Sport and Exercise Sciences, Leisure and Tourism	4.294	−5.794	1%
27	Area Studies	4.180	−4.556	5%
28	Modern Languages and Linguistics	4.518	−3.439	1%
29	English Language and Literature	4.549	−3.132	1%
30	History	4.580	−3.246	1%
31	Classics	4.300	−2.941	5%
32	Philosophy	4.502	−2.329	5%
33	Theology and Religious Studies	4.801	−0.862	NS
34	Art and Design: History, Practice and Theory	4.796	−1.293	10%
35	Music, Drama, Dance and Performing Arts	4.773	−1.381	10%
36	Communication, Cultural and Media Studies, Library and Information Management	4.613	−3.264	1%

Notes: The submissions with submission sizes ranging between 14 and 15.99, 24 and 25.99, 34 and 35.99, and so on, are considered. 10, 20, 30, and so on are subtracted from these submission sizes, respectively. Average size presents the average submission size for these submissions. NS represents no significance.

REF. 2011. “Assessment framework and guidance on submissions.” REF 02.2011 July 2011. https://www.ref.ac.uk/2014/media/ref/content/pub/assessmentframeworkandguidanceonsubmissions/GOS%20including%20addendum.pdf.

 Google Scholar