The REF games are even more brutal this time around

Forcing academics on to teaching-only contracts based on flawed assessments of their research is ruining careers, an anonymous academic says 

Published on
January 3, 2019
Last updated
January 18, 2019
Illustration: THE main opinion 3 Jan 2019 issue
Source: Miles Cole

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Reader's comments (15)

I'm not overly sympathetic to the author. In my discipline, something like 60% of all submitted outputs were rated 3- or 4-star in REF 2014. A 3-star publication is therefore hardly an excellent one, merely a solid one. If an academic on a research and teaching contract cannot produce one solid publication in 5+ years, then they should make room so that one of the many bright and unemployed PhDs can have a chance. Moving to a teaching-only contract seems a fair outcome.
@acemoglu It takes two hands to tango. What if the situation was due to mismanagement from the employer (i.e., the university)? How would that factor into this? Is shifting the blame all on the academic a fair (REF) game?
Come and work at a non-research intensive. We'd welcome you and your outputs with open arms!
I appreciate the position and argument from the anonymous research active academic in last week’s issue (‘The Ref games are even more brutal this time around’) who may be forced by university managers onto a teaching only contract because of a lack of at least one 3* output. I recognise particularly the, to some extent unintended, consequences of the REF in concentrating research and narrowing its scope. However, at least three points seem pertinent from my perspective as a research active academic in a university of applied science (often referred to as ‘post 1992’) where the focus of academics is on knowledge exchange and teaching as much as on research. First, the impact of REF game playing is likely to be differentiated across the diversity of academics, so women, ethnic minority origin and working class academics beware! It was noticeable that the illustration accompanying the article last week showed one white female and seven white male academics being metaphorically cut down to teaching only. Second, for some academics, including many of my colleagues in professional fields who may not (yet) have a doctorate, a teaching only contract may be a welcome relief. Third, and in tension with the second point, no matter what your field, your contract, your institutional context, or the response of your university managers to the REF, as an academic there remains a sector wider pressure to be active in research or advanced scholarship, to publish or perish is simply part of the territory. In a UK survey based study of academics in Nursing, Midwifery and Allied Health Professions, we found that many were struggling to develop their research work and researcher identity. A significant proportion, even in research intensive universities, were subverting researcher identity – they were doing ‘just enough’ to keep managers happy then focusing on teaching, knowledge exchange or leadership. It does seem perverse for managers to deliberately move an academic towards more teaching without considering their effectiveness as a teacher, but on the other hand asking them to juggle multiple identities all at the highest level may not be realistic. REF and TEF game playing at institutional and individual level is just part of the marketization of education policy framework that has reinforced an elite education system, university managers need to understand this wider context and be proactive within it. At a graduation ceremony before Christmas I was dismayed to hear the vice chancellor of a research intensive university boast to the assembled parents and students that his was an ‘elite’ university. I would suggest that his world view rests on the myth of meritocracy and I only hope that his Christmas stocking included copies of Danny Dorling’s ‘Injustice: Why Social Inequality Still Persists’ or Diane Reay’s ‘Miseducation’.
“Mock” refs scores have huge variance. I had two papers scored by four people last time (two internal, two external). The scores on both? 1,2,3,4 stars. One external gave two ones, the other two fours. Both profs at Russell group unis in top ranked departments. Clearly my work divides opinion, but to determine someone’s career trajectory based on one score is grossly unfair
The unsympathetic comment above appears to be going on a level playing field notion that may exist at their place of employment. The problem may not be the production producing a 3* publication but in a hostile work environment the issue can be getting it recognised as one. It should be straightforward but ranking is a subjective process that is open to abuse. I know from experience of having a paper rated as 2* by the internal process and 3/4* by an academic that sat on the REF panel that it is not a precise science. If the department is attempting to portray a particular image/specialism it can influence judgement. Giving early career academics a shot is fine but when you add that to the current move towards "X-Factor" teaching where youthful enthusiasm ticks boxes the process can mask ageism. Moving older academics to teaching only may seem fair but often it is a humiliating demotion calculated to move someone closer to the exit.
"but in a hostile work environment the issue can be getting it recognised as one. It should be straightforward but ranking is a subjective process that is open to abuse". Absolutely valid point. Often times there is no clear oversight of this whole process and no proper feedback. In one instance the feedback for a 3* rated paper was "it dosent meet the criteria for 4*". It is like saying to a student, you have not got a disctinction because you have only got a merit! A lot of good that feedback is!
I agree with the article but for a different reason. Teaching or education contracts should be for those who excel in teaching and improving the quality of education at an institution. These contracts are demeaned if they are used for people who can't do something rather than people who can do something. Plumbers and electricians often work together. You would not make an electrician a plumber because they blew a fuse. You should encourage and develop good electricians and good plumbers, and some excellent individuals who can excel at both. Research and teaching are complementary, but not the same. Research and teaching are both important, and should not be played-off against each other.
I agree with simonkent no place in teaching for failed researchers, just great teachers. And while I understand the point about fair mock REF assessments, someone on a substantial research contract with PhD students and external funding should be able to produce one 3* paper in 5 years. If they're on a full research contract and not produced at least two they should be looking for a new job.
There is nothing necessarily bad about being on a Teaching & Scholarship contract so long as it is voluntary and there is true parity of esteem between teaching and research, including a recognised promotion route; indeed, I switched a few years ago as I near the end of my career and suffered a series of, frankly, gutting paper rejections and revise and resubmits I no longer had an appetite for. However, there is a world of difference between aggregate measures (such as @acemoglu's 60% of submitted REF2014 outputs being rated 3*/4*) that might - just might, despite all the well known assessment flaws and consequent margins for error - be useful for assessing groups of researchers, departments and universities, i.e. the stated purpose of REF, and using such dubious metrics for forced, top-down "performance management" at an individual level, especially when there is a lack of accountability and transparency and no right of appeal. This is just another sad example of the enormous waste of resources represented by REF and TEF and the inevitable gaming of them both. The only good thing about them is that now there is a parity of garbage on both sides of the research/teaching equation.
Nothing wrong with a teaching appointment in a university. They pay the same and you can become a professor. (In my experience, they teach less than most academics). If staff want to pursue research they should be given support and permitted time to plan this. You cant create quality research in a short period of time since the cycle is generally about a year. If you havent done much research in a while though, it is very difficult to reclaim these skills, especially if you are in a discipline where research is done through an intermediary (eg PhD student, postdoc etc).
Firstly the student goes to a university pays an extraordinary amount of money for excellent teaching. How can that teaching be excellent when the teachers' English is so poor as to be unfathomable. The account seen above suggests something is seriously wrong with the core activity of a university, that is its teachers and those teachers' skills to teach. Knowledge is nothing if it stays in the head of someone mumbling at the lectern. The university in this country has lost its way no longer fit for purpose. Researchers need to be in a research institute somewhere, only guest lectering if they meet the high skill standards required to teach. The idea that research, often the pet project of who ever is in charge, stands above teaching high paying clients is perverse.
Excellent comment - I agree wholeheartedly with this sentiment!
Now what we have been told is that for REF 2021, only 'independent' researchers will have to be submitted, so for Research Only staff, that is going to be taken to include only Senior Research Fellows, not postdocs.
The major issue that in many cases, an "internal REF" is used to determine whether a paper is 3 or 4 star. Many papers that well cited and often times practically useful may not fit the category of 3 or 4 because it does nto appear in the right journal (even thought the claim is that the journal dosent matter!) Often times it is unclear who is part of the panel that makes this evalaution, what checks and balances are in place to ensure that the process is fair and free? When these are undertaken by people outside one's home university, how will the home university make sure that those people do not have any unconcious biases that they bring to their evaluations? One needs to ask if there are places where these exercises actually are done by departments or schools without clear and transparent university oversight?

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT