{"id":115130,"date":"2020-06-25T14:34:51","date_gmt":"2020-06-25T12:34:51","guid":{"rendered":"https:\/\/www.erasmusmagazine.nl\/en\/?p=115130"},"modified":"2025-12-19T11:24:59","modified_gmt":"2025-12-19T10:24:59","slug":"this-article-is-of-no-use-to-the-world-well-almost-none","status":"publish","type":"post","link":"https:\/\/www.erasmusmagazine.nl\/en\/2020\/06\/25\/this-article-is-of-no-use-to-the-world-well-almost-none\/","title":{"rendered":"This article is of no use to the world (well, almost none)"},"content":{"rendered":"

Scientists are publishing like mad, especially during this corona crisis. But does this make us any smarter? According to Professor of Psychology Rolf Zwaan, a culture has emerged in which results are exaggerated and shortcomings are glossed over. “We all need to take a step back.”<\/p>\n

\"\"

\n\t\n\n<\/svg>\n<\/span>\n\tImage by:<\/span>\n\n\t\t\t\n\t\t\t\t\t\t\tBas van der Schot<\/a>\t\t\t\t\t<\/span>\n\t<\/p>\n<\/figcaption><\/figure>\t

\n\t\t

Rolf Zwaan is Professor of Biological and Cognitive Psychology. Among other things, he conducts research on language, communication and knowledge in the digital age and the replication crisis<\/a> within science.<\/p>\n\n\t<\/div>\n

Since 1 January, tens of thousands of scientific articles have appeared on the subject of COVID-19. According to critics, this makes it impossible to keep up to date. This applies to the Outbreak Management Team and even more so to an individual intensive care physician. Is too much being published?<\/strong><\/p>\n

\u201cYes. And not just to be able to stay up to date. An even bigger problem is that too much is published to be able to guarantee the quality of the articles. One of the most important foundations of academic research is the peer review system. Scientists scrutinise the work of colleagues because they also want their own work to be peer-reviewed. For example, I myself receive several peer review requests every week, hundreds a year, although officially it is not part of my job. I get paid to teach, research and manage a group of scientists. Consequently, I have to refuse a large proportion of these review requests. Therefore, these kinds of articles are not subjected to review or are then reviewed by someone who is not as well versed in that particular subject. That does have an effect on the quality.\u201d<\/p>\n\n\t

\n\t\t
\n\t\t\t
\n\t
\n\t\t\u2018You see a lot of pressure on scientists to be considered relevant, interesting and to have an impact\u2019\n\t<\/blockquote>\n\n\t<\/figure>\n\t\t<\/div>\n\t<\/div>\n

Why is so much being published?<\/strong><\/p>\n

\u201cA whole industry has sprung up around publications. Contributors to these publications include doctors in training to become specialists<\/em> who have to publish four or five articles over the course of their PhD programme and people who have a permanent position and are judged on the how many of their articles appear in print. There is a drive towards quantity. This is not new, by the way. When I started out in science thirty years ago, people were already talking about the overly excessive pressure to publish.\u201d<\/p>\n

This publication pressure might also lead to sub-standard science. Why is that?<\/strong><\/p>\n

\u201cYou see a lot of pressure on scientists to be considered relevant, interesting and to have an impact. As a result, scientists often feel compelled to inflate results. Look, science is not a chain of exciting discoveries. Usually it comes down to making a cautious initial finding that says very little and is also surrounded by uncertainties. Yet if you present your paper like that, no one wants it. Plenty of journals ask: \u201cWhat\u2019s the highlight of your article?\u201d <\/em>You have to sell your manuscript somehow. So that\u2019s what you do. And then there\u2019s a communications department at a university that spices things up a bit, a journalist that puts a bold caption above it and before you know it, badly executed research spreads across the internet like some revolutionary discovery.\u201d<\/p>\n\n\t

The Greek-American epidemiologist John Ioannidis claimed a number of years ago that most research results were flawed. Is he right?<\/strong><\/p>\n

\u201cThat is a pretty strong statement. But we do see that a whole system has arisen in which scientific results are being exaggerated and the shortcomings of specific research are not clearly visible. In my field of psychology, a lot of attention is being paid to the replication crisis. That is why we have launched an initiative to repeat research. The basic idea is that something is only scientific knowledge once you have developed a method that allows you to reliably produce and reproduce a result. It turned out that this did not actually work for a lot of research within psychology. A recent study in Science magazine showed that a third of several important psychological experiments could not be replicated.\u201d<\/p>\n

Is that shocking?<\/strong><\/p>\n

\u201cIt\u2019s very easy to say after the fact that that was pretty stupid of all those researchers. But they often acted with the best intentions and with the knowledge that was available back then. It could also be possible that at the time, something was overlooked that later proved to be very important. Well, that is essential when conducting science. We must not forget that it is difficult to carry out good research, right?<\/p>\n

\"\"\n\t\t\t\n\t\t\t\t\n\t\t\t<\/svg>\n\t\t<\/button>

\n\t\n\n<\/svg>\n<\/span>\n\tImage by:<\/span>\n\n\t\t\t\n\t\t\t\t\t\t\tBas van der Schot<\/a>\t\t\t\t\t<\/span>\n\t<\/p>\n<\/figcaption><\/figure>

In recent years, we have increasingly been working with large-scale datasets where patterns are sought, without formulating a hypothesis beforehand. Is that a major problem?<\/strong><\/p>\n

\u201cHypothesis-driven research is the<\/em> method to prove causality. You start with a theory, form a hypothesis and then you test it. If you just randomly browse through the data, you will always find something. This is not such a serious problem, by the way, as long as you make a distinction between testing and exploratory research. And that\u2019s where it sometimes runs into snags.\u201d<\/p>\n

In practice, it is very difficult for the public to ascertain which research is of any value. Look what is happening right now concerning the coronavirus. Any research looking at a potential solution goes viral. For example, high concentrations of vitamins were said to help prevent COVID-19 and there are still people who think that hydroxychloroquine is an effective medicine. Who is in charge of ensuring that these kinds of misconceptions are avoided?<\/strong><\/p>\n

\u201cYou may not want to hear this, because it\u2019s another typically nuanced answer from a scientist, but: everyone is. It is a systemic problem. Researchers, press officers, journalists, politicians, citizens \u2013 we all have a responsibility to handle things conscientiously. For instance, I think it\u2019s great that fact checks are taking place more and more often. And now even Twitter is posting warnings<\/a> next to Donald Trump\u2019s tweets that are so blatantly false.\u201d<\/p>\n\n\t

\n\t\t
\n\t\t\t
\n\t
\n\t\t\u2018The most important thing is to simply use your common sense\u2019\n\t<\/blockquote>\n\n\t<\/figure>\n\t\t<\/div>\n\t<\/div>\n

Do you have any tips for the news consumer as to how to cope with all the science news?<\/strong><\/p>\n

\u201cI think it is right to question very bold claims. The more staunch a scientist is, the more I have my doubts. It\u2019s also good to check if someone is really a specialist in the field he or she is talking about. A lot of scientists tend to dabble in things they actually don\u2019t know much about. I know plenty of professors and they all talk nonsense sometimes. Myself included, as it happens.\u201d<\/p>\n

\u201cWithout wanting to lead people to conspiracy theories, you may well ask yourself if there are perhaps ulterior motives at work in some research. For example, for years, a great deal of research into the effects of smoking has been made possible by the tobacco industry. The most important thing is to simply use your common sense. Every day, an article pops up in the newspapers about the relationship between food and health. But, for instance, is it really the case that half an avocado a day has the same effect on everyone?\u201d<\/p>\n

The lack of clear, unequivocal knowledge has proven to be quite difficult over the past few months. On the one hand, virologists from the Outbreak Management Team were listened to very carefully. On the other, there was fierce criticism when the RIVM (the Dutch National Institute for Public Health and the Environment) <\/em>director Jaap van Dissel had to revise his views. Were the expectations of the general public too high as far as the science is concerned?<\/p>\n

\u201cI think so. The population got a peek inside the kitchen during this crisis. And I think that this is a good thing. We should become aware of the fact that the knowledge that you acquire as a scientist tends to be provisional in nature, until a sort of corpus of research results emerges that is readily reproducible. That process is slow, which is problematic whenever you want answers quickly, as is the case now.\u201d<\/p>\n\n\t

\n\t\t\n\t\t
\n\n\t\t\t\t\t\t\t

Lees meer<\/h2>\n\t\t\t\n\t\t\t