{"id":159849,"date":"2023-10-11T14:47:03","date_gmt":"2023-10-11T12:47:03","guid":{"rendered":"https:\/\/www.erasmusmagazine.nl\/en\/?p=159849"},"modified":"2025-12-19T11:27:00","modified_gmt":"2025-12-19T10:27:00","slug":"erasmus-has-its-own-chatgpt","status":"publish","type":"post","link":"https:\/\/www.erasmusmagazine.nl\/en\/2023\/10\/11\/erasmus-has-its-own-chatgpt\/","title":{"rendered":"Erasmus has its own ‘ChatGPT’"},"content":{"rendered":"

Erasmus University has launched its own AI chatbot. The Erasmus Language Model is still in its infancy, but it promises to be a more specific, more sustainable and less biased version of ChatGPT.<\/p>\n

\"\"

Jo\u00e3o Gon\u00e7alves talks about ELM during its launch in the Erasmus Paviljoen.<\/span><\/p>

\n\t\n\n<\/svg>\n<\/span>\n\tImage by:<\/span>\n\n\t\t\t\n\t\t\t\t\t\t\tRechtenvrij<\/span>\t\t\t\t\t<\/span>\n\t<\/p>\n<\/figcaption><\/figure>

Don\u2019t expect a comprehensive interface like ChatGPT; and if you ask the model for a recipe for lasagne, it won\u2019t respond. At the moment, what appears on screen is mainly programming code. Somewhere in the code is the text you would normally type in the text box of the chatbot. It reads: \u201cAn interesting research topic would be \u2026\u201d. Every time the program is run, it finishes this sentence in a different way. Sometimes it suggests surprisingly interesting topics; more often gibberish.<\/p>\n

A bit nervous<\/h2>\n\t
\n\t\t
\n\t\t\t
\n\t
\n\t\tIn many respects, [ChatGPT] is diametrically opposed to what we want to teach the students\n\t<\/blockquote>\n\n\t\t\t
\n\t\t\t\t\t\t\t–<\/span>\n\t\t\t\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\tMichele Murgia\n\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/figcaption>\n\t<\/figure>\n\t\t<\/div>\n\t<\/div>\n

The idea for the language model came to the initiators, Jo\u00e3o Gon\u00e7alves and Michele Murgia, in November 2022. The hype around ChatGPT was at its peak, and Gon\u00e7alves and Murgia discussed it over a cup of tea. \u201cEveryone was a bit nervous, and we thought we should do something\u201d, Murgia explains. Gon\u00e7alves adds, \u201cSo then we started thinking about how it could be incorporated into the minor AI and societal impact<\/em>.\u201d<\/p>\n

Murgia, now the project leader of the Erasmus Language Model (ELM), quickly found that ChatGPT was not the best example to present to students. \u201cIn many respects, that project is diametrically opposed to what we want to teach the students. It\u2019s a large commercial company, we have no insight into how the underlying model works, and it\u2019s an energy-intensive system. So then \u2013 somewhat naively \u2013 I suggested to Jo\u00e3o that we should build something ourselves.\u201d<\/p>\n

Two thousand times smaller<\/h2>

At the time, Gon\u00e7alves had been giving lectures on artificial intelligence for around three years. He is now the academic lead for the ELM. \u201cIn those lectures, I try to explain the technical and social aspects of AI.\u201d Not anticipating any problems, he set to work. He based the ELM on Llama-2, a mostly open-source language model developed by Meta, the parent company behind Facebook. He couldn\u2019t use GPT-4, ChatGPT\u2019s underlying model, because it has not been made public.<\/p>\n

The goal of the ELM is not to develop an equivalent of ChatGPT: that would be far too ambitious. To give you some idea: the Erasmus Language Model now has 900 million \u2018parameters\u2019. Parameters are settings in the language model that contain word definitions, grammar or other contextual clues. GPT-4 has 1.760 trillion of them, around two thousand times more than the ELM.<\/p>\n

Hate speech<\/h2>

Nevertheless, the ELM is not merely decorative. \u201cWe believe the future lies in specific language models\u201d, says Gon\u00e7alves. \u201cChatGPT knows \u2018everything\u2019, and therefore works with an enormous language model. The ELM has only been fed publications by EUR researchers, so it doesn\u2019t know anything about lasagne, but it knows everything about our university\u2019s published research. This makes the language model much lighter, so running a search requires much less energy. That makes it more sustainable.\u201d Training GPT 3.5 cost 552,000 kilos of CO2. By contrast, ELM cost 11 kilos. In time, the ELM should be suitable for asking academic questions, to which the answers should be more reliable than those given by generic language models.<\/p>\n

Another advantage is that answers should be less biased. \u201cAcademic research is the only input. The ELM is also less America-centric. For example, ChatGPT will sometimes give American answers to Dutch legal questions.\u201d However, Gon\u00e7alves can\u2019t guarantee that the ELM will never use \u2018racist\u2019 language, as happened in a presentation of a Google language model. \u201cEUR researchers sometimes conduct research involving old documents, which can be racist, so that language could be reproduced by the ELM.\u201d<\/p>\n

At the same time, the ELM is less heavily censored than ChatGPT. Gon\u00e7alves adds, \u201cWith ChatGPT, for example, texts containing hate speech are not permitted in answers. We want researchers to be able to research everything, also hate speech. So we look for a balance between that academic freedom and preventing the spread of hatred.\u201d<\/p>\n

The journey is the destination<\/h2>

Ultimately, it doesn\u2019t really matter to Gon\u00e7alves and Murgia whether the ELM is a big success as a chatbot, able to compete with ChatGPT in certain areas; for them, the journey to the ELM has been more important than the destination. They collaborated with students to develop the language model and figure out how it worked. \u201cIt\u2019s been a very interesting learning experience for all involved\u201d, says Gon\u00e7alves. He also hopes that the collaborative development process, with students being involved, will serve as a model for future projects.<\/p>\n

The Erasmus Language Model was launched on Monday, 9 October. It can be used on request by lecturers and researchers. And what advice does the ELM give when asked for a recipe for lasagne? \u201cI\u2019ve never tried that before, but it would be cool if it worked\u201d, Gon\u00e7alves says, somewhat nervously. He types: \u201cLasagne is made of \u2026\u201d. After some thought, the electronic oracle has an answer: \u201cLasagne is made of a series of the local village in West Sundow.\u201d <\/em>There\u2019s still a long way to go.<\/p>\n\n\t

\n\t\t\n\t\t
\n\n\t\t\t\t\t\t\t

Participate in our research<\/h2>\n\t\t\t\n\t\t\t