141 - Building an open source LM, with Iz Beltagy and Dirk Groeneveld

In this special episode of NLP Highlights, we discussed building
and open sourcing language models. What is the usual recipe for
building large language models? What does it mean to open source
them? What new research questions can we answer by open sourcing
them? We particularly focused on the ongoing Open Language Model
(OLMo) project at AI2, and invited Iz Beltagy and Dirk Groeneveld,
the research and engineering leads of the OLMo project to chat.
Blog post announcing OLMo:
https://blog.allenai.org/announcing-ai2-olmo-an-open-language-model-made-by-scientists-for-scientists-ab761e4e9b76
Organizations interested in partnership can express their interest
here: https://share.hsforms.com/1blFWEWJ2SsysSXFUEJsxuA3ioxm You
can find Iz at twitter.com/i_beltagy and Dirk at
twitter.com/mechanicaldirk