Vol. 20 - Deep Thinking: Reinforcement Learning and Benchmarking for Better LLMs

The 20th volume of Better AI Meetup will somewhat return to the topic of the very first meetup in 2021, where the first ever Slovak language neural model was presented. This meetup will be all about fine-tuning and benchmarking LLMs to help people get the most out of them. First, Jakub Mačina, an LLM researcher from ETH Zurich will talk about a post-training alignment method for collaborative agents to help LLMs co-reason and co-act with humans. He will show how an 7B open model can rival larger proprietary LLMs by thoughtful use of reinforcement learning. Marek Šuppa, a Principal Machine Learning and AI Engineer at Slido and Andrej Ridzik, a Senior Research Engineer at KInIT will show us how language models are evaluated to separate real capability from marketing fluff. They will cover the ongoing effort to create a benchmark model for Slovak language, why different models require different benchmarks and what are the challenges of LLM evaluation.