BLABLADOR

JSC’s Inference Infrastructure

Alexandre Strube

December 4th, 2024

Website

https://helmholtz-blablador.fz-juelich.de
  • Play around! 🐶

OUTLINE

  • Past
  • Present
  • Future

Blablador

  • /ˈblæblæˌdɔɹ/
  • Bla-bla-bla 🗣️ + Labrador 🐕‍🦺
  • A stage for deploying and testing large language models
  • Models change constantly (constantly improving rank, some good, some awful)
  • A mix of small, fast models and large, slower ones - changes constantly, keeps up with the state of the art
  • It is a web server, an api server, model runner, and training code.