BLABLADOR ![]()
JSC’s Inference Infrastructure
Alexandre Strube
December 4th, 2024
Website
https://helmholtz-blablador.fz-juelich.de
Blablador
- /ˈblæblæˌdɔɹ/
- Bla-bla-bla 🗣️ + Labrador 🐕🦺
- A stage for deploying and testing large language
models
- Models change constantly (constantly improving
rank, some good, some awful)
- A mix of small, fast models and large, slower ones
- changes constantly, keeps up with the state of the art
- It is a web server, an api server, model runner,
and training code.