LightOn
ColBERT-Zero v1.0
ColBERT-Zero is a late interaction model trained from scratch using PyLate, designed for multi-vector retrieval tasks. Developed in collaboration with École Polytechnique Fédérale de Lausanne (EPFL) and the Swiss AI Initiative, it achieves state-of-the-art results on the BEIR benchmark with under 150 million parameters, utilizing only public data.
OriOn v1.0
OriOn is a family of long-context visual language models developed by LightOn, capable of processing up to 250 pages in a single pass. The 32-billion parameter model achieves state-of-the-art performance, matching or exceeding models seven times its size. Combined with Paradigm's Visual RAG, OriOn enhances agentic workflows by providing extended memory for deep reasoning, tool chaining, and complex task execution on sovereign infrastructure.