Truly Open Models

OSI models via gguf inference in standard and T3 mode. Default model is a 32b model in just 8.0 GB!
Model
1 4096
0.1 4
0.1 1
0 100
0 2