Server hermes-01: Model Qwen3.6 27B MTP started inference job #1234
Server hermes-02: GPU 0 temperature at 65°C, VRAM usage 14.2GB
Server hermes-03: GPU 1 temperature approaching threshold (68°C)
Server hermes-04: Job #1233 completed successfully
Server hermes-05: Model Qwen3.6 27B MTP loaded into memory
| Model Name | Quantization | Context | GPU | Status | Jobs |
|---|---|---|---|---|---|
| Qwen3.6 27B MTP | MTP 4-bit | 32K | hermes-01 GPU 0 | Running | 3 |
| Qwen3.6 27B MTP | MTP 4-bit | 32K | hermes-02 GPU 0 | Running | 2 |
| Qwen3.6 27B MTP | MTP 4-bit | 32K | hermes-03 GPU 0 | Running | 1 |
| Qwen3.6 27B MTP | MTP 4-bit | 32K | hermes-04 GPU 0 | Running | 4 |
| Qwen3.6 27B MTP | MTP 4-bit | 32K | hermes-05 GPU 0 | Running | 2 |
| Qwen Coder | MTP 4-bit | 16K | hermes-02 GPU 1 | Running | 1 |
| Qwen3.6 27B MTP | MTP 4-bit | 32K | hermes-02 GPU 1 | Paused | 0 |
| Qwen3.6 27B MTP | MTP 4-bit | 32K | hermes-03 GPU 1 | Error | 0 |