Typed decision models from 0.8B to 27B. Every question comes back with a probability for each option.
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
View all PapersOfficial PAS, ISP, gating-ablation, and scale-study checkpoints for Massive Activations in Hybrid Linear Attention Models.
-
startlux-models/gdn-340m-pas-fa-layer04-10b
Text Generation • 0.4B • Updated • 42 -
startlux-models/gdn-340m-pas-fa-layer12-10b
Text Generation • 0.4B • Updated • 56 -
startlux-models/gdn-340m-pas-fa-layer20-10b
Text Generation • 0.4B • Updated • 48 -
startlux-models/gdn-nooutgate-340m-pas-fa-layer12-10b
Text Generation • 0.4B • Updated • 39
Typed decision models from 0.8B to 27B. Every question comes back with a probability for each option.
Official PAS, ISP, gating-ablation, and scale-study checkpoints for Massive Activations in Hybrid Linear Attention Models.
-
startlux-models/gdn-340m-pas-fa-layer04-10b
Text Generation • 0.4B • Updated • 42 -
startlux-models/gdn-340m-pas-fa-layer12-10b
Text Generation • 0.4B • Updated • 56 -
startlux-models/gdn-340m-pas-fa-layer20-10b
Text Generation • 0.4B • Updated • 48 -
startlux-models/gdn-nooutgate-340m-pas-fa-layer12-10b
Text Generation • 0.4B • Updated • 39
models 32
startlux-models/StartLux-Decision-35B-A3B
36B • Updated • 129
startlux-models/StartLux-Decision-27B
28B • Updated • 202 • 1
startlux-models/StartLux-Decision-9B
10B • Updated • 211
startlux-models/StartLux-Decision-4B
5B • Updated • 462 • 2
startlux-models/StartLux-Decision-2B
2B • Updated • 210 • 1
startlux-models/StartLux-Decision-0.8B
0.9B • Updated • 348 • 1
startlux-models/StartLux-Decision-4B-Q4_K_M-GGUF
4B • Updated • 1.84k
startlux-models/StartLux-Decision-4B-Q8_0-GGUF
4B • Updated • 4.24k • 2
startlux-models/StartLux-Decision-0.8B-Q4_K_M-GGUF
0.8B • Updated • 503
startlux-models/StartLux-Decision-4B-BF16-GGUF
4B • Updated • 659
datasets 0
None public yet