IT's posible to use GLM-4.5 AIR directly without openrouter?

[jvalen36]

hello:

IT's posible to sue GLM-4.5 AIR directly with out openrouter?

reagrds

[acoliver]

How big is your rig?

[jvalen36]

I have a i7 36 gb dell laptop.

regards

[acoliver]

LMStudio get a 4-bit quantization and maybe. I'd double-check with ChatGPT o3. Depends on your graphics card too...

[acoliver]

Oh but that's a really big model...you may be better off with something smaller

[BradKML]

Usual rule with AutoRound: take the GB of VRAM (or RAM if you want slow CPU), double it, that is the number of billion parameters the GPU can take with no sweat.