Ahaha thank you, I naively assumed the unlabeled graph in the readme was tps, no... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

jackb4040 36 days ago | parent | context | favorite | on: AirLLM 70B inference with single 4GB GPU

Ahaha thank you, I naively assumed the unlabeled graph in the readme was tps, not spt!

throwawayffffas 36 days ago [–]

Running 292 tps on K3 would make your gpu a money printer.

meneton 36 days ago | [–]

spt not tps

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact