jankyai

Local AI, on purpose

jankyai

Local models, with the janky left in.

A home-lab notebook: what runs on the machine in front of you, what breaks, and what the IronClaw bench actually measured.

IronClaw local bench, selected measurements from 2026

Models tested locally
8+

Conservative documented count

Documented
Tokens/sec
95.7tok/s

GPT-OSS 20B measured generation speed

Measured
Largest model run
35B

Qwen3.5 mixture-of-experts, quantized

Documented
GPU VRAM
16GB

NVIDIA RTX 5060 Ti

Documented

Personal test results, not standardized benchmarks. Speeds vary with context, quantization and runtime settings.

Four drawers

The build log sits underneath. These are the shelves.

From the bench

One break, one save, from the IronClaw machine.

warn

Featured pitfall

Fast models don't guarantee useful agents

GPT-OSS passed 9 of 16 current-contract tool tasks in one controlled evaluation.

Measured

What it taught meThe tokens-per-second number was not the job. Nine out of sixteen is what that tool contract actually scored.

ok

Featured win

20B on a 16GB GPU

GPT-OSS 20B, MXFP4, llama.cpp, on the RTX 5060 Ti. Generated tokens per second.

95.72tok/sMeasured

Observed local model speeds Measured

Full bench

Scale, 0 to 120 tok/s

  1. GPT-OSS 20B

    MXFP4, llama.cpp

    95.72 tok/sMeasured

  2. Qwen3-Coder 30B

    quantized Q3 variant

    ~82 to 84 tok/sMeasured

  3. Gemma 4 26B-A4B

    IQ3_XXS

    ~77 to 78 tok/sMeasured

  4. Qwen3.5 35B-A3B

    IQ3 variant

    ~64 to 68 tok/sMeasured

Rounded observations from different sessions, not a standardized comparison. A range bar uses the midpoint, which is not another measurement.

The story so far

All logs

ironclaw

Story 3

Story 3: The break

OpenClaw never fully ran. The name that stuck was IronClaw. The third real build log.

rebuild

Story 4

Story 4: The pain

A WSL fix wiped the containers. A 16 GB card and a fresh Windows install came after. The fourth real build log.

models

Story 5

Story 5: Build, build, build

GPT-OSS 20B on 16 GB, a switch from Claude to GPT, and the lesson that the build was the problem. The fifth real build log.