← r/LocalLLaMA
▲
0
 
6👁
r/LocalLLaMA · u/alichherawalla · 14d ago

[Research Proposal] Cognitive Sharding: A Systems Architecture for Computer Use on Consumer Hardware

https://preview.redd.it/z2a8tjtenkrh1.png?width=2408&format=png&auto=… Computer-use agents do not need one large model to perform every cognitive function. Cognitive Sharding partitions the agent across specialist models, then coordinates them through a code-owned control plane. The current implementation uses: \- Bonsai 2 27B for reasoning and planning \- Kev 4B, built on Qwen3.5 4B, for rapid action selection \- UI-Mate 9B for visual grounding The control plane owns execution state, model residency, validation, retries, and recovery. Models receive bounded decisions instead of unrestricted control over the agent loop. This separation changes the hardware requirements. Models can be loaded and unloaded transactionally according to the current execution phase. The system therefore runs a complete local computer-use stack within the memory limits of a 16 GB consumer computer. This is different from a mixture-of-experts model. The shards are independent models with different inputs, training objectives, runtimes, and authority. Their composition happens at the system level, not inside one neural network. The approach document describes the planner–selector–grounder architecture, candidate construction, bounded execution, environment-verified recovery, and memory-aware model residency. I've added more details here: https://github.com/off-grid-ai/cognitive-sharding#cognitive-sharding-a-systems-architecture-for-computer-use-on-consumer-hardware Will run it against additional benchmarks and will publish the results soon.

1 0 0 10/3 06:32 10/4 01:40 UTC
scorecomments6 sightings
first seen 2026-10-03 06:32 UTClast seen 2026-10-04 01:40 UTCscore then 0score now 0gained 0sightings 6
open on reddit ↗ 💬 2