Skip to content
Launchpad Library logo

inference

2 free resources on this topic. Everything here is free and hand-picked. You can also search within this topic.

FreeArticle
Technology & Ethics

Offloaded inference for real-world physical AI robotics

Microsoft Research blog post on running the heavy AI thinking for robots on remote computers instead of on the robot itself, and what that means for speed, cost and reliability in real-world robotics.

Why I recommend it: Free to read. Written by Microsoft researchers, so it presents their own approach favorably — Microsoft also sells the cloud computing this kind of setup relies on.

#robotics#physical ai#inference#microsoft research#research
microsoft.comAdded Sep 24, 20260 opens
FreeAI Tool
AI & Assistive Tools

Cactus

On-device AI with cloud fallback for smartphones, laptops, and edge devices, designed to cut inference costs by knowing when to hand off to frontier cloud models.

Why I recommend it: I am watching on-device AI closely because it could make powerful tools accessible at lower cost and with more privacy. Cactus is a useful example of the "know when to hand off" design pattern.

#accessibility#ai#ai ethics#ai-tool#ai-tools#cost-saving#data-privacy#edge-ai#efficiency#free#frontier-models#inference#laptop#local-ai#on-device-ai#privacy#smartphone#tool
cactuscompute.comAdded Sep 9, 20260 opens