JibarOS, a shared inference runtime for Android
JibarOS, a shared inference runtime for Android
JibarOS is an Android 16 fork I’ve been building to explore a shared runtime for on-device inference. It adds: a system service in system_server a native daemon pluggable inference backends a Binder AIDL for capability-based calls across text, audio, and vision The goal is to centralize things that are otherwise handled independently by apps, like model residency, scheduling, fairness, and backend routing. The current interface exposes 12 capabilities including completion, translation, rerank, embeddings, transcription, synthesis, VAD, OCR, detection, and description. Repo: https://github.com/Jibar-OS/JibarOS Interested in feedback from anyone who has worked on Android framework/services, ML runtimes, or device-level resource scheduling.
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
java runtime android jar swing
A container runtime implemented in x86_64 assembly
Subverting Go's Runtime System
Toggle Methods and Endpoints at Runtime
Mixing C++ with Angelscript for runtime introspection and debugging
Restate, a Distributed Async Runtime
AegisBPF – Deterministic Runtime Enforcement via eBPF LSM
Kern – container and resource runtime in a 1.5 MB binary, no daemon
Permission Nanny – Porting Android M Runtime Permissions to Gingerbread
Fault-tolerant inference for noisy and imperfect data.