CogniSim – Interaction utilites for crossplatform LLM agents
CogniSim – Interaction utilites for crossplatform LLM agents
We built a tool to that makes it easy to create LLM UI automations for IOS and Android. If You've ever tried to create tests that run with an LLM on mobile, probably encountered context problems due to the accessibility view being too long or just sending a screenshot to the LLM, which has low accuracy. Cognisim: 1. Turns the accessibility into a more LLM parseable form for your agents, and uses set of mark prompting to combine the screenshot and text for more accuracy. We create a grid of the screen so the text representation also has some form of visual structure to it. 2. Implements a simple API to do interactions on IOS and Android 3. Maps LLM responses back to accessibility components via a dictionary that maps id -> accessibility component Pretty simple, but we hope you get some value from it :) We run CogniSim in production for thousands of mobile UI tests a day at Revyl. If you are interested in proactive observability - combining resilient end to end tests with open telemetry traces, give us a shout - revyl.ai
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
I made GAI to have LLM agents in Go without heavy frameworks
Redis-LLM – Redis module integrates LLM with Redis
LitLLM the Spiciest LLM Wrapper
LLM Reasonsers
Resilient LLM
Hegelion – Force your LLM to argue with itself before answering
I Stopped Hoping My LLM Would Cooperate
Module for LLM Homeostasis (PoC)
Doom Compiled into an LLM