I was looking for a light weight web application for RP, couldn't find a good and easy, so built one myself - NanoRP
I self-host open-webui locally but that is a resource hungry app, taking around 2-3GB of RAM. I wanted something light weight, local at the cost of some stuff like tool calling etc. After spending my weekend looking for something that fits my need, I decide…
I self-host open-webui locally but that is a resource hungry app, taking around 2-3GB of RAM. I wanted something light weight, local at the cost of some stuff like tool calling etc. After spending my weekend looking for something that fits my need, I decide to build one for myself and thought to share with wider community. (it wasn't vibe coded, it was agentic-ally engineered) I tried SillyTavernAI, LiteRP, Anything-llm, LibreChat all are either very resource heavy, complicated or not a webapp with mobile friendly view. Anything I missed? Please suggest, I want it to be self host-able, run with under 1GB RAM (Nano-RP works with just 50MB RAM) and must be simple and have mobile friendly view, with ability to add and switch models/providers mid conversation (similar to open-webui).
Collected discussion
I'm in the process of building a solution that fits into this niche, currently floating around ~71MB RAM with full support for OpenAI compatible endpoints, SDK subscriptions, and soon-to-be local models. Python + SolidJS + TailwindCSS Will open source it when I am happy with it, maybe in a few weeks.
Did you try kobold.cpp? It comes with a lightweight chat interface for rp and general use.