Building a personal AI assistant device, looking for ideas
Hey all. I am building a personal AI assistant device and I am looking for input from anyone who has tried/seen something similar. The idea: a small computer that is always on, that I can talk to like a normal person, back and forth, not just one question one…
Hey all. I am building a personal AI assistant device and I am looking for input from anyone who has tried/seen something similar. The idea: a small computer that is always on, that I can talk to like a normal person, back and forth, not just one question one answer. It should also do real work in the background, notes, search, Notion, email, calendar, files. My phone can not do this well. It sleeps, kills background processes, and will not listen for a custom wake word unless the screen is on. So I want dedicated hardware instead. What I want it to do: Wake up on one spoken word, no button Hear me across a room, let me interrupt it while it talks Small screen for showing data Camera so I can show it things Simple tasks run locally and fast, even offline, harder thinking goes to Claude's API Act as a hub other future projects of mine can connect to Parts I am considering: Raspberry Pi 5 16GB + something to boost AI ability, a mini mic, active cooler, battery, small screen and camera module. Thinking of this as a custom wearable hardware strapped to my phone. Anyone built something like this? Any tips on software and hardware to use?
已收录讨论
You might get the same output by having a server with local llm connected to home assistant.
Thank you, I appreciate it! I will look into it and will most likely come back to you with several questions - thanks!
But are you able to control all stuff then?
I have thought about that to but I hope I could do it with the Raspberry haha
Wow, what models do you use?
That sounds absolutely interesting to look into. Maybe a bit expensive but cool to have it accessed from a smartwatch. Yes, please share that, thank you!
Will look into it, thanks!
Yeah and it’s free to use if you have a Claude subscription since it uses the cli. And I can easily swap the voice model for something open source or cheaper. Let me clean the repo and finish off some bugs before I share it with you. I also plan to make an app to pair with it so I can code on my phone since Termius/tmux is very finicky to use. Itll be easy to use like chat gpt ui but connect to your MacBook directly.
Yeah maybe that is right
I havent implemented it yet, but this is one of the project I want to work on next. I know home assistant can have a alexa-like voice assistant whoch you can talk to. Then if you keep a log of the conversations and give context to an llm (in a separate machine i am thinkjng) , this may do all the things you want ot to do. - this was my thinking. My plan is to give it access to all the IoT devices as well eventually which will make it very powerful (and dangerous haha)
I've built probably 60 of these for different scenarios. Different people different things. You only need a raspberry pi 5. There's a Gemma 4 it for model that is designed to run on a small hardware just like that. You'll want a three-tier application as your backend server will be written in Python, from there you can instantiate almost anything you want including Lang chain and Claude, all you need to do. Is build a standard agent with agent tools and then you bolt on the tools that you want. All that stuff is relatively straightforward to make once you've done it once. old video old 2 watch hologram small Here's some examples I made. Ask me any question you want.
I think you still need some GPU to run local model to work relatively fast. You also need to run Speach-To-Text model, etc. So i am afraid that Raspberry Pi is not enough.
I’ve build a ai voice that lives on my Apple Watch. It’s open source but private. Can share it with you if you want. It uses Cartesia so it’s bit pricey but nothing big. Maybe $40-50 if u talk for it 4 hours a day. It can listen live, very fast response, it’s similar to the new chat gpt voice so it can interrupt you and you can speak both ways. I use it as a brainstorm partner as speaking to someone helps me think more deep about ideas and it’ll write it all down then I use fable to plan it out before I implement a feature. I also plan to make the ai voice be able to call tools, use the Claude code cli by connecting it opus 5 as its brain, so you can def get it to do smart home activities for you
hermes plus phone plus cheap used minipc. telegram app
You are looking for Hermes Agent.