I have the voice calling app. I have an ai agent app. Now I need to get them working together.
Adding Tools to Cluster-chat
I opened up the api endpoints for my Smith agent app (light Openclaw/nanoclaw clone) so that I can add Smith as a model to cluster-chat. Then I created the Smith agent and added the model and my already existing piper (text to speech) and whisper (speech recognition) to it.
It works!
A New To-do List
I have been using a combination of Google keep notes, a self hosted Vikunja service, and flat files with custom scripts as some sort of to-do list solution. Instead of launching some bridge service to put them all in one place, I decided to create one system to truly replace them all. My agents already have access to gitea, gitea has "issues", why not use this as a to-do list? I could then have a web app that utilizes git api to display and manage my tasks. A few paragraphs with Claude and I was able to launch this "gitodo" service.
All together now
I added a new tool to Smith spelling out how to use git for a to-do list. It's running qwen-2.5:7b on cpu only Ollama, so being specific on tool use helps, even though agents speak fluent git.
video
There it is! I can talk to my agent and have it add and remove things to my git(ea) backed to-do list!
Next
I need to start cleaning up little UI bugs. I also want to make an android app that uses the same git api for a to-do list widget like keep notes has.
Extra
I also got started a new home/launch page that leverages traefik api to detect and display links to all the services on my swarm.
Called Launch, it is replacing my fenrus service. For me, fenrus is too slow and too manual. Launch detects services and grabs favicons automatically.
It still allows customization of links, but lacks categories or a user system. Those are two things fenrus has that launch will need. Still, when you have 50 odd services, it gets tedious adding links for them one by one. The fenrus service will be shut down, the stack yaml moved to the dreaded "old" folder. 💀
Getting computers to do things for me is the goal here 😁
[j@justinjanson.com ~]$