The quickest and simplest guide to spinning up a powerful local AI stack. Part 4 – Transcription via Whisper

So it turns out that OpenWeb-UI comes with a form of whisper integration out of the box. So I'm going to cover what changes you should make to make it better, and then I'll include a bonus of a n8n + docker-compose you can use to run a whisper-server + n8n test workflow for it. … Continue reading The quickest and simplest guide to spinning up a powerful local AI stack. Part 4 – Transcription via Whisper

The quickest and simplest guide to spinning up a powerful local AI stack. Part 3 – Image Generation via Stable Diffusion

So as this is the first part that integrates things that aren't included out of the box, I'm going to build these parts out separately and then at the end I'll release my full docker-compose.yml which will have all the pieces. With that in mind, lets get started. First you should go to your users … Continue reading The quickest and simplest guide to spinning up a powerful local AI stack. Part 3 – Image Generation via Stable Diffusion

The quickest and simplest guide to spinning up a powerful local AI stack. Part 2 – SearXNG

In this part I'll keep it short and sweet and just cover how to get Searxng going and connected to OpenWeb-UI. So you want to comment out the following lines within the docker-compose.yml cap_drop: - ALL and then restart the stack: python3 start-services.py --profile=gpu-nvidia Once it's all up, remove the comments and restart it again. … Continue reading The quickest and simplest guide to spinning up a powerful local AI stack. Part 2 – SearXNG

The quickest and simplest guide to spinning up a powerful local AI stack. Part 1

As I delve deeper into AI, I got tired of the Jan's and LLM Studio. I have a handful of goals in mind, but of course to start it's important to get local stack. Thankfully the tool suites have exploded including docker composes. My goal after a prototype is RAG support. Anything like integrating Whisper, … Continue reading The quickest and simplest guide to spinning up a powerful local AI stack. Part 1