The quickest and simplest guide to spinning up a powerful local AI stack. Part 6 – Open-WebUI To Crawl4AI – Chat

Well this took a unexpected turn.

As I mentioned in my last post, I’d like to give the Open-WebUI models access to Crawl4AI via the chat then I’d like to implement RAG into the n8n workflow I created and shared in my last post. THEN I’d create my own structure and docker-compose.

However, after restarting the base stack I started with today, there was some error and rather then trying to figure that out (or seeing if the docker-compose has been updated in Cole’s repo) I created my own structure and docker-compose.

That said, I’m not going to share it just yet, as I want to add a few more tweaks but that’ll come before the crawl4ai RAG implementation.

Anyway, turns out that giving Open-WebUI access to Crawl4AI is a lot simpler then the n8n workflow from the last post lol.

Also, makes integrating stable diffusion and whisper WAY easier which I’ll include when I release my docker-compose/stack repo which I’ll then continue to build.

Good thing is, going the N8N route at least has prepared me quicker for more complex use cases.

Anyway, turns out that any web service with a /openapi.json can be integrated quickly and easily with Open-WebUI via the Admin Panel –> Settings –> Tools

Yup…

So after you spun up crawl4ai from the previous post and you’ve confirmed that that http://localhost:8860/playground is accessible, try hitting /docs which should work and give you a link or then hit /openapi.json

As expected if that works you should see:

So now in the Open-WebUI tools settings just hit the + and then enter the domain + port which in my case is:

http://crawl4ai:11235

Make sure you hit the refresh button in this window and that it states ‘Connection Successful.’ Also, I changed visibility to Public as to not deal with groups or anything atm.

Then hit ‘Save.’

Now you should see that entry added in the list of tools in the settings:

Now start a new chat, hit the + button and toggle crawl4ai on:

And now you should see a wrench to the left of ‘Web Search.’

When you click it you should see it’s available:

Awesome! Now you can just ask something with a URL and get a proper response. Now it still very finicky atm and I will definitely go over and share some of the templates I make that help open-webui/llms determine what tool/functionality I’m actually expecting.

So just keep that in mind.

Anyway, now input something like “what is https://gainsec.com/” and enjoy!

Or “what is the latest article on https://gainsec.com/”

Using it with Qwen:

Come to think of it, that’s the second latest article. Oop.

END TRANSMISSION