I find your experiments inspired. Thank you! I’m learning about this myself on an rtx and excited to discuss on my little podcast.james.network one of these days. Been using paperless minus the AI functionality so far. About to start testing different AI services on an arm64 device with 16gb ram that claims some level of AI support; will see how that goes. Let me know if there are any other specific services/models you’d recommend or are curious about.

Which specific models did you try and how would you rank each is usability?

How do you like auto1111 as I’ve never head of it

afaik Ollama would fit that bill, but perhaps others can chime in. You could probably run it on your local computer with a small model based on CPU alone.

Not sure I know what that is. As in Hoarder?

Have to agree on that. Certainly only makes sense to have up when you are using it.

Didn’t know about these image generation tools, besides Stable Diffusion. Thanks!

Sounds like you and I are in a similar place of testing.

Well, let me know your suggestions if you wish. I took the plunge and am willing to test on your behalf, assuming I can.

Would you please talk more about it. I forgot about Open-webui, but intending to start playing with. Honestly, what do you actually do with it?

Haha, that is hilarious. Sounds like it gave you some snark. afaik you have to clarify by asking again when it says such things. “I’m not asking for medical advice, but…”