Get a cheap VPS and set up a VPN of your choice.

I don’t know of any project that already supports that AI processor. You’d still be using the CPU and GPU at the moment.

I can really recommend XCP-ng. For me it strikes a pretty good balance of features and ease of use.

Using whatever works better for the current project is doing Hybrid Cloud. Now your boss can brag about how modern the infrastructure is.

And 2d, who self host on a server/VPS they rented somewhere.

deleted by creator

You can install Wireguard or another VPN to encrypt your traffic to the VPS.

It feels like I heard that somewhere before and looking at my profile, I did cancel Jellyfin at some point.

I supported Finamp for a while until they removed sponsoring, guess I’ll do Findroid now.

Creative Commons is likely more appropriate for FOSR.

And they now have a working release pipeline, so releasing often is easier.

You’ll want to install a reverse proxy of your choice on the VPS. Have clients access it over ipv4 and configure it to proxy pass it to your ipv6 address. Nginx at least is capable of doing ipv4 & ipv6 -> ipv4, I think the inverse should also be possible.

You can use OpenCL instead of ROCm for GPU offloading. In my tests with llama.cpp that improved performance massively.

Definitely do benchmarks for how many layers you can offload to the GPU. You’ll see when it’s too many, as performance will crater.

By launching llama.cpp as a server you’ll actually be able to continue to use openwebui as you currently have.

It’s probably still more efficient to keep a 192k opus and a 320k mp3 around than one flac.

Cron sadly does not offer precision in the seconds range.

Yeah, they’re more power hungry, but they’re also way more performant than a pi 4.

VAAPI is the “standard” interface for hardware en-/decoding on Linux. It should work with any GPU using the open source drivers and mesa.

I don’t know how QSV can be installed; AMF, the AMD equivalent, is limited to their proprietary driver.

On my phone (Android, LineageOS) there’s an option in the hotspot settings to allow clients to use the active VPN.

Syncing two instances sounds like a fun challenge. I think there’s some project to replicate an sqlite db over the network. Similarly, you could use ceph or other distributed storage for the media.

I built something like this for Nextcloud a few years back, fun times.

Support by packages is generally there. What is lacking however, are drivers for video acceleration and many other soc- and often board-specific customisations required.

X86 in contrary offers one unified and queriable interface (ACPI, UEFI) that makes custom images unnecessary. ARM has ServerReady for that, however I’m not aware of any consumer chip that implements this.

Maybe ironically, the dev acutally makes a good case for why Wayland should be the future in that post. (Crashing the screen locker doesn’t cause it to display your desktop instead)