u/WouterC

70 post karma · 4 comment karma · joined May 2013

  1. 23points

    Single Radeon AI PRO R9700 and vllm (self.ROCm)

    55 comments

  2. 2points

    Silverblue and AMD Radeon AI PRO R9700 (self.silverblue)

    7 comments

  3. 3points

    Inlegzooltjes (self.Hardlopen) [Schoenen/Kleding]

    15 comments

  4. 14points

    RTX5070, Qwen 3.6 and GPU load (self.Qwen_AI) [Help 🙋‍♂️]

    7 comments

  5. 1points

    HermesAgent in rootless podman containers (self.hermesagent) [Help / Troubleshooting — Errors, bugs, crashes, not working]

    10 comments

  6. 1points

    Opencode and M365 Copilot (self.opencodeCLI)

    2 comments

  7. 1points

    F43: disable suspend (self.Fedora) [Support]

    2 comments

  8. 2points

    ConnectLife app and AEH-W4E1 wifi modules (self.Hisense) [Question]

    3 comments

  9. 10points

    Custom build container and quadlets (self.podman)

    13 comments

WouterC

I noticed that most of these repositories fork a modified version of vLLM and compile custom patches during the initial startup. Is there a specific reason why pre-built, ready-to-run container images with these patches already baked in aren't provided?

WouterC

I also prefer the forced hygiene. I like to play around with different software.
Now I'm forced to install it in a container (for example distrobox). All the dependencies are installed in that container. Afterwards I just throw away the container and there is no garbage left in the OS.

WouterC

I know, but does it work with the amdgpu driver that comes with the kernel or do I have to install the latest version of amdgpu on the host os?

WouterC

Does everything work fine? Also the gateway and dashboard?

WouterC

So a RTX 5060 would be better then a RTX 5070 for this workload?

WouterC

And with 12GB VRAM?

WouterC

Thanks

WouterC

Good advice

WouterC

Idem

WouterC

I logged already issues on github but there now more then 3000 issues and 5200 pull requests open.

WouterC

I don't want it to run as root ;-)

WouterC
WouterC
WouterC

How can you can launch automatically Qwen3.5-2B-Q6_K when llama starts?
I have also my models defined in a models.ini file.

WouterC

Industrieparken zijn ook heel rustig op zondag

WouterC

During the pairing phase the AEH-W4E1 wifi module creates a wifi network 'hismart-XXXX' but the ConnectLife is searching for a network 'HIS-XXXXXX'.
ConnectLife will never find the network.