I'm running it in router mode, but people on Reddit were recommending people use llama-swap instead. Am I missing something by using router mode?

I believe it's useful for running multiple llama.cpp forks at the same time (e.g. a model you want requires special patching)

Poolside Laguna was quite good too (if you look beyond some of the teething issues).

Had Deepseek V4 Flash 0731 not launched, their latest Laguna release was really intelligent at non-coding tasks and it would have been my go-to model for my local workloads.

For me Laguna frequently slightly corrupted text then it would be unable to notice the difference and get stuck making the dumbest conclusions. Thinks like typoed directory or function names. It was a great model other than that, but I ended up just going back to Qwen3.6

Make sure you've got the latest updates - both Poolside and Unsloth updated about a week after release, and that you're running via llama.cpp (I've noticed on the same model and same command line arguments, ik_llama.cpp loses quality for me).

Also just in case you didn't see it, Laguna S 2.1 was having issues on MXPF4 but people on Q4 and Q6 couldn't repeat the problem.

I just downloaded the latest llama.cpp and poolside Q4 and within 10k tokens it corrupted "Use ~/p/kevincox.ca as a reference" into "kevinc.ai" and then starts doing stupid things because the directory "doesn't exist".

In previous testing the Q8 was better but still had the same problem frequently enough to be very difficult to use. I don't know if it is a runner bug or model bug but at least with llama.cpp this seems to always happen and I haven't seen an issue like this with any other model.

Wow that's weird. I have it running sometimes at least 8 hours straight on a single prompt and no weirdness.

Could it be something weird like you're hitting your compaction limit?

No compaction happened. (That is set near 256k.) It seems to really not like my domain but I've seen it for various things as well (especially high-entropy tokens). Dropping random characters or various things. I've tried various flash attention and context quantization settings but nothing seemed to resolve it completely.

At 1.5 bits per weight it'll still be over 500gb - that's still not running on consumer hardware.

Best case they release smaller models. 120b class of qwen 3.8 would be incredible - it fits on device for those serious about AI, but without millions of dollars in hardware for terabytes of VRAM

If he bans them, they'll just show up as torrents. Or we'll download them from Chinese hugging face.

Over Dario's dead body.

At least Sam have us a nice model last year with the gpt-oss family.

Events in the future are labelled in past tense. Rather than "happened in 4.5B" you could write "forecast in 4.5B"

Oh yeah and it doesn't even account for time dilation 5/7

Why risk it either way if they provide weights for others to run this?

Am I being overly cautious not wanting to send my data to Chinese companies?

Your safety is more at risk with your data in the US government's hands.

Continuing to build my olive oil tracking site (https://www.extravirginvault.com/) and pipeline. Freshness is king in the world of olive oil, and I hope to highlight to people they can find high quality, fresh olive oil produced near them.

It's been received well from producers and olive oil enthusiasts (e.g. looking for specific chemistry, cultivars and similar oils) but I feel like I've been shadow banned from Google - I seem to get more traffic from DuckDuckGo and Bing.

I'd imagine the Google issue may be to the fact that your URL looks like it would be porn.

I hope you're joking.

Definitely a plausible possibility

I mean I was personally disappointed here

Site was excruciatingly slow to load, locked up my browser and I just had to bounce. iPhone chrome. Likely google penalty.

Thankyou. Sorry to hear it locked up your browser. That definitely sounds like a bug - I've got GPT 5.6 Sol on the case...

Very nice site but small dataset on producers, only 2 from Spain that produces about 50% of the Olive Oil in the planet

Thanks - I'm saving the biggest and oldest producers like Spain and Italy till last so I can do them justice.

> I pre-cache all the domains I use hourly via cron.

How does this look? Shell script querying a list of hostnames? What qualifies as a domain you use?

It looks like this [1] I enable query logging to a tmpfs RAM disk and then every month I update a list of domains that I have queries more than {n} times. I mix that in with a list of the Cloudflare top 20K domains after removing the broken ones and some TLD's.

[1] - https://nochan.net/b/Internet-Crap/20260602-Set-Up-Your-Own-...

It would be nice if a site like this could offer a basic speed comparison test to your local network.

Imagine seeing response times at P90 for a series of random lookups and comparing the median response times.

Clone this repo [1] and then edit the domain names and resolvers to your liking. It will be something close to what you might be looking for.

[1] - https://github.com/cleanbrowsing/dnsperftest

Author here, I added this now: https://evilbit.de/dns-resolver-guide2.html#speedtest Only works for DoH though.

I run an instance of smokeping locally for this purpose. It pings a variety of DNS servers (including my ISPs DNS) and several of the top websites. I periodically update my local DNS server’s upstream accordingly.

All the big DNS servers are in the 5-6ms range for me, but that hasn’t always been the case. My ISPs DNS is about the same but with crazy variance and spikes of up to 50ms, even though they should be able to be the fastest.