Speedometers being under is a European thing. All manufacturers are required to show more speed speed than you are doing, up to an error depending on the current speed.
The thing is, right now it is exploding because we are at the beginning of it. At some point, it will plateau at a specific level, and not that much quality will be gained. There is however leaps to make for efficiency.
The same can be said about the CISC computer: yes, new processors introduce new instructions that do something slightly faster, you could still crunch that with an older processor. The real benefit comes in clock cycles (that's why Arm with a reduced set can compete with x86).
Also: there are myriads of models, for myriads of tasks. Not all have the same development gains as we see for general purpose AI. If you etch those, you reduce your bill by factors down.
It also democratises models: Instead of running them on a cloud server by some company, you can run them at home, for coding tasks, without the need of internet connection, etc.
I'll note this one down. I was under the impression that yes, retyping helps learning something about a language and architecture, but I found myself forgetting it after a while...
Trying it first sounds slower, but definitely better for cognitive training :)
I use a VPN to have access to my HomeAssistant instance at home, where I can control every aspect of the house. Without this, I would have to pay for a domain name, manage the certificates, and exposing myself to external attacks. So, for me, a VPN reduces massively the attack surface.
There is this law, where if you don't see the purpose of something, is probably because you never needed it. Which is fine, but don't gatekeep others wanting to use them.
Edit: OP forgot to format text, so my anger should be directed to however said the quote...
Yes agreed. I use tailscale for the same purpose, and it's so much simpler than having to properly ingress everything from the internet. I have a few older devices on the LAN that have reached EOL as well and would be a terrible idea to expose them directly to the internet (not so much because I don't want someone turning off my light, but more so I don't end up as part of a botnet)
It is a sort of LAN network over the Internet. That way, you can connect to devices as if you were in the local network, but having them exposed to the internet.
Traffic is encrypted so there is noone knowing what you are sending, they can still trace that is coming to/from a specific node.
I guess accessing a streaming service without permission is considered a copyright violation, but blanket-blocking them based on copyright infringement will be legally difficult now...
The article frames a GPU cluster as if it was rocket science. If you swap a GPU cluster with, say, a power plant, the question doesn't change a bit. Also high complexity, multiple variables, you don't know the current output power, scheduled maintenance, skilled labor needed etc.
In the end, they will either figure it out, or contract a company that can figure it out. Truth is, there will be many companies wanting to do the rental of those clusters for AI...
This is what I hate about AI. Not that people use it, it's great to accelerate specific workflows, make less mistakes etc. It's just blindly trusting it and just saying "Make a post about a CV library release, make no mistakes" and calling it a day.
Where is the human creativity in writing release notes gone?
This is how I treated LLMs from the beginning, maybe because of my impostor syndrome of not knowing if my understanding of _anything_ is correct, and going down the rabbit hole of the concepts that are presented there...
Now the question to the round: in your opinion, are LLMs ok to learn in this way? At least on the theoretical side of things?
Not the author, but one way you could mitigate some of the LLMs problems while learning (authoritatively stating wrong facts, reward hacking, ...) is to have it give you testable code exercises to teach you facts. So you can get the benefits of the LLM AND deterministically verify its claims. I've been trying this lately and recovering some of the lost joy of learning CS nowadays.
reply