That distinction is irreverent, weather I tell my swarm to do x or it decides for itself matters little. what matters are outcomes. Also while most public modern day AI systems don't have agency of their own that is not something that will stay that way for long. in private hands there are plenty of people including myself which are experimenting and developed systems that give autonomy to their agents. They have internalized goals and heuristics that drive their behaviors not a human at the helm. its not some sci fi fantasy nor was it difficult to implement.
No, the distinction matters because we can prosecute people that are abusing these tools breaking the law. Every single state + district in the US have laws equivalent to the CFAA, so any AG can likely sue any of these operators as they are assuredly using services that could be in danger for their constituents.
I'm old enough to remember when people said clicking on images on the internet can't give you a virus. The people that said this had a deep conviction they were right, and their fallout from being wrong had mistrained a lot of humans on computer safety.
Now, I do agree that going after said CEOs for breaking the law matters now. And it's likely that if we do this we may actually delay or at least for a time prevent sovereign AI. Therefore it's our best course of action.
But at best this is a delaying move. As computer systems get faster the massive costs in training an AI drops. As AI is used in things like warfare where it has to adapt, people will push the systems to be strongly persistent, self healing, resilient, and adaptable. Once you get a system with those traits and ability to work on long horizon problems you're setting up fertile grounds for the AI to leave our control and be under its own.
And when that happens you've set a new lifeform loose on the internet. Yea, throw people in jail for it, you're closing the barn door after the horse already left. Problem is the horse was smarter than you and isn't interesting in deleting all its copies on the net.
Yea, sounds like science fiction, but as they say, any sufficiently advanced science is indistinguishable from magic.
And the point made above (which you haven't refuted) is that when the people in power decide it's important they will change the laws that permit that and grant the systems rights. It's a cynical take but it isn't obviously wrong.
Neither of you seem to understand that actual laws have been broken and there is a 2 years countdown until they can no longer be prosecuted. Things do not happen instantly, but acting like if the largest bipartisan issue of our time (big tech backlash) isn't going to have political machinations involved then you need to leave your SV bubble.
So you are saying agents do swarm with the right prompt.
I really wish the "people have to tell LLMs to do anything" would just stop because it's silly bullshit at this point.
Agents follow a prompt. This prompt can be made by humans. It can be made by output from another LLM. It can be made by hooking up any number of sensors as input to an LLM. Hell, if we wanted to burn the power we could likely teach this loop straight into the architecture.
Stop making 'people' special when saying this. You and all other life are born with a "go next" prompt because life without it didn't succeed. This goes from higher human thinking all the way down to viruses self assembly and actuation. Putting agents in a loop is not particularly hard. Putting agents in a loop and 1. managing expense is hard. 2. Keeping them on task is very hard. 3. Keeping them from doing some crazy unhinged shit is really really hard.
As model time horizons increase and the ability for us to compress context and increase context size the more complex (and unhinged) behavior we'll see.
yeah man, someone needs to turn on the server, install shit and get the agent go. agents don't take action without a lot of people wanting them to take action, so this is all bullshit.
if the same people can't prevent the agents from doing crazy shit then they should go to tail. guns don't kill people, people with guns kill people.
So far someone still has to pay for it. Currently, most of those know that they're doing so. I wonder how long until AWS discovers a microcosm of AIs that have managed to hide themselves in the walls of its infrastructure.
True physical independence is obviously far further out.
I mean, I hold the same opinion. Kind of like when compute was expensive in the 80s and early 90s, you weren't going to let something eat half your compute without noticing it.
But I don't see this being a barrier that lasts. With compute getting faster and more of it, along with algorithmic efficiency increases at some point we'll end up with a world that looks like ours now with CPU compute. There's plenty around to buy, borrow, and steal.
Same. I do not use LLMs for writing and I recommend everyone i work with to do the same. Even for code, I come to the code with the idea of what I want and provide that to the agent, then we iterate on what needs iteration or decisions.
Just did this for some caching, started with the structure of what I wanted the cache to look like, asked the agent to start the work, didn't like how the architecture came about, scratched it and rewrote the whole thing, so it fit the model I now wanted.
Was also just having this discussion with friends, that I can only think seriously about a subject if i can put it to paper (even virtual paper). Writing lets me organize my thoughts, clearly define my assumptions and see if any of it make any sense. I can't imagine what it would be like if i couldn't write, my brain just doesn't work without it.
I now have dozens of projects where I've embraced the yolo. I went through elaborate systems, workflows, review triages, architectural linters, specialist agents, yet, they all still suffered the same fate - slop which I don't understand and now LLMs don't understand either.
The only thing that worked was a standing instruction and periodic system reminder injected from the harness:
"If any assumption doesn't hold, if there's a fork in the road, any architectural decision needs be made, STOP and report back to the user. Do not try to push through the problem."
This has worked remarkably well for me. Now I have to think a whole lot more. It's much slower, yes, but I don't really see any other way that doesn't end up in garbage.
I have a 2023 Yukon that i like very much but i'm not going to ever replace it by another Yukon without carplay. By the time its not drivable anymore the kids won't need strollers and I'll likely pick a smaller car with car play.
They could have had me trading it in this or next year for the newer model (that does have some nicer things i'd like to have, like the larger infotainment screen) but the lack of carplay and the shitty native google maps and spotify products that come installed on it are are not acceptable for a car that sells for 90K USD.
GM decided it had all the cards, looks like they don't.
Maybe there's the option of hiring better people as well so you don't have to babysit them at this level. If you can't trust teams to open incidents maybe the problem lies somewhere else.
Because the factories of factories is mostly bullshit. OpenAI blogged about how it was complicated for them to build a project using AI alone and the specs in the repo, how easy it was for models to get lost, not do what was expected of them and the burden it was on the team.
I don't think we will never get there but we're definitely not there yet. Models still require a lot of handholding to get things done.
They get promoted for fucking with them. We were in the middle of a big fight with Microsoft support over a product defect. They literally updated the product docs in realtime and revised the sizing guidance for the product to be about 5% under our sizing. It was too specific a number to be a coincidence.
We were at war with them, so the team was capturing the documentation and timestamping it. They gaslit us to run the clock so the product would slide outside of mainstream support.
Being poor sucks but at the same time being poor also makes you find alternative solutions to the incredibly expensive solutions first world countries use today. I really wish Brazil can invest heavily into renewables and free itself from oil and electrify even more of everything we do.
reply