AI PBs
-
@ProperPenguin said in AI PBs:
When I told a few dev friends this, they got surprised and then tested on other instances (not just ChatGPT) and found yeah, it spits out a whole mess or sometimes it suddenly veers into turning your request into Python or similar.
Knowing how these things work, it is not at all surprising that they are bad at generating a custom regex. If you want a well-known one, maybe, but GenAI doesn’t truly think or reason. It generates statistically likely responses. Not correct ones.
But vetting regex-es is as hard as writing them, so you’re still not getting out ahead.
-
I don’t have much to contribute here other than a serious amount of sardonic snark, so I’m just going to summarize the major points here with a metaphor:
Generative “AI” (note the quotes) is like makeup. It can make things pretty, but unless you’re a skilled makeup artist or have a lot of experience with putting on your own cosmetics, there’s probably going to be flaws and eventually other people are going to notice and compare notes.
Also, sooner or later the makeup has to be removed. We’ll leave that part open to interpretation; there’s many.
(This metaphor also assumes the components of the makeup aren’t toxic, too!)
-
This is a non-sequitur to “AI” PBs, but it feels so adjacent to the discussion (it overlaps it slightly) that I have to share it.
This is for the programmers out there, especially @Faraday.
-
@dvoraen Heh I enjoyed that video, thanks.
That reminds me of this post: My new hobby: watching AI slowly drive Microsoft employees insane. It’s reactions to a series of Pull Requests (the programmer equivalent of “Hey, I did a thing, someone check it out please and make sure I didn’t mess up”) from Copilot AI. The top comment says it all:
I just looked at that first PR and I don’t know how you could trust any of it at some point. No real understanding of what it’s doing, it’s just guessing. So many errors, over and over again.
Can AI tools make coding easier? Sure. Just in my lifetime I’ve seen code go from assembly language (low-level instructions to the computer registers) to visual coding tools (like Scratch) that let my kid build a game like Frogger. But even with that astonishing advancement, we still need developers to figure out what to build in the first place, and then make sure what gets built does what the customer needs. AI is highly unlikely to replace that in the forseeable future.
In other news: AI industry horrified to face largest copyright class action ever certified
They’ve warned that a single lawsuit raised by three authors over Anthropic’s AI training now threatens to “financially ruin” the entire AI industry if up to 7 million claimants end up joining the litigation and forcing a settlement.
I know it’s unlikely to succeed, but one can dream.
-
Here’s the “Fighting against AI in SRE” update for the past week.
- Experienced developer raised a PR for our IaC that was full of AI slop, which he only admitted to when pressed, and expected it waved through.
- Stumbled across Claude (free version) configuration in a very proprietary repo.
- C-level keeps setting up meetings every two weeks asking how we get AI in our product, unsatisfied with “it breaches GDPR so we don’t” as an answer.
- Got sent this painful little article which caused war flashbacks to my desktop support days: https://thenewstack.io/vibe-coding-the-shadow-it-problem-no-one-saw-coming/
-
This is an example of what I am hopeful AI will eventually do, which is help push scientific discovery forward.
-
@MisterBoring said in AI PBs:
This is an example of what I am hopeful AI will eventually do, which is help push scientific discovery forward.
That is neat, though it’s worth noting that this doesn’t appear to be “Generative AI” in the usual sense of ChatGPT, etc., but a custom-trained model. With much of this, it’s not the technology itself that is the problem, it’s the way in which it’s being trained and used that people take issue with.
-
@Faraday Totally. I feel like there’s just as many groups building AI models trained solely on academic works and scientific knowledge, but those groups aren’t getting any sort of news coverage because it’s not as controversial.
-
As per usual, capitalism makes things 1000% worse.
I don’t mind that humanity has unlocked the ability to generate human-like text in response to a prompt, but I DO mind that LLMs are now hooked to millions of bot accounts designed to propagandise the social media landscape.
I don’t mind that we have the ability to sort samples of text into broad categories, but I do mind that it’s being used to screen for abusive content without a human in the loop I can appeal to when blatantly bigoted speech slips through the cracks.
I don’t mind that people have the ability to generate images for personal use, but I do mind the interminable pile of slop other people have generated filling up online spaces I used to visit for real, human-created content.
Sadly because We Live In A Society it’s pretty much impossible to separate the existence of technology from the way it is being used, and there is nothing to do about it but opt out as much as possible and complain loudly that Microsoft ever thought a new AI-lead operating system was a good idea.
-
it’s pretty much impossible to separate the existence of technology from the way it is being used
This is absolutely something I think (or at least hope) that many of these techthusiasts just don’t get. They’re up to their elbows in snizbangs per faloop and productivity metrics per powerpoint presentation that they don’t see reality.
It could be used for X, Y, and Z thing! But it’s not, it’s being used to regurgitate a kindergartener’s view of Shakespeare a thousand times a second or fifteen billion pictures of a flower that somehow has too many and not enough petals at the same time.
-
This is absolutely something I think (or at least hope) that many of these techthusiasts just don’t get. They’re up to their elbows in snizbangs per faloop and productivity metrics per powerpoint presentation that they don’t see reality.
See also: splitting the atom, letting every idiot have a handgun
