When a generated photo or video becomes indistinguishiable from reality, does reality just collapse? How do we know what’s real anymore, and if society deems an image/video as false, how do we know it isn’t just a government cover-up?
Just a few words into a Gen-AI program and there will be a video on the news of you commiting a terrorist bombing of a pre-school, even tho you were never anywhere near there. They can send the secret police to murder people, then post a video of the people they’ve killed as “resisting arrest” or “trying to shoot the officers on scene”, even tho they were unarmed and cooperative.
Like… do governments just get to shape the world as they see fit?
You must log in or register to comment.
Truth has not been around for a long time now. AI will make it worse.
Some kids make fake ‘fairy’ photos in 1917 and lots of people believed them. As others have mentioned, the USSR removed people from photographs. A forged will in the middle ages let the papacy claim authority over Europe, and shaped the western world as we know it today.
There have always been lies and fakes, and there’s always people who’ve ignored real evidence claiming it’s been fake. AI certainly makes things worse, and will be used to discredit legitimate evidence as much as it is used to fake shit. But humanity has lived most of its existence without a “pics or it didn’t happen” attitude, and will continue to figure stuff out (and make mistakes) through investigation, interpersonal trust and community.
Yes but not because of generated videos. Cop just shoots you and the nearest bystander says “grok what happened” and their camera glasses say “What an intelligent question!!! It looks like someone was just nonviolently apprehended for a serious crime!!! You’re so pretty!!!” Then they ask grok if they can cross the street now and get hit by a truck.
“Please visit your nearest firing squad for free cake!”
No, it isn’t.
I’m so mad about people buying into the fake hype.
The death of truth was social media. Or squishy human brains on social media, I suppose. We just came from a massive argument about whether vaccines work, whether masks are useful in the middle of a respiratory virus pandemic and a bunch of Americans believed there was a pizzeria pedophilia vampire ring so much they elected a fascist turd president. Twice.
What the hell is marginally better photo doctoring going to do in that context? Who gives an actual crap?
The only real concern you should have is you now shouldn’t trust phone calls that sound vaguely like someone you know from a phone number you don’t recognize. And maybe if you get a video call from a celebrity standing suspiciously still don’t wire them all your money.
Otherwise we’re just as boned as we were five years ago.
You know how Google gives you AI summary at the top now? It’s great, isn’t it?
No longer do you have to sift through multiple results to and give your device ad cancer just to get a simple answer to a question. Google just gives you the answer directly! It’s so great and helpful.
Except when it’s not, but it never says “I don’t know, check the results manually”, it just makes shit up. The other day I googled “geely pixel 9 wireless connection” because I couldn’t connect my pixel 9 to a geely car wirelessly. Google (the maker of the pixel 9) confidently described how the “Geely Pixel 9 is a device made by Geely…” and went on to give useless instructions.
This was a inconsequential query. What happens when you look up a serious topic and the sites that maintained that knowledge online no longer find it financially feasible? What happens when you rely on the trained model and that’s the only option? What happens when it hallucinates convincingly? Are you sure it hasn’t fooled you yet?
Social media created bubbles of ignorance and fake news, AI replacing search intends to eliminate the non-bubbles the rest of us seek and count on. What are you gonna do, drive to the library and read books every time you need to learn something new?
You act like before Google we couldn’t figure things out. Sometimes not taking the easier/easiest way is better. We existed until the year 2000 without this futuristic computer in our pocket (technically longer) and we did just fine and we still had to suffer fools. Great example would be the emergence of AIDS spreading through the heterosexual community. Lots of disingenuous and lost humans and not a Google in sight. AI is computer driven and it’s counterpart will also be computer driven. . . I am convinced there will be a counterpart. We’ll have a “detect AI button” or something similar. If the program has language the program can be spotted. Scams, lies, propaganda, shilling, etc will always exist and the intelligence that creates these things will also have the chance to defeat these things. This is maybe naive or optimistic, but . . . so it goes.
This is true. I had been thinking my previous post was a bit too optimistic, actually. For the sake of making a point I implied that conspiracy theorists, anti-vaxxers and anti-maskers didn’t previously exist. They absolutely did. There was plenty of public conflict about masking and social distancing in the 1918 flu. The AIDS panic was horrific and obviously this isn’t the first time that hate discourse puts fascists in power in a major superpower, let alone in a country overall.
The real issue with the Internet isn’t the flexibility of truth, it’s the ease in diseminating the satisfying falsehood. With no source of authority over which truths are acceptable and what lies are shameful you end up in a worldwide radicalization engine. It’s not that the old gatekeepers told you the truth, either. They still don’t. But at least we all had some culture-wide baseline for acceptable narratives.
But hey, people can keep hating on the obvious boogeyman of AI. At least it’s a start to realizing what the pattern is. It’s still not “the end of truth”, but like I said elsewhere, if it gets people to start noticing these things we’ll be better off than when social media was doing the exact same thing to us as a global society without anybody realizing.
It does say “check the results manually”. Not that this changes anything. For the record, always double check anything any AI tells you unless you can verify the response off the top of your head. Also for the record, double check anything anybody else tells you. If you haven’t seen it from more than one source, you don’t know if it’s true.
Hell, if the thing people learn from AI summaries is to never believe anything the see on the Internet without double checking it we’ll be better off than we were before.
Also, every negative impact you assign to AI is applicable to traditional search. I was hearing communication scholars warn people of the issues with algorithmic selection and personalized search back in the 90s. They were correct.
I am endlessly fascinated by the billions of boiling frogs that hadn’t realized their perception of the world was owned by Google until Google made a noticeably change to their advertising engine. Did you think them getting to select which answers you got at the top of the page and which ones to bury past the fold was any less misleading? I am increasingly glad that AI is as unreliable as it is at this point. We definitely need a change in how people acquire information.
Photos have been staged and lies have been printed as soon as those technologies were invented.
AI generated stuff will cause video evidence to be weaker in court. Other than that we will quickly adapt as a society to become as resistant to fake videos as we are to fake photos or text.
Too late. Social media was already the end of truth.
Lying wasn’t something invented in modern times
The major news outlets ran interference on a literal genocide for years now. I don’t think AI will change much besides making the rubes rube harder.
Like others have said, this is an age old question. Plato’s Cave is my favorite rendition of the question.
The simple solution would be reason. Unless we live in a dystopia in full effect, like in 1984 or Fahrenheit 451, there will usually be multiple sources and perspectives on an issue or event, AI or not. Get info from all sides, and make a well informed personal decision with the info available. Never believe something initially and only do so if it is confirmed by multiple sources. Use logic, science, reason, ethos, or even faith as tools to seek and verify truth
Like… do governments just get to shape the world as they see fit?
This is not new, most likely in history class you’ve heard about Soviet propaganda and saw how Trotsky was removed from photography.
The interesting part is now every stupid ass can forge photograph without complex techniques and a long training. IMO it’s great, people will finally understand that a photo/video is most likely fake.
It will help them to use their critical thinking skills and check the context
People already aren’t using critical thinking skills. Why would they start now?
This works both ways: you can also always claim it’s a deepfake even if it isn’t.
If the government is after you they don’t need excuses so I doubt gen-AI changes anything in that regard.
But they would normally lose popularity, with a highly detailed 4K video (deepfake video, that is), the official narritive would be very convincing when state media put that video out there, and contradicting media censored. Human brains would be more convinced that a highly detailed (deepfake) video is real, rather than some blurry photoshop.
with Red Alert accent: Glorious Soviet Union has much much big time advantage over american technology !
Lol their technology is so superior, I’ve never heard about this until now xD
(Seriously tho, I have heard of censorship in general, but never heard of a state literally editing photos, I thought they just ommitted publishing some photos)
Did truth not exist before photography?
An arguement could be made that good governance is the responsibility of citizens/voters.
So it’s up to us (in the broad sense) to elect goverments that do not engage in cover-ups and do not shape the world as they see fit.
But this means once a country becomes authoritarian, or for those already in authoritarian countries, its over. Its would hard for any resistance to be able to trust each other.
Lile you see a video of your fellow revolutionaries apparantly colluding with the government and spying for them. Do you trust the video? What if its fake? And what if its actually real? If gonna make everyone suspicious of each other. Its gonna fracture your rebellion.
It used to be that only the rich and the powerful had access to fake videos. Many people believed in such videos because of that.
Now that fake videos are common, more people become suspicious of the authencity, which might be a good thing.
During the Tibet unrest in 2008, Chinese media produced videos of the “riot” which were obviously CGI. Nobody doubted because it wasn’t comon to have fake videos at the time.
You need really need genAI for a country to become authoritarian.
My bigger point is that it’s counterproductive to think of a government as an external black box. At the end of the day it’s a reflection of society (at least to some degree).
What to do about it is another question. But IMO the first step has to be recognition of “how things got to be this way”. If you can’t do that, the discussion around the impact of genAI are IMO moot.
Take russia as an example. In the 90s they had a relatively open media landscape, chaotic and influenced by oligarchs, but critique was allowed and it was very prominent.
But the russians elected a KGB goon in 2000 and then reelected him in 2004 after he shut down most independent media in his first term.
To this day, the russian opposition continues to look for scapegoats (90s liberals, Yeltsin, etc.) and reject any responsibility of society more broadly (revanchism, supremacist ideas, imperialism).
If you can’t even do that, then how are you going to deal with the impact of genAI?
My bigger point is that, IMO, genAI is almost a red herring. There will always be tech that can be used to enable authoritarianism. There is no magical tech solution to what is fundamentally a social issue.
We don’t need gen-AI to produce realistic looking videos. We already have the technology for decades, but reality hasn’t collapsed yet. With gen-AI it is just cheaper and quicker to make.
