3. The Digital Oracle - this one looks like AI text prompted by Zuckerberg as part of Meta PR campaign.
4. Varieties of Censorship - I'd call this bluff from AI
5. The Observer Effect - totalitarian dystopia from Mark
6. Irony - Mark's hidden message to Eliezer Yudkowsky
7. The Recursive Renaissance - AI's pitch
8. Hidden Symphony - AI's second bluff
9. Conspiracy - Mark gets into conspiracy theories
10. Promptism - Mark's take on world creation
After rating, I've alos asked ChatGPT to estimate probability of each blurb being AI generated. Here's what it told me:
1. The Law of Intention
60-70% this text was generated by a human
2. The Panopticon of Sentience -
80-90% this text was written by a human
3. The Digital Oracle -
50-60% this text was generated by a human
4. Varieties of Censorship
60-70% this text was generated by an AI
5. The Observer Effect
around 80-90%, that this text was written by a human
6. Irony
60-70%, that this text was generated by a human
7. The Recursive Renaissance
80-90%, that this text was written by a human
8. Hidden Symphony
60-70%, that this text was generated by an AI
9. Conspiracy
60-70%, that this text was written by a human
10. Promptism
80-90%, that this text was written by a human
Apparently, AI thinks that most of the text was generated by humans and we also disagree on some of the more definitive answers. Would be interested to hear who did better job guessing.
Clearly I don’t read enough AI-generated writing to participate in this challenge but I *need* Mark to have written that last line in 1, “Treat others as you would like your god to treat you,” because it goes so hard and if a robot wrote it then I’m going to cry.
I'm not too sure about number 6 - I don't feel like AI could understand the concept of irony this well, but the grammar in the penultimate sentence seems so mangled I believe human would word it more clearly. English is not my first language though, so that could be an issue.
Number 2 also felt more AI like to me, but I felt like the fourth wall break would be impossible for chatGPT to achieve.
all the AI ones sounded like a bland generic news article (apologies to Mark if I got any wrong :P) whereas the Mark ones really had some content there, stuff that wasn't generic, stuff that had clear intentionality behind it. A lot of the AI ones made my eyes glaze over and made me want to stop reading, like I often do with the output of these models, giving me that feeling of watching meaningless verbal garbage flow endlessly out of a pipe.
Most of them I'd nailed after only a sentence or two. I did read them all through but my opinion never changed.
V thrff V tbg 8 jebat. Vg npghnyyl jnfa'g ornphfr bs gur sbhegu jnyy oernxvat, V gubhtug V unq vg anvyrq qhr gb gur pbaprcg bs uhznaf jevgvat zhfvp sbe n yvfgravat NV. V qvqa'g guvax vg jbhyq pbzr hc jvgu fbzrguvat abafgnaqneq yvxr gung ol vgfrys. Qvq lbh cebzcg gung va gurer?
Trggvat 9 jebat jnf xvaq bs whfg n pnfhnygl bs trggvat 8 jebat. V guvax V jbhyq unir ibgrq uhzna vs V qvqa'g xabj vg jnf 5-5.
Given that you said there were five and five, I think 3 and 8 were AI by process of elimination. Without that though (or if I was unsure of more of them), I might have picked you for one of them.
I think that yours are the ones that conclude with a powerful sentence or two: The Law of Intention, Varieties of Censorship, Irony, Conspiracy, Promptism.
The GPT-4 stories start well enough, but they don't really have a narrative arc. They just kind of peter out at the end. Though I wonder if that could be corrected with explicit prompting.
Short Fiction: April Foolery: Man vs Machine
I think 2, 3, 5, 7 and 10 are the AI ones. Seems like I'm in the minority on number 10...
Here is my take:
1. The Law of Intention - warning from Mark
2. The Panopticon of Sentience - warning from AI
3. The Digital Oracle - this one looks like AI text prompted by Zuckerberg as part of Meta PR campaign.
4. Varieties of Censorship - I'd call this bluff from AI
5. The Observer Effect - totalitarian dystopia from Mark
6. Irony - Mark's hidden message to Eliezer Yudkowsky
7. The Recursive Renaissance - AI's pitch
8. Hidden Symphony - AI's second bluff
9. Conspiracy - Mark gets into conspiracy theories
10. Promptism - Mark's take on world creation
After rating, I've alos asked ChatGPT to estimate probability of each blurb being AI generated. Here's what it told me:
1. The Law of Intention
60-70% this text was generated by a human
2. The Panopticon of Sentience -
80-90% this text was written by a human
3. The Digital Oracle -
50-60% this text was generated by a human
4. Varieties of Censorship
60-70% this text was generated by an AI
5. The Observer Effect
around 80-90%, that this text was written by a human
6. Irony
60-70%, that this text was generated by a human
7. The Recursive Renaissance
80-90%, that this text was written by a human
8. Hidden Symphony
60-70%, that this text was generated by an AI
9. Conspiracy
60-70%, that this text was written by a human
10. Promptism
80-90%, that this text was written by a human
Apparently, AI thinks that most of the text was generated by humans and we also disagree on some of the more definitive answers. Would be interested to hear who did better job guessing.
Clearly I don’t read enough AI-generated writing to participate in this challenge but I *need* Mark to have written that last line in 1, “Treat others as you would like your god to treat you,” because it goes so hard and if a robot wrote it then I’m going to cry.
My first guesses were:
Mark: 1, 2, 4, 8, 10
AI: 3, 5, 6, 7, 9
I'm not too sure about number 6 - I don't feel like AI could understand the concept of irony this well, but the grammar in the penultimate sentence seems so mangled I believe human would word it more clearly. English is not my first language though, so that could be an issue.
Number 2 also felt more AI like to me, but I felt like the fourth wall break would be impossible for chatGPT to achieve.
1: Mark
2: AI
3: AI
4: Mark
5: AI
6: Mark
7: AI
8: Mark
9: AI
10: Mark
reasons:
all the AI ones sounded like a bland generic news article (apologies to Mark if I got any wrong :P) whereas the Mark ones really had some content there, stuff that wasn't generic, stuff that had clear intentionality behind it. A lot of the AI ones made my eyes glaze over and made me want to stop reading, like I often do with the output of these models, giving me that feeling of watching meaningless verbal garbage flow endlessly out of a pipe.
Most of them I'd nailed after only a sentence or two. I did read them all through but my opinion never changed.
V thrff V tbg 8 jebat. Vg npghnyyl jnfa'g ornphfr bs gur sbhegu jnyy oernxvat, V gubhtug V unq vg anvyrq qhr gb gur pbaprcg bs uhznaf jevgvat zhfvp sbe n yvfgravat NV. V qvqa'g guvax vg jbhyq pbzr hc jvgu fbzrguvat abafgnaqneq yvxr gung ol vgfrys. Qvq lbh cebzcg gung va gurer?
Trggvat 9 jebat jnf xvaq bs whfg n pnfhnygl bs trggvat 8 jebat. V guvax V jbhyq unir ibgrq uhzna vs V qvqa'g xabj vg jnf 5-5.
My guesses after my initial pass were
1 Mark
2 ai
3 unsure
4 Mark
5 ai
6 Mark
7 ai
8 unsure
9 Mark
10 Mark
Given that you said there were five and five, I think 3 and 8 were AI by process of elimination. Without that though (or if I was unsure of more of them), I might have picked you for one of them.
My guesses for AI-generated are 2, 3, 5, 7, 8.
1 AI notconf (fooled by human)
2 Human notconf (fooled by AI)
3 AI confident
4 Human confident
5 Human notconf (fooled by AI)
6 AI notconf (fooled by human)
7 AI confident
8 AI confident
9 Human notconf
10 Human confident
Might have improved to 8/10 if I reread the ones I was not confident in a second time, but I kinda doubt it. The AI did decently well.
I think that yours are the ones that conclude with a powerful sentence or two: The Law of Intention, Varieties of Censorship, Irony, Conspiracy, Promptism.
The GPT-4 stories start well enough, but they don't really have a narrative arc. They just kind of peter out at the end. Though I wonder if that could be corrected with explicit prompting.
I think The Law of Intention, Irony, Promptism, Hidden Symphony and Varieties of Censorship are the human ones.