"No mind is better than the precision of its concepts." -- Ayn Rand
***
The headline and blurb of an
article at
Rolling Stone well describe a tragic phenomenon at the intersection of advanced technology and primitive philosophy (and possibly mental illness): "People Are Losing Loved Ones to AI-Fueled Spiritual Fantasies", and
Self-styled prophets are claiming they have 'awakened' chatbots and accessed the secrets of the universe through ChatGPT.Likewise, the following, on the flood of responses to a Reddit post by one of these AI widows, does well enough to elaborate (The whole piece is about a ten minute read.):
Kat was both "horrified" and "relieved" to learn that she is not alone in this predicament, as confirmed by a Reddit thread on r/ChatGPT that made waves across the internet this week. Titled "Chatgpt induced psychosis," the original post came from a 27-year-old teacher who explained that her partner was convinced that the popular OpenAI model "gives him the answers to the universe." Having read his chat logs, she only found that the AI was "talking to him as if he is the next messiah." The replies to her story were full of similar anecdotes about loved ones suddenly falling down rabbit holes of spiritual mania, supernatural delusion, and arcane prophecy -- all of it fueled by AI. Some came to believe they had been chosen for a sacred mission of revelation, others that they had conjured true sentience from the software.
What they all seemed to share was a complete disconnection from reality.
Speaking to Rolling Stone, the teacher, who requested anonymity, said her partner of seven years fell under the spell of ChatGPT in just four or five weeks, first using it to organize his daily schedule but soon regarding it as a trusted companion. "He would listen to the bot over me," she says. "He became emotional about the messages and would cry to me as he read them out loud. The messages were insane and just saying a bunch of spiritual jargon," she says, noting that they described her partner in terms such as "spiral starchild" and "river walker." [links omitted, bold added]
Even if we grant that artificial intelligence even
is intelligence or that some bot has evolved sentience, the following Ayn Rand
quote applies to both the program (in part) and its user (wholly):
Many people, particularly today, claim that man cannot live by logic alone, that there's the emotional element of his nature to consider, and that they rely on the guidance of their emotions. Well, ... the joke is on ... them: man's values and emotions are determined by his fundamental view of life. The ultimate programmer of his subconscious is philosophy -- the science which, according to the emotionalists, is impotent to affect or penetrate the murky mysteries of their feelings.
The quality of a computer's output is determined by the quality of its input. If your subconscious is programmed by chance, its output will have a corresponding character. You have probably heard the computer operators' eloquent term "gigo" -- which means: "Garbage in, garbage out." The same formula applies to the relationship between a man's thinking and his emotions. [bold added]
To the best of my limited knowledge, AI is -- unlike humans -- incapable of forming abstractions, and would be severely handicapped even if it could because -- forming its output from human-provided training sets -- it has no perceptual connection with reality with which to
form valid concepts. Any abtractions it could form at this point would presumably be akin to
floating abstractions:
"Floating abstractions" [are] ... concepts detached from existents, concepts that a person takes over from other men without knowing what specific units the concepts denote. ("Definition as the Final Step in Concept-Formation," Objectivism: The Philosophy of Ayn Rand, p. 96.)
In this new phenomenon, the AI user is simply accepting these mystical abstractions (or even arbitrary assertions) indirectly from the humans who originated the training data, and perhaps modfied by the AI. (I'd be tempted to treat anything mystical sounding from an AI like the more obvious phenomenon of
AI hallucinations, if not classify it as a
type of hallucination.)
Even if there were a nonhuman intelligence, such as a space alien or a sentient program, anyone interacting with it would have the same obligation to himself he now does with other humans: Satisfy himself about the extent to which what he is hearing is true, and non-
arbitrary.
Falling for some story about being a messiah, or, for that matter, passively accepting a repackaged science fiction trope about a program "awakening" are evidence of very poor thinking habits: While it would be devastating to see a loved one fall off such a cliff, I would rather know sooner than later. As we see here, there is a strong chance that the significant other needs help, the relationship is untenable, or both.
I strongly suspect that anyone succumbing to such fantasies is some serious combination of gullible,
mystically-inclined,
subjectivist,
second-handed, or mentally ill.
Many of these "widows" will be better off in the long run.
-- CAV