Research  Widespread AI use narrows society’s creative space

#1
C C Offline
https://www.eurekalert.org/news-releases/1123936

EXCERPTS:  There are already hundreds of thousands of large language models (LLMs) in existence with a few dozen commercial systems dominating the market. Between options such as GPT-4, Claude and Gemini, many people have their favorite, especially when it comes to creative tasks such as writing.

Those preferences, however, are likely entirely in the eye of the beholder. According to new research from Duke University, the creative outputs of commercial LLMs are more similar to each other than users might hope. When challenged with three standard tasks assessing creativity, answers from commercial LLMs are much more alike than their human counterparts.

The results appeared online March 24 in the journal Proceedings of the National Academy of Sciences Nexus.

“People might wonder if different LLMs will take them in different directions with the same prompts for creative projects,” said Emily Wenger, the Cue Family Assistant Professor of Electrical and Computer Engineering at Duke. “This paper basically says no. LLMs are less creative as a population than humans.”

According to a 2024 survey by Adobe, over half of Americans have already used LLMs as creative partners for brainstorming, writing, creating images or writing code. Because an overwhelming majority of users trust them for help with being more creative, researchers have been trying to find out if that trust is misplaced.

[...] The results, which aimed to measure the variability and originality in responses between LLMs and people, were clear. While individual LLMs might outperform individual people in levels of creativity, as a whole, the algorithms’ responses were much more similar to each other than the people’s. Importantly, altering the LLM system prompt to encourage higher creativity only slightly increased their variability—and human responses still won out.

“This work has broad implications as people continue adopting and integrating LLMs into their daily life,” Wenger said. “Over reliance on these tools will smooth the world’s work toward the same underlying set of words or grammar, tending to make writing all look the same.”

“If you’re trying to come up with an original concept or product to stand out from the crowd,” Wenger continued, “this work highly suggests you should bring together a diverse group of people to brainstorm rather than relying on AI.” (MORE - missing details, no ads)
Reply
#2
Syne Offline
Stands to reason that LLMs largely trained on all the same data would output the same average of that data. You'd probably have to limit the training data to get more "creative" outputs. Different data, different average.
Reply
#3
confused2 Offline
Test of AI local learning ..
If
1 maps to 4,
2 maps to 3,
3 maps to 2
4 maps to 1
What does 1.5 (most likely) map to?
The AI's I use are 'busy' .. I don't want to break the context .. anyone try it?
Reply
#4
confused2 Offline
some AI Wrote:It looks like the mapping is pairing values (1↔4) and (2↔3)
A natural “most likely” extension to decimals is to use the symmetry around the midpoint between 1 and 4.
That midpoint is  2.5, so the rule is:
f(x)=5−x
for x=1.5:
f(1.5)= 5-1.5 = 3.5
So 1.5 most likely maps to 3.5
A very simple test but the AI has worked out the most likely answer without being given it.
IMHO the ability to identify patterns and join the dots is so akin to 'intelligence' that it makes no difference.

You could try "What does 10 (most likely) map to?" which is way outside the values you've 'trained' it with.
Reply
#5
Syne Offline
Pattern recognition is not intelligence.
Reply
#6
confused2 Offline
Using things you know to make predictions about things you don't know? Not intelligent?
Reply
#7
Syne Offline

Pattern Recognition Isn’t Intelligence, It’s an Emergent Survival Side-Effect
...
No neuron understands a pattern.
No neuron sees meaning.

Patterns arise after the fact, when large populations of neurons repeatedly activate together and the system learns that certain activations correlate with outcomes that matter: food, danger, reward, pain.

Pattern recognition is therefore not intelligence — it’s compression.

A way of reducing a complex, noisy world into manageable signals quickly enough to survive.
...
That’s why humans see:

Faces in clouds
Intent in randomness
Meaning in coincidence
...


LLMs are cluster maps of semantic meaning, much like groups of simultaneously and repeatedly activated neurons (data training).
Like pareidolia, there is no actual understanding of the pattern or reflection upon its substrate.
Reply
#8
confused2 Offline
I think you need to to clarify what you mean by intelligence. My example of intelligence would be Einstein taking apparently unrelated results and deriving the equations of SR and GR from them .. the equations can then predict results which weren't present in the original dataset. Your example of intelligence?
Reply
#9
Syne Offline

Pattern recognition is a core component of intelligence, but they are not the same thing. Pattern recognition is the ability to identify recurring elements—such as sounds, shapes, behaviors, or ideas—and use them to predict what comes next. Intelligence is broader, encompassing the ability to learn, reason, solve novel problems, and adapt to new situations.
- Google AI

See, even AI knows there's a difference.
Reply
#10
confused2 Offline
learn, reason, solve novel problems, and adapt to new situations
Yep.. pattern recognition.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
Question Why flat-Earthers are a clear & present threat to an AI-powered society C C 0 3,739 Oct 30, 2021 08:54 AM
Last Post: C C
  How Will Deep Learning Advance Society? C C 1 4,151 Jan 1, 2017 07:28 PM
Last Post: Magical Realist
  Widespread multi-touch surface computing by 2020 Magical Realist 2 4,813 May 19, 2016 10:21 PM
Last Post: stryder



Users browsing this thread: 1 Guest(s)