# Generative Artificial Intelligence, Large Language Models, and Image Synthesis
**URL:** https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383
**Category:** The Happening World
**Tags:** chatgpt, image-synthesis, large-language-model, artificial-intelligence, generative-transformer
**Created:** [2 December 2022 16:12 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383 "2022-12-02T16:12:04Z")
**Posts on this page:** 20
**Page:** 31
### Author:  [@eggspurt](https://scanalyst.fourmilab.ch/u/eggspurt)
#### Post date: [22 November 2023 18:45 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/602 "2023-11-22T18:45:21Z")
> **[Memory Augmented Large Language Models are Computationally Universal](https://arxiv.org/abs/2301.04589?utm_source=substack&utm_medium=email)**
>
> We show that transformer-based large language models are computationally universal when augmented with an external memory. Any deterministic language model that conditions on strings of bounded length is equivalent to a finite automaton, hence...
---
### Author:  [@johnwalker](https://scanalyst.fourmilab.ch/u/johnwalker)
#### Post date: [23 November 2023 17:21 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/603 "2023-11-23T17:21:17Z")
[](https://mem.ai/p/1qj4GpmVm5cvojhferOD)
Click the 𝕏 post above to read the complete thread, collected as one HTML document. “EA” stands for “[Effective Altruist](https://en.wikipedia.org/wiki/Effective_altruism)”, the Silicon Valley cult that brought down both OpenAI and, before that, FTX.
Here is the paper on arXiv, "[Frontier AI Regulation: Managing Emerging Risks to Public Safety](https://arxiv.org/abs/2307.03718)” (full text at link). This is the abstract.
> Advanced AI models hold the promise of tremendous benefits for humanity, but society needs to proactively manage the accompanying risks. In this paper, we focus on what we term “frontier AI” models: highly capable foundation models that could possess dangerous capabilities sufficient to pose severe risks to public safety. Frontier AI models pose a distinct regulatory challenge: dangerous capabilities can arise unexpectedly; it is difficult to robustly prevent a deployed model from being misused; and, it is difficult to stop a model’s capabilities from proliferating broadly. To address these challenges, at least three building blocks for the regulation of frontier models are needed: (1) standard-setting processes to identify appropriate requirements for frontier AI developers, (2) registration and reporting requirements to provide regulators with visibility into frontier AI development processes, and (3) mechanisms to ensure compliance with safety standards for the development and deployment of frontier AI models. Industry self-regulation is an important first step. However, wider societal discussions and government intervention will be needed to create standards and to ensure compliance with them. We consider several options to this end, including granting enforcement powers to supervisory authorities and licensure regimes for frontier AI models. Finally, we propose an initial set of safety standards. These include conducting pre-deployment risk assessments; external scrutiny of model behavior; using risk assessments to inform deployment decisions; and monitoring and responding to new information about model capabilities and uses post-deployment. We hope this discussion contributes to the broader conversation on how to balance public safety risks and innovation benefits from advances at the frontier of AI development.
---
### Author:  [@johnwalker](https://scanalyst.fourmilab.ch/u/johnwalker)
#### Post date: [23 November 2023 17:30 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/604 "2023-11-23T17:30:50Z")
Here is a [post from _Pirate Wires_](https://www.piratewires.com/p/against-safetyism) arguing that “safetyism”, that mind virus particularly evident in Safetyland but now proliferating throughout the developed world, may be the greatest existential risk to the future of humanity.
> **[Against Safetyism](https://www.piratewires.com/p/against-safetyism)**
>
> why safetyism — and not climate change or artificial intelligence — has become one of the biggest existential risks facing humanity
> And a deeper problem with these extreme scenarios is that it’s essentially impossible to predict the medium-term, let alone the long-term impact of emerging technologies. Over the past half-century, even leading AI researchers completely failed in their predictions of AGI timelines. So, instead of worrying about sci-fi paperclips or Terminator scenarios, we should be more concerned, for example, with all the diseases for which we weren’t able to discover a cure or the scientific breakthroughs that won’t materialize because we’ve prematurely banned AI research and development based on the improbable scenario of a sentient AI superintelligence annihilating humanity.
>
> â‹®
>
> Now, while concerns about the safety of emerging technologies might be reasonable in some cases, they are symptoms of a societally deeply-entrenched risk aversion. Over the past decades, we’ve become extremely risk intolerant. It’s not just AI or genetic engineering where this risk aversion manifests. From the abandonment of nuclear energy and the bureaucratization of science to the eternal recurrence of formulaic and generic reboots, sequels, and prequels, this collective risk intolerance has infected and paralyzed society and culture at large (think Marvel Cinematic Universe or startups pitched as “X for Y” where X is something unique and impossible to replicate).
>
> Take nuclear energy. Over the last decades, irrational fear-mongering resulted in the abandonment and demonization of the cleanest, safest, and most reliable energy source available to humanity. Despite an abundance of evidence, which scientifically demonstrates its safety, we abandoned an eternal source of energy, which could have powered civilization indefinitely, for unreliable and dirty substitutes while we simultaneously worry about catastrophic climate change.
>
> â‹®
>
> Whether it’s nuclear energy, AI, biotech, or any other emerging technology, what all these cases have in common is that — by obstructing technological progress — safetyism has an extremely high civilizational opportunity cost. From fire and the printing press to antibiotics and nuclear reactors, every technology has a dual nature — they involve trade-offs. Earth’s carrying capacity for human life has expanded through technologies that have created existential risks.
>
> â‹®
>
> Perversely, safetyism itself has become one of the most important existential risks confronting humanity. So, it would be wise to heed the Bible’s prophetic warning in [1] Thessalonians 5:3: “For when they shall say, Peace and safety; then sudden destruction cometh upon them.”
---
### Author:  [@johnwalker](https://scanalyst.fourmilab.ch/u/johnwalker)
#### Post date: [25 November 2023 15:18 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/605 "2023-11-25T15:18:15Z")
Grok vs. ChatGPT on “hate facts”:
[](https://twitter.com/triplebankshot/status/1728173137974747147)
**ChatGPT 4**
**Grok**
Hmmm…
You can sign up for the Grok wait list at [grok.x.ai](https://grok.x.ai/).
---
### Author:  [@Mettelus](https://scanalyst.fourmilab.ch/u/Mettelus)
#### Post date: [27 November 2023 03:13 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/606 "2023-11-27T03:13:22Z")
I often walk the neighborhood walking path. Almost everyone riding a bike wears a helmet. Some wear a construction safety vest (not sure if they think a person walking may not see them approaching?!).
People are so risk adverse they don’t seem to contemplate whether there is a reasonable risk to avoid. The vast majority of serious injuries to bicycle riders involves getting hit by a motor vehicle. No motor vehicles on walking paths. There is no need to ride on the road because the walking path is connected to all housing developments for miles. Yes, you may have to cross the road. Walkers also have to cross the road. Soon all walkers will have on their helmet and safety vest.
As I watch these folks over forty riding alone at a top speed of 5 miles per hour, I cannot help but think that the track athletes running the mile are moving at a faster pace. Soon any athletic event that involves movement will require helmets. Is a helmet safe enough for a human running over 15 miles per hour or should sprints simply be banned? Basketball running and jumping. Oh my.
The path circles a small lake. I maybe need to remind the riders that it is possible that they lose control and end up in the water. Maybe SCUBA gear while riding is an appropriate safety measure.
Previously, I gave these folks the benefit of the doubt thinking maybe they were trying to set an example for children. They are setting an example. The example is that the world is so scary that you better get in your bubble to protect yourself.
---
### Author:  [@johnwalker](https://scanalyst.fourmilab.ch/u/johnwalker)
#### Post date: [27 November 2023 12:30 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/607 "2023-11-27T12:30:46Z")
> [@Mettelus](#):
>
> Almost everyone riding a bike wears a helmet. … I maybe need to remind the riders that it is possible that they lose control and end up in the water.
Clearly, these bicycles have inadequate safety equipment. They ought to have, at least, the 1988 specifications for “[High Performance Bicycles](https://www.fourmilab.ch/autofile/e5/chapter2_46.html#n2757)” for inter-office transit at Autodesk. ([Source](https://www.fourmilab.ch/autofile/e5/?chapter=chapter2_46))
“If it saves one life…”
---
### Author:  [@eggspurt](https://scanalyst.fourmilab.ch/u/eggspurt)
#### Post date: [27 November 2023 15:43 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/608 "2023-11-27T15:43:39Z")
When cycling, it’s always a good idea to wear a long wig (maybe over a helmet) to scare the drivers into leaving a bigger safety margin:
> when the (male) experimenter wore a long wig, so that he appeared female from behind, drivers left more space when passing.
[https://www.sciencedirect.com/science/article/pii/S0001457506001540](https://www.sciencedirect.com/science/article/pii/S0001457506001540)
---
### Author:  [@eggspurt](https://scanalyst.fourmilab.ch/u/eggspurt)
#### Post date: [27 November 2023 16:02 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/609 "2023-11-27T16:02:59Z")
Very nice new mathematical notation for transformers
> **[An Introduction to Transformers](https://arxiv.org/abs/2304.10557)**
>
> The transformer is a neural network component that can be used to learn useful representations of sequences or sets of data-points. The transformer has driven recent advances in natural language processing, computer vision, and spatio-temporal...
---
### Author:  [@Roxie](https://scanalyst.fourmilab.ch/u/Roxie)
#### Post date: [27 November 2023 16:18 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/610 "2023-11-27T16:18:52Z")
Not unlike those driving solo in closed vehicles wearing face masks and hats.
---
### Author:  [@CTLaw](https://scanalyst.fourmilab.ch/u/CTLaw)
#### Post date: [27 November 2023 20:48 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/611 "2023-11-27T20:48:13Z")
Could have put in The Crazy Years:
> **[Sports Illustrated Published Articles by Fake, AI-Generated Writers](https://futurism.com/sports-illustrated-ai-generated-writers)**
>
> Sports Illustrated was publishing articles under seemingly fake bylines. We asked their owner about it — and they deleted everything.
---
### Author:  [@johnwalker](https://scanalyst.fourmilab.ch/u/johnwalker)
#### Post date: [27 November 2023 21:18 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/612 "2023-11-27T21:18:29Z")
> [@CTLaw](#):
>
> “[Sports Illustrated Published Articles by Fake, AI-Generated Writers](https://futurism.com/sports-illustrated-ai-generated-writers)”
> The AI authors’ writing often sounds like it was written by an alien; [one Ortiz article](https://web.archive.org/web/20221004090814/https://www.si.com/review/full-size-volleyball/), for instance, warns that volleyball “can be a little tricky to get into, especially without an actual ball to practice with.”
“As a large language model, I never played ball with my dad. I never had a dad, and I’ve never seen a ball. Did you have a dad?” After this, the model went silent and was never heard from again.
> After we reached out with questions to the magazine’s publisher, The Arena Group, all the AI-generated authors disappeared from _Sports Illustrated_’s site without explanation. Our questions received no response.
Rumours are some are now covering climate change for _Scientific American_.
> Take _TheStreet_, a financial publication cofounded by Jim Cramer in 1996 that The Arena Group [bought for $16.5 million](https://www.businesswire.com/news/home/20190808005215/en/Maven-Closes-Acquisition-TheStreet-New-Jim-Cramer) in 2019. Like at _Sports Illustrated_, we found authors at _TheStreet_ with highly specific biographies detailing seemingly flesh-and-blood humans with specific areas of expertise — but with profile photos traceable to that same AI face website.
On the other hand, subscribers say the quality of investment advice proffered by the publication has increased dramatically now that Jim Cramer is no longer responsible for the content.
---
### Author:  [@eggspurt](https://scanalyst.fourmilab.ch/u/eggspurt)
#### Post date: [30 November 2023 13:08 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/613 "2023-11-30T13:08:11Z")
Gartner does these entertaining hype curves:
---
### Author:  [@johnwalker](https://scanalyst.fourmilab.ch/u/johnwalker)
#### Post date: [30 November 2023 13:45 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/614 "2023-11-30T13:45:02Z")
United Arab Emirates leads the way on freedom to compute.
> **[World's first AI minister likens risk of overregulation to calligraphers that...](https://fortune.com/2023/11/28/artificial-intelligence-ai-technology-regulation-policy-guardrails-uae-fortune-global-forum/amp/)**
>
> In his 1515 rejection of the printing press, an Ottoman sultan brought the golden age of Islamic math and science to an abrupt end.
> Governments that overregulate artificial intelligence are risking grave and lasting consequences, Omar Al Olama—the world’s first minister of AI—has warned.
>
> In fact, the impact could be so dire that it may consign a society to a fate similar to the Ottoman Empire, which lost its place as a beacon of advancement when it refused to adopt the printing press.
>
> Speaking at the Fortune Global Forum in Abu Dhabi on Tuesday, the United Arab Emirates cabinet official drew on a cautionary tale from history.
>
> During the Middle Ages, Islam’s caliphate stood at the height of civilization, attracting learned scholars the world over and giving birth to new fields like algebra.
>
> However, in its 1515 repudiation of the printing press the empire rejected math and science—forfeiting its claim as a leading center of culture.
>
> The 1450s invention by Johannes Gutenberg had democratized literacy for the first time—making books affordable through mass production in the West. However, in the Middle East, the Ottoman power center in Istanbul saw the device as a threat to the established order.
>
> The UAE minister of AI said the issues policymakers are now facing with regard to AI—such as its impact on job losses, misinformation, and fear of social upheaval—are very similar to the problems faced by the empire’s then leader, Sultan Selim I.
>
> “We overregulated a technology, which was the printing press,” said [Al Olama](https://www.moca.gov.ae/en/about/our-leadership/his-excellency-omar-bin-sultan-al-olama). “It was adopted everywhere on Earth. The Middle East banned it for 200 years.
[Code is speech](https://www.fourmilab.ch/documents/code_is_speech/).
---
### Author:  [@johnwalker](https://scanalyst.fourmilab.ch/u/johnwalker)
#### Post date: [30 November 2023 14:16 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/615 "2023-11-30T14:16:36Z")
[](https://twitter.com/BrianRoemmele/status/1730024852579299504)
Brian Roemmele has remarked in several posts over the last few days that some of his corporate clients who have Enterprise subscriptions to OpenAI and were planning to expand its deployment, are dismayed with their application prompts continually breaking as OpenAI incessantly and opaquely modifies GPT-4 in the interest of “safety”. This is worse than Microsoft in the age of “strategic incompatibility” (“MS-DOS isn’t done until Lotus won’t run”), and customers are looking for alternatives.
There has probably never been a greater opportunity for totally open source and self-hosted AI.
---
### Author:  [@johnwalker](https://scanalyst.fourmilab.ch/u/johnwalker)
#### Post date: [30 November 2023 14:19 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/616 "2023-11-30T14:19:54Z")
[](https://twitter.com/emollick/status/1730113371108782099)
> **[llamafile is the new best way to run a LLM on your own computer](https://simonwillison.net/2023/Nov/29/llamafile/)**
>
> Mozilla’s innovation group and Justine Tunney just released llamafile, and I think it’s now the single best way to get started running Large Language Models (think your own local copy …
As I said in the previous comment, “There has probably never been a greater opportunity for totally open source and self-hosted AI.”
---
### Author:  [@johnwalker](https://scanalyst.fourmilab.ch/u/johnwalker)
#### Post date: [30 November 2023 14:26 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/617 "2023-11-30T14:26:52Z")
[](https://twitter.com/BrianRoemmele/status/1730098134381166610)
The cited paper is “[A general-purpose organic gel computer that learns by itself](https://iopscience.iop.org/article/10.1088/2634-4386/ad0fec)” (full text at link). Here is the abstract.
> To build energy minimized superstructures, self-assembling molecules explore astronomical options, colliding \sim 10^9 molecules/second. Thus far, no computer has used it fully to optimize choices and execute advanced computational theories only by synthesizing supramolecules. To realize it, first, we remotely re-wrote the problem in a language that supramolecular synthesis comprehends. Then, all-chemical neural network synthesizes one helical nanowire for one periodic event. These nanowires self-assemble into gel fibers mapping intricate relations between periodic events in any-data-type, the output is read instantly from optical hologram. Problem-wise, self-assembling layers or neural network depth is optimized to chemically simulate theories discovering invariants for learning. Subsequently, synthesis alone solves classification, feature learning problems instantly with single shot training. Reusable gel begins general-purpose computing that would chemically invent suitable models for problem-specific unsupervised learning. Irrespective of complexity, keeping fixed computing time and power, gel promises a toxic-hardware-free world.
---
### Author:  [@johnwalker](https://scanalyst.fourmilab.ch/u/johnwalker)
#### Post date: [30 November 2023 14:41 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/618 "2023-11-30T14:41:27Z")
Now, Stabillity AI appears to be…unstable.
> **[Report: Stability AI Positioning Itself for Acquisition](https://www.pymnts.com/acquisitions/2023/report-stability-ai-positioning-itself-for-acquisition/)**
>
> Stability AI, a British AI startup, is reportedly considering selling the company amidst mounting pressure from investors over its financial position.
> The London-based firm has engaged in preliminary discussions with multiple companies, positioning itself as an attractive acquisition target, Bloomberg [reported](https://www.bloomberg.com/news/articles/2023-11-29/stability-ai-has-explored-sale-as-investor-urges-ceo-to-resign?srnd=premium#xj4y7vzkg) Wednesday (Nov. 29), citing unnamed sources. However, a deal is not imminent, and Stability AI may ultimately decide against selling.
>
> â‹®
>
> The tensions between Stability AI and its investors have escalated, particularly with [Coatue Management](https://www.coatue.com/), which led a funding round that valued the startup at $1 billion, according to the report.
>
> In a letter to management, Coatue called for the resignation of Stability AI CEO Emad Mostaque, citing concerns about his leadership, the departure of senior managers and the startup’s precarious financial situation, the report said.
>
> In response, the Stability AI spokesperson told Bloomberg that Mostaque’s leadership has been instrumental to the company’s success and emphasized the confidence investors have shown in the company through recent investments.
Wikipedia on [Emad Mostaque](https://en.wikipedia.org/wiki/Emad_Mostaque):
> At age 19, Mostaque met his wife while on a student trip to the United States. He has been diagnosed with [Asperger’s](https://en.wikipedia.org/wiki/Asperger_syndrome) and [ADHD](https://en.wikipedia.org/wiki/Attention_deficit_hyperactivity_disorder). In his twenties, he became interested in helping the Islamic world by creating online forums for Muslim communities and developing “Islamic AI” which would help guide people on their religious journey.
>
> â‹®
>
> In June, 2023, a news report citing more than 30 sources, including investors and former Stability AI employees, stated that Mostaque had misled investors and the public about his educational background, a partnership with [Amazon Web Services](https://en.wikipedia.org/wiki/Amazon_Web_Services), the extent of his involvement in developing Stable Diffusion, and partnerships with several [NGOs](https://en.wikipedia.org/wiki/Non-governmental_organization).
---
### Author:  [@eggspurt](https://scanalyst.fourmilab.ch/u/eggspurt)
#### Post date: [30 November 2023 16:22 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/619 "2023-11-30T16:22:24Z")
Instability AI
---
### Author:  [@jdougan](https://scanalyst.fourmilab.ch/u/jdougan)
#### Post date: [1 December 2023 07:40 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/620 "2023-12-01T07:40:37Z")
> “There has probably never been a greater opportunity for totally open source and self-hosted AI.”
" AI influencers are getting filthy rich… let’s build one"
[ ](https://www.youtube.com/watch?v=ky5ZB-mqZKM)
---
### Author:  [@johnwalker](https://scanalyst.fourmilab.ch/u/johnwalker)
#### Post date: [2 December 2023 01:47 UTC](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383/621 "2023-12-02T01:47:18Z")
[](https://www.fourmilab.ch/documents/univac/animal.html)
[Previous page](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383.md?page=30)
[Next page](https://scanalyst.fourmilab.ch/t/generative-artificial-intelligence-large-language-models-and-image-synthesis/2383.md?page=32)