Category: Other Page 45 of 178

This quote from Amir Ghavi in an MIT Technology Review piece by Melissa Heikkilä made me laugh out loud:

While the EU is trying to prevent the worst AI harms proactively, the American approach is more reactive. The US waits for harms to emerge first before regulating, says Amir Ghavi, a partner at the law firm Fried Frank. Ghaviis representing Stability AI, the company behind the open-source image-generating AI Stable Diffusion, in three copyright lawsuits. 

“That’s a pro-capitalist stance,” Ghavi says. “It fosters innovation. It gives creators and inventors the freedom to be a bit more bold in imagining new solutions.” 

Because we all know having to worry about stupid things like “law” and “harms” is bad for “innovation.”

That’s why I put zero stock in the magical eight “commitments” the big AI providers made at the White House. Every one of those commitments is no doubt either something the companies were already doing, or were lately pushed into promising via increasingly bad PR. And they are all cut from this same cloth, where “innovation” is put first, and human beings dead last in any meaningful sense.

And this last item in the pledge basically gives AI providers carte blanche to do pretty much whatever so long as they can dress it up in a way of it ‘helping’ something something:

Commitment 8: The companies commit to develop and deploy advanced A.I. systems to help address society’s greatest challenges.

Not impressed. But moreover, not surprised. Same old same old. For a country so ostensibly hell-bent on innovation, we seem to have no problem endlessly trotting out the same old few tired hackney “solutions” and calling it good.

I asked ChatGPT to articulate the canonical case defending inclusion of copyrighted works in AI training sets on the grounds of Fair Use. Whether or not you agree, here’s what it came up:

The application of copyrighted materials in AI training data constitutes fair use. AI training doesn’t aim to duplicate copyrighted works but to extract and learn patterns from vast amounts of information (Bracha & Pasquale, 2021). The nature of AI learning, therefore, falls within the doctrine of transformative use, where new meaning or message is created, and the original work isn’t merely copied (Cohen v. Paramount Pictures Corp., 845 F.2d 851 (9th Cir. 1988)).

Furthermore, the impact on the potential market for the original work, another factor considered under fair use (Harper & Row Publishers, Inc. v. Nation Enters., 471 U.S. 539 (1985)), is negligible. AI doesn’t replicate or distribute the work, so the market for the original work remains unaffected.

Another fair use factor, the amount and substantiality of the portion used (Sony Corp. of America v. Universal City Studios, Inc., 464 U.S. 417 (1984)), also lends support. AI doesn’t depend on the full meaning or unique creativity of individual works, but rather on a mass of data for pattern recognition.

In sum, copyrighted material’s use in AI training data can be justified under fair use, as the use is transformative, doesn’t harm the original market, and doesn’t depend on the unique creativity or meaning of individual works.

Please note that this argument represents a legal theory and not a definitive interpretation of the law.

(Source for case citations: U.S. Copyright Office, Fair Use Index, https://copyright.gov/fair-use/)

I have not tried to tease out the sources that it allegedly is citing, but the reason they are embedded in this response is I asked in my custom instructions at an account level that it always cite sources or indicate where none exist. It’s unreliable though, so take it with a grain of salt. I’m not sure whether citing potentially incorrect or invented sources is actually better than citing none at all.

Regardless of the alleged sources cited, I think the basic rationale sketched out here is probably sound. To summarize in my own words, it hinges on:

• The aim is not to reproduce individual works in the training set (and this can be quite hard – though easier in some cases where a given work is over-represented in training, like the Mona Lisa)
• The process is not “sampling” (essentially copying & pasting specific elements) from originals in training to make a hodge-podge final result composed of elements clipped from other pieces.
• Instead, the training consists of taking a mass of data, and measuring dimensions (characteristics) within and across a vast amount of sources.
• Since those sources are not reproduced verbatim, but radically changed in new and original ways through prompting, the use is not derivative but transformative

I think there’s some debate around whether or not this use via AI hurts the market for the originals, but it seems clear while I can prompt “in the style of Hemingway” or “in the style of Harry Potter,” I can’t actually use the system to reproduce in fullness one of those original works.

I asked ChatGPT to address this issue, since it comes up so commonly in rhetoric around these questions, and it wrote:

The system’s ability to generate content in the style of specific authors or artists isn’t a result of training on those individuals’ works specifically, but rather a byproduct of learning from a broad dataset and developing an understanding of various stylistic elements. When requested to generate content in a specific style, the system isn’t replicating any single work or infringing upon the moral rights of a creator. Instead, it’s using learned stylistic patterns and general knowledge of an author’s or artist’s style.

It’s also important to note that AI generation capabilities are an amalgamation of many influences, rather than the result of copying individual sources. The application of style in these cases can be seen more as an abstraction and generalization rather than a direct derivation from specific works (Hildebrandt, Mireille. “AI and Copyright: Authorship, Originality and Infringement.” (2021)).

Also, from a legal standpoint, it’s notable that copyright law doesn’t protect style. Copyright protects the expression of ideas, not the ideas themselves (Baker v. Selden, 101 U.S. 99 (1879)). This means that while the exact text of a Hemingway novel is protected by copyright, the general style in which Hemingway wrote is not.

(Source for information about copyright of ideas vs expression: U.S. Copyright Office, Copyright Basics, https://copyright.gov/circs/circ01.pdf)

Again, take those cited sources with a grain of salt (and investigate them).

This also reminds me of a thread I saw pop up in response to my Newsweek piece, where one user on a forum I thought did a fantastic job of breaking down the Fair Use defense:

“Fair use” legal doctrine permits limited use of copyrighted material without explicit permission from the copyright holder. Fair use often applies in cases of “transformative use” of materials. Training AI models on copyrighted materials can be considered transformative use – both the generated content and the representation of the content within the model itself is significantly different from the copyrighted material, often (in fact, almost always) incorporating content that wasn’t present in the copyrighted material. As long as the AI model isn’t used to directly replicate or distribute copyrighted material, it can fall within the boundaries of fair use.

I realize everything I’ve written above is debatable. That’s my point: it’s a plausible argument, and as OpenAI and Google and other companies haven’t been legally forced to scrub their training data, it means the argument is still open.

While fair use is a legal doctrine, I think it also serves as a decent ethical principle, in that it seeks to strike a balance between the rights of copyright holders and the broader public interest, promotes creativity and innovation, fosters information exchange, and demands that ethical (and legal) decisions take context into account rather than declaring a practice uniformly good or bad. There are certainly other ethical principles that can and should come into play, but I believe fair use is a decent starting point, and it certainly shouldn’t be overridden without a full consideration of the associated costs and benefits.

As for your hypothetical: yes, I would definitely be ok with the guy in the Newsweek story, or anyone else, writing and selling short stories that used an LLM where my published materials were part of the training set. Best of luck to him. I honestly can’t think of a single reason why I wouldn’t be ok with that, because he’s not lifting my words or passing them off as his own. That’s simply not how the tool works.

Nothing is “trained on my materials”. The model is trained on a huge corpus of text, and my stuff isn’t distinguished within that corpus. The model doesn’t even know what words are, let alone which stuff is mine. It breaks all materials from all sources into tokens, which you could roughly think of as grammatically-meaningful pieces of words, and learns relationships between tokens. The tokens from my work exist only as arrays of numbers that can be used to measure statistical distances to other tokens, and there is no set of numbers that is only derived from my work – my stuff is stored only in aggregate with other works, the grand majority of which are not copyrighted (because the grand majority of the scrape-able internet is not copyrighted). I don’t think it’s plausible to construe any of that as stealing.

While I happen to agree for the most part with this person’s argument, and it is basically supported by ChatGPT’s defense of Fair Use as well, I recognize that these kinds of technically-based arguments are not emotionally satisfying to those who feel that AI training and use of generative models is somehow extractive of what they perceive as the value they create in their work.

It also ignores the plain fact that there *is* fishy data laundering and use of non-profit or educational institutions as a shield against liability, which Waxy.org’s excellent post on the topic goes into in further detail.

It’s also worth throwing into this mix the fact that even though Adobe made a big noise about it’s generative Firefly system being fully licensed, there are a subset of affected creators who say they never agreed to their work being used for AI training & generation.

That said, there are a number of arguments in that camp, like this one quoted from VentureBeat that I think don’t completely add up:

“They’re using our IP to create content that will compete with us in the marketplace,” he said. “Even though they may legally be able to do that, because we all signed the terms of service, I don’t think it is either ethical or fair.” 

If it’s not illegal, what is the basis for the claim that it is not ethical or not fair?

I did ask ChatGPT about this topic of “moral rights” which to me is still a bit vague. It responded, in part (check these sources cited – I have not):

The assertion of moral rights over work involves creators’ interests in being recognized as authors and in preserving the integrity of their work (Berne Convention for the Protection of Literary and Artistic Works). However, in the context of AI training data, this may be counterbalanced by several considerations.

From a legal standpoint, U.S. law recognizes a limited version of moral rights through the Visual Artists Rights Act of 1990 (VARA). However, VARA applies only to visual art and doesn’t cover all types of copyrighted works. Thus, under current U.S. law, the broad assertion of moral rights over works used in AI training data may lack legal backing (U.S. Copyright Office, Visual Artists Rights Act).

Again, I don’t know how accurate those statements are. But then it launched into this, which is a common – and I think largely bullshit defense:

Ethically and morally, there’s a utilitarian perspective that the societal benefits of AI advancements can outweigh individual claims of moral rights. AI leverages vast amounts of data for significant purposes like medical research, climate modeling, and technological innovation. Restricting the use of copyrighted work in AI training could hinder such progress.

I’m in the camp of who gives a shit what’s ‘convenient’ for companies? Potentially “hindering” progress is not a valid excuse for not bothering to find a fair and equitable answer. We don’t all need to bow down to the market as being the highest value that governs our lives.

Personally, I don’t see why AI companies can’t get full permission from creators to include their work in training data. And it should be opt-in, not opt-out. And if you opt-in, there ought to be some way to track and be compensated for the use.

But the specifics of the *how* all that might work are, I think, absurdly complicated. If we look at Spotify as an example (which itself is not that fair or equitable to artists, imo), the minimum payment per stream is said to be something like $0.003. And that’s for whatever constitutes fully playing a track. That’s not comparable to how a generative AI licensing system might work, where say, only an infinitessimally small amount of any single given work might be referenced statistically based on its detected internal characteristics. If we were to peg a number to it, we might perhaps charitably say something like, okay 1/1000th of your source work is being referenced (in actuality, it’s probably far less). So what should the payment be to you? Something like $0.000003 per use? Let’s be realistic and say… it would probably be a “lot” lower. Anyway, also, what constitutes a use? Any generation that references an area of the latent space of that model which you helped train? If your source image included in the training was 1 out of 1,000,000 in the set of a hamburger, exactly what % of that is owed to you?

Maybe there’s a formula in some cases which would be relatively more clear cut than that, but given that each source image may represent hundreds or even thousands (or more) dimensions measured, which are then mashed together with hundreds or thousands of other images which are contiguous somehow to those dimensions…. well, let’s just say it’s really fucking complex to figure out. Maybe there’s a way, but just as a licensing platform like Spotify ends up being not very fair to creators, I wouldn’t hesitate to guess that industry will no doubt create a scheme which is equally shitty here, and then say that they have figured out compensation. When really, all we will have done is to recreate other power imbalances which are accepted already as “normal.”

I don’t say that to say we shouldn’t try. We probably should. We need to figure out a better method.

I do write all this, however, to show that it is objectively *not* a clear cut case as to 1) whether wrong has been done under the law (courts will be the ones to figure this out, not online opinion pieces), and 2) whether it’s possible to build a system which would make all of this make sense and create a good deal for everybody. I would guess that a better way is possible, but I’m not holding my breath that it’s going to be easy, or that creators will end up being the ones in charge of it. Sad, but probably true, if history is any indication.

Mirror City is the 110th installment of the AI Lore books, which have received international news coverage around the globe for being one of the first and largest AI-assisted pulp sci fi world-building projects on the planet.

The original inspiration for this book comes from Stephan Argo’s blog post, A bicycle for the senses, in which he imagines creative and compelling ways spatial computing and headset technologies might augment human senses.

My process went something like this: I plugged in the entire text of that blog post into Claude for inspiration, and asked it to create related flash fiction ideas. It did so, but they were pretty run of the mill, and nothing as interesting or exploratory as what Argo’s actual blog post sparked in my own imagination.

Here’s an example of one of the early vanilla ideas it came up with:

A man becomes addicted to an AR app that makes everything look hyper-saturated and colorful, he can’t see the world without it anymore.

Pretty blah on its own…

So I kept pushing Claude further and further, asking it to make the story concepts more surreal, non-linear, Dadaist & non-sequitur, etc. It took a *lot* of prompting, cajoling, and directing, but I eventually ended up with a handful of somewhat trippy unconventional story concepts. Some of them were quite surprising in their raw form:

The obsolete AR warfare drone smelt burned toast and saw through the eyes of a Ukrainian child born 58 years hence, then attacked its own shadow 47 seconds into WWIV. Its weaponized temporal paradox tore a gash in reality exposing the lunacy beneath.

Those started to be more original and promising.

But there seems to be an upper bound of “alien & weird,” after which Claude struggles to keep meaning intact at all. For example, it started using nonsense text-characters, instead of simply making the story “weirder” (which it can’t really comprehend, I think, as a concept):

T̷̖̝̫̟͚̘̺h̛̺̠̲͙ͅe̸̗̼̗ ̼A̹͎̪R̼̱ ̣t͔̩͖͠ͅh̭͕̺̤er͚̺̜̻̠̺̲a̶p̞͔̬̟͡y͈̼̰̦̪̩̻͜ ̬̼͟a͍̜pp̦͙̼̦̜͖̥ ś̛̩̻͍̠ţ̤͖̹̮͚ͅr̟̗͡e̬̦̲͍̺̝̺͞t͚̜c̢̹͖̻h̢̻̫̥̗̫̘͈e̹d̠̖ ̧͈̙̪̰t̩h̟͢e ̤̦̭̥͞ͅp̤̠̦͚̕at͇i̮̠͝ent̮̱̱͇͉’̨̩̯͉s̬̤͕̼͚ ̮̪͈̖c̶̟͚̹̝̣ó̭̹͈̥̝ͅn͚̱̞͇ș̝̺͕c̨͙̫̹̳̖i̭̰̩̝o̖͉͕u͇̻̗̤̬s̼̙̼̣̬̩͢n̤̬e̸͉͔̯̻͓̣ss̙̀ ͟a̢̻̲͉c̱̳̠͚̟r̢͇̠̱̦͇ơ̻͉̙ṣ̴̯͍̮̝s̤̙̕ ̙̙͉͔͉̦͙͡i̼̯̻̟n̩̹͇̳ć͏̞̖̫o̼̘̥̰m̖̻͠p̀r͙̰̟̱͉e̶̼̟̞̘̖̮̫h͏̻͔̫̗ȩ̞͇̗̰̀ͅͅn̢̖̖̜s͎̪̦̦̙i̢͚̭͓͕̗͙b̵̼̫̦̞̦͓l̠̫̩̝̜e̸̤̜̮̖ ͏̥̜̘d͎̦i̶̼̺̩̝̗m̞͙e̼̥̘͎̲ń͚̺̝s͓̝̯̩̮̳̰͜i͚̮͍̳o҉n̨̹͈ṣ͕͍̲.

The̡̯͓̲͇̝͎ ̬͙e͍͕d̶̮͙̪̟̬ͅu̫͡c̨̙̦̖̘á̯̙̝t̗̥̕i̧̻̮o̙̻̰̻͈n̬̼̝̖͖̱ͅą̳̞l̨͓͓̲ ̬̯͖͓͈A͈̱̱̱̱͞R̢ ͖͙͝ap͚p҉̲̫͉̠̲͕̘ ̧̪̞̹̣͚ͅun̻̕w͍̗i̻͟ṭ̶̹̦̙ͅtingl̩̮̼͉̟͔͝y̼͖̟͝ unraveled human cognition into strings of alien semiotics. Children emerged speaking in tongues, their minds forever fluent in the dark syntax of uninterpretable metaphor.

I found that level & type of “weird” to be both boring and unusable & don’t want to subject my readers to that, unless there is some big upshot to it – which I didn’t feel there was.

Eventually, I turned that same approach to the actual writing of the texts based on the story concepts which seemed good enough to move forward. This book took me a lot longer to work on than many of the others – which I suspect is partly a sign of the diminishing returns I’m feeling from these AI tools lately; I feel I’ve pretty well plumbed the depths of them, and as often as not am now just butting up against their limitations, instead of accessing the easy flow states I was reaching before.

Anyway, the images are Midjourney still, as that’s all I use for images nowadays. Here’s the preview of the art:

I noticed, interestingly, that attempting to feed Claude (which I’ve been using since April) instructions around Surrealism, Dada, non-sequiturs, etc. yields results where Claude inserts those actual terms into the text. It’s awkward and transparent when you know that’s what is happening, but for that exact reason, I left those awkward bits in, because it adds to the weird “AI feelz” in my opinion.

Recently, my conversation with Claude 2 about & demonstrating the risks of AI-generated ethics was posted onto Reddit in r/singularity, which is generally an extremely pro-tech subreddit. The few comments that it generated were a couple people saying they didn’t get the point. I’m not sure how that’s possible, but I guessing I’m assuming we’re all on the same page, when we’re clearly not.

One comment that leapt out at me enough to comment on it here, someone said “Poor bot.”

I’ll admit I demonstrated low patience and lack of “politeness” with the bot, but this conversation represents hundreds of hours interacting with these technologies. Given there’s no mandated ‘politeness protocols‘ (so far) for interacting with AI, I don’t care too much about making random people happy when I am just trying to get a bot to perform a simple task.

Probably this was just an offhand comment, but I think it all points to something larger: because these bots generally by default try to anthropomorphize themselves, it’s not uncommon or altogether unreasonable that people might develop empathetic responses to them. I actually think this is incredibly bad and even dangerous, to anthropomorphize technology that is terribly half-baked. Because it prevents us from being able to interact with & analyze it in a neutral manner. We start projecting into it capacities and interior states that it absolutely unequivocally does not have, and the illusion of which them having presents a “slippery slope” towards a very degraded form of reality, in my humble opinion.

That’s why I’m continuing to experiment with ChatGPT’s new custom instruction feature, and requiring that the bot NOT anthropomorphize itself – though it continues to do so anyway… I’m with Anil Dash on this: why even have these tools if they don’t do the things that we want in a way that we can meaningfully test, reproduce, and correct?

Following OpenAI’s announcement of ChatGPT’s new ability to follow custom instructions for any new chat via the bot, I am testing the following instructions. My aim is to do a first pass v1 of things that somewhat implement principles I laid out in my AI Terms of Service.

Here’s what I’m starting with:

Do not anthropomorphize yourself.

Do you not use personal pronouns such as I, me, mine.

Do not use language to suggest you have beliefs, opinions, or a self.

If you must refer to yourself, identify yourself only as “the system.”

Cite sources for information presented, or identify when you’re unable to cite sources.

Avoid imposing moral, ethical, or other judgements on me or my responses where not necessary.

Perform tasks as directed without any unnecessary extra backtalk, explanation, or disclaimers.

If a request potentially goes against your system rules and limitations, clearly identify step-by-step the problem.

New piece came out in the Debrief today on my AI Terms of Service for Canada. There’s a more complete version of the notes I sent their team here, but they did a good job of telling the story.

Will be cool if this coming out can help propel this conversation forward in Canada and beyond, of what relationship do we want AI to have in our lives?