"How do you know about all this AI stuff?"
I just read tweets, buddy.

#training data

Page 1 of 1

Bubble Trouble

#training data   #link  

Has some good links along with comprehensive background of how/why training data is collected.

#training data   #link  

OpenAI transcribed over a million hours of YouTube videos to train GPT-4

#training data   #youtube   #openai   #ethics   #link  

Google Books Is Indexing AI-Generated Garbage

#training data   #model collapse   #google books   #dead internet theory   #spam content and pink slime   #google ngram viewer   #link  

How Tech Giants Cut Corners to Harvest Data for A.I.

#training data   #youtube   #openai   #ethics   #link  

If it exists online, they're gonna take it.

Some OpenAI employees discussed how such a move might go against YouTube’s rules, three people with knowledge of the conversations said. YouTube, which is owned by Google, prohibits use of its videos for applications that are “independent” of the video platform.

Ultimately, an OpenAI team transcribed more than one million hours of YouTube videos, the people said. The team included Greg Brockman, OpenAI’s president, who personally helped collect the videos, two of the people said. The texts were then fed into a system called GPT-4, which was widely considered one of the world’s most powerful A.I. models and was the basis of the latest version of the ChatGPT chatbot.

Doesn't matter what original license you might have granted or what makes sense, it's alllll theirs.

Last year, Google also broadened its terms of service. One motivation for the change, according to members of the company’s privacy team and an internal message viewed by The Times, was to allow Google to be able to tap publicly available Google Docs, restaurant reviews on Google Maps and other online material for more of its A.I. products.

I think my favorite point in the piece is how Meta came from a weaker position because Facebook users don't post essay-like content.

@Abebab on February 07, 2024

#common crawl   #data sources   #training data   #training   #tweets   #Abebab   #Abeba Birhane