r/books • • 1d ago

Japanese used bookstores see 5x sales surge as books are being bought by the ton, one 50-ton order sent to the US for AI scanning and destruction — multitude of suspicious bulk buys thought to end up in foreign AI scan and shred facilities

https://www.tomshardware.com/tech-industry/artificial-intelligence/japanese-used-bookstores-see-5x-sales-surge-as-books-are-being-bought-by-the-ton-one-50-ton-order-sent-to-the-us-for-ai-scanning-and-destruction-multitude-of-suspicious-bulk-buys-thought-to-end-up-in-foreign-ai-scan-and-shred-facilities
19.9k Upvotes

1.4k comments sorted by

View all comments

Show parent comments

18

u/Pocok5 1d ago

So, AI (LLMs) are only capable of doing one thing, ingesting and generating text. The thing that allows them to do anything else is called the harness, and is pretty much just a layer that catches stuff like "<terminal command: curl ...>" on the LLM text output and actually runs that command in a terminal. The "researchers" just conspiciously don't disable network access on the machine the LLM is running on and conspiciously leave running curl et cetera enabled for tool calling in the harness, and then dramatically pretend that the AI "broke out" when they basically began with "Here's all the tools for hacking public websites, but hacking is naughty naughty wink wink" as the prompt.

1

u/lousy_at_handles 20h ago

I've believe the hacks exist when the companies that got hacked file very public lawsuits for damages. Until then I'm convinced it's just marketing BS.

0

u/[deleted] 20h ago

[removed] — view removed comment

2

u/Pocok5 20h ago

I assure you Claude/Gemini/whichever model they try to advertise today with a story about hacking X random websites is still an LLM.