Hacker Read

Mirioron · 2020-03-06 23:21:59+00:00

Or just regular text. Or algorithms with PNG or binary blob seeds.

drblast | karma 3624 | avg karma 6.19 · | 2014-09-19 09:40:13

If only there were some automated way to convert those images to text.

koalaman | karma 435 | avg karma 3.82 · | 2012-07-31 14:07:24+00:00

couldn't you just encode the images into text?

kijin | karma 10374 | avg karma 2.8 · | 2013-06-30 10:43:19

Image extraction would be cool, but to me getting a readable block of text is more important.

untog | karma 43841 | avg karma 4.88 · | 2015-06-07 22:19:33+00:00

Huh. Surely there's a better way to do that than post text in an image? Even just using pixels to encode the text.

whymauri | karma 4493 | avg karma 4.45 · | 2021-07-19 10:54:56

I would like to also couple an algorithm to generate those images. Maybe just randomly select nouns for the title, but pass on augmented/cleaned versions of the title to some generator + CLIP to autogenerate fitting images.

LarryMade | karma 64 | avg karma 0.72 · | 2012-02-01 04:55:21+00:00

Many languages support creating image maps and then writing strings to text to it. Not that hard a process.

ShamelessC | karma 2803 | avg karma 1.26 · | 2022-09-01 09:48:50

The article shows a model that does this.

It's only a few frames, but they are entirely generated from text - no seed image or interpolation required.

reply

flippyhead | karma 2704 | avg karma 3.79 · | 2013-04-27 14:05:35

Yes! I love the idea of being able to find images that actually include the text you want. Even better if the image itself is relavent.

city41 | karma 10113 | avg karma 3.53 · | 2013-04-27 20:18:27+00:00

Actually I meant have it generate a meme image from the text you provided. Like all the other meme generators out there, but much more simple.

immibis | karma 2313 | avg karma 0.88 · | 2024-06-16 00:11:16

You can poison all your images with Glaze and Nightshade. Then you don't have to stop them from using them - they have to stop themselves from using them or their image generator will be useless. I don't know if there's a comparable system for text. If there was, it would probably be noticeable to humans.

pipes | karma | avg karma · | 2023-12-09 02:13:23

This all seems premature. So far we have something that can generate text and pictures based on other text and pictures ?

hgsgm | karma 1743 | avg karma 0.72 · | 2023-03-11 09:11:20

Why would you say that? Every word can be easily encoded in a tiny picture.

amelius | karma 42902 | avg karma 1.63 · | 2018-08-16 16:45:08+00:00

With modern ML, that is not true. For example, a browser could easily run OCR on the frame-buffer and read it out loud.

In fact, the approach would be more general, since a lot of text is already embedded in images on a lot of websites (think also about ads).

reply

yccs27 | karma 1021 | avg karma 3.08 · | 2021-04-22 10:21:54+00:00

you simply have a tool which extracts the text, transforms it however you please, and then puts it back as an image.

Then you still need some way to handle text, and image to text is not reliable. Text simply has so much more distilled information. Images are nice for humans, but I can't imagine them as a storage format for programs.

reply

notriddle | karma 2413 | avg karma 2.6 · | 2022-07-06 15:45:50

Text rendering is more complex than decoding a PNG.

sp332 | karma 55607 | avg karma 2.75 · | 2023-06-25 12:35:23

I'd like to find a way to start with an embedding and have the computer generate some text that corresponds, at least approximately. There are tools that do that for images, right? Like Stable Diffusion, you can put an image in, get an embedding, then do gradient descent in latent space to find a new embedding, then generate a new image from that.

alexcnwy | karma 777 | avg karma 2.48 · | 2017-05-16 07:28:37

I think this is true not just of images but also for text with things like word2vec etc

Anuiran | karma 16 | avg karma 1.45 · | 2023-02-10 15:37:16

Many AI image generation can do text now. Especially some unreleased ones like Muse from Google.

What does behind the scenes might isn’t necessarily 1:1 with old image generation stuff either way.

reply

stevenhuang | karma 1213 | avg karma 1.5 · | 2024-01-08 15:45:36

You got that switched around. Text generation is harder than image generation.