Hacker Read

kc0bfv · 2021-03-06 13:51:46

Thanks for that - I haven't tried it there...

Yup - single file operation was a design goal, but I bet there's a better way to get it working than the hack I used.

reply

BlueTemplar | karma 2807 | avg karma 0.63 · | 2021-04-12 11:26:18

Single File works better IMHO.

j88439h84 | karma 1090 | avg karma 1.52 · | 2020-08-10 17:22:03+00:00

SingleFile can do it.

anotheryou | karma 3032 | avg karma 1.22 · | 2020-05-23 20:08:07

Yea, have to try that some time.

I'll need to switch from one biiiig file to multiple than though. I think my biggest hindrance is setting up the refile targeting :)

reply

pmjordan | karma 7982 | avg karma 3.26 · | 2010-11-08 03:44:43

OK, I'll give that a go too, thanks!

EDIT: I guess one disadvantage of this approach is that the file system structure is exposed. Convenient though.

reply

oblio | karma 25694 | avg karma 2.47 · | 2019-04-23 15:19:31+00:00

Cool hack.

Though I'd definitely advise wanting to do this to Do The Right Thing™ and just put each thing in its own file.

reply

sneak | karma 23753 | avg karma 1.62 · | 2018-10-08 08:46:27+00:00

What bothers me is that this requires a running linux kernel and root to eventually produce a single regular file. Why is this not refactored in such a way that it can be done conveniently from userspace?

Uptrenda | karma 3706 | avg karma 4.99 · | 2020-11-26 04:27:05

Looks useful. Should make it single-header / single-file too. Regex would also be good to have.

ianai | karma 10241 | avg karma 1.69 · | 2019-10-18 12:09:16+00:00

How would that be possible without having to essentially keep track of two files? Nice idea though.

robbintt | karma 406 | avg karma 1.74 · | 2023-06-19 11:59:54

I will take a look -- however, since I only use a single file, it may not be needed.

burntsushi | karma 13683 | avg karma 4.52 · | 2023-11-26 15:55:51

For the single file case, if you pass --with-filename then it should work.

effie | karma 1121 | avg karma 0.74 · | 2019-06-20 21:10:17+00:00

That is interesting. Could you please describe in short your methodology? Did you try to read/write many small files, or one big file?

trynumber9 | karma 1355 | avg karma 3.4 · | 2021-06-25 18:54:52

What about with ReadyToRun and single file?

shorez | karma 54 | avg karma 2.7 · | 2020-01-11 10:58:54+00:00

But only as long as it stays in a single file :(. And it does not have support for arrays as well

kraemate | karma 186 | avg karma 2.0 · | 2016-07-08 20:36:20+00:00

Wow, thanks for the script. Surprising in its simplicity. I would have thought this use-case was popular enough to warrant specialized tools etc. Especially in the scientific community where they transfer large files.

IshKebab | karma 13023 | avg karma 1.29 · | 2023-03-27 16:56:32

I mean multiple files.

TimothyFitz | karma 1494 | avg karma 7.22 · | 2010-06-05 03:54:46+00:00

I've been doing this with sshfs (Linux/Mac) or ExpanDrive (Windows) for years, with whatever my editor of choice is for the file in question.

jeresig | karma 2957 | avg karma 9.33 · | 2010-01-14 16:23:33

Yeah, we only use simple mode - it's advanced mode that everyone needs to watch out for - it doesn't do what you expect (it's optimized for combining multiple files, not producing one file).

nawitus | karma 3654 | avg karma 2.15 · | 2014-03-29 18:20:20+00:00

I didn't propose that. The point is to read the file once, then do multiple steps on it, and write it out just once.

Dylan16807 | karma 31639 | avg karma 1.39 · | 2013-05-20 09:44:41+00:00

That link talks about putting the entirety of very small files into their inodes. I don't see anything about combining the tails of multiple files in a single block.