Hacker Read top | best | new | newcomments | leaders | about | bookmarklet login

This is very interesting. The triple store space is crying out for a good solution; a good _distributed_ solution - unheard of.


sort by: page size:

This is pretty incredible both from a product perspective, as well as the potential to push the whole industry towards a race to the bottom. Equilibrium here pushes storage, processing, and availability towards distributed nodes, unless high availability is required for some unique business case

Decentralised storage could be pretty cool for this, no?

Indeed, we want to provide storage, but easy-to-use storage that can scale to 100+ (or 1000+) nodes is tricky. We're working on it. :)

PS. If you're a distributed storage expert and want to work on this, we're hiring!


I really like the idea of integrating with shared data-stores! It is a quick win for going multi-cloud since it's quite challenging to run a complex arch on multiple clouds. There also isn't great parity yet across them.

Popular when seen in relation to other options for decentralized storage perhaps. It might be a small group at the moment but they can still be large in a small space.

I agree. A lot of these storage solutions are starting to be so cheap that it's not hard to see different sorts of players investing in them. The benefit being, as you rightly point out, distributed storage.

Such systems are "no-brainers" for entities like, say, hospitals.


I agree also perhaps for grid scale storage

This actually looks like a really interesting idea, though I'm curious to see how well it'd handle the combination of both local and shared storage.

Yeah, I was wondering about that. It looks like you guys have done some brilliant work with the storage engine, but reimplementing all the distributed logic is another (possibly bigger) project.

I loved it... we are currently working on a ind of idea storage systemsolving exactly that problem. (And I'm only writing this comment as a a kind of bookmark)

I think this is quite amazing, building high-availability storage is a complex endeavour because the entire storage path needs to be 100% redundant.

It's quite an achievement to get this functional using open-source.


I'd like to see other distributed filesystems catch on too. HDFS has a lot of room for improvement.

Great work. Planning to read about it. I, and I am sure others, are continually intrigued about this space and I hold out hope that the definitive solution appears soon (along with the solution to micropayments !!).

On a slightly related note, is anyone interested in having a discussion about how to layer on top of all these "drive" systems a `HDFS` like drive that would have n block replication across different sources, and trying to interpret any given source (dropbox, hyperdrive, google drive, etc..) blocks to make sense of what is being stored there would render the person confused?

:)


Yes agreed, distributed block storage is definitely the future. Nice to see Linux pioneering this too.

The key is over a large enough area and with enough integrated storage systems it all averages out. It ends up being a lot more decentralized and resilient.

While only solving the storage part of the equation, checkout projects like Sia Coin[0] and Storj[0]. Both of them aim to provide hyper-competition for storage space, through the use of blockchain technology. I think a future, where multiple blockchain projects provide access to computational resources, isn't too farfetched.

[0] http://sia.tech/

[1] https://storj.io/


yep. Those solutions aren't there yet, and arguably too early, but the market direction is clear. In five years I would not be surprised to see some form of transactional data store(high TPS, blob store) on a decentralized layer.

Crazy to talk about different FS compression schemes when trying to optimize business/app logic higher up the stack. should be abstracted away by now. (yea, I know it's not, but should be)


The possibilities do seem rather endless. This could very well be the backbone storage layer for may popular sites such as youtube or netflix, imgur etc. Decentralization eliminates a single point of failure.

This is, in my opinion, is the first and only "solution" to a real problem built using the blockchain.

Distributed file storage, if done correctly, can be a transformative technology. And it can be even more revolutionary implemented at the OS level.

next

Legal | privacy