Hacker Read top | best | new | newcomments | leaders | about | bookmarklet login

There was a similar talk[1] at FOSDEM, where the speaker describes how, as an experiment, he replaces a full ELK stack plus other monitoring tools with PostgreSQL. He even goes as far as implementing a minimal logstash equivalent (i.e. log parsing) into the database itself.

It wasn't an "we do this at scale" talk, but I'd love to see more experiments like it.

For the impatient: Skip to 17 minutes into the video, where he describes the previous architecture and what parts are replaced with Postgres.

1. https://fosdem.org/2017/schedule/event/postgresql_infrastruc...



sort by: page size:

Thanks. Yeah I've been making my way through the video - "Elephants on Automatic: HA Clustered PostgreSQL with Helm"

and its discussed at the 15:57 minute mark here if anyone else is interested:

https://www.youtube.com/watch?v=CftcVhFMGSY

Cheers.


This looks great, I'll add it to my list.

I've gone far out of my way not to use Elasticsearch and push Postgres as far as as I can in my SaaS because I don't want the operational overhead.


Didn't watch the video, but if I recall correctly it was always PostgreSQL?

This is awesome. Sounds more exciting to see greatly used PostgreSQL stuff packed together.

It looks like this is built on top of Postgres, so they're already doing this.

I would love to see postgres in the mix.

It’s Postgres under the hood.

There's for example Aiven, which is offering managed Postgres in cloud [1]. They also have similar managed offerings for various other open source tools. They raised $40M earlier this year.

[1] https://aiven.io/postgresql


BTW if you're going to FOSDEM check out http://www.postgresql.eu/events/schedule/fosdem2015/session/... where I will host a full talk about pgloader ;-)

It’s Postgres.

Oooh, making it a standardized postgres extension (rather than its own compiled fork) is suuuuper-compelling. I've toyed with pipelinedb here and there, but the mental overhead of maintaining it separately from postgres is a little heavy. Even if the benefit is largely psychological, I think this is a great move.

Or Postgres.

This is great to see. I hope this kind of client can be connected to Postgres one day.

Would love to see this! I could see a wasm version of postgres being useful for all sorts of things, especially an easy dev instance of pg runing inside a node app.

Or managed Postgres on AWS Aurora, AWS RDS, Google Cloud SQL, Heroku, etc :)

SNS, Kenesis (Kafka), Google Pub/Sub are awesome. Not the same problem/solution fit as an event store, but awesome for the scenarios and architectures they're targeted at.


It's built on top of PostgreSQL.

Josh Berkus, core PostgreSQL member and currently employed by Red Hat seems to think they go well together. Here's some of his work:

https://www.youtube.com/watch?v=iruaCgeG7qs

https://github.com/jberkus/atomicdb


That's how I've been thinking/talking about it. It should be a drop-in replacement for Postgres. Obviously the install process isn't as smooth yet, but, technical preview...

Are you using Postgres by chance? If so, I'd love to hear about how you deployed it (struggling to figure out a performant, HA setup!)
next

Legal | privacy