Hacker Read

yazaddaruvala · 2017-05-11 02:42:05+00:00

Sorry, I'm not talking about "number of partitions" but if I "forcibly"[0] hit the same partition, will the SLA hold?

[0] i.e. If I somehow pick keys which are on the same partition.

reply

gregmac | karma 9633 | avg karma 5.8 · | 2018-04-19 19:18:06

This makes me wonder also what happens with multiple partitions, for example:

5 into 2, 2, and 1

7 into 3, 2, and 2

reply

biksnep | karma 2 | avg karma 2.0 · | 2017-05-11 01:42:38+00:00

Partition tolerance?

erik_seaberg | karma 4377 | avg karma 1.56 · | 2019-11-30 15:20:45

Yeah, partition size is only limited if you create a local index, because those are strongly consistent.

mulmen | karma 13520 | avg karma 2.38 · | 2024-02-21 01:25:06

I wouldn’t expect either of those filters to utilize a partition key if one exists. So yeah, you probably did a full table scan every time. Is the partitioning documented somewhere?

tomnipotent | karma 4025 | avg karma 2.28 · | 2022-07-19 16:57:15

Only if those partitions are on separate storage, otherwise you have the same number of dead tuples/dirty pages.

UK-Al05 | karma 1071 | avg karma 1.89 · | 2020-12-09 18:43:38+00:00

There's logical and physical partitions.

Logical partitions are always handled by the same physical partition. But physical partitions can handle multiple logical partitions.

reply

theprotocol | karma 1281 | avg karma 3.58 · | 2017-08-19 21:58:23

Can you elaborate? What kind of partition are you referring to? Thanks.

rathboma | karma 552 | avg karma 3.02 · | 2009-11-25 07:36:24

Yeah, you're right. I threw it together really quickly, I think I'll just replace the randomized partition with a regular partition call.

siliconviking | karma 336 | avg karma 2.69 · | 2013-08-17 13:32:43

Very interesting - I wasn't aware of this! Looks like this could provide a solid first cut to the partitioning process. Thanks for recommending...

ergo14 | karma 3421 | avg karma 4.03 · | 2019-03-04 08:51:34+00:00

Only if you want to have a single partition :( If you want to have separate ones you have to do manual dance around luks. I'd wish it was easier to set up for multiple partitions.

spraak | karma 2505 | avg karma 1.72 · | 2018-07-14 05:14:06+00:00

Is partition intolerance the only piece of the three that disproves it? I'm curious to know more about how partition intolerance is handled.

yread | karma 18099 | avg karma 4.2 · | 2011-06-23 13:20:36+00:00

Yes, check out the Partition I 12.1 table 6 of ECMA-335 standard

alexhutcheson | karma 3718 | avg karma 4.14 · | 2018-09-27 15:25:21+00:00

Good clarification, thanks. I'm not familiar with the exact partitioning schemes of the various systems.

Deejahll | karma 251 | avg karma 5.98 · | 2009-07-12 19:32:00+00:00

Ah, this is very helpful. I was aware that I wanted to do something like #2, but I was not aware that such a partitioning was the norm.

Xorlev | karma 1924 | avg karma 3.36 · | 2013-07-24 00:08:32

I'd imagine pretty well...until partition behavior occurs.

ColanR | karma 3951 | avg karma 3.27 · | 2017-06-14 17:38:13+00:00

I don't think so. There was an encryption scheme thought up and partially implemented about a decade (or two?) ago that allowed for an arbitrary number of partitions to exist in a single encrypted drive. It was called 'rubber hose' because the scheme was designed such that it was impossible to determine how many partitions existed inside the encrypted drive.

I don't think it's a scheme that's even relevant to this context, though.

Edit: source. https://en.wikipedia.org/wiki/Rubberhose_(file_system)

reply

simonask | karma 125 | avg karma 2.16 · | 2017-01-20 06:50:18+00:00

That's correct. I also believe you could in theory forgo partition tolerance, it just wouldn't be a very useful system. Maybe there are use cases out there for it.

noduerme | karma 11910 | avg karma 2.8 · | 2023-05-22 22:39:29

Any partitioning?

pgaddict | karma 1042 | avg karma 3.07 · | 2017-09-22 11:47:41+00:00

Yes, but partitioning also has a number of limitations that may be quite undesirable. Like inability to create UNIQUE constraints or primary keys, for example.