Hacker Read

rhizome · 2013-09-26 17:31:01

That sounds like a problem of too-tightly coupled tests.

latchkey | karma 15349 | avg karma 2.37 · | 2022-11-17 14:45:05

I still don't understand why that would cause testing to be hard, but since you won't explain it... I guess it leaves me thinking the problem might not be entirely them.

loeg | karma 21759 | avg karma 2.57 · | 2024-05-28 02:26:04

Essentially the problem is that our testing isn't perfect.

earenndil | karma 1974 | avg karma 1.51 · | 2019-03-28 02:47:35+00:00

Tests must not be robust enough, then.

dcolkitt | karma 11878 | avg karma 6.64 · | 2019-12-04 11:38:00

There are tradeoffs to this approach. When the tests break it becomes a lot harder to triangulate the origin of the problems.

mysterydip | karma 6948 | avg karma 3.42 · | 2022-10-18 05:33:28

Sounds like test data gone awry

snotrockets | karma 1466 | avg karma 1.97 · | 2013-11-09 22:30:53+00:00

All tests are problematic; some are more so.

ouid | karma 3609 | avg karma 1.75 · | 2017-08-29 00:40:03

sounds like the tests are bad.

sdurkin | karma 1060 | avg karma 3.75 · | 2008-10-28 00:17:01

Flawed tests.

KingOfCoders | karma 8559 | avg karma 2.83 · | 2020-11-02 12:28:53+00:00

Tests can have bugs too.

andreareina | karma 4966 | avg karma 2.57 · | 2023-02-16 18:42:34

With mutable global state I wouldn't be too sure it's the tests that are the problem.

frgtpsswrdlame | karma 5852 | avg karma 2.93 · | 2017-07-24 15:04:22+00:00

Sounds more like the problem is means-testing with strict cutoffs. Mean-testing is good in helping to even the field, the problem is that (some of) our current programs don't slowly fade out as you climb up.

stfwn | karma 830 | avg karma 6.59 · | 2019-01-04 23:41:29+00:00

Can you elaborate a bit on how such testing is done, or share a good article on the topic? It sounds like a hard problem to need to get things right this bad, or else.

adrianN | karma 29995 | avg karma 2.78 · | 2021-01-05 08:26:06+00:00

It also needs to be corrected for test strategy.

pc2g4d | karma 2023 | avg karma 2.47 · | 2023-07-28 20:17:56

Perhaps an unrealistic test environment?

mattigames | karma 2003 | avg karma 1.68 · | 2020-03-07 00:20:53+00:00

Yeah sorry, I was just trying to be succinct in the post, I been working on fixing some tests lately so I guess that's why it came to mind.

fabiospampinato | karma 1047 | avg karma 2.37 · | 2020-07-09 16:51:30+00:00

Writing tests for this feature might be difficult.

WrtCdEvrydy | karma 5479 | avg karma 2.32 · | 2023-05-22 18:35:09

But it has broken tests in the similarity tests.

flukus | karma 10283 | avg karma 1.36 · | 2016-08-04 15:42:54

I found that in some of our code the other day, even that wasn't enough to stop the tests from randomly failing.

ekianjo | karma 34827 | avg karma 2.44 · | 2021-07-26 20:33:32

Possibly, or a myriad of other factors as well, which is why designing proper control/test groups is extremely difficult.