Hacker Read

earenndil · 2019-03-28 02:47:35+00:00

Tests must not be robust enough, then.

sdurkin | karma 1060 | avg karma 3.75 · | 2008-10-28 00:17:01

Flawed tests.

PaulKeeble | karma 4401 | avg karma 5.57 · | 2017-09-11 11:42:14+00:00

Some approaches aren't very testable and produce either very bad tests or can't be tested at all.

loeg | karma 21759 | avg karma 2.57 · | 2024-05-28 02:26:04

Essentially the problem is that our testing isn't perfect.

catnaroek | karma 1638 | avg karma 0.78 · | 2017-09-01 19:00:38+00:00

Alas, tests aren't proofs.

jakobegger | karma 8283 | avg karma 4.45 · | 2018-07-24 08:32:40

Relying on tests is naive. Your tests can't cover every case. The article even mentions this -- their tests passed, but it failed in production.

R0b0t1 | karma 2066 | avg karma 1.31 · | 2022-08-03 20:53:07

It is possible to make useless tests.

pmoriarty | karma 58518 | avg karma 5.75 · | 2020-07-23 23:51:59+00:00

Only because they're using the wrong type of tests.

snotrockets | karma 1466 | avg karma 1.97 · | 2013-11-09 22:30:53+00:00

All tests are problematic; some are more so.

chopin | karma 3564 | avg karma 2.52 · | 2023-12-14 14:28:11

In my experience such tests are brittle as hell.

wila | karma 1535 | avg karma 2.31 · | 2015-08-21 10:25:55

Don't think so if your testing has obvious flaws.

kragen | karma 31428 | avg karma 2.09 · | 2022-11-13 11:13:09

testing is never sufficient

philjackson | karma 2322 | avg karma 4.79 · | 2010-05-25 08:09:29+00:00

This whole article could be boiled down to: "bad tests are useless".

rhizome | karma 18082 | avg karma 1.64 · | 2013-09-26 17:31:01

That sounds like a problem of too-tightly coupled tests.

flukus | karma 10283 | avg karma 1.36 · | 2016-08-04 15:42:54

I found that in some of our code the other day, even that wasn't enough to stop the tests from randomly failing.

m3kw9 | karma 3357 | avg karma 0.75 · | 2019-07-04 03:13:11

The problem is they cannot back test the final result.

alexchamberlain | karma 3749 | avg karma 2.12 · | 2012-03-19 10:33:17+00:00

With proper testing, why not?

millstone | karma 6895 | avg karma 3.52 · | 2018-02-14 08:34:19+00:00

In this sort of scenario, the bugs lie in the expectations themselves. Tests that don’t account for that are dead weight.

richieb | karma 109 | avg karma 1.22 · | 2009-12-21 09:22:02

Not really. As Dijistra said: "Testing only proves existence of errors, not their absense."

adrianratnapala | karma 3270 | avg karma 2.22 · | 2018-08-05 22:30:24

What I have trouble with is even gauging the quality of existing tests.