Hacker Read top | best | new | newcomments | leaders | about | bookmarklet login

It's a shame that a product that probably took 7- or 8-figure dollars worth of development effort, didn't have some beta testers do a once-over on the documentation.


sort by: page size:

I'm surprised they didn't consider beta testing the feature with a subset of users to see how it'd go first.

"production ready" software seems very difficult without all the data they are gathering from the beta release.

The archived site emphasizes that "this is a beta version, and there are a lot of known bugs." It's not unreasonable to assume they intended to do more with it.

"How can me make these dumb users beta testers without telling them?"

You just have to be sure you don't eliminate the customer support with documentation, and then not ever fix the problem. I think it's better to feel the pain in the short run, and have a better product in the long run.

This reminds me of another thing we do - when we make new apps, we don't provide a manual to the beta group. We make one after the fact, but we want to get feedback from users as if there are no instructions.

Your product is awesome btw. We use it in two apps, and plan to add it to a third soon.


Or perhaps they released beta docs too early?

Beta testers are not typical users!

Absolutely. It wasn't even beta, it was just a tech preview. If they didn't have bugs of that sort, they aren't pushing things hard enough.

"Beta testers" is generous. More like alpha, or even nightly builds.

Why do you put this out there if it's not even beta-ready?

Thanks so much for writing all this down, this is extremely useful!

You are right, the documentation is incomplete and there are still lots of issues, the next week's update will fix some of the above and make it a more stable and proper 'beta'.


Your post makes it sound like said beta version will never see the light of day.

There is nothing "beta" about this, it's at a "proof of concept" level at best.

I'm assuming since this is beta they probably guessed enough of the users who want this are technically capable of managing without a UI during testing.

It was not even a beta feature, it was not exposed to end users at all.

It's a limited beta with the goal of discovering error cases.

There was an internal beta for over a year now. And our approach changed twice over those 3 years.

A product which is so complex and aimed at businesses can't be 'bootstrapped' in 3 months and launched. The result would be that nobody would care about it because it would be incomplete and wouldn't cater to their needs. There are a lot of such products and nobody remembers about them. I hope our effort will pay off, and that's what our current testers are telling me :)


Out of curiosity, why was it necessary to be in beta for over two years? Doesn't seem like the technology would take that long to develop.

People don't seem to understand that it's still in a beta stage. A semi-public beta but a beta nonetheless.
next

Legal | privacy