Interesting. Based on this conversation[1], I think Gemini Ultra is massively overfit. Make it do unit conversions or use units it hasn't seen in the same framing before and it does well. But stay close enough to the original trick question (1 and 1) and it fails.
Thank you very much! Yes, it seems that the units are a real pain point. This will be customizable in the next release.
Would you believe it if I told you that I myself use Kgs and need to convert every time? I had to make some decisions for an alpha release and this was one of them (I just picked the lower unit as default)!
google can't calculate to different unit types like wolfram alpha. For example "1.5 cup of uranium in kg" is something wolfram alpha can calculate but nothing else can without extra manual steps.
Not to mention, Spotlight does a /bunch/ of unit conversions. You can even type things like `1km/h to kt` for example. There's quite a few units defined already that I'm usually pleasantly surprised. This also works on iOS.
The one downside is you can't do unit conversions of a mathematical expression, just of a number. (i.e., 2^2 m/s does not work but 4 m/s does).
Whenever I have to do something more complicated I usually use M-x calc or maxima with ezunits.
-make standard units available: liters, kilograms, meters;
-allow users to express full range of my beliefs; I have no idea how many reincarnations of Dalai Lama there was I guessed 1000 and wanted to set a straight line from 1 to infinity (or something going down to 0 slowly). It didn't allow me to; it's not overconfidence from my side, it's a bug on your side :)
My professors would be so mad if I submitted data like this. I already can hear "What are the units? Seconds? So yours are by one second better? Error margin? Percent? So yours is worse?"
I get that this is a very specific information for a specific audience. People who stumble on this repo should know what is that.
However we can all be better at presenting our data.
[1] https://g.co/gemini/share/94bfb8f9ebea
reply