I don't believe there is a way to change the temperature format for either the Weather Underground or jkUtils weather apps for Windows phone or Android. It has been asked for, but no update to change the setting is currently available. So no, you aren't missing anything.