Are you sure you're not on the beta channel? Coming from Firefox 4, that channel stuff was under the hood. If you used Firefox 4 beta, then you're probably on the beta channel (you can check in about:config looking at app.update.channel)
Strange, mine (4.0.1) doesn't. There's something broken either in the update routine or in your Firefox. The beta is not supposed to be recommended to users of a release version.