No, that's not good, it should stay there and very slowly drop if at all
It might be leaking back thru the pump, regulator or an injector
To test, need to block off the fuel line going to the fuel rail and attach gauge. Turn key ON and see if gauge stays up then its an injector or fuel line...