The empire will presumably have access to young worlds where the ratio of 235U to 238U is closer to that of the original supernova-produced uranium. That's nearly (but not quite) weapons grade, without any enrichment needed.

Which means, I suppose, that the knowledge of how to enrich uranium could have been lost, at least for non-weapon purposes.