I've suggested this before - if a player takes a number a team has previously retired, shadowbox the number on the jersey like the way the 49ers did back in the early 90's. Imagine this on a Chiefs uni but with a yellow shadow on the number....
That, or put the retired player's name in small text on the number or somewhere. Something to pay honor to the player while still being able to use the number currently.