If it only makes a sound when tipped back and forward not side to side it's more than likely the cardboard cover to the power supply, nothing to worry about.
Yes, there is this loose cover inside that is making a sound when moving/handling the synth.