I have the same problem going over rough surfaces and some speed bumps. Mines an estate with with about 2.5k on the clock with 18" Cadiz. On compression it feels fine but on the rebound it feels/sounds like something is loose or vibrating.
I did notice the rears feel and sound ok in comparison.