Do wheels with a higher inertia roll slower down an inclined plane?

You answered your own question. Inertia means resistance to change of linear motion. So yes, more inertia means slower acceleration. Assuming all wheels are under the same gravitational force. More inertia means more massive the wheel is by the way.

On the same lines once read a thing written by Newton that the reason that a light object and a heavy object when dropped from a tower hit the ground at the same time is due to inertia.According to him gravity has to overcome the heavy objects greater inertia to get it falling but gravity has a smaller effect on the lighter object due to its reduced mass and that these two forces are always in exact equilibrium so they hit the ground at exactly the same time.clever bloke old Newton