I'd be putting the shim back in Ian,
The shim usually provides a few benefits....
Provide proper spacing between the bearing and the pulley
Prevent undue stress or uneven load on the pulley material
Reduce the risk of premature wear or failure of the alloy pulley
Yes it's possible without the shim it could wear the clutch material prematurely .
Cheers
Max.
