Have you checked the idler pulleys?? Might be when one gets hot it starts playing up.

The intermittent application of the deck brake might hold the key to the answer. It should be constant, what does it work on???