Yes the fuel tank just sits there, originally there was a big foam washer that went between the cowling and fuel tank around the fuel filler to hold it a litthe bit tighter but these days most of them have broken up and disappeared. I am unsure at present if the foam washer is available as a part.
