I have used building prefabs before and did not have any issues with decay as such, for example the Wall Frame Shop Front Metal, Wall Frame Toptier and Wall Doorway.
But yes, some testing needs to be done. Will probably get a local server up this weekend to have a look.