You're right about it being a nuisance to apply.
I think if you are only using a single layer of foam, the plastic is desirable in case there are any little gaps in the insulation seams. If you are using two staggered layers of foam, and are careful to seal the seams, you may be right about eliminating the plastic (especially if you can close everything in quickly.)