You will indeed need two pairs of glasses; the light that comes out the back is merely plane polarised.

Of course, this does mean that you can vandalise a pair of RealD 3D glasses into a plane polarising pair by flipping both the filters and rotating one of them 90 degrees :)