It was very rare they put fans on the open side except in 'big' FA Cup games. You might be thinking of when we played them there in the FA Cup in 1993 when the whole ground had a temporary feel about it due to the main stand having been partly taken down following the Bradford disaster many years before and they were in the midst of getting ready to move to Sixfields.
I'm not quite that old pip_y LOL! Wish I had been, at least would have been out of the wind coming off the coast that felt like it was cutting us all in half