Lowe didn't come till a couple of seasons later. I think you're right about Big Tony. Probably Tim Colman was manager. Whilst he made his name at Posh it seems as if he came to us from Coventry and had scored against us in a couple of preceding seasons, from his Wiki:
1956–1960 Norwich City 57 (31)
1960–1962 Peterborough United 88 (81)
1962–1963 Coventry City 32 (25)
1963–1964 Notts County 29 (4)
1964–1970 Grantham 199 (125)