You believe the referendum was binding, you are factually wrong. That was never the case, for a referendum to be binding it has to be part of the law that proposes the referendum, as it was in 2011. In law, it was nothing more than a glorified opinion poll.
This is the government's official briefing paper on the referendum Bill in June 2015 (
http://researchbriefings.parliament....ary/CBP-7212):
"
This Bill requires a referendum to be held on the question of the UK’s continued membership of the European Union (EU) before the end of 2017. It does not contain any requirement for the UK Government to implement the results of the referendum, nor set a time limit by which a vote to leave the EU should be implemented. Instead, this is a type of referendum known as pre-legislative or consultative, which enables the electorate to voice an opinion which then influences the Government in its policy decisions.
"
There it is, undisputedly written down, the government's official position. It doesn't matter what someone said that you want to believe or what you think you remember - this is the official factual position, anything else is wrong.