Motorola Moto G — trusted place is not recognised

My trusted place is my home but I have to keep on entertaining my PIN even though I did not leave the house. It is at its worst in the morning after the initial login.

I tried to include my immediate neighbours on either side,did not help. The only thing that helps is powering the phone off and then on again. This works as long as I don't leave the house but if I set foot in the garden I can start the whole power off/on again.

Does anybody know why this happens and how can I make sure that the trusted place I entered is recognised?