As far as I know, you can use them both interchangeably sometimes.
However, I used to be taught that:
you should say 'at the front/back of something' when something/somebody is outside a place, e.g.
Terri is in/at the front of the house, I mean in the kitchen making something to eat for dinner.
There's a beautiful garden at (NOT in) the front of her house.