An english question about "returning to"?

"I just returned to the office" is the correct one. Using "to" shows where you are going to, and "in" shows that you're returning IN the office, so it still doesn't state where you're returning to.