When you take a TSP loan, you are essentially borrowing your own money and paying yourself back, with interest, through payroll deductions. That’s desirable until you look at all sides of the issue. The published cost of getting a TSP loan is just the $50 or $100 processing fee, but the true cost of actually having a TSP loan can be thousands of dollars in lost retirement wealth.