Having a good credit score is essential for securing the best rate on any loan, second mortgages included. Begin by paying particular attention to paying bills on time and building your credit. Before shopping for second mortgage rates, determine the market value of your home. This number represents the equity you have in your home and is the amount you can borrow against. Compare interest rates between lending institutions, as companies' rates may vary at any given time.