I thought it had something to do with the fourth finger being directly linked to the heart, hence love.
did I forget to mention the house?