With the surge in home prices since the COVID pandemic hit, there are big concerns that housing has become much less affordable. But context is important.