High mortgage rates and the looming budget are putting some buyers off