Build-to-rent investment has fallen 90% over the past four years, with cost of debt shuttering institutional investment plans.