Immediately before the gates travelling up Oxford Street was a freshly laid out Square and gardens, reputedly the equal of those in London. And the merchants and mighty of the town who wanted to be admired wanted to be there. And be seen.
By 1820 the West side was already partly occupied, and once one powerful or influential man moves in, others swifty follow. Build it, and they will come.