Yet, just two years after opening, the building witnessed ... this Upper East Side gem is entering a luxury market in flux.