Empire Management has offloaded a 22-story Midtown office building it has owned since 2000, according to city records.