How to Live Larger Than Your Labels