The latest Social Security Administration figures show "Joe" steadily lost popularity throughout Biden’s presidency.