Brexit or Remain: Workers Pay Either Way