When loading raw images, we do crop + resize. The board_pts needs to take these into account, currently it is completely wrong