Indeed, since the scan server field is automatically updated with whichever scanning server last scanned an asset, the only way to prevent the "wrong" scanning server from being listed for an asset would be to make sure there can be no "cross-server scanning", which is most easily achieved by limiting your scanning targets to IP Range targets.