Wipe the old oil off with a clean, soft, WHITE cloth or tissue paper. The best course of action is to prevent rust rather than to have to remove it. High quality chinese kung fu sword sharp t10 clay tempered steel wushu jian complete sword care kits are available and perfect for the sword owners.