Japanese character encoding corrupted during migration
CRM migrations from legacy systems to HubSpot, Salesforce, or Zoho frequently corrupt Japanese-language contact data. The corruption happens at one of several points: when exporting data from the source system as a CSV file, when opening that CSV file in Excel (which can default to a Latin character set), when importing the file into the destination CRM, or when the destination CRM's import tool uses a different character encoding than the source file. The result is garbled kanji and katakana characters in contact name, company name, and address fields. Correcting hundreds or thousands of corrupted contact records manually after a migration is time-consuming and error-prone. Some records cannot be corrected because the original source data is no longer available in a clean format. The correct approach is to validate character encoding at every step of the migration pipeline before the live migration is executed. We test the export, the transformation, and the import using a sample dataset with Japanese characters, verify the encoding is preserved correctly at each stage, and only proceed to the full migration once the test validates clean output.