Currently on the var.file properties there is setting for "Encoding" which allow user select following options:
- Stream default
- System default
And on the stream properties, there is "Encoding" setting with option of "System default" and "UTF-8".
When Modeler running on system with non-UTF-8 locale (for example Japanese Windows OS with shift-JIS locale), by set the "Encoding" to "System default", it's allow modeler to work correctly with non-UTF-8 locale (in this example shift-JIS).
However if Modeler running on system with UTF-8 locale (for example Japanese MacOS/Linux with UTF-8 locale), set the "Encoding" to "System default" is useless, since the system locale use UTF-8, so with this setting Modeler only accept UTF-8 and cannot work with non-UTF-8 encoded file correctly.
We are strongly request to allow Modeler list specific Encoding (i.e. UTF-8, shift-JIS, EUC-JP, etc.) on list of Encoding setting both on stream properties and var.file properties.
NOTICE TO EU RESIDENTS: per EU Data Protection Policy, if you wish to remove your personal information from the IBM ideas portal, please login to the ideas portal using your previously registered information then change your email to "email@example.com" and first name to "anonymous" and last name to "anonymous". This will ensure that IBM will not send any emails to you about all idea submissions