Currently, DSXL only supports writing .csv files in Data Sets. In that case, the user can view the file and export/download the file to the local machine for further processing.
Other file formats can be written, but the file cannot be viewed or exported.
DSXL needs to support any file format that notebooks want to write and allow the user to download these file individually.
This is in particularly important for debugging decision optimization models.
Generated optimization models can be exported by the doCplex library as '.lp' files, which is a readable, textual format for optimization models.
The ability to get access to the .lp file of a model is crucial for serious optimization model development.
Other examples are image files.
The current work-around is:
1. Write the file to datasets
2. Use bash commands in a Jupyter notebook to rename the file extension to .csv. (For example using '%mv $original_name $csv_name')
3. Export the file to the local machine.
4. Rename the file extension back to the original.
5. Delete the file from Data Sets
This work-around works, but is ugly and not user friendly.
Work-around update: instead of a bash command for the rename, you can also use Python using 'os.rename(original_name, csv_name)'
Real Scenario + Problem Statement
|Role Summary||Data Scientist|
|Who would benefit from this IDEA?|
How should it work?
|Geo - Use for OBDR Reporting only|
Why is it useful?
NOTICE TO EU RESIDENTS: per EU Data Protection Policy, if you wish to remove your personal information from the IBM ideas portal, please login to the ideas portal using your previously registered information then change your email to "email@example.com" and first name to "anonymous" and last name to "anonymous". This will ensure that IBM will not send any emails to you about all idea submissions