I just did a large prepareupload, and got the following:
[nruest@rho:SwiftBulkUploader] (git)-[master]-$ python prepareupload.py /mnt/vol1/data_sets wahrUpload
1360489 parsed. /home/nruest/git/SwiftBulkUploader/olrcdb.py:71: Warning: Incorrect string value: '\xE2%80%9...' for column 'path' at row 1
self.cursor.execute(query)
1555060 parsed. /home/nruest/git/SwiftBulkUploader/olrcdb.py:71: Warning: Data truncated for column 'path' at row 1
self.cursor.execute(query)
1882041 parsed. /home/nruest/git/SwiftBulkUploader/olrcdb.py:71: Warning: Incorrect string value: '\xE9s&Vol...' for column 'path' at row 1
self.cursor.execute(query)
2544230 parsed. %
If I'm reading that correctly, we're having issues with escaping and encoding filenames and paths.
I just did a large prepareupload, and got the following:
If I'm reading that correctly, we're having issues with escaping and encoding filenames and paths.