SmallFileBuffer and BigFileBuffer

Following up on previous comments in the multiprocessing feature request thread.

One of the most common workloads I have, is copy/move files from local disks to network disks - and back. The payload is usually a mix of millions of small files (10-512KB) and thousands of medium to large files (10MB to 100+GB).

Using separate, configurable, buffers for small files could speed up the process greatly.

Please authenticate to join the conversation.

Upvoters
Status

Planned

Board

TeraCopy

Date

Over 1 year ago

Author

Ole Aldric

Subscribe to post

Get notified by email when there are changes.