Try sorting the progress bar instead, that should do what you want.
I would like to change this wishlist to: when you sort the time remaining, sort by time remaining first, and then for those that have a ? (i.e. not downloading) sort by file size remaining, instead of leaving them in random order.