Amazon S3 Java SDK multiple files upload


What I need is to download many files from Internet and upload them to S3 as fast as it possible. For now I open every file as stream and upload it one after another. Average speed is 1 picture per second =(

Any ideas?


Split in parts and upload in parallel would be a good start, the TransferManager class can help with that.
Also, the article “Pushing the Limits of S3 Upload Performance” has some nice ideas on the subject.

Leave a Reply