Question:
What I need is to download many files from Internet and upload them to S3 as fast as it possible. For now I open every file as stream and upload it one after another. Average speed is 1 picture per second =(
Any ideas?
Answer:
Split in parts and upload in parallel would be a good start, the TransferManager class can help with that.
Also, the article “Pushing the Limits of S3 Upload Performance” has some nice ideas on the subject.