Work around for AWS Lambda 500MB /tmp storage limit

Question:

Is it possible to add temporary storage space to AWS Lambda so I can write files larger than 500 MB before I upload those to S3? Is NFS/EFS possible?

Thank you.

Answer:

Nope. You shouldn’t rely on it. And EFS isn’t an option either.

Also, the time taken to download a file more than 500MB depends on network conditions and you won’t able to predict before hand how long will it take for the function to complete.

Your lambda function must complete execution within 300 seconds.

Moreover, if multiple instances of this lambda function are invoked, you will always be constrained for storage space if all requests are going to process files larger than 500MB.

You are better off, moving this functionality outside lambda.

Leave a Reply