How to use AWS CLI to only copy files in S3 bucket that match a given string pattern?

You can use include and exclude parameters with aws s3 cp command to copy files in the S3 bucket that match a given string pattern. Though the support for the pattern is very primitive and currently does not support all the regex functionality that we love and use. Here is one example to copy file with a particular extension

## Copy only .txt files in S3 bcuket
aws s3 cp </SOME/PATH/> s3://<S3_BUCKET_NAME>/<SOME>/<PATH>/ --recursive --include "*.txt"

## Copy all files except .txt in S3 bcuket
aws s3 cp </SOME/PATH/> s3://<S3_BUCKET_NAME>/<SOME>/<PATH>/ --recursive --exclude "*.txt"

## Copy only .txt files in S3 bcuket

aws s3 cp s3:///// --recursive --include "*.txt"

## Copy all files except .txt in S3 bcuket

aws s3 cp s3:///// --recursive --exclude "*.txt"

Tags: aws, AWS CLI, FAQ, S3