“The specified key does not exist” for VueJS app deployed on deployed on S3 with CloudFront


I have deployed a VueJS app with S3 and CloudFront using Route53. It seemed like everything was working fine. I’m able to visit the site at https://my-domain.com, and I can navigate to different routes that I have set up with Vue router. However, when I try to access https://my-domain.com/about directly, I see the following error: