Hi @cole-brand_2889 ,
Wow, I didn't realize that S3 rate-limited like that!! That's good to know.
Unless this is something that could be configured as an advanced SDK switch in the S3FileSystem, then I don't think there's much that could/should be done in the ProGet or extension code.
After searching the error (and seeing this very post on the first page of Google ), this just seems to be endemic with S3; there's no published rate limit, and even in AWS official blog article the only solutions seem to be "follow the error message and reduce your request rate".
There's probably something you can do do on the load-balancer side of things... reducing concurrent requests, etc.
Let us know what you find!
Thanks,
Alana
