I have an S3 bucket in place with subfolders. I would like to fetch the latest file from the bucket, but I am not sure how this works? The current JSON manifest that I have created has the URI of the file for yesterday and I want the latest file to be refreshed from the S3 bucket subfolder. Any help would be highly appreciated.
I can’t think of a method for Quick Sight to only collect the most recent file from a bucket, unless you are able to implement some logic that always writes the latest file to a file with an S3 object with a fixed URI. For example, when the latest file is written to S3, could it also be written to an object with the same name? e.g.
s3://awsexamplebucket/folder/latestdata.csv
The manifest file can remain the same, yet the data in the file it points to is updated periodically.
Hello @akshaym, did the response from @abacon help you resolve the issue you are facing? If so, please mark his response as a solution. Otherwise, let us know what else you have tested on your end and we can try to come up with an alternative solution.