Hello everyone. QuickSight newbie here.
We have daily CSVs within an S3 folder that I would need to ‘automatically’ upload and read into an existing QuickSight dataset. I would assume incoming file triggers would need to be put in place. Any ideas on how to set this up? Looked up AWS Lambda to create a script, but so far haven’t found a simple example for me to use. Thanks for all your help in advance.
Hello @bertviloria , welcome to the Quicksight community!
I would recommend trying the solution posted here:
Hi @bertviloria - Welcome to AWS QuickSight community and thanks for posting the question. If I understood correctly, you have the file available in S3 and use that to do the reporting in QuickSight. I assume you have define the manifest file where the location of the file and file details are available. You can make the manifest file with wild card pattern matching so that when the ingestion will happen it will consider all files ( in case of any new files added). To make the ingestion automatically, yes you can use event notification and call a lambda function which in turn call the create ingestion process and refresh the SPICE and bring all require S3 data. See the documentation for the create ingestion below
https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/quicksight/client/create_ingestion.html
The second approach can be followed as per @duncan but that may require additional work at athena side.
Regards - Saneeb
Hello @bertviloria !
Was @Sanjeeb2022 's comment or the linked I posted above helpful or are you still working on this problem? If one of the posts above was helpful could you mark it as a solution to help the community?