do you mean that the csv files will be updated in a regular time(e.g. daily)?
for instance, day1.csv has Jan1 data. day2.csv has Jan2 data. Then you want to show all data in QuickSight
If it is the case, you may refer to this approach shared by @darcoli using Athena as data source