Appending dataset using csv files - data source is multiple csv files with same column names

do you mean that the csv files will be updated in a regular time(e.g. daily)?
for instance, day1.csv has Jan1 data. day2.csv has Jan2 data. Then you want to show all data in QuickSight

If it is the case, you may refer to this approach shared by @darcoli using Athena as data source