Yes, QuickSight is only supporting UTC for now. If you want to customize your specific timezone, you will need to create a new calculated field using addDateTime()to add offset to the time column with rolling date.
We will work on the custom timezone as a new functionality in our roadmap.