You cannot downgrade users from Admin to Reader. If the users have not created any assets in QuickSight, you can delete them and then recreate them as Readers.
Please refer the below QuickSight documentation and community post this might be helpful for you.