Hello @Rahul_001, welcome to the QuickSight community!
Currently the functionality for setting up RLS through tag based rules only works with the embedded dashboard view. If you are building dashboards to view within the QuickSight console, you could consider implementing RLS at the user or group level to ensure only the correct users are viewing the proper office_name. I think that is likely your best course of action. I’ll link some documentation below:
I will mark this as the solution, but let me know if you have any further questions and I’ll be happy to assist.