Yes, you should be able to create alert for KPI visuals similar to gauge visuals (see below image) . My suggestion will be to refresh the dashboard and check if you are able to create alert. If not, open a support ticket and make sure you are checking for create alert icon on a published dashboard KPI visual and not in an analysis.