Undo "restrict access to only me" option

I use the “restrict access to only me” on some fields in a dataset, and I want to undo this. But the option is greyed-out, how can I remove the restriction?

You should be able to do this directly from editing the dataset and then clicking on the three dot menu to the right of the field.

Is it a calculated field? Also, make sure you’ve selected the parent dataset if there are any datasets created from the one in question.