Maybe I missed it, but is there a tool or console where I can quickly test calculated fields while composing them without having to save and use in a visual?
Not yet, but we are working on improving the Calculated Field user experience.
You can you use the analysis calculation fields for this. This is they way you can do quickly.
Using dataset its a delay factor as refresh all the time to check calculation.