As I was factoring out logic for the remove tag button, noticed a small issue where the button was slightly shifting the height of the panel a few pixels when the content was going from "Remove tag" to the loading spinner. We should set the height of the button container so that this does not happen
Depends on D12532