As I was factoring out logic for the remove tag button, noticed a small issue where the button was slightly shifting the height of the panel a few pixels when the content was going from "Remove tag" to the loading spinner. We should set the `height` of the button container so that this does not happen