Andrew is right.
One - I don't recommend doing this unless you absolutely need to.
Here is what I did - and I hope Bill weighs in on this.
I used a small bit of emory cloth taped on a dowel and carefully and slowly rid the bottom tube of the bur and then used an old battle swab and some polish (Brasso) to smooth that area back. I would wager I barely took off any material as the anno was barely polished in all areas that was not the burr.