Display UI buttons for decorative letters

I would like to see a button displayed for entering decorative text.
For those who find this button distracting, it might be nice to have a checkbox to hide it

Just like here