It is really annoying when a fresh install decides the locale should
be en_IN which is nonsense and annoying because it breaks rendering
of other symbols. Setting LANG seems not enough and some of the others
still default to en_IN. So explicitly set everything to en_US.UTF-8.