This is a small part of the unsuccessful last commit of #5121, this part removes `InternedString::new` from the innerest of loops.
This is mostly a resubmission of #5147, that I accidentally deleted while bors was testing. This one has new commits, so github will take the resubition.