columnview: Clear the sorter first thing in dispose

columnview: Clear the sorter first thing in dispose

Otherwise, when removing the columns, each column will trigger a
sorter::changed signal emission.

And because sorters are often still connected to a sortlistmodel, we
can't skip that emission and need to do it.
But we only need to do it once.