Improve missing label handling

rpkilby

See `https://github.com/carltongibson/django-filter/issues/1009`