Could supermassive black holes anchor the tiniest galaxies?