When setting the level of the POIs to hide, after you save it, the POIs do not disappear on the map, rather are just not able to be selected. I'm not sure if this is a bug or not, but shouldn't the blips disappear as well for all POIs under the selected level?