The "remove from list" action node in flow builder should include "remove from all list except" as most companies would have more than 50 contact list / groups, this makes it easier to choose majority of the contact list without selecting majority of it one by one.