This is probably the best implementation of ByteRangeSet at the moment, though a HashMap produces
garbage when adding a new element to it. We can probably create a tighter implementation without
pointers or garbage.