mem: Use the caching in the AddrRangeMap class in PhysicalMemory