gallium/pb_cache: reduce the number of pointer dereferences