The ARC
conceptYou check a ZFS machine's system monitor, see nearly all the memory in use on a quiet day, and conclude something is broken. Actually, that's the ARC—ZFS's reading cache—and it is supposed to be huge. The ARC keeps recently and frequently read data parked in memory, where fetching it again is thousands of times faster than going back to the disks. Memory sitting empty helps no one; ZFS puts it to work—and gives it back when your programs genuinely need it.
The correction under the correction: the memory bar you've read as a fuel gauge all your life is the wrong instrument here. Full is the healthy state.