Yes. As far as I know std::set is usually implemented as a red-black tree.
Trees are made of nodes, which are linked together. So each node contains the extra linking information, besides the actual integer.
Arrays are pretty much a contiguous block of memory containing the bare data.