It is said that looking for a deer shed is like looking for a needle in a haystack. I know people who have hunted for deer for decades, but have never found a shed. The reason is probably two: one, they don’t try, and two, they don’t know where to look.
Although sometimes you can come across antlers, without looking for it, you mostly have to actively look for antlers to find them. And even then I often go home empty -handed.