At a typical two way stop intersection, the road that is appreciably busier, i.e., the road without the stop signs is the through road with the right-of-way. In the interests of keeping traffic moving steadily, it makes sense that traffic on the smaller, less traveled road should yield to traffic on the more heavily traveled through road.
