This fact can be explained to a general audience by saying that food odors cause us to eat what causes us to produce pheromones that cause us to associate, or not associate, with other people. In this context, pheromones are social odors.
Pheromones are like food odors. Not every food is equally appealing. But we can enhance individual appeal with pheromones just like we can spice up the appeal of food.
This effect helps to explain why the odor preferences of mammals, including humans, appear to develop before birth, but it probably has nothing to do with visual input except via its association with olfactory/pheromonal input, neurogenesis, learning and memory.