Our interactions with objects are often guided by past experiences with them or the lack thereof. Previously, we have demonstrated that rewarding or aversive outcome associations as well as mere perceptual exposures (familiarity vs novelty) biases gaze toward objects with effects that last for many months.  For reward association, this gaze bias was shown to support efficient visual search. However, the neural substrates of experience dependent object salience remain poorly understood. Importantly, it is not known to what degree the coding of different dimensions of salience such as value, punishment and novelty are distributed across areas that control gaze. Here I will first review some of our recent studies that show cortical and subcortical areas involved acquired salience in nonhuman primates. I will then show results suggesting that the value and value uncertainty is learned and represented in parallel in prefrontal cortex (PFC) and basal ganglia. Both regions also similarly code punishment related object salience. However, novelty and recency salience seem to be preferentially encoded in PFC. Furthermore, behavioral and neural analysis as well as multi-alternative drift-diffusion modelling suggests that efficient search is likely to be accompanied by processing area enlargement for valuable objects.  Finally, I will describe some preliminary results on learning and long-term memory of value-based object salience in humans.