SampleSet: check that the value exists before trying to access it

Fix #4869
14 jobs for feature-s/faster-list in 37 minutes and 27 seconds (queued for 3 seconds)