In the Exceptions section of Dictionary<TKey,TValue>.IDictionary.Item[Object] Property, for .Net Framework versions, there should be KeyNotFoundException, that is thrown when specified Key is not a key of the dictionary.
Reading these page, it looks like there won't be any Exception when retrieving a value from dictionary if specified Key does not exist