If Viktor and Varric were talking, then he really could have been right next to Viktor when he died. Plus, think of the height difference: he would have had to swing that hammer in a very specific way to hit Viktor's head like that.