I don't think 记号 is a "notch" in this case but more of a "marker". I think it can be translated that he tried to put a marker in the water where the sword was. In any case, he has to be pretty stupid to think a marker would stay in one place in the water without an anchor.