It seems that some lame light version of VIM gets installed with Ubuntu by default. A specific situation I was running into was that whenever I pressed a cursor key while in edit mode it wouldn’t move the cursor but instead write a character (A,B,C,D) to the file. After fighting with it for a while I found a suggestion to install the “full” version (sudo apt-get install vim) which I did and my headaches went away.