That's latency by definition. The question is, where in your signal chain is it being introduced? Are you running the guitar through any software? An amp sim? How are you integrating the guitar and the computer?
Rus's suggestion to use AISO4ALL is a good one for anyone using a Windows machine. It's a bit more confusing, but it is vastly superior to the default software audio drivers that ship with Windows.