Xcorr is not returning expected results.

So I am trying to do voice recognition with xcorr function. I am using recorded audio as 'A' and a .wav as 'B'. The .wav is the word I am trying to make the program recognize, however it does't give a high correlation when I say the word. I can post my code if it is needed. My question is, should a voice signal and a computer generated signal give back high correlation or am I going about this the wrong way? Any help is appreciated.