Would you ever change this for people that may be quicker or the other way that are just naturally slower?

I've usually seen team's figure out a rough number of points for each person based on their performance. This is unique and I do like the idea of trying to get everyone to do the same amount of work, but obviously some people do work slower or faster than others.