Despite its utility, there are limitations to using Z scores. One key limitation is that it assumes normal distribution of the data. In cases where the data is not normally distributed, Z scores may not provide accurate insights. Additionally, Z scores may not be suitable for small sample sizes as the estimates of the mean and standard deviation may be unreliable.