This might in general be a good preprocessing step to check for punctuation repeating in fixed intervals and remove it, and restore after decompression.