To CoT or not? Chain-of-thought helps mainly on math and symbolic reasoning