The symptoms of tertiary syphilis can vary widely but often include severe neurological problems such as neurosyphilis, cardiovascular complications like aortic aneurysm, and gummatous syphilis, which involves the formation of large, destructive lesions on the skin, bones, and other organs.