One of the biggest issues is they can be recorded and potentially decrypted in the future once quantum computing attacks become feasible. At the moment, the cryptography in Signal (or similar) has no known vulnerabilities that would make it vulnerable to practical attacks given reasonable assumptions about the technology that exists in the world at the moment.