Why is "link text" not allowed to "contain other links"?

I believe that reusing reference link definitions in shorthand notation, especially for links to full-size versions of embedded images like [![text=label]], is a good argument in favor of allowing square brackets, and thus nested links, within link texts (and thereby link labels):