In commonmark the nested parens work fine, as you can see here:
https://spec.commonmark.org/dingus/?text=[Text](file%3A%2F%2F%2FUsers%2FUserName%2F(Folder)%2FSubfolder%2Fdocumentname.pdf)