It does output this error:
mtr: mtr-packet reported invalid argument
I tried using regular ICMP probes, which work just fine, but mtr does not send udp probes at all.
I tried several machines with several linux flavors on them like Ubuntu server 18.04, 19.10 and 20.10
IPv6 however is configured correctly and works just fine.