I don't think you can change the output format of dnf check-upgrade but here is a workaround:
dnf repoquery --upgrade --queryformat '%{name}.%{arch}'