Postfix was using a temporary address instead of the EUI-64, which is the one associated to the mailserver domain.