Would be good to see `net iface` output. I've investigated a similar issue some time ago and it turned out that Zephyr selected some rubbish source address due to misconfiguration: https://github.com/zephyrproject-rtos/zephyr/issues/30688#issuecomment-746249565