Only build aarch64 wheels for cpython manylinux.