docker错误 legacy plugin:Post http://127.0.0.1:23750/Plugin.Activate: dial tcp 127.0.0.1:23750 refused

Docker internal error: 500 Server Error for http+docker://localhost/v1.26/containers/e0f71bb3bda889c34d2ead20b6865e18465c65ac37884696eee69b61b9ed9a8e/start: Internal Server Error (“legacy plugin: Post http://127.0.0.1:23750/Plugin.Activate: dial tcp 127.0.0.1:23750: connect: connection refused”).

Error occurred while calling Docker start API: Docker internal error: 500 Server Error for http+docker://localhost/v1.26/containers/c30252e1daaec1d954124eede42bb9572992f7cea80e5b3855bd553772795fe5/start: Internal Server Error (“legacy plugin: Post http://127.0.0.1:23750/Plugin.Activate: dial tcp 127.0.0.1:23750: connect: connection refused”).: zun.common.exception.DockerError: Docker internal error: 500 Server Error for http+docker://localhost/v1.26/containers/c30252e1daaec1d954124eede42bb9572992f7cea80e5b3855bd553772795fe5/start: Internal Server Error (“legacy plugin: Post http://127.0.0.1:23750/Plugin.Activate: dial tcp 127.0.0.1:23750: connect: connection refused”).

解决方法：

systemctl restart kuryr-libnetwork

021-09-16 16:43:45.885 13109 ERROR zun.compute.manager
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager Traceback (most recent call last):
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/requests/adapters.py”, line 449, in send
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager timeout=timeout
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py”, line 756, in urlopen
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/util/retry.py”, line 532, in increment
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager raise six.reraise(type(error), error, _stacktrace)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/packages/six.py”, line 770, in reraise
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager raise value
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py”, line 706, in urlopen
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager chunked=chunked,
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py”, line 447, in _make_request
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py”, line 337, in _raise_timeout
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager self, url, “Read timed out. (read timeout=%s)” % timeout_value
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host=‘localhost’, port=None): Read timed out. (read timeout=60)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager During handling of the above exception, another exception occurred:
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager Traceback (most recent call last):
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/zun/compute/manager.py”, line 481, in _do_container_start
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager container = self.driver.start(context, container)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/zun/common/utils.py”, line 247, in decorated_function
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager return function(*args, **kwargs)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/zun/container/docker/driver.py”, line 97, in decorated_function
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager return function(*args, **kwargs)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/zun/container/docker/driver.py”, line 811, in start
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager docker.start(container.container_id)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/docker/utils/decorators.py”, line 19, in wrapped
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager return f(self, resource_id, *args, **kwargs)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/docker/api/container.py”, line 1110, in start
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager res = self._post(url)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/docker/utils/decorators.py”, line 46, in inner
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager return f(self, *args, **kwargs)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/docker/api/client.py”, line 233, in _post
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager return self.post(url, **self._set_request_timeout(kwargs))
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/requests/sessions.py”, line 590, in post
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager return self.request(‘POST’, url, data=data, json=json, **kwargs)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/requests/sessions.py”, line 542, in request
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager resp = self.send(prep, **send_kwargs)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/requests/sessions.py”, line 655, in send
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager r = adapter.send(request, **kwargs)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/requests/adapters.py”, line 529, in send
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager raise ReadTimeout(e, request=request)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host=‘localhost’, port=None): Read timed out. (read timeout=60)
2021-09-16 16:43:45.885 13109 ERROR zun.compute.manager
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager [req-40a4a3ee-bdcf-49df-baa3-b49fbaed3d4c - - - - -] Unexpected exception: UnixHTTPConnectionPool(host=‘localhost’, port=None): Read timed out. (read timeout=60): requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host=‘localhost’, port=None): Read timed out. (read timeout=60)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager Traceback (most recent call last):
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py”, line 445, in _make_request
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager six.raise_from(e, None)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “”, line 3, in raise_from
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py”, line 440, in _make_request
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager httplib_response = conn.getresponse()
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/lib64/python3.6/http/client.py”, line 1346, in getresponse
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager response.begin()
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/lib64/python3.6/http/client.py”, line 307, in begin
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager version, status, reason = self._read_status()
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/lib64/python3.6/http/client.py”, line 268, in _read_status
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager line = str(self.fp.readline(_MAXLINE + 1), “iso-8859-1”)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/lib64/python3.6/socket.py”, line 586, in readinto
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager return self._sock.recv_into(b)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/eventlet/greenio/base.py”, line 373, in recv_into
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/eventlet/greenio/base.py”, line 361, in _recv_loop
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager self._read_trampoline()
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/eventlet/greenio/base.py”, line 333, in _read_trampoline
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager timeout_exc=socket_timeout(‘timed out’))
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/eventlet/greenio/base.py”, line 210, in _trampoline
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager mark_as_closed=self._mark_as_closed)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/eventlet/hubs/init.py”, line 159, in trampoline
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager return hub.switch()
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/eventlet/hubs/hub.py”, line 313, in switch
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager return self.greenlet.switch()
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager socket.timeout: timed out
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager During handling of the above exception, another exception occurred:
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager Traceback (most recent call last):
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/requests/adapters.py”, line 449, in send
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager timeout=timeout
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py”, line 756, in urlopen
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/util/retry.py”, line 532, in increment
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager raise six.reraise(type(error), error, _stacktrace)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/packages/six.py”, line 770, in reraise
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager raise value
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py”, line 706, in urlopen
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager chunked=chunked,
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py”, line 447, in _make_request
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py”, line 337, in _raise_timeout
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager self, url, “Read timed out. (read timeout=%s)” % timeout_value
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host=‘localhost’, port=None): Read timed out. (read timeout=60)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager During handling of the above exception, another exception occurred:
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager Traceback (most recent call last):
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/zun/compute/manager.py”, line 481, in _do_container_start
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager container = self.driver.start(context, container)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/zun/common/utils.py”, line 247, in decorated_function
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager return function(*args, **kwargs)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/zun/container/docker/driver.py”, line 97, in decorated_function
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager return function(*args, **kwargs)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/zun/container/docker/driver.py”, line 811, in start
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager docker.start(container.container_id)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/docker/utils/decorators.py”, line 19, in wrapped
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager return f(self, resource_id, *args, **kwargs)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/docker/api/container.py”, line 1110, in start
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager res = self._post(url)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/docker/utils/decorators.py”, line 46, in inner
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager return f(self, *args, **kwargs)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/docker/api/client.py”, line 233, in _post
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager return self.post(url, **self._set_request_timeout(kwargs))
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/requests/sessions.py”, line 590, in post
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager return self.request(‘POST’, url, data=data, json=json, **kwargs)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/requests/sessions.py”, line 542, in request
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager resp = self.send(prep, **send_kwargs)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/requests/sessions.py”, line 655, in send
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager r = adapter.send(request, **kwargs)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager File “/usr/local/lib/python3.6/site-packages/requests/adapters.py”, line 529, in send
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager raise ReadTimeout(e, request=request)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host=‘localhost’, port=None): Read timed out. (read timeout=60)
2021-09-16 16:43:45.888 13109 ERROR zun.compute.manager

解决办法：

systemctl restart httpd
systemctl restart zun-api zun-compute zun-wsproxy

使用kuryr网络创建容器，也可以运行，但是就是连不上网，谁都ping不通，网关也不通。查看opensatck发现网络端口是down的，显然不能用，然后呢，查看日志/var/log/kuryr/kuryr-server.log，可以发现每次创建容器的时候都会有这一句报错。

ERROR kuryr_libnetwork.controllers [-] ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (Permission denied)

用的是opencswitch，大概是kuryr没有权限操作这个db.sock去操作数据库，所以最后一步无法完成。

解决方案：

chmod 777 /var/run/openvswitch/db.sock