问题描述
我遇到了 db DuplicateEntry,有没有人帮助解决这个问题？ （好像 mariadb 同步太慢了）
我有一个由 3 个节点组成的集群。
node1 ip:10.19.43.101（本主机有cinder_api cinder-scheduler cinder-volume）
node2 ip:10.19.43.102（本主机有cinder-volume）
node3 ip:10.19.43.103（本主机有cinder-volume）
创建卷时：
代码流..
1.cinder-scheduler worker_create on 10.19.43.101 mariadb
2.cinder-volume set_work on 10.19.43.102 mariadb
步骤a。代码流似乎 get_worker 失败，所以 cinder-volume create_worker
步骤 b。 mariadb同步发生...
步骤 c。 cinder-volume 想要提交 db ----> 引发异常：重复条目
我的 cinder-volume cinder.conf
node1.
[数据库]
连接 = MysqL+pyMysqL://cinder:cinderxxxx@10.19.43.101:3456/cinder
node2.
[数据库]
连接 = MysqL+pyMysqL://cinder:cinderxxxx@10.19.43.102:3456/cinder
node3.
[数据库]
连接 = MysqL+pyMysqL://cinder:cinderxxxx@10.19.43.103:3456/cinder
问： 不推荐不同的ip数据库????(mariadb(AA模式)同步太慢？)
cinder-volume.log
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server [req-a272a0c9-ca7b-43fe-b935-88d4a7f8f986 af41e130ceb74202ad193967367bf5a3 c12539100b2c49d3bed5d7a55bd3ff27 - default default] Exception during message handling: cinder.exception.CleanableInUse: Volume with id d1007d56-0e9a-4336-9ae4-eb7e70e2f836 is already being cleaned up or another host has taken over it.
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/cinder/objects/cleanable.py",line 136,in set_worker
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server resource_id=self.id)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/cinder/db/api.py",line 1769,in worker_get
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server return IMPL.worker_get(context,**filters)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/cinder/db/sqlalchemy/api.py",line 7047,in worker_get
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server raise exception.WorkerNotFound(**filters)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server cinder.exception.WorkerNotFound: Worker with resource_type=Volume,resource_id=d1007d56-0e9a-4336-9ae4-eb7e70e2f836 Could not be found.
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server During handling of the above exception,another exception occurred:
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/engine/base.py",line 1249,in _execute_context
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server cursor,statement,parameters,context
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/engine/default.py",line 580,in do_execute
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server cursor.execute(statement,parameters)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/PyMysqL-0.10.1-py3.6.egg/pyMysqL/cursors.py",line 163,in execute
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server result = self._query(query)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/PyMysqL-0.10.1-py3.6.egg/pyMysqL/cursors.py",line 321,in _query
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server conn.query(q)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/PyMysqL-0.10.1-py3.6.egg/pyMysqL/connections.py",line 505,in query
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/PyMysqL-0.10.1-py3.6.egg/pyMysqL/connections.py",line 724,in _read_query_result
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server result.read()
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/PyMysqL-0.10.1-py3.6.egg/pyMysqL/connections.py",line 1069,in read
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server first_packet = self.connection._read_packet()
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/PyMysqL-0.10.1-py3.6.egg/pyMysqL/connections.py",line 676,in _read_packet
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server packet.raise_for_error()
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/PyMysqL-0.10.1-py3.6.egg/pyMysqL/protocol.py",line 223,in raise_for_error
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server err.raise_MysqL_exception(self._data)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/PyMysqL-0.10.1-py3.6.egg/pyMysqL/err.py",line 107,in raise_MysqL_exception
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server raise errorclass(errno,errval)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server pyMysqL.err.IntegrityError: (1062,"Duplicate entry 'Volume-d1007d56-0e9a-4336-9ae4-eb7e70e2f836' for key 'resource_type'")
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server The above exception was the direct cause of the following exception:
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/cinder/db/sqlalchemy/api.py",line 7035,in worker_create
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server worker.save(session)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/oslo_db/sqlalchemy/models.py",line 50,in save
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server session.flush()
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/orm/session.py",line 2470,in flush
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server self._flush(objects)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/orm/session.py",line 2608,in _flush
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server transaction.rollback(_capture_exception=True)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/util/langhelpers.py",line 68,in __exit__
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server compat.reraise(exc_type,exc_value,exc_tb)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/util/compat.py",line 153,in reraise
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server raise value
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/orm/session.py",line 2568,in _flush
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server flush_context.execute()
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/orm/unitofwork.py",line 422,in execute
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server rec.execute(self)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/orm/unitofwork.py",line 589,in execute
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server uow,2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/orm/persistence.py",line 245,in save_obj
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server insert,line 1137,in _emit_insert_statements
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server statement,params
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/engine/base.py",line 988,in execute
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server return meth(self,multiparams,params)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/sql/elements.py",line 287,in _execute_on_connection
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server return connection._execute_clauseelement(self,params)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/engine/base.py",line 1107,in _execute_clauseelement
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server distilled_params,2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/engine/base.py",line 1253,in _execute_context
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server e,cursor,context
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/engine/base.py",line 1471,in _handle_dbapi_exception
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server util.raise_from_cause(newraise,exc_info)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/util/compat.py",line 398,in raise_from_cause
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server reraise(type(exception),exception,tb=exc_tb,cause=cause)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/util/compat.py",line 152,in reraise
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server raise value.with_traceback(tb)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/sqlAlchemy-1.3.10-py3.6-linux-x86_64.egg/sqlalchemy/engine/base.py",errval)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server oslo_db.exception.DBDuplicateEntry: (pyMysqL.err.IntegrityError) (1062,"Duplicate entry 'Volume-d1007d56-0e9a-4336-9ae4-eb7e70e2f836' for key 'resource_type'")
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server [sql: INSERT INTO workers (created_at,deleted_at,deleted,updated_at,resource_type,resource_id,status,service_id,race_preventer) VALUES (%(created_at)s,%(deleted_at)s,%(deleted)s,%(updated_at)s,%(resource_type)s,%(resource_id)s,%(status)s,%(service_id)s,%(race_preventer)s)]
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server [parameters: {'created_at': datetime.datetime(2021,3,26,2,11,13,595960),'deleted_at': None,'deleted': 0,'updated_at': datetime.datetime(2021,594376),'resource_type': 'Volume','resource_id': 'd1007d56-0e9a-4336-9ae4-eb7e70e2f836','status': 'deleting','service_id': 11,'race_preventer': 0}]
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server (Background on this error at: http://sqlalche.me/e/gkpj)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server During handling of the above exception,another exception occurred:
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/cinder/objects/cleanable.py",line 145,in set_worker
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server service_id=service_id)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/cinder/db/api.py",line 1764,in worker_create
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server return IMPL.worker_create(context,**values)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/oslo_db/api.py",line 154,in wrapper
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/oslo_utils/excutils.py",line 220,in __exit__
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server self.force_reraise()
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/oslo_utils/excutils.py",line 196,in force_reraise
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server six.reraise(self.type_,self.value,self.tb)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/six-1.15.0-py3.6.egg/six.py",line 703,in reraise
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server raise value
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/oslo_db/api.py",line 142,in wrapper
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server return f(*args,**kwargs)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/cinder/db/sqlalchemy/api.py",line 7038,in worker_create
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server id=values.get('resource_id'))
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server cinder.exception.WorkerExists: Worker for Volume d1007d56-0e9a-4336-9ae4-eb7e70e2f836 already exists.
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server During handling of the above exception,another exception occurred:
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/oslo_messaging/rpc/server.py",in _process_incoming
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py",line 265,in dispatch
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint,method,ctxt,args)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py",line 194,in _do_dispatch
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server result = func(ctxt,**new_args)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "</usr/local/ceph/lib/python3.6/site-packages/decorator-4.4.1-py3.6.egg/decorator.py:decorator-gen-676>",line 2,in delete_volume
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/cinder/coordination.py",line 151,in _synchronized
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server return f(*a,**k)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "</usr/local/ceph/lib/python3.6/site-packages/decorator-4.4.1-py3.6.egg/decorator.py:decorator-gen-675>",in delete_volume
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/cinder/objects/cleanable.py",line 205,in wrapper
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server cleanable.set_worker()
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server File "/usr/local/ceph/lib/python3.6/site-packages/cinder/objects/cleanable.py",in set_worker
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server id=self.id)
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server cinder.exception.CleanableInUse: Volume with id d1007d56-0e9a-4336-9ae4-eb7e70e2f836 is already being cleaned up or another host has taken over it.
2021-03-26 10:11:13.637 882746 ERROR oslo_messaging.rpc.server
解决方法
暂无找到可以解决该程序问题的有效方法，小编努力寻找整理中！
如果你已经找到好的解决方法，欢迎将解决方案带上本链接一起发送给小编。
小编邮箱:dio#foxmail.com (将#修改为@）