zl程序教程

您现在的位置是:首页 >  数据库

当前栏目

mysql错误解决总结

mysql错误 解决 总结
2023-09-14 08:59:38 时间
div PRIMARY required more than innodb_online_alter_log_max_size bytes of modification log. Please try again.  解决方法: 我的数据库为MySQL 5.5版本,innodb_online_alter_log_max_size值为默认大小128M。 mysql show variables like innodb_online_alter_log_max_size; +——————————————+———————-+ | Variable_name                            | Value                | +——————————————+———————-+ | innodb_online_alter_log_max_size         | 134217728            | +——————————————+———————-+ 1 rows in set (0.00 sec) 该参数为动态参数且全局的,可通过如下命令加大 mysql set global innodb_online_alter_log_max_size=402653184; Query OK, 0 rows affected (0.03 sec) 加到合适大小,我往120G大小表里添加字段设置该值4G,成功执行。 ———————————————————————————————————————————————————————– MySQL日志: 140306 12:03:25  InnoDB: ERROR: the age of the last checkpoint is 9434024, InnoDB: which exceeds the log group capacity 9433498. InnoDB: If you are using big BLOB or TEXT rows, you must set the InnoDB: combined size of log files at least 10 times bigger than the InnoDB: largest such row. 应该是Innodb引擎下日志大小设置过小导致的,某个事物产生大量日志,但innodb_log_file_size设置过小,可以加大解决。 解决方法: 直接贴网上找到的方法,如下 STEP 01) Change the following in /etc/my.cnf [mysqld] innodb_log_buffer_size          = 32M innodb_buffer_pool_size         = 3G innodb_log_file_size            = 768M STEP 02) mysql -uroot -p -e"SET GLOBAL innodb_fast_shutdown = 0;" STEP 03) service mysql stop STEP 04) rm -f /var/lib/mysql/ib_logfile* STEP 05) service mysql start I added SET GLOBAL innodb_fast_shutdown = 0;. What does that do? It forces InnoDB to completely purge transactional changes from all of InnoDB moving parts, including the transactional logs (ib_logfile0, ib_logfile1). Thus, there is no need to backup the old ib_logfile0, ib_logfile1. If deleting them makes you nervous, then make Step 04 mv /var/lib/mysql/ib_logfile* .. ———————————————————————————————————————————————————————– 使用pt-online-schema-change工具添加字段时,收到错误如下: # pt-online-schema-change –alter="add column tag_common text default null" –user=root –password=xxxxxxxx D=MYDB,t=MYTB –execute Cannot connect to D=lsedata_13Q1,h=10.13.7.47,p=…,u=root No slaves found.  See –recursion-method if host BJL1-Y13-10-ops.gaoder.net has slaves. Not checking slave lag because no slaves were found and –check-slave-lag was not specified. # A software update is available: #   * Percona Toolkit 2.2.6 has a possible security issue (CVE-2014-2029) upgrade is recommended. The current version for Percona::Toolkit is 2.2.7. The table `MYDB`.`MYTB` has triggers.  This tool needs to create its own triggers, so the table cannot already have triggers. 这是MYTB表上之前就有触发器的原因,可以从pt-online-schema-change的工作机制了解到: 1) 如果存在外键,根据alter-foreign-keys-method参数值,检测外键相关的表,针对相应的设置进行处理; 2) 创建一个新的表,表结构修改后的数据表,用于从源数据表向新表中导入数据; 3) 创建触发器,在复制数据开始之后,将对源数据表继续进行数据修改的操作记录下来,以便在数据复制结束后执行这些操作,保证数据不会丢失; 4) 复制数据,从源数据表中复制数据到新表中; 5) 修改外键相关的子表,根据修改后的数据,修改外键关联的子表; 6) 更改源数据表为old表,把新表更改为源表名,并将old表删除; 7) 删除触发器; pt-online-schema-change详细文档,请阅读:http://www.percona.com/doc/percona-toolkit/2.1/pt-online-schema-change.html ———————————————————————————————————————————————————————– 我们在使用mysqldump的时候可能会遇到如下错误: mysqldump: Got error: 1044: Access denied for user lseread@IP to database lsedata_13q1 when doing LOCK TABLES 解决方法: 加上–skip-lock-tables即可,类似如下: mysqldump -h1.1.1.1  -uuser   -ppassword   -P3306 mydb mytb –where "time = cast(2014-04-03 16:00 as datetime)" –skip-lock-tables –default-character-set=utf8   mytb.txt  MySQL5.6开始提供新特性GTID模式,我们的研发人员在我提供的从库上dump的时候遇到如下警告: Warning: Using a password on the command line interface can be insecure. Warning: A partial dump from a server that has GTIDs will by default include the GTIDs of all transactions, even those that changed suppressed parts of the database. If you dont want to restore GTIDs, pass –set-gtid-purged=OFF. To make a complete dump, pass –all-databases –triggers –routines –events. 虽然有警告,但数据还是可以dump出来,郁闷的是,想把dump文件导入到其他版本数据库的时候将会遇到: ERROR 1839 (HY000) at line 24: @@GLOBAL.GTID_PURGED can only be set when @@GLOBAL.GTID_MODE = ON. 参考如下文: gtid_executed: WHEN used WITH global scope, this variable contains a representation OF the SET OF ALL transactions that are logged IN the BINARY log.  WHEN used WITH SESSION scope, it contains a representation OF the SET OF transactions that are written TO the cache IN the CURRENT SESSION. Issuing RESET MASTER causes the global VALUE (but NOT the SESSION VALUE) OF this variable TO be reset TO an empty string. 解决方法: dump的时候加上参数–gtid-mode=OFF,类似如下: mysqldump -h1.1.1.1  -uuser   -ppassword   -P3306 mydb mytb –where "time = cast(2014-04-03 16:00 as datetime)" –skip-lock-tables –default-character-set=utf8 –gtid-mode=OFF mytb.txt  ———————————————————————————————————————————————————————– 给一张大表添加字段,过了一段时间系统HANG住,添加字段工作中断。系统重启之后,想重新添加字段,却遇到如下错误: mysql alter table mytb add column yyy text default null; ERROR 1050 (42S01): Table mydb/#sql-ib54 already exists 查看MySQL err日志: 2014-04-04 09:10:12 10578 [Note] /opt/mysql5.6/bin/mysqld: ready for connections. Version: 5.6.17-log  socket: /opt/mysql5.6/data/mysql.sock  port: 3307  Source distribution 2014-04-04 09:10:24 10578 [ERROR] InnoDB: Failed to find tablespace for table "mydb"."#sql-ib54" in the cache. Attempting to load the tablespace with space id 54. 2014-04-04 09:10:24 52e55940  InnoDB: Operating system error number 2 in a file operation. InnoDB: The error means the system cannot find the path specified. 2014-04-04 09:10:24 10578 [ERROR] InnoDB: Could not find a valid tablespace file for mydb/#sql-ib54. See http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html for how to resolve the issue. 查看数据目录,有#开头的一些文件,如下: – 其他表信息忽略,之所以.ibd文件较多是因为操作表mytb为分区表 #sql-ib58.ibd  #sql-ib65.ibd #sql-1935_2.frm  #sql-ib59.ibd  #sql-ib66.ibd #sql-1935_2.par  #sql-ib60.ibd  #sql-ib67.ibd #sql-ib54.ibd    #sql-ib61.ibd #sql-ib55.ibd    #sql-ib62.ibd #sql-ib56.ibd    #sql-ib63.ibd #sql-ib57.ibd    #sql-ib64.ibd 这个问题我头一次碰到,没深入研究过其中细节,只是想着#开头为临时文件,觉得可以rm,不犹豫直接删掉。 然后重启数据库,结果报了大量ERROR: 2014-04-04 09:10:12 2b1b9b20dfe0  InnoDB: Operating system error number 2 in a file operation. InnoDB: The error means the system cannot find the path specified. InnoDB: If you are installing InnoDB, remember that you must create InnoDB: directories yourself, InnoDB does not create them. 2014-04-04 09:10:12 10578 [ERROR] InnoDB: Could not find a valid tablespace file for mydb/#sql-ib54. See http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html for how to resolve the issue. 2014-04-04 09:10:12 10578 [ERROR] InnoDB: Tablespace open failed for "mydb"."#sql-ib54", ignored. 2014-04-04 09:10:12 2b1b9b20dfe0  InnoDB: Operating system error number 2 in a file operation. InnoDB: The error means the system cannot find the path specified. InnoDB: If you are installing InnoDB, remember that you must create InnoDB: directories yourself, InnoDB does not create them. 2014-04-04 09:10:12 10578 [ERROR] InnoDB: Could not find a valid tablespace file for mydb/#sql-ib55. See http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html for how to resolve the issue. 2014-04-04 09:10:12 10578 [ERROR] InnoDB: Tablespace open failed for "mydb"."#sql-ib55", ignored. 遇到问题需要淡定,我尝试继续添加字段,但报错依然。 然后我阅读了下错误日志里给出的http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html文章,才了解到,在独立表空间模式下通过shell命令删除表结构和表空间文件的话就会遇到这种问题。 文中还给出了抢救方法,我找到了如下文段: Problem with Temporary Table If MySQL crashes in the middle of an ALTER TABLE operation, you may end up with an orphaned temporary table inside the InnoDB tablespace. Using the Table Monitor, you can see listed a table with a name that begins with #sql-. You can perform SQL statements on tables whose name contains the character “#” if you enclose the name within backticks. Thus, you can drop such an orphaned table like any other orphaned table using the method described earlier. To copy or rename a file in the Unix shell, you need to put the file name in double quotation marks if the file name contains “#”. 我就创建了一个新库,创建了同结构的表,然后再该表上进行添加字段操作,这时候新库数据目录下又产生#sql-开头的文件,我把这些文件全部拷贝到原库目录下。 接着全部改名,如下: # mv \#sql-2ff9_1.frm sql-2ff9_1.frm # mv \#sql-2ff9_1.par sql-2ff9_1.par # mv \#sql-ib82.ibd sql-ib82.ibd  # mv \#sql-ib83.ibd sql-ib83.ibd  # mv \#sql-ib84.ibd sql-ib84.ibd  # mv \#sql-ib85.ibd sql-ib85.ibd  # mv \#sql-ib86.ibd sql-ib86.ibd  # mv \#sql-ib87.ibd sql-ib87.ibd  # mv \#sql-ib88.ibd sql-ib88.ibd  # mv \#sql-ib89.ibd sql-ib89.ibd  # mv \#sql-ib90.ibd sql-ib90.ibd  # mv \#sql-ib91.ibd sql-ib91.ibd  # mv \#sql-ib92.ibd sql-ib92.ibd  # mv \#sql-ib93.ibd sql-ib93.ibd  # mv \#sql-ib94.ibd sql-ib94.ibd  # mv \#sql-ib95.ibd sql-ib95.ibd  这样show tables能查看表信息: mysql show tables; +———————+ | Tables_in_mydb   | +———————+ | #mysql50#sql-2ff9_1 | +———————+ 1 rows in set (0.01 sec) 但悲剧的是,我尝试删除#mysql50#sql-2ff9_1这个表,却始终没能删掉。 时间耗得也不少,开发那边一直在询问进展。 我就想到别的方案: 该表rename,创建结构一样的新表,导数据到新表,再往新表里增加字段,rename的表删除。 实际证明此方案可行。就是数据量大,导数据过程时间长,当然增加字段时间也一样长。 那网上有些人说删除ibdata1和ib_logfile0、1,然后重启数据库就可以解决,这方法可行吗? 答案当然是NO,在独立表空间模式下,ibdata里保存数据字典以及UNDO信息,删除之后重启数据库将会生成全新的ibdata,也就是丢失了字典信息和UNDO了。 到时候会出现如下现象: mysql show tables; +——————-+ | Tables_in_mydb | +——————-+ | t1          | +——————-+ 1 rows in set (0.01 sec) mysql select count(*) from t1; ERROR 1146 (42S02): Table mydb.t1 doesnt exist ———————————————————————————————————————————————————————–  

主从复制失败,查看slave日志如下错误: 140405  4:16:12 [ERROR] Slave I/O: error reconnecting to master rep1@10.13.34.199:3306 – retry-time: 60  retries: 86400, Error_code: 2003 140405  6:53:12 [Note] Slave: connected to master rep1@10.13.34.199:3306,replication resumed in log mysql-bin.000275 at position 192295247 140405  6:53:12 [ERROR] Error reading packet from server: Could not find first log file name in binary log index file ( server_errno=1236) 140405  6:53:12 [ERROR] Slave I/O: Got fatal error 1236 from master when reading data from binary log: Could not find first log file name in binary log index file, Error_code: 1236 140405  6:53:12 [Note] Slave I/O thread exiting, read up to log mysql-bin.000275, position 192295247 140405  6:54:11 [Note] Error reading relay log event: slave SQL thread was killed 140405  6:54:11 [Note] Slave I/O thread: connected to master rep1@10.13.34.199:3306,replication started in log mysql-bin.000275 at position 192295247 140405  6:54:11 [ERROR] Error reading packet from server: Could not find first log file name in binary log index file ( server_errno=1236) 140405  6:54:11 [ERROR] Slave I/O: Got fatal error 1236 from master when reading data from binary log: Could not find first log file name in binary log index file, Error_code: 1236 140405  6:54:11 [Note] Slave I/O thread exiting, read up to log mysql-bin.000275, position 192295247 140405  6:54:11 [Note] Slave SQL thread initialized, starting replication in log mysql-bin.000275 at position 192295247, relay log ./SHUBEI-34-198-relay-bin.000153 position: 192295393 从指定的binlog里找到指定的position位置,我发现这已经到头了,之后就是切了新binlog # mysqlbinlog mysql-bin.000275 | grep -A 10 192295247  #140405  3:16:06 server id 1  end_log_pos 192295247     Xid = 468032712 COMMIT/*!*/; DELIMITER ; # End of log file ROLLBACK /* added by mysqlbinlog */; /*!50003 SET COMPLETION_TYPE=@OLD_COMPLETION_TYPE*/; 这下问题好解决了,给从库指定新的binlog即可。 主库show master status; mysql show master status; +——————+———-+————–+——————+ | File             | Position | Binlog_Do_DB | Binlog_Ignore_DB | +——————+———-+————–+——————+ | mysql-bin.000276 |      107 |              | test             | +——————+———-+————–+——————+ 1 row in set (0.00 sec) 从库重新配置复制: mysql stop slave; Query OK, 0 rows affected (0.00 sec) mysql change master to master_host=10.13.34.199,master_port=3306,master_user=rep1,master_password=RepSlavE 2013, master_log_file=mysql-bin.000276,master_log_pos=107;  Query OK, 0 rows affected (0.05 sec) mysql start slave; Query OK, 0 rows affected (0.00 sec) 查看主从复制状态: mysql show slave status\G —-省略—-              Slave_IO_Running: Yes             Slave_SQL_Running: Yes ———————————————————————————————————————————————————————– 解决ERROR 1872 (HY000): Slave failed to initialize relay log info structure from the repository 修改了relay-log的输出格式之后,重启MySQL,同步失败 mysql start slave; ERROR 1872 (HY000): Slave failed to initialize relay log info structure from the repository MySQL Error日志: 2014-02-20 16:35:19 27094 [ERROR] Failed to open the relay log ./luocs166-relay-bin.000007 (relay_log_pos 359). 2014-02-20 16:35:19 27094 [ERROR] Could not find target log file mentioned in relay log info in the index file /opt/mysql/data/anav-relay-log.index during relay log initialization. 解决方法: 我在查看change master to命令的时候找到如下文段 mysql ? change master to – 省略大部分 The next example shows an operation that is less frequently employed. It is used when the slave has relay log files that you want it to execute again for some reason. To do this, the master need not be reachable. You need only use CHANGE MASTER TO and start the SQL thread (START SLAVE SQL_THREAD): CHANGE MASTER TO   RELAY_LOG_FILE=slave-relay-bin.006,   RELAY_LOG_POS=4025; 但我的数据库版本为5.6,使用了GTID模式,使用报错: mysql CHANGE MASTER TO     - RELAY_LOG_FILE=anav-relay-log.000001,     - RELAY_LOG_POS=120; ERROR 1776 (HY000): Parameters MASTER_LOG_FILE, MASTER_LOG_POS, RELAY_LOG_FILE and RELAY_LOG_POS cannot be set when MASTER_AUTO_POSITION is active. 因此如下解决: mysql reset slave; Query OK, 0 rows affected (0.00 sec) mysql CHANGE MASTER TO     - MASTER_HOST=10.19.3.168,     - MASTER_USER=repl2,     - MASTER_PASSWORD=oracle,     - MASTER_AUTO_POSITION = 1; Query OK, 0 rows affected, 2 warnings (0.02 sec) mysql start slave; Query OK, 0 rows affected, 1 warning (0.01 sec) mysql show slave status\G …. 省略部分 ….              Slave_IO_Running: Yes             Slave_SQL_Running: Yes http://www.luocs.com/archives/840.html

MySQL总结 一.SQL语句简介 1.什么是SQL? SQL(Structured Query Language):结构化查询语言 其实就是定义了操作所有关系型数据库的规则。每一种数据库操作的方式存在不一样的地方,称为“方言”