Recently we upgrade our database cluster to version 8.x .
Read this PDF to get some experience MySQL_8.x_upgrade
[Upgrade] MySQL database upgrade to 8.x version tips
December 6, 2021 MYSQL, software, system No comments upgrade
online-schema-change tool ddl problem
October 24, 2018 Internals, MYSQL, rdbms No comments
On our job schedule system. Using osc-tool cause deadlock problem.
We investigated the root cause in detail and published this PDF doc.
Donkey System
January 18, 2018 Architect, Architecture, linux, MYSQL, software, system No comments
Donkey system is a fully automatic MySQL database change system.
It gives a great help both to the release of the business and the company’s automated operation and maintenance.
Logcenter Project architect
August 16, 2017 Architect, Architecture, bigdata, hadoop, hive, network, NoSQL, rdbms No comments
We created a project called LC (log center) for ops department
All member of ops are using this system for analyzing in a lower layer.
We collects all types of log including db-system, crond, secutiry log , cmdlog , api log etc.
We used MQ system for log push which based on a policy center. And we created a new background system to search and management.
Click this project LC-system-design
MySQL special character rollback
August 16, 2017 Architect, Internals, MYSQL, replication No comments
Actually, Mysqlbinlog tools can’t miner mysql binlog exactly correct.
In this post ,a special environment we got may hexadecimal characters what we don’t need.
Read this PDF: Special-code-rollback.pdf
[JKDB] BACKUP AND RESTORE
May 11, 2017 Architect, backup, hardware, IDC, maintain, MYSQL, rdbms, replication, system No comments
JKDB PLATFORM – our company’s data management platform
In this post, we introduce backup-restore module,focus on automatic backup and restore in a huge MySQL database environment.
Read this PDF: JKDB:BACKUP-RESTORE
Donkey – system for MySQL automatic maintenance
February 17, 2017 Architect, Architecture, maintain, MYSQL, system No comments
We build this system based on Inception (Qunar)。
All of MySQL DDL/DML operations are based on Donkey system, with strict approval process to keep online system strong and available.
Open this file by Mockplus Donkey-system
TCP Trace
September 21, 2016 Architecture, MYSQL, redis, system No comments
I found a useful tool named sniffer to help us analyze network packages (this tool can capture packages on specific port)
I use sniffer to analyze mysql and redis packages (translate these packages to normal queries)
#./vc-redis-sniffer –help
vc-redis-sniffer is a utility from VividCortex to monitor query activity and write results to a file.
See --license for the terms governing your usage of this program.
-binding="[::]:6379" This is a list of comma separated bind strings as seen in /proc/net/tcp
-help="false" Show this usage message
-license="false" Print the usage terms of this program
-output="" Filepath to output queries to. Defaults to stdout if none specified.
-show-database="false" Include a 'USE `database`' for every statement. Supersedes show-database-changes.
-show-database-changes="false"
Include a 'USE `database`' every time the database is changed.
-verbose="false" Enable logging on program startup to stderr
-version="false" Show version and exit
Flag Current value
--------------------------------------------
-binding "[::]:6379"
-help "true"
-license "false"
-output ""
-show-database "false"
-show-database-changes "false"
-verbose "false"
-version "false"Capture packages and gather logs
[root@a1-dba-test-242-13 /tmp/vc-redis-sniffer]
#./vc-redis-sniffer -binding=”[::]:6379″ -output=/tmp/redis.log
Analyze logs using pt-tools
[root@a1-dba-test-242-13 /tmp/vc-mysql-sniffer]
#pt-query-digest /tmp/redis.log
Also we can analyze mysql online queries ,do above steps to get result:
MySQL TCPCOPY
June 29, 2016 Architect, Architecture, hardware, MYSQL, network No comments
we use tcpcopy to make real traffic on our core systems. Many problems will be found in advance if we enlarge queries several times.
Read this PDF TCPCOPY