We created a project called LC (log center) for ops department
All member of ops are using this system for analyzing in a lower layer.
We collects all types of log including db-system, crond, secutiry log , cmdlog , api log etc.
We used MQ system for log push which based on a policy center. And we created a new background system to search and management.
Click this project LC-system-design
Actually, Mysqlbinlog tools can’t miner mysql binlog exactly correct.
In this post ,a special environment we got may hexadecimal characters what we don’t need.
Read this PDF: Special-code-rollback.pdf
JKDB PLATFORM – our company’s data management platform
In this post, we introduce backup-restore module,focus on automatic backup and restore in a huge MySQL database environment.
Read this PDF: JKDB:BACKUP-RESTORE
We test Facebook WDT tool:https://github.com/facebook/wdt
Read this PDD: WDT-TEST
We build a strong log-collection system to analyze total logs of our operation teams (including system ,database, web service ,load balance ,audit, cache system , hardware, iDrac logs). All of these logs are used to build a high streaming log system to find a particular performance point of our apps .We also analyze these logs in time to get a notification of attack or even a risk of event.
We build this system based on Inception (Qunar)。
All of MySQL DDL/DML operations are based on Donkey system, with strict approval process to keep online system strong and available.
Open this file by Mockplus Donkey-system
we use tcpcopy to make real traffic on our core systems. Many problems will be found in advance if we enlarge queries several times.
Read this PDF TCPCOPY
Sandisk (FusionIO) and Nexenta are working together to build this SDS solution.
Infiniflash is a very large SDS production, which manages for very large DW system who requires large storage space and also high IOPS.
We test infiniflash system ,read this Infiniflash_benchmark
Based on messages, we create mysql replication platforms , using async message to build strong distributed subscription system.
read this PDF : http://www.vmcd.org/docs/MySQL_async_message.pdf
因公司业务发展迅速，部门现在招两个mysql dba 同学，目前本人在平安健康互联网（平安好医生）数据团队，负责数据库的整体规划，想来的同学可以发简历到我的邮箱 firstname.lastname@example.org 靠谱的公司靠谱的团队 ：）