We use presto as the main data query engine to provide data query services for business parties. In our architecture, presto as a core capability requires access to data query permission control, including permission control at the table and column levels. We designed The following scheme to achieve this requirement
Recently we upgrade our database cluster to version 8.x .
Read this PDF to get some experience MySQL_8.x_upgrade
We use Antdeck paltform to do mysql data archiving jobs. This platform was developed by ruzuojun . He is also the author of Lepus
Read this pdf Antdeck , we use TiDB as secondary storage .
Donkey system is a fully automatic MySQL database change system.
It gives a great help both to the release of the business and the company’s automated operation and maintenance.
Introduction of JKDB. JK.CN‘s data management platform.
A platform for database /cache system management
A platform for resource control management
A platform for all of data management
Download this PPT JKDB_PLATFORM
JKDB PLATFORM – our company’s data management platform
In this post, we introduce backup-restore module,focus on automatic backup and restore in a huge MySQL database environment.
Read this PDF: JKDB:BACKUP-RESTORE
We test Facebook WDT tool:https://github.com/facebook/wdt
Read this PDD: WDT-TEST
We build a strong log-collection system to analyze total logs of our operation teams (including system ,database, web service ,load balance ,audit, cache system , hardware, iDrac logs). All of these logs are used to build a high streaming log system to find a particular performance point of our apps .We also analyze these logs in time to get a notification of attack or even a risk of event.
We build this system based on Inception (Qunar)。
All of MySQL DDL/DML operations are based on Donkey system, with strict approval process to keep online system strong and available.
Open this file by Mockplus Donkey-system