Architect

Clickhouse Materialized view

April 24, 2021 Architect, bigdata No comments

We are now using Clickhouse for OLTP  streaming computing system.

Read this PDF for some tips for MV of Clickhouse CK-MV

Consul with Redis HA

April 14, 2020 Architect, NoSQL, redis, software No comments

We make a test to see how consul hold redis High Available solution.

In this test we don’t use sentinel to do auto failover.(we simulate sentinel manually)

Read this PDF for detail  Consul_Redis_HA

[Archiving] Antdeck Platform for MySQL

March 5, 2020 Architect, backup, MYSQL, rdbms, storage, system No comments

We use Antdeck paltform to do mysql data archiving jobs. This platform was developed by ruzuojun . He is also the author of  Lepus 

Read this pdf  Antdeck , we use TiDB as secondary storage .

[Hardware] Redis with Intel AEP Test

November 12, 2019 Architect, hardware, redis, storage, system No comments

Based on Netease Test

Read this PDF :AEP_REDIS_TEST

 

Reference:

从Intel Optane SSD和DIMM谈全闪存性能优化
Intel Data-Centric Innovation Day的启示(2)-Intel AEP
Optane DIMM写速度比SSD慢?内存接口可能并非完美
Intel Optane DC持久化内存性能测试、数据库应用优化

[Platform] Database OPS architect

May 29, 2019 Architect No comments

Please download below ppt file,shared in Shenzhen 2019

PDF: JKDB_PLATFORM

Redis Cluster tools and source code

April 25, 2018 Architect, NoSQL, redis No comments

From our team @CruePan, Detail explain Redis cluster system tools usage. Deeply mining redis client source code

download this ppt Redis_tools_sourcecode.pptx

Donkey System

January 18, 2018 Architect, Architecture, linux, MYSQL, software, system No comments

Donkey system is a fully automatic MySQL database change system.
It gives a great help both to the release of the business and the company’s automated operation and maintenance.

Donkey.pptx
Donkey_intro.pdf

Logcenter Project architect

August 16, 2017 Architect, Architecture, bigdata, hadoop, hive, network, NoSQL, rdbms No comments

We created a project called LC (log center) for ops department
All member of ops are using this system for analyzing in a lower layer.
We collects all types of log including db-system, crond, secutiry log , cmdlog , api log etc.
We used MQ system for log push which based on a policy center. And we created a new background system to search and management.

Click this project LC-system-design

MySQL special character rollback

August 16, 2017 Architect, Internals, MYSQL, replication No comments

Actually, Mysqlbinlog tools can’t miner mysql binlog exactly correct.

In this post ,a special environment we got may hexadecimal characters what we don’t need.

Read this PDF: Special-code-rollback.pdf

[JKDB] BACKUP AND RESTORE

May 11, 2017 Architect, backup, hardware, IDC, maintain, MYSQL, rdbms, replication, system No comments

JKDB PLATFORM – our company’s data management platform

In this post, we introduce backup-restore module,focus on automatic backup and restore in a huge MySQL database environment.

Read this PDF: JKDB:BACKUP-RESTORE