Focus on database architecture

HBASE migrate table part 1

Posted by admin on December 19th, 2014

Copy table between different hbase clusters – Version 0.96.2-hadoop2

Create test table and initial some records.

$hbase shell
2014-12-19 15:01:36,085 INFO  [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
HBase Shell; enter 'help&lt[......]

Read more

Posted in system | No Comments »

MySQL message subscription system

Posted by admin on December 9th, 2014

Introducing MQ system based on MySQL (canal + roma)
Using this system to subscribe message between different platforms.

View this PDF roma_system
Also download this PDF from slideshare

Posted in Architect, MYSQL | No Comments »

MyAWR : MySQL Workload Report V3 release

Posted by admin on December 2nd, 2014

myawr-v3 release now !

history of myawr:

v1: create by noodba

mysql load information and system information 

v2: create by louis liu

myawr_v2 add :

1 more os information module.

2 multiple instance support (extend table by db_port)

3 modified[......]

Read more

Posted in Architect, MYSQL | No Comments »

webm_v2 has been released

Posted by admin on October 21st, 2014

Webm_v2 was add oracle and mongodb monitor module

webm was agent uploaded mode to save statistics

we use mysql database as monitor server

we already design tables to store these data (consider for future analysis)

you can download from github : https://github.com/ylouis83/webm

Posted in Architect, MYSQL, NoSQL | No Comments »

Webm: MySQL database performance web monitor

Posted by admin on September 28th, 2014

You can download webm from github: https://github.com/ylouis83/webm

webm: mysql web key performance monitor

webm is a tool that display key value graph on website and webm was developed by javascript and mysqlmon ( mysql data collection tool wrote by AnySQL)

Environment need:

Linux vers[……]

Read more

Tags: , ,
Posted in Architect, MYSQL | No Comments »

关于Dell 推出第13代服务器的一些想法

Posted by admin on September 12th, 2014

戴尔近日推出了旗下的13G服务器,其主力机型为R730xd,包含了诸多的特性,为其成为主流db server以及规模存储集群打下了良好的基础。



1.CPU 为intel haswall最新架构,减少了功能的损耗
2.更多的插槽,扩展为可支持18块1.8寸SSD的槽位 以及多种磁盘混插的模式[……]

Read more

Posted in MYSQL, NoSQL, system | No Comments »

HBASE Performance Test by YCSB

Posted by admin on September 3rd, 2014

Posted in NoSQL | No Comments »

关于Partial write for all MySQL and Oracle

Posted by admin on September 2nd, 2014

很久之前看过这个帖子,当时没有细究,这几天看了下mysql相关的internal 突然想起这个问题,跟三四个朋友讨论了下 想把这个问题展开讲一讲。


这个帖子的内容为一个老外问oracle如何避免partial write的,也就是大家所说的半个IO问题,IO 在写到一半的时候发生断裂,(瞬间断线,瞬间crash瞬间存储或者机器故障等) 虽然这个情况极少发生,但是在非常规恢复的时候也是经常遇到的,例如某个block内部出现不一致,也就是我们所谓的逻辑[……]

Read more

Posted in MYSQL | No Comments »

Some data collection display

Posted by admin on August 21st, 2014

Reference Oracle AWR. These two was developed by python and perl.

Both of these are following data collection method.

Use these tools can help quick identify problem.

MyAWR v2 –collection of mysql and os information

MongoAWR v1 — collection of mongodb and os information

Tags: , , ,
Posted in MYSQL, NoSQL | No Comments »

Talk about some MySQL HA architecture

Posted by admin on August 12th, 2014

Some tips for MySQL architecture

Tags: ,
Posted in MYSQL | No Comments »