VMCD.ORG

Focus on database architecture

linux tools part 10– Monitoring process iostat

Posted by admin on April 24th, 2015

We can use iopp tool to monitor process io performance

download from github : https://github.com/markwkm/iopp

pid: The process id.
rchar: The number of bytes which this task has caused to be read from storage.
wchar: The number of bytes which this task has caused, or shall cause to be written[......]

Read more

Posted in system | No Comments »

MariaDB : Bug when add index on Partition table

Posted by admin on April 23rd, 2015

Version: 5.5.5-10.0.10-MariaDB-log MariaDB Server

When I use mariadb as multi-source slave DB I met a strange problem . Creating index on a vary large partition table , Mariadb do — copy to tmp table on the slave side. It takes a long time and still not finish over 9 hours.

Primary : MySQL 5.[……]

Read more

Posted in Internals, MYSQL, replication | No Comments »

MySQL 5.7 milestone

Posted by admin on April 22nd, 2015

MySQL 5.7 will be a great milestone in MySQL total history.
Oracle has released many useful new features in LAB version . MySQL is becoming more similar to Oracle database :)

Read this presentation I post on slideshare:

MySQL 5.7 milestone

Posted in Architect, MYSQL, software | No Comments »

Design for “seckilling ” on MySQL

Posted by admin on March 13th, 2015

Today I read a nice article , which give a new design for mysql database . In this article , Author (Mr.lou) uses OneSQL (a branch of MySQL) for the whole test.

you can read from : http://www.onexsoft.com/?page_id=378

This article explain how to use mysql in seckilling scenario (especially f[……]

Read more

Posted in system | No Comments »

Architecture of data warehouse which is based on MQ

Posted by admin on January 20th, 2015

Recently, we create a mysql data warehouse which is based on message queue.

Most companies must prepare for particular queries in their systems if they consider to split their databases or tables into many pieces.

some problems should be solved in this situation:

1. how to get correct re[……]

Read more

Posted in Architect, Architecture, MYSQL, rdbms, software | No Comments »

MHA with binlog server

Posted by admin on December 31st, 2014

In this post ,we mainly talk about MHA GTID behavior, we test different cases and find something is different from previous versions .

we have four machines for this test.

environment:


master server: 10.0.128.77
slave server : 10.0.128.110/113/114
port : 3306 

———————–[……]

Read more

Posted in Architect, Architecture, MYSQL, software | No Comments »

HBASE migrate table part 1

Posted by admin on December 19th, 2014

Copy table between different hbase clusters – Version 0.96.2-hadoop2

Create test table and initial some records.

$hbase shell
2014-12-19 15:01:36,085 INFO  [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
HBase Shell; enter 'help&lt[......]

Read more

Posted in bigdata, hbase | No Comments »

MySQL-Oslayer-Performance-Optimization

Posted by admin on December 13th, 2014

upload on 2014.12 [ten important tips of MySQL database design for better performance] Download this PDF

Tags:
Posted in Architecture, MYSQL, performance | No Comments »

MySQL message subscription system

Posted by admin on December 9th, 2014

Introducing MQ system based on MySQL (canal + roma)
Using this system to subscribe message between different platforms.

View this PDF roma_system
Also download this PDF from slideshare

Tags:
Posted in Architect, Architecture, MYSQL, replication, software | No Comments »

MyAWR : MySQL Workload Report V3 release

Posted by admin on December 2nd, 2014


myawr-v3 release now !

history of myawr:

————————–
v1: create by noodba

mysql load information and system information 

v2: create by louis liu

myawr_v2 add :

1 more os information module.

2 multiple instance support (extend table by db_port)

3 modified[......]

Read more

Tags:
Posted in Architecture, MYSQL, performance | No Comments »