network

MySQL TCPCOPY

June 29, 2016 Architect, Architecture, hardware, MYSQL, network No comments

we use tcpcopy to make real traffic on our core systems. Many problems will be found in advance if we enlarge queries several times.

Read this PDF TCPCOPY

How to configure Tcpdump system

July 24, 2015 Architect, Architecture, Internals, MYSQL, network, system No comments

MySQL Tcpdump system : use percona-toolkit to analyze network packages

We can identify problem SQLs with high execution frequency.

With DBMON system and AWR system we can find problem SQLs in a special time (high frequency, occurs over a period of time)

View this PDF:

http://www.vmcd.org/docs/MySQL_TCPDUMP.pdf

Oracle DGHA architecture

November 1, 2013 advanced tech, Architect, network, oracle, replication No comments



Download this PDF

Connection Speeds Compare

February 17, 2013 Architect, network No comments

+------------+----------+-------------+------------+-------------+-------------+
|bps         |B/s       |network      |storage     |port         |bus          |
+------------+----------+-------------+------------+-------------+-------------+
|56/48K      |5.6/4.8K  |Modem 56k    |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|57.6/28.8K  |7.2/3.6K  |GPRS         |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|236.8/236.8K|29.6/29.6K|EDGE (2.75G) |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|1M          |125K      |Bluetooth 1.1|            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|1536K       |192K      |             |            |USB low speed|             |
+------------+----------+-------------+------------+-------------+-------------+
|1,536/512K  |192/64K   |ADSL (G.Lite)|            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|3M          |375k      |Bluetooth 2.0|            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|10M         |1.25M     |10BASE-T     |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|12M         |1.5M      |             |            |USB full     |             |
|            |          |             |            |speed        |             |
+------------+----------+-------------+------------+-------------+-------------+
|12.288M     |1.536M    |             |            |AC97         |             |
+------------+----------+-------------+------------+-------------+-------------+
|13.98/5.760M|1,706/720k|HSDPA/HSUPA  |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|24M         |3M        |Bluetooth    |            |             |             |
|            |          |3.0/4.0      |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|54M         |6.75M     |IEEE 802.11g |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|98.3M       |12.28M    |             |            |IEEE 1394 100|             |
+------------+----------+-------------+------------+-------------+-------------+
|100M        |12.5M     |100BASE-TX   |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|108M        |13.5M     |IEEE 802.11g |            |             |             |
|            |          |with Super G |            |             |             |
|            |          |by Atheros   |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|160M        |20M       |             |Ultra SCSI  |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|196.608M    |24.57M    |             |            |IEEE 1394 200|             |
+------------+----------+-------------+------------+-------------+-------------+
|264M        |33M       |             |UDMA33      |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|320M        |40M       |             |Ultra-2 SCSI|             |             |
|            |          |             |40          |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|393.216M    |49.15M    |             |            |IEEE 1394 400|             |
+------------+----------+-------------+------------+-------------+-------------+
|480M        |60M       |             |            |USB 2.0      |             |
+------------+----------+-------------+------------+-------------+-------------+
|533M        |66M       |             |UDMA66      |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|600M        |75M       |IEEE 802.11n |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|640M        |80M       |             |Ultra-2 wide|             |             |
|            |          |             |SCSI        |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|786.432M    |98.3M     |             |            |IEEE 1394b   |             |
|            |          |             |            |800          |             |
+------------+----------+-------------+------------+-------------+-------------+
|800M        |100M      |             |UDMA100     |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|1G          |125M      |1000BASE-T   |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|1067M       |133M      |             |            |             |PCI-33 32bit |
+------------+----------+-------------+------------+-------------+-------------+
|1064M       |133M      |             |UDMA133     |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|1500M       |150M      |             |SATA1       |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|1280M       |160M      |             |Ultra-3 SCSI|             |             |
+------------+----------+-------------+------------+-------------+-------------+
|1573M       |196M      |             |            |IEEE 1394b   |             |
|            |          |             |            |1600         |             |
+------------+----------+-------------+------------+-------------+-------------+
|2G          |250M      |             |            |             |PCI Express  |
|            |          |             |            |             |1.0 (1 link) |
+------------+----------+-------------+------------+-------------+-------------+
|2.133G      |266M      |             |            |             |PCI-33 64bit |
+------------+----------+-------------+------------+-------------+-------------+
|2.133G      |266M      |             |            |             |PCI-66 32bit |
+------------+----------+-------------+------------+-------------+-------------+
|2.133G      |266M      |             |            |             |AGP 1x       |
+------------+----------+-------------+------------+-------------+-------------+
|2400M       |300M      |             |SAS         |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|3000M       |300M      |             |SATA2       |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|2560M       |320M      |             |Ultra-320   |             |             |
|            |          |             |SCSI        |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|2.8G        |0.35G     |             |            |LVDS         |             |
+------------+----------+-------------+------------+-------------+-------------+
|3145.7M     |393M      |             |            |IEEE 1394b   |             |
|            |          |             |            |3200         |             |
+------------+----------+-------------+------------+-------------+-------------+
|4G          |500M      |             |            |             |PCI Express  |
|            |          |             |            |             |2.0 (1 link) |
+------------+----------+-------------+------------+-------------+-------------+
|5G          |500M      |             |            |USB 3.0      |             |
+------------+----------+-------------+------------+-------------+-------------+
|4.266G      |533M      |             |            |             |PCI-66 64bit |
+------------+----------+-------------+------------+-------------+-------------+
|4.266G      |533M      |             |            |             |AGP 2x       |
+------------+----------+-------------+------------+-------------+-------------+
|4800M       |600M      |             |SAS2        |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|6000M       |600M      |             |SATA3       |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|4.95G       |0.619G    |             |            |HDMI v1.0    |             |
+------------+----------+-------------+------------+-------------+-------------+
|5120M       |640M      |             |Ultra-640   |             |             |
|            |          |             |SCSI        |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|6.48G       |0.81G     |             |            |DisplayPort  |             |
|            |          |             |            |v1.0 (4-lane |             |
|            |          |             |            |reduced rate)|             |
+------------+----------+-------------+------------+-------------+-------------+
|7.88G       |984.6M    |             |            |             |PCI Express  |
|            |          |             |            |             |3.0 (1 link) |
+------------+----------+-------------+------------+-------------+-------------+
|8.533G      |1.067G    |             |            |             |AGP 4x       |
+------------+----------+-------------+------------+-------------+-------------+
|9600M       |1200M     |             |SAS3        |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|10G         |1.25G     |10GBASE-X    |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|10.2G       |1.275G    |             |            |HDMI v1.3    |             |
+------------+----------+-------------+------------+-------------+-------------+
|10.8G       |1.35G     |             |            |DisplayPort  |             |
|            |          |             |            |v1.0 (4-lane |             |
|            |          |             |            |full rate)   |             |
+------------+----------+-------------+------------+-------------+-------------+
|17.066G     |2.133G    |             |            |             |AGP 8x       |
+------------+----------+-------------+------------+-------------+-------------+
|21.6G       |2.7G      |             |            |DisplayPort  |             |
|            |          |             |            |v1.2         |             |
+------------+----------+-------------+------------+-------------+-------------+
|32G         |4G        |             |            |             |PCI Express  |
|            |          |             |            |             |1.0 (16 link)|
+------------+----------+-------------+------------+-------------+-------------+
|34.133G     |4.266G    |             |            |             |AGP 8x 64bit |
+------------+----------+-------------+------------+-------------+-------------+
|40G         |5G        |40GBASE-X    |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|64G         |8G        |             |            |             |PCI Express  |
|            |          |             |            |             |1.0 (32 link)|
+------------+----------+-------------+------------+-------------+-------------+
|64G         |8G        |             |            |             |PCI Express  |
|            |          |             |            |             |2.0 (16 link)|
+------------+----------+-------------+------------+-------------+-------------+
|100G        |12.5G     |100GBASE-X   |            |             |             |
+------------+----------+-------------+------------+-------------+-------------+
|126.03G     |15.8G     |             |            |             |PCI Express  |
|            |          |             |            |             |3.0 (16 link)|
+------------+----------+-------------+------------+-------------+-------------+
|128G        |16G       |             |            |             |PCI Express  |
|            |          |             |            |             |2.0 (32 link)|
+------------+----------+-------------+------------+-------------+-------------+
|252.06G     |31.5G     |             |            |             |PCI Express  |
|            |          |             |            |             |3.0 (32 link)|
+------------+----------+-------------+------------+-------------+-------------+
 from  wikipedia
Interconnect Max speed Notes
56k dialup 0.005 upload is slower (V.90 = 0.003, and V.92 = 0.004)
128k ADSL 0.014 assuming an ATM+TCP overhead of 14%
256k ADSL 0.028 assuming an ATM+TCP overhead of 14%
512k ADSL 0.055 assuming an ATM+TCP overhead of 14%
1M ADSL 0.110 assuming an ATM+TCP overhead of 14%
2M ADSL 0.220 assuming an ATM+TCP overhead of 14%
8M ADSL 0.881 assuming an ATM+TCP overhead of 14%
12M ADSL2 1.321 assuming an ATM+TCP overhead of 14%
24M ADSL2+ 2.642 assuming an ATM+TCP overhead of 14%
10Mb/s LAN 1.200 assuming a TCP/IP overhead of 4%
100Mb/s LAN 12.000 assuming a TCP/IP overhead of 4%
1Gb/s LAN 120.000 assuming a TCP/IP overhead of 4%
localtalk 0.028 assuming a TCP/IP overhead of 4%
arcnet 0.300 assuming a TCP/IP overhead of 4%
token ring 1 0.499 assuming a TCP/IP overhead of 4%
token ring 2 1.920 assuming a TCP/IP overhead of 4%
HomePlug 1.0 0.750 Typical thoughtput is 2.5Mb/s. Marketed as 14Mb/s
Intellon HomePlug Turbo 3.125 Typical throughput is 10Mb/s. Marketed as 85Mb/s. Intellon proprietry
HomePlug AV 7.500 Typical throughput is 36Mb/s. Marketed as 200Mb/s
Wireless    
IrDA-control 0.009  
IrDA-SIR 0.014  
IrDA-FIR 0.500  
Bluetooth 1.x 0.090 723Kbps max asymmetric. 434Kbps max symmetric
Bluetooth 2.0 0.260 2.1Mbps max asymmetric. 1.45Mbps max symmetric
Wimedia Bluetooth 0.500 Will be next bluetooth standard, range 10m. See CES 2006 presentation for other Wimedia speeds/applications
Wimedia USB 60.000 Will be next USB standard, range 10m. See CES 2006 presentation for other Wimedia speeds/applications
802.11b 0.700 very variable
802.11a 3.100 very variable
802.11g 3.100 very variable
802.11n 6.200  
802.16a 9.200 range up to 50Km
Local/Serial    
Parallel (SPP) 0.10  
Parallel (EPP/ECP) 1.35 Assuming 10% overhead
USB 1.0 low speed 0.16 Ditto
USB 1.0 high speed 1.35 Ditto. Also known as usb 1.1
USB 2.0 low speed 0.16 Assuming 10% overhead
USB 2.0 full speed 1.35 Ditto
USB 2.0 hi speed 35.00 bulk transfer mode only seems to get about 58% of max
USB 3.0 400.00 38% overhead. optical and electrical. backwards compatible with USB 2.0. Full duplex
Firewire 50.00 S100 = 12.5MB/s, S200 = 25MB/s, S400 = 50MB/s
Firewire b 400.00 S800 = 100MB/s, S1600 = 200MB/s, S3200 = 400MB/s
Thunderbolt 800.00 Based on PCI express. Full duplex and port supports 2 of these lanes
Multimedia    
SPDIF 0.375 just audio (24 bit, 48KHz)
SDI 33.7 26.8 for video, 6.9 for other data
SDI-WS 45.0  
HD-SDI 187.5  
DVI 618.7 video and slow I2C data
HDMI 625.0 video, audio and data
Discs    
FD (1.44MB) 0.030  
CD (1X) 0.153  
DVD (1X) 1.385  
zip (100/250MB) 1.400  
zip (750MB) 7.500  
MD (177MB) 0.160  
Hi-MD (305MB) 0.540  
Hi-MD (1000MB) 1.230  
ATAPI   ATAPI modes supported by hard disks, CD-ROM drives etc.
PIO Mode 0 3.3  
PIO Mode 1 5.2  
PIO Mode 2 8.3  
PIO Mode 3 11.1  
PIO Mode 4 16.7  
DMA Mode 0 4.2  
DMA Mode 1 13.3  
DMA Mode 2 16.7  
UDMA Mode 0 16.7 Note Ultra DMA modes do not support overlapped seeks, bus bandwidth sharing, or command queuing/reordering because of their single-threaded nature.
UDMA Mode 1 25.0
UDMA Mode 2 33.3
UDMA Mode 3 44.4
UDMA Mode 4 66.7
UDMA Mode 5 100.0
UDMA Mode 6 133.0
Serial ATA 150.0 Note SATA modes support asynchronous operation through “tagged command queuing”.
Serial ATA II 300.0
Serial ATA III 600.0
SCSI   Note Hard disk speeds (both SCSI & ATAPI), are the limiting factor rather than the bus speeds specified here.
SCSI-1 5.0  
SCSI-2 5.0  
Wide SCSI 10.0  
Fast SCSI 10.0  
Fast Wide SCSI 20.0  
Ultra SCSI 20.0  
Ultra Wide SCSI 40.0  
Ultra2 SCSI 40.0  
Ultra2 Wide SCSI 80.0  
Ultra160 SCSI 160.0  
Ultra320 SCSI 320.0  
Ultra640 SCSI 640.0  
PC bus    
8 bit ISA 2.3 original XT
16 bit ISA 8.0  
EISA 32.0  
MCA 40.0 (typical PS/2 speeds) 160.0 theoretical limit
Vesa Local 44.0 105.0 in burst mode
AGP 2132.0 Base AGP speed (1x) = 266MB/s. There was 1x & 2x (AGP 1), 4x (AGP 2) and 8x (AGP 3)
PCMCIA 20.0  
CardBus 132.0  
Newcard 250.0 Bidirectional. 60MB/s if USB2 used internally
ExpressCard 200.0 uses USB 2.0 (any of 3 modes) or PCI-Express (1x) internally
PCI 2.0 132.0  
PCI 2.1 264.0  
PCI 2.2 528.0  
PCI-X 1.0 1024.0  
PCI-X 2.0 4300.0 nbsp;
PCI-Express 1.1 200.0 Bidirectional per “lane”. Any number of lanes between points, e.g. 16X is 3.2GB/s. Can extend 5M like USB, and is hotplug.
PCI-Express 2.0 400.0 Bidirectional per “lane”. Any number of lanes between points, e.g. 16X is 6.4GB/s. May extend 10M, and is hotplug.
RapidIO 290.6 Bidirectional per “lane” at 3.125 GBaud. 1x,2x,4x lanes currently supported, with 8x,16x in future.
HyperTransport 1.x 6400.0 Bidirectional per 32 bit link at 800MHz
HyperTransport 2.0 11200.0 Bidirectional per 32 bit link at 1.4GHz
HyperTransport 3.0 20800.0 Bidirectional per 32 bit link at 2.6GHz
Tape    
8mm 0.5  
DLT3XL 1.5  
DLT4 4.0  
SDLT 6.0  
DDS2 0.5  
DDS3 1.5  
DDS4 3.0  
DLT7000 5.0  
AIT2 6.0  
AIT3 12.0  
LTO-1 15.0  
LTO-2 40.0  
LTO-3 80.0  
LTO-4 120.0  
WAN    
DS1 0.193 Also known as T1
DS1C 0.394 Also known as T-1C
DS2 0.789 Also known as T2
DS3 5.592 Also known as T3
DS3D 16.900 Also known as T-3D
DS4 34.300 Also known as T4
E-1 0.256  
E-2 1.056  
E-3 4.296  
E-4 17.408  
E-5 70.644  
OC-1 6.264 assuming sonet overhead of 3.3%
OC-3 18.792 assuming sonet overhead of 3.3%
OC-12 75.168 assuming sonet overhead of 3.3%
OC-48 300.671 assuming sonet overhead of 3.3%
OC-192 1208.688 assuming sonet overhead of 3.3%