Re: 3PAR 7400 Performance Expectations (824 Views)
Reply
Occasional Advisor
Shrek71
Posts: 10
Registered: ‎08-14-2013
Message 1 of 9 (943 Views)

3PAR 7400 Performance Expectations

Hi

 

I'm new to 3PAR and new to this board but I need help setting my expectations about what performance the a 3PAR 7400 4-node with 2 disk shelves can achieve. The array has with 96 900GB 10K SAS drives. These drives support approximately 140 IOPS, so 96 of them should give me 6720 IOPS (allowing for a write penalty of 2 becuase the CPG is RAID1)

 

I just set this up a RAID1 CPG and created a 16TB TPVV

I'm using Centos 6.4 on the host (BL 465c G8: 32 core AMD with 128GB RAM)

MTU on NICs and 3PAR set to 9000

 

BL 465c G8 -> 10Gb pass through module -> HP 5800 switch -> HP 3PAR 7400.

 

A quick test using dd gives the following: 

 

root@c7k1hv3 ~]# dd bs=1M count=512 if=/dev/zero of=/mnt/tmp/test2 conv=fdatasync
512+0 records in
512+0 records out
536870912 bytes (537 MB) copied, 2.35333 s, 228 MB/s
[root@c7k1hv3 ~]#

 

Is this considered a good result? I think not given that the array is doing nothing and I have a "shed load" of IOPS, however I'm new to 3PAR and SANs in general - (background is networks and systems)

I limited the server to only seeing a single target on the 7400 4-node to avoid any multipathing complications.

 

Thanks in advance for any feedback, comments or guidance.

Please use plain text.
HP Pro
Jason_L
Posts: 52
Registered: ‎07-01-2003
Message 2 of 9 (934 Views)

Re: 3PAR 7400 Performance Expectations

I would be intereted to see the test results..

 

1.  With multipathing and load balancing across at least 2 paths.

2.  With varying block sizes.  In your test you used 1M bs, have you tied smaller bs's?

 

-Jason

I work for HP.
Please use plain text.
Occasional Advisor
Shrek71
Posts: 10
Registered: ‎08-14-2013
Message 3 of 9 (910 Views)

Re: 3PAR 7400 Performance Expectations

Hi Jason, Members

 

Here's a summary of through using different byte sizes.

 

BS               Count        Throughput

==========================

1M             1024            227 MB/s

512K        2048            222 MB/s

256K        4096            231 MB/s

128K        8096            226 MB/s

64K          16192          229 MB/s

8K             128000       215 MB/s

4K             256000       209 MB/s

 

Command: dd bs=BS count=Count if=/dev/zero of=/mnt/tmp/test conv=fdatasync

 

I'll add in a second path and repeat the test.

 

Thanks for replying.

Please use plain text.
Occasional Advisor
Shrek71
Posts: 10
Registered: ‎08-14-2013
Message 4 of 9 (902 Views)

Re: 3PAR 7400 Performance Expectations

[ Edited ]

I added in a second path and repeated the test.

 

Recap on setup from server to switch:

 

HP BL465c in Bay 3

Eth0 mapping to PTM internal port 3 which is connected to swith-a-port 3-vlan83

Eth1 mapping to PTM internal port 3 which is connected to swith-b-port 3-vlan84

Switch a and b are not connected.

 

3PAR is connected to the switches as follows:

0:2:1          Switch A Port 41             192.168.83.201

0:2:2          Switch B Port 41             192.168.84.202

1:2:1          Switch A Port 43             192.168.83.211

1:2:2          Switch B Port 43             192.168.84.212

2:2:1          Switch A Port 45             192.168.83.221

2:2:2          Switch B Port 45             192.168.84.222

3:2:1          Switch A Port 47             192.168.83.231

3:2:2          Switch B Port 47             192.168.84.232

 

In the original post, I only had an iscsi mapping to Node 0 port 1. For the multipath test, I added a mapping to Node 1 port 2. 

 

View from the server.

 

[root@c7k1hv3 ~]# multipath -ll
mpathb (360002ac0000000000000000200004983) dm-4 3PARdata,VV
size=16T features='1 queue_if_no_path' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
|- 7:0:0:0 sdb 8:16 active ready running
`- 8:0:0:0 sdc 8:32 active ready running
[root@c7k1hv3 ~]# arp -a

? (192.168.83.201) at 2c:27:d7:53:e9:3e [ether] on eth0
? (192.168.84.212) at 2c:27:d7:53:e9:ea [ether] on eth1
[root@c7k1hv3 ~]#

 

The second path didn't make any noticable difference.

 

BS             Count                  Throughput

==========================

1M            1024                    233 MB/s

512K       2048                    225 MB/s

256K       4096                    234 MB/s
128K       8192                    224 MB/s
64K       16384                    234 MB/s
8K       128000                    215 MB/s
4K       256000                   191 MB/s

 

WRT the server iSCSI setup, I followed the directions in the HP 3PAR RHEL and Oracle implementation guide.

 

Let me know if you want me to upload any config files.

Please use plain text.
Honored Contributor
Sheldon Smith
Posts: 889
Registered: ‎07-27-2003
Message 5 of 9 (893 Views)

Re: 3PAR 7400 Performance Expectations

A common misconception. A single IO stream is the worst possible test. The 3PAR is designed for multiple IO streams and multiple workloads. Get and set up IOMeter.

 

Get a couple of servers (2 beefy should be able to easily do it). Create 8 VVs per server (full or thin) on FC drives. Make sure the VVs are big enough that you are hitting all the disks. Create half, make a really large VV so the other test VVs are some distance away from the first ones. Prevents short-stroking.

 

Load IOMeter.
Under Access Specifications, create a new test:

 * Name: 3PAR
 * Transfer Request Size: 8KB
 * Percent of Access Specification: 100%
 * Percent Read/Write Distribution: default
 * Percent Random/Sequential Dist: 100% Random
 * Align I/Os on 16 KB boundaries
 * Align block size = 16k.

 

You want 4 – 8 workers per CPU core.


Note: While I work for HP, all of my comments (whether noted or not), are my own and are not any official representation of the company.
----------
If my post was useful, click on my KUDOS! "White Star" !

Please use plain text.
HP Pro
Jason_L
Posts: 52
Registered: ‎07-01-2003
Message 6 of 9 (888 Views)

Re: 3PAR 7400 Performance Expectations

Agree with Sheldon about the comment to how DD inheriently works.  With the DD my understanding is you are basically doing a sequential "single-threaded" operation, which althought not completely without merit doesn't necessarily refelct the "real world" - w/ multiple data streams of varying R/W percentages and varying block sizes.

 

Generally speaking IOP "ratings" are based on certain R/W percentages @ a certain block size average. But even then IOPS are only part of the story and throughput (KB/s),  with the block size in mind is also an important measurement.

 

Various tools are availabe to generate and test a this "real world" I/O as Sheldon mentions as well. 

 

-Jason

 

 

 

 

 

 

I work for HP.
Please use plain text.
Acclaimed Contributor
Torsten.
Posts: 23,132
Registered: ‎10-02-2001
Message 7 of 9 (886 Views)

Re: 3PAR 7400 Performance Expectations

Agreed, "dd" is probably the worst performance measurement tool ;-)

BTW, if you write only zeros to the array, it is not even writing a lot to the disks ...

Hope this helps!
Regards
Torsten.

__________________________________________________

There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________

No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! star in the left column!   
Please use plain text.
Occasional Advisor
Shrek71
Posts: 10
Registered: ‎08-14-2013
Message 8 of 9 (867 Views)

Re: 3PAR 7400 Performance Expectations

Thanks to everyone for their comments advice. I'll get iometer installed next week however the reason I was using dd is twofold:

 

1) a lot of people still use it for a simple benchmarking exercise and my expectations were set by (2)

2) when the array was configured as RAID 5 - magazine level redundancy - I got better better results?

 

root@ftest:~# dd bs=1M count=512 if=/dev/zero of=test conv=fdatasync

512+0 records in

512+0 records out

536870912 bytes (537 MB) copied, 1.38168 s, 389 MB/s

 

I expected a move to RAID1 to increase performance, not decrease it. 

 

For the record, I created 16 VM on the server and re-ran the 'dd' command simultaneously -  I got approx 70MB/s throughput per VM which is very respectible....it's close to 900Mbps! 

 

Thank you all again for your time and comments. I will definitely explore iometer when resources permit (no windows machine to hand) and update this post.

Please use plain text.
HP Pro
Prakash Singh_1
Posts: 180
Registered: ‎11-25-2010
Message 9 of 9 (824 Views)

Re: 3PAR 7400 Performance Expectations

Hi,

 

For HP 3PAR storage system querries you can also visit the HP Guided troubleshooting tree.

 

Below is the link for 3PAR HPGT:

http://h20180.www2.hp.com/apps/Nav?h_pagetype=s-905&h_lang=en&h_cc=us&h_product=304617&h_audience=sm...

 

Please use plain text.
The opinions expressed above are the personal opinions of the authors, not of HP. By using this site, you accept the Terms of Use and Rules of Participation