Re: создание/удаление миллиона файлов

From

Vlad Gnatov (2:5020/400)

To

Eugene Grosbein

Date

2007-01-14T20:54:34Z

Area

RU.UNIX.BSD

From: Vlad Gnatov <stalker@rm-rf.kiev.ua>

Eugene Grosbein пишет:
EG> Попробовал воспроизвести
EG> http://groups.google.com/group/fido7.ru.unix.bsd/msg/f3aa909c54b394cf
EG> на шестерке и офигел.

EG> Сейчас запустил тот же самый скрипт на FreeBSD 6.2-PRE, Pentium-D 2x2.8Gb,
EG> 1Gb RAM, диск WDC 80G WD800JB-00FMA0 в режиме ATA100 (без TQ),
EG> noasync+softupdates, раздел UFS2, 22G с 2Gb и 2.5 миллионов inode
EG> свободных, ядро SMP, vfs.ufs.dirhash_maxmem: 8388608.
EG> Скорость создания - 666 файлов в секунду против 10000 на четверке.
EG> то есть 6% от прежней. Вот это прогресс...
И снова, шо я делаю нетак?
(Все тот же RELENG_6, x2 4200, 4G, sg 320G ST3320620A)
$mount |grep garbage3
/dev/ad8s1d on /mnt/garbage3 (ufs, local, with quotas, soft-updates)

p.s. Без квоты должно получиться быстрее, но лень пересоберать ведро.

$sh testm
vfs.ufs.dirhash_maxmem: 8388608
creating...
created 20000: 1 sec, 20000 files/sec, vfs.ufs.dirhash_mem: 1608890
created 40000: 2 sec, 20000 files/sec, vfs.ufs.dirhash_mem: 1735353
created 60000: 3 sec, 20000 files/sec, vfs.ufs.dirhash_mem: 1857368
created 80000: 4 sec, 20000 files/sec, vfs.ufs.dirhash_mem: 2041417
created 100000: 5 sec, 20000 files/sec, vfs.ufs.dirhash_mem: 2041417
created 120000: 7 sec, 17142 files/sec, vfs.ufs.dirhash_mem: 2316464
created 140000: 8 sec, 17500 files/sec, vfs.ufs.dirhash_mem: 2316464
created 160000: 9 sec, 17777 files/sec, vfs.ufs.dirhash_mem: 2730061
created 180000: 10 sec, 18000 files/sec, vfs.ufs.dirhash_mem: 2730061
created 200000: 11 sec, 18181 files/sec, vfs.ufs.dirhash_mem: 2730061
created 220000: 12 sec, 18333 files/sec, vfs.ufs.dirhash_mem: 2730061
created 240000: 14 sec, 17142 files/sec, vfs.ufs.dirhash_mem: 3349430
created 260000: 15 sec, 17333 files/sec, vfs.ufs.dirhash_mem: 3349430
created 280000: 16 sec, 17500 files/sec, vfs.ufs.dirhash_mem: 3349430
created 300000: 17 sec, 17647 files/sec, vfs.ufs.dirhash_mem: 3349430
created 320000: 18 sec, 17777 files/sec, vfs.ufs.dirhash_mem: 3349430
created 340000: 21 sec, 16190 files/sec, vfs.ufs.dirhash_mem: 4280026
created 360000: 22 sec, 16363 files/sec, vfs.ufs.dirhash_mem: 4280026
created 380000: 23 sec, 16521 files/sec, vfs.ufs.dirhash_mem: 4280026
created 400000: 25 sec, 16000 files/sec, vfs.ufs.dirhash_mem: 4280026
created 420000: 26 sec, 16153 files/sec, vfs.ufs.dirhash_mem: 4280026
created 440000: 27 sec, 16296 files/sec, vfs.ufs.dirhash_mem: 4280026
created 460000: 28 sec, 16428 files/sec, vfs.ufs.dirhash_mem: 4280026
created 480000: 33 sec, 14545 files/sec, vfs.ufs.dirhash_mem: 5674892
created 500000: 34 sec, 14705 files/sec, vfs.ufs.dirhash_mem: 5674892
created 520000: 35 sec, 14857 files/sec, vfs.ufs.dirhash_mem: 5674892
created 540000: 36 sec, 15000 files/sec, vfs.ufs.dirhash_mem: 5674892
created 560000: 37 sec, 15135 files/sec, vfs.ufs.dirhash_mem: 5674892
created 580000: 38 sec, 15263 files/sec, vfs.ufs.dirhash_mem: 5674892
created 600000: 40 sec, 15000 files/sec, vfs.ufs.dirhash_mem: 5674892
created 620000: 41 sec, 15121 files/sec, vfs.ufs.dirhash_mem: 5674892
created 640000: 42 sec, 15238 files/sec, vfs.ufs.dirhash_mem: 5674892
created 660000: 44 sec, 15000 files/sec, vfs.ufs.dirhash_mem: 5674892
created 680000: 45 sec, 15111 files/sec, vfs.ufs.dirhash_mem: 5674892
created 700000: 46 sec, 15217 files/sec, vfs.ufs.dirhash_mem: 5674892
created 720000: 55 sec, 13090 files/sec, vfs.ufs.dirhash_mem: 7766677
created 740000: 56 sec, 13214 files/sec, vfs.ufs.dirhash_mem: 7766677
created 760000: 57 sec, 13333 files/sec, vfs.ufs.dirhash_mem: 7766677
created 780000: 59 sec, 13220 files/sec, vfs.ufs.dirhash_mem: 7766677
created 800000: 60 sec, 13333 files/sec, vfs.ufs.dirhash_mem: 7766677
created 820000: 61 sec, 13442 files/sec, vfs.ufs.dirhash_mem: 7766677
created 840000: 62 sec, 13548 files/sec, vfs.ufs.dirhash_mem: 7766677
created 860000: 63 sec, 13650 files/sec, vfs.ufs.dirhash_mem: 7766677
created 880000: 64 sec, 13750 files/sec, vfs.ufs.dirhash_mem: 7766677
created 900000: 66 sec, 13636 files/sec, vfs.ufs.dirhash_mem: 7766677
created 920000: 67 sec, 13731 files/sec, vfs.ufs.dirhash_mem: 7766677
created 940000: 68 sec, 13823 files/sec, vfs.ufs.dirhash_mem: 7766677
created 960000: 69 sec, 13913 files/sec, vfs.ufs.dirhash_mem: 7766677
created 980000: 70 sec, 14000 files/sec, vfs.ufs.dirhash_mem: 7766677
created 1000000: 71 sec, 14084 files/sec, vfs.ufs.dirhash_mem: 7766677
removing...removed: 44 sec, 22727 files/sec
-- 
Отправлено через сервер Форумы@mail.ru - http://talk.mail.ru
--- ifmail v.2.15dev5.3
 * Origin: Talk.ru (2:5020/400)
SEEN-BY: 50/12 400/814 450/159 1024 461/43 132 640 469/999 4616/3 4625/8
SEEN-BY: 4641/444 5000/76 5000 5006/1 5007/1 5010/70 5011/13 5012/46 5015/28
SEEN-BY: 5019/26 5020/18 175 194 400 545 982 1057 1909 1922 2238 2395 2871
SEEN-BY: 5020/4441 5021/29 5025/3 5026/14 45 5027/12 5030/1080 1957 5034/10 13
SEEN-BY: 5035/38 5036/1 5045/7 5049/1 5051/15 5054/1 4 8 9 11 28 35 36 37 45
SEEN-BY: 5054/66 67 70 75 84 85 5059/9 5060/88 5061/15 5062/10 5063/3 5064/7
SEEN-BY: 5066/18 5075/5 5076/1 5077/70 5084/9 5085/13 5095/20 5096/18 6001/10

PATH: 5020/400 545 5054/1 37