Linux Storage Benchmarking With FIO

Forum post referenced in video:

Connecting With Us
---------------------------------------------------

Lawrence Systems Shirts and Swag
---------------------------------------------------

AFFILIATES & REFERRAL LINKS
---------------------------------------------------
Amazon Affiliate Store

UniFi Affiliate Link

All Of Our Affiliates that help us out and can get you discounts!

Gear we use on Kit

Use OfferCode LTSERVICES to get 5% off your order at

Digital Ocean Offer Code

HostiFi UniFi Cloud Hosting Service

Protect you privacy with a VPN from Private Internet Access

Patreon

⏱️ Timestamps ⏱️
00:00 Linux Storage Benchmarking
02:24 Getting Started with FIO
03:21 Block Size, IOPs and Throughput
05:48 IOTOP
06:22 FIO Example Commands
10:31 Phoronix Test Suite

#Storage #Linux #FIO

[nandurx]

Why not make a video on ZFS data set tuning on truenas?

[esarworks]

hi, , might be worth mentioning that fio can destroy data in disk if not used properly. cutting an pasting commands makes it too easy to do harm on a running system.

[bradleyeverson]

Great how to video. I take it that since true-nas is open source platform you can run these scripts you highlighted. When it comes to synology nas systems you have to use their built in tool sets. Which would make true-nas better in the sense that you can generate reports unique to your system setup. Is my understanding here correct?

[didjeri]

Lately I'm pretty frustrated with TrueNAS, having it virtualized (proxmox) and attached/passthrough my SAS controller, I only manage to get 20-30Mbps of transfer speed (13x 10TB Raidz2 setup) and I don't know whats going on. My 12 old Synology keeps a steady +-100Mbps transfer speed.

I know it's very vague and all, but do you - or the community have an Idea what I'm doing wrong, how I could speed up my NAS?

Thanks

[keyboard_g]

Latency of storage is big for end users.

[ierosgr]

An old video but I m going to give it a shot. So I am running fio with other parameters and engine (not even sure are the correct ones but its not the point here) like
fio --directory=/mnt/test/ --name=async_randwrite --rw=randwrite --bs=4k --direct=1 --sync=0 --numjobs=1 --ioengine=psync --iodepth=1 --refill_buffers --size=1G
My issues are:
where do I run fio? If the VM storage I want to test is in HHproxVM for instance, should I fist cd to that storage cd /HHproxVM and then run fio from there or run it from the boot-pool and specify as directory=/HHproxVM/mnt/test instead of /mnt/test

I had very weird results by changing only the directory option like below
fio --directory=/mnt/test/ --name=async_randwrite --rw=randwrite --bs=4k --direct=1 --sync=0 --numjobs=1 --ioengine=psync --iodepth=1 --refill_buffers --size=1G
Result:
WRITE: bw=149MiB/s (156MB/s), 149MiB/s-149MiB/s (156MB/s-156MB/s), io=1024MiB (1074MB), run=6884-6884msec

fio --name=async_randwrite --rw=randwrite --bs=4k --direct=1 --sync=0 --numjobs=1 --ioengine=psync --iodepth=1 --refill_buffers --size=1G
Result (didn t even finish after 30 min!!! and the bw and iops are less)
async_randwrite: Laying out IO file (1 file / 1024MiB)
Jobs: 1 (f=1): IOPS][eta 12m:56s

What am I missing here?

[bharaths]

can you plz create a video how to use gpu related ioengines in fio

[slipknottin]

Unrelated to this. But question, could you do a guide some time about how to get things like streaming devices to work across different vlans? I put my iot devices on a different vlan using your guide. But now if I want to cast to the streaming device from my phone I have to switch the wifi network on my phone to the iot vlan, then switch back after I’m done. Has to be a better way.