OpenWRT - Mellanox ConnectX-3 10GbE SFP+ Network Adapter ft. Zimaboard

I want to build an x86 OpenWRT router PC with low power consumption. At the same time, the router must has a SFP/SFP+ port because I plan to replace the ISP provided fiber optic modem with a SFP GPON module.
Therefore, I decided to give a try with the Zimaboard and the Mellanox ConnectX-3 (OCP form factor, converted to PCIe x4 with an adapter). Unfortunately, with the kmod-mlx4-core kernel module, only 1 network port is working regardless it is a single port or dual port NIC.

Video timeframe:
00:00 - Mellanox ConnectX-3 & ZimaBoard SBC Introduction
03:31 - Build OpenWRT firmware with kmod-mlx4-core (supports ConnectX-3)
04:48 - Write the OpenWRT firmware to USB drive
05:25 - Connect cables & Boot up the Zimaboard
08:00 - Acces LuCI & Setup WAN connection
11:01 - iperf3 test (PC to Router)
11:18 - iperf3 test with power consumption
11:41 - iperf3 test (Reverse mode - Router to PC)
12:04 - Test with MTU 9000
13:45 - Test the Mellanox ConnectX-3 with a 1.25G SFP module
15:30 - iperf3 test on Ubuntu

That's all for this video. Thanks for watching and see you all!

[eliotcole]

This is what I'm looking for, I think. This as my router, with a mikrotik 10gb switch in switch mode, I should have minimal bottlenecks for my casual use cases. 😊

Thank you!

[johncnorris]

This was an interesting test. I'd like to see the dmesg output for the dual SFP port card too.

[boumarc]

also for iperf3 test please try to run several TCP connections in parallel with -P4 or something similar to see if there is any throughput improvement (multiple flows can be processed in parallel on different queues/cpu threads). Trying with UDP with -u -b10g would be interesting too.

[rashedobaid]

Hi! I have been looking to connect a gpon/xpon module directly to my router (opnsense) what sfp+ cards support those modules? I heard that not all cards are compatible.

[kovalsky]

Am I crazy, or did you get 10G speed with an 1.25G optical module in the Mellanox SFP port? You said 10G optical cable, so I'm a bit lost here…

[boumarc]

for the jumbo frame test did you set the mtu to 9000 on the zuma side too ?

[salat]

Jumbo frames make only sense when enabled on both hosts in your example.

[xerkstyle]

so i can have 10gbe with a zimaboard/zimablade set as a router/firewall for home networking using this card?

[dfgdfg_]

Did you stop using the Mellanox and replace it with a media converter? I am thinking about testing a Gowin R86S which has this Mellanox board.

[artemshemyakin]

hi, did you try to connect a GPON SFP module to these adapters? Do they support 2.5Gb/s link speed?

[brighteduacation]

is it possible for to test dual port SFP + on zima board with pfsense?

[cutecouple]

Bác cho e zalo em hỏi tý được không ạ, em muốn setup proxy cho router có trả phí