Follow along with the video below to see how to install our site as a web app on your home screen.
Note: This feature may not be available in some browsers.
So, if my goal is to get 8 PCIE cards working off a single motherboard, instead of trying to use every available slot and then splitting the last one one or two, I should instead only use slot combination that motherboard can provide with 16 lanes per slot and then use two of your x4x4x4x4 splitters? I don't see any x8 to dual x4 splitters with power connectors. This approach actually widens the motherboard selection quite a bit.2)no, one will work at x8 and the other one will get x0
Damn, how did I miss your store link. I see you even have PLX splitters there, I wonder how those would show up in VFIO grouping for passthrough.I do have an x4x4 card. https://peine-braun.net/shop/index.php?route=product/category&path=65_67
An x4x4x4x4 in the first slot would still be preferable I guess.
Your BIOS/CPU must be capable of supporting this though. Need to verify that first!
How difficult would it be to make something like this but in M.2 format (x4 -> x4x4 or x4->x4x4x4x4 for instance)?
Would the temperature and size be the only problem here? I am seriously tempted to try connecting your bigger PLX board to an M.2 slot via an ADT M.2->PCI x4 cable unless you can tell it is not going to work on just 4 lanes right away.Physical placement of all necessary components and the temperature of the PLX chip.
Need a smaller device, with less power consumption. (less power rails as well!)
Curious how this would ideally be installed? Love the product of course, super neat stuff. This is the one designed for the NCASE I believe. Any pics of the install by chance?C_Payne, I received the x8/m.2/m.2 riser and put it through its paces. It works beautifully!
View attachment 330910
View attachment 330911
Full passthrough for pcie x8 and a pair of m.2s in a low profile footprint. It's a work of art.
Curious how this would ideally be installed? Love the product of course, super neat stuff. This is the one designed for the NCASE I believe. Any pics of the install by chance?
It's actually designed for the U-NAS NSC-800, but should work in any other situation where you want to run a low-profile x8 card and still use the rest of the lanes. It's a tiny NAS case that fits a mini-itx motherboard and 8x 3.5" drives.
The bifurcating riser is connected to the motherboard, and a short length of flex riser goes from that riser to a LSI9211-8i SAS2 card installed in an offset position. Across the top is a Mellanox Connectx-3 in a 3d-printed retainer bracket, connected to the motherboard's m.2 slot through a m.2 to pcie x4 adapter.
In total, in that small case, I have the motherboard/cpu/memory, 8x 4TB SAS2 drives, 2x 2.5" SSDs, 2x nvme drives, a SAS2 card, a Connectx-3 card and a pair of 120mm fans.
About as packed as it can get for a case that's 12"x10"x7" (~13.7 liters)
Shame its not sold anymore by the looks of it.
I had never heard of the U-NAS cases before, but they are pretty sweet. I like the 810A idea, and also maeslin, your build out is awesome!
Uhm, I just checked their page again. It's "R83SR" I can't find the "RS83R". I think they are the same thing though, maybe a misspelling.C_Payne Can I get your recommendation on what riser to use with your x8x4x4 in the nCase M1 please?
You mention "R83SR" on your site, but I can't find one on their page: http://www.adt.link/x16.html
There seems to be two possibilities on http://www.adt.link/product/R83.html
RS83R - I think a 10cm one could bend straight down from the second slot on the riser, go underneath the GPU, and bend over in a way that allows getting the horiztonal placement of the slot right
RS83L - A short one (maybe 5cm) might work too - but I fear it means the loop now has to go up in between the main GPU and low-profile card.
You're right, sorry not sure why I put the 'S' in the wrong place.Uhm, I just checked their page again. It's "R83SR" I can't find the "RS83R". I think they are the same thing though, maybe a misspelling.
Make sure to use the "R" one and not the "L" one as that one won't fit.
Yes, the left turn one will interfere with the mobo.You're right, sorry not sure why I put the 'S' in the wrong place.
So you're saying the R83SR, presumably because it can be folded over to get the right spacing, while then putting the slot in the right orientation?
That's awesome!I will have them back in stock in 3 weeks or so. gen4 should be good, if you are not planning to add a cable.
That adapter is amazing!C_Payne, I received the x8/m.2/m.2 riser and put it through its paces. It works beautifully!
View attachment 330910
View attachment 330911
Full passthrough for pcie x8 and a pair of m.2s in a low profile footprint. It's a work of art.
Running multiple GPUs off a single M.2 slot (4 lanes) is a bad idea.That adapter is amazing!
What if it were used with two of these:
https://www.amazon.com/gp/product/B08CX7FWHC/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1
View attachment 340401
I'm using one of these right now on the thin client in my sig with a standard PCI-E to M.2 (PCI-E 4x) adapter, but with the adapter above, that could potentially allow for up to three GPUs or PCI-E devices off of one 16x slot, assuming one of these on each side, plus the slot on top.
It wouldn't be doing that, though, GPU0 would be on the PCI-E adapter itself (4x), then GPU1 and GPU2 would be on the two side M.2 slots to that adapter I posted (each 4x).Running multiple GPUs off a single M.2 slot (4 lanes) is a bad idea.
Bifurcation is out of the question: no 4x->??? risers that I know of, and I highly doubt your motherboard has support for it.
That leaves PLX but it would be very slow AND very expensive.
I don't think a 16x->? bifurcation riser (like the one maeslin has) would work on a 4x slot (like the one on a M.2 -> PCIE 4x adapter). 12 of those 16 pins are disconnected.It wouldn't be doing that, though, GPU0 would be on the PCI-E adapter itself (4x), then GPU1 and GPU2 would be on the two side M.2 slots to that adapter I posted (each 4x).
The power draw would primarily being going through the additional PSUs for the adapters.
Also, I'm only using the one adapter that I posted, not the whole thing - that was just a suggestion and possibility, and I see no reason it wouldn't work if a motherboard had support for bifurcation.
I never said my motherboard specifically had support for it, which it doesn't since it is only PCI-E 2.0 4x.
I think I am transposing my words, and you are right.I don't think a 16x->? bifurcation riser (like the one maeslin has) would work on a 4x slot (like the one on a M.2 -> PCIE 4x adapter). 12 of those 16 pins are disconnected.
[ 2268.015030] pcieport 0000:00:03.1: AER: Multiple Corrected error received: 0000:07:00.0
[ 2268.015037] pcieport 0000:00:03.1: AER: PCIe Bus Error: severity=Corrected, type=Data Link Layer, (Transmitter ID)
[ 2268.015041] pcieport 0000:00:03.1: AER: device [1022:1483] error status/mask=00001000/00004000
[ 2268.015045] pcieport 0000:00:03.1: AER: [12] Timeout
[ 2268.015051] vfio-pci 0000:07:00.1: AER: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Receiver ID)
[ 2268.015055] vfio-pci 0000:07:00.1: AER: device [10de:1aef] error status/mask=00000001/00000000
IOMMU Group 18:
07:00.0 VGA compatible controller [0300]: NVIDIA Corporation Device [10de:2206] (rev a1)
07:00.1 Audio device [0403]: NVIDIA Corporation Device [10de:1aef] (rev a1)
IOMMU Group 19:
08:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP108 [10de:1d01] (rev a1)
08:00.1 Audio device [0403]: NVIDIA Corporation GP108 High Definition Audio Controller [10de:0fb8] (rev a1)
AER = advanced error reportingC_Payne - I'm trying your bifurcator for the first time in a new way - passing through two different GPUs, to two different VMs, at the same time (whereas previously the guest had one, and the host had one).
What's really peculiar is that I can passthrough both GPUs to a *one* VM fine. But if I passthrough to two different guest VMs, I get an instant crash of the machine.
I've ensured BIOS set to Gen 3 PCI. IOMMU groups show the GPUs in different groups.
If it were a power issues presumably that wouldn't be anything to do if it were one VM or two. So I'm really scratching my head. There's nothing to go on in the logs - and just completely and instantly kills the host OS.
One thing I did try was enabling 'AER' in the BIOS, although I'm not exactly sure what that does. When I turned that on my guest logs are spammed with correction logs:
Code:[ 2268.015030] pcieport 0000:00:03.1: AER: Multiple Corrected error received: 0000:07:00.0 [ 2268.015037] pcieport 0000:00:03.1: AER: PCIe Bus Error: severity=Corrected, type=Data Link Layer, (Transmitter ID) [ 2268.015041] pcieport 0000:00:03.1: AER: device [1022:1483] error status/mask=00001000/00004000 [ 2268.015045] pcieport 0000:00:03.1: AER: [12] Timeout [ 2268.015051] vfio-pci 0000:07:00.1: AER: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Receiver ID) [ 2268.015055] vfio-pci 0000:07:00.1: AER: device [10de:1aef] error status/mask=00000001/00000000
IOMMU groups:
Attach filesCode:IOMMU Group 18: 07:00.0 VGA compatible controller [0300]: NVIDIA Corporation Device [10de:2206] (rev a1) 07:00.1 Audio device [0403]: NVIDIA Corporation Device [10de:1aef] (rev a1) IOMMU Group 19: 08:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP108 [10de:1d01] (rev a1) 08:00.1 Audio device [0403]: NVIDIA Corporation GP108 High Definition Audio Controller [10de:0fb8] (rev a1)
Thanks inf3rno - what I'm not clear on is if AER is uncovering, or causing issues? I mean, I have the problem before enabling AER, so wondering if this is explaining it?AER = advanced error reporting
If it is what the name says then it does not cause issues, it just reports more errors if you turn it on. I guess the corrected errors are not a big issue and you need to look for the not correctable errors, but I don't know much about what's normal in the case of PCIE.Thanks inf3rno - what I'm not clear on is if AER is uncovering, or causing issues? I mean, I have the problem before enabling AER, so wondering if this is explaining it?
If it is what the name says then it does not cause issues, it just reports more errors if you turn it on. I guess the corrected errors are not a big issue and you need to look for the not correctable errors, but I don't know much about what's normal in the case of PCIE.
What kind of card do you use? Do you have this error only in VM?I just tried this - I removed the bifurcator, turned the BIOS back to x16, and the AER error disappear (even though AER is still enabled).
When I try x8x8 and just have one GPU (no nvme drive or second GPU), the AER errors return. And not just a few - the logs are completely full of them.
Wait, does this mean it is possible to add bifurcation to mobos with Intel chipsets too? Or is it just that in the case of some boards the manufacturer was too lazy to enable it, but it is already supported for boards with the same chipset?I’m using AmiBcp 5.02 and on my board there really is no security. I’m just confused why there are four IO divisions with each one having their own IOU 0-2 controller reference and each one of those four IO divisions have 11 pcie slices. If you find 5.02 take a look.
Thanks
I just asked because if you don't have the error in the logs outside the VM, then it can be a VM related issue, but if you got them, then I think this is hardware related and your card is junk. At least 90% chance, that we are talking about the latter case. Actually this is what I am struggling with too, I cannot find a decent 2x8 passive card in the EU, all I could do is ordering one from C_Payne here and who knows how bad shipping prices, customs, VAT, etc. would be.I just tried this - I removed the bifurcator, turned the BIOS back to x16, and the AER error disappear (even though AER is still enabled).
When I try x8x8 and just have one GPU (no nvme drive or second GPU), the AER errors return. And not just a few - the logs are completely full of them.
This Chinese stuff looks like exactly what I need: https://www.ruten.com.tw/item/show?22030929704581 But $1200 is a joke for a passive card. Are they nuts? Or is it $1.2 lol? Quality does not look like the best though.Hello, Tilde, I am already give up to use ameri-rack to retrieve a flexible 2*8 risers, I am also have the requirements to getting 4*10Gb SFP+ and also 4*1Gb POE(48v) ports.
And Now I am not using flexible riser but using a fixed 2*8 riser.
I'd like to post a URL for you to buy, but comes from China.
And besides, I am also ask for someone designing a custom ITX-box for two 2*8 PCI-E card(Full height).
You may be interesting
View attachment 149052
View attachment 149053 View attachment 149054
View attachment 149055