Personal computing discussed

Moderators: renee, JustAnEngineer

 
Airmantharp
Emperor Gerbilius I
Posts: 6192
Joined: Fri Oct 15, 2004 10:41 pm

Re: FreeNAS I̶n̶t̶e̶l̶ ̶8̶0̶8̶6̶k̶ AMD Threadripper upgrade!

Thu Oct 04, 2018 2:59 pm

Waco wrote:
??? I thought BSD drivers for those Aquantia chipsets didn't exist! If they do work in FreeNAS, damn, I'm game.


It's in a Hyper-V VM ;)

[which works quite well with FreeNAS and ZFS- used it with ZoL systems too, only one I wish I could use is Unraid, but I have no interest in tying a machine's ability to boot and provide services to a perishable USB drive]
 
Waco
Gold subscriber
Grand Gerbil Poohbah
Topic Author
Posts: 3103
Joined: Tue Jan 20, 2009 4:14 pm
Location: Los Alamos, NM

Re: FreeNAS I̶n̶t̶e̶l̶ ̶8̶0̶8̶6̶k̶ AMD Threadripper upgrade!

Thu Oct 04, 2018 3:33 pm

Aha, of course. I didn't think of virtualizing it. Nice trick!

I triple-mirror my boot device for FreeNAS due to that reason. :)
Desktop: X570 Gaming X | 3900X | 32 GB | Alphacool Eisblock Radeon VII | Heatkiller R3 | Samsung 4K 40" | 1 TB NVME + 2 TB SATA + LSI (128x8) RAID
NAS: 1950X | Designare EX | 32 GB ECC | 7x8 TB RAIDZ2 | 8x2 TB RAID10 | FreeNAS | ZFS | LSI SAS
 
Airmantharp
Emperor Gerbilius I
Posts: 6192
Joined: Fri Oct 15, 2004 10:41 pm

Re: FreeNAS I̶n̶t̶e̶l̶ ̶8̶0̶8̶6̶k̶ AMD Threadripper upgrade!

Thu Oct 04, 2018 5:47 pm

Waco wrote:
Aha, of course. I didn't think of virtualizing it. Nice trick!

I triple-mirror my boot device for FreeNAS due to that reason. :)


I first started out with it by doing random wacky things with virtualization, and I'm pretty confident in the solution for enthusiast use.

Virtualbox would likely work too but I stopped using it after I installed Hyper-V, as they're somewhat exclusive on the same machine due to desiring access to virtualization extensions.

I've also found Storage Spaces to not be terrible, but it's also not quite fully baked.

I built two arrays:
-a 4x 8TB single-parity array made up of shucked SMR Seagates
-a 4x 6TB Ironwolf double-parity array with 2x500GB SATA SSD for cachine

The first array could be built pretty much anywhere. It's currently setup with Storage Spaces and formatted with a single full-size ReFS volume, and shared out as a backup target. I've also considered it as a downloads folder, but not sure I need it for that yet.

The second array I could never get Storage Spaces to set up with the drives with caching and format with ReFS. To me, the journaling capabilities of ReFS are the real draw of Storage Spaces, so I used ZFS instead, and arrived at FreeNAS after trying multiple BSD- and Linux-based NAS distributions.

As for the boot drive, I need to get on that... I'm actually out of SATA ports after having had added a cheap 4-port HBA, and it looks like I should probably add a larger HBA, likely an LSI server pull in IT mode.
 
prb123
Gerbil
Posts: 43
Joined: Wed Apr 25, 2007 10:04 pm

Re: FreeNAS I̶n̶t̶e̶l̶ ̶8̶0̶8̶6̶k̶ AMD Threadripper upgrade!

Thu Oct 04, 2018 8:47 pm

dragontamer5788 wrote:
I'm halfway thinking of buying a cheap SPF+ Mellanox card off of Ebay for like $25, some direct-attach fibers and have a point-to-point between my NAS and Desktop. I mean


This is not very expensive anymore. Can get new SPF+ DA cable or transceivers from FS.com super cheap now. This is the route I went to attach our new 2 Node VSAN. Direct Attach 40GB between nodes, 2x 10GB from each server to a central Cisco 4900m with Intel/Cisco fiber transceivers.

https://www.fs.com/c/mellanox-qsfp-dac-2252
https://www.fs.com/products/36431.html
https://www.fs.com/products/11751.html
https://www.fs.com/products/40280.html

On a threadjacking note...is anyone familiar with the different Operating Systems some of their switches offer?
https://www.fs.com/products/69342.html
 
Airmantharp
Emperor Gerbilius I
Posts: 6192
Joined: Fri Oct 15, 2004 10:41 pm

Re: FreeNAS I̶n̶t̶e̶l̶ ̶8̶0̶8̶6̶k̶ AMD Threadripper upgrade!

Sat Oct 06, 2018 12:20 am

So, I just moved the 4x 8TB drives to the FreeNAS VM, now as a RAIDZ2 (double parity). Storage Spaces worked but was slow and a bit inflexible with these drives in parity, whereas ZFS doesn't seem to have an issue. Backups went a lot faster, I'm trying out Veeam's free Windows agent and will attempt to try their free Linux agent soon.
 
Waco
Gold subscriber
Grand Gerbil Poohbah
Topic Author
Posts: 3103
Joined: Tue Jan 20, 2009 4:14 pm
Location: Los Alamos, NM

Re: FreeNAS I̶n̶t̶e̶l̶ ̶8̶0̶8̶6̶k̶ AMD Threadripper upgrade!

Sat Oct 06, 2018 8:42 pm

Up and running with essentially zero hiccups on the new Gigabyte board. Transcoding ~70 Mbps 4K to 65 Mbps 4K (to embed subtitles) in Plex just works. :)

I'm bad about pictures this time around since I just wanted the damn thing to work. I have lots of pictures from building up the other board, but whatever. Pretend this one is really a Gigabyte board and that it worked the first time:
https://photos.app.goo.gl/fqaRomc7zJEbZi9NA :P


The last shot I took of the actual build before I put it back downstairs: https://photos.app.goo.gl/XQUJCPV6YDbRRXZW9

Threadripper boards are HEAVY, btw. Just the board itself is easily 2-3 times as heavy as the outgoing ASRock workstation board I pulled out.

The office wall needs some new boards on it so the old board is likely becoming a work buddy's new NAS, and I'll get his old stuff to adorn the wall: https://photos.app.goo.gl/pxLu7FDQxzm1jGAr7 99% of the hardware on it is either stuff I've gotten in exchange for "upgrades" I've given away or hardware we've killed over the course of 20 years of overclocking. :)
Desktop: X570 Gaming X | 3900X | 32 GB | Alphacool Eisblock Radeon VII | Heatkiller R3 | Samsung 4K 40" | 1 TB NVME + 2 TB SATA + LSI (128x8) RAID
NAS: 1950X | Designare EX | 32 GB ECC | 7x8 TB RAIDZ2 | 8x2 TB RAID10 | FreeNAS | ZFS | LSI SAS
 
MOSFET
Gerbil XP
Posts: 369
Joined: Fri Aug 08, 2014 12:42 am

Re: FreeNAS I̶n̶t̶e̶l̶ ̶8̶0̶8̶6̶k̶ AMD Threadripper upgrade!

Sun Oct 07, 2018 2:00 am

Whoa! I don't think I've seen a PC Power & Cooling Silencer since...1998? It was shiny too, not sleek and black. I'm glad you have something up and running. Sounds performant.

Oh man, the wall is epic!
Be careful on inserting this (or any G34 chip) into the socket. Once you pull that restraining lever, it is either a good install or a piece of silicon jewelry.
 
Airmantharp
Emperor Gerbilius I
Posts: 6192
Joined: Fri Oct 15, 2004 10:41 pm

Re: FreeNAS I̶n̶t̶e̶l̶ ̶8̶0̶8̶6̶k̶ AMD Threadripper upgrade!

Tue Oct 09, 2018 4:55 pm

MOSFET wrote:
Whoa! I don't think I've seen a PC Power & Cooling Silencer since...1998? It was shiny too, not sleek and black.


I don't think I've ever heard one that was 'silent' either ;)
 
Waco
Gold subscriber
Grand Gerbil Poohbah
Topic Author
Posts: 3103
Joined: Tue Jan 20, 2009 4:14 pm
Location: Los Alamos, NM

Re: FreeNAS I̶n̶t̶e̶l̶ ̶8̶0̶8̶6̶k̶ AMD Threadripper upgrade!

Tue Oct 09, 2018 5:22 pm

It's a Silencer Mk II, built after OCZ acquired PCP&C. It works well and is reasonably efficient.
Desktop: X570 Gaming X | 3900X | 32 GB | Alphacool Eisblock Radeon VII | Heatkiller R3 | Samsung 4K 40" | 1 TB NVME + 2 TB SATA + LSI (128x8) RAID
NAS: 1950X | Designare EX | 32 GB ECC | 7x8 TB RAIDZ2 | 8x2 TB RAID10 | FreeNAS | ZFS | LSI SAS
 
Mr Bill
Gerbil Jedi
Posts: 1792
Joined: Mon Jan 21, 2002 7:00 pm
Location: Colorado Western Slope
Contact:

Re: FreeNAS I̶n̶t̶e̶l̶ ̶8̶0̶8̶6̶k̶ AMD Threadripper upgrade!

Wed Oct 10, 2018 12:16 am

That wall display is very cool. I may try that myself.
X6 1100T BE | Gigabyte GA-990FXA-UD3 AM3+ | XFX HD 7870 | 16 GB DDR3 | Samsung 830/850 Pro SSD's | Logitech cherry MX-brown G710+ | Logitech G303 Daedalus Apex mouse | SeaSonic SS-660XP 80+ Pt | BenQ 24' 1900x1200 IPS | APC Back-UPS NS-1350 | WinXP64 Pro

Who is online

Users browsing this forum: No registered users and 15 guests
GZIP: On