Diskless Folding Virtual Appliance

Come join the... uh... er... fold.

Moderators: just brew it!, farmpuma

Diskless Folding Virtual Appliance

Postposted on Mon Jun 09, 2008 7:24 pm

The Diskless Folding Virtual Appliance (i.e. VMWare and others Virtual Machine) is released. This includes updates to all the other Diskless Folding things as well. Sorry it took so long, life has been hectic recently, but it's here now. See the link in my sig as usual.
notfred
Grand Gerbil Poohbah
 
Posts: 3726
Joined: Tue Aug 10, 2004 10:10 am
Location: Ottawa, Canada

Re: Diskless Folding Virtual Appliance

Postposted on Mon Jun 09, 2008 8:04 pm

:o Thank you so much!
Usacomp2k3
Gerbil God
 
Posts: 21291
Joined: Thu Apr 01, 2004 4:53 pm
Location: Orlando, FL

Re: Diskless Folding Virtual Appliance

Postposted on Tue Jun 10, 2008 1:58 pm

Thanks SOOO much notfred!! This works great! Hopefully no more lost WU's under VMware.

Any chance this will support USB sticks properly? Just as an added layer of safety/backup. Although I can't see filling up a 512mb disk too quick. :lol:

Thanks again for your contributions to the Folding Community.... :D
20.4 Ghz Folding for the [H]orde
nomad8u
Gerbil In Training
 
Posts: 7
Joined: Tue Jun 10, 2008 1:42 pm

Re: Diskless Folding Virtual Appliance

Postposted on Tue Jun 10, 2008 2:10 pm

I think it should support the USB stick IF you can get VMWare to access USB devices. I have managed to get it to work in the past, but it can require enabling the USB device and then unplugging it and plugging it back in and various other weird things.

The drive is shared on the network, so you could just copy from that to do a backup - restore would require you to overwrite before a backup kicked in and then reboot the diskless folding instance.
notfred
Grand Gerbil Poohbah
 
Posts: 3726
Joined: Tue Aug 10, 2004 10:10 am
Location: Ottawa, Canada

Re: Diskless Folding Virtual Appliance

Postposted on Tue Jun 10, 2008 2:20 pm

I'll give the USB stick a run and see if I can get it running

notfred wrote:The drive is shared on the network, so you could just copy from that to do a backup - restore would require you to overwrite before a backup kicked in and then reboot the diskless folding instance.


Yeah.. I have a batch file setup doing that now for the VM CD images I'm running due to their lack of USB stick support..
20.4 Ghz Folding for the [H]orde
nomad8u
Gerbil In Training
 
Posts: 7
Joined: Tue Jun 10, 2008 1:42 pm

Re: Diskless Folding Virtual Appliance

Postposted on Wed Jun 11, 2008 2:17 pm

Hey notfred... I seem to have an issue with a VA running in VMWare. It seems as though "time" is getting stuck per the FAH log. Hang check log looks normal with a check every 5 minutes.

It was progressing normally at around 12:16 - 12:28/frame or so until the 34% mark. Then it seemed to "lose" 2 hours and jumped several % at the same time

Code: Select all
--- Opening Log file [June 10 14:21:40]


# SMP Client ##################################################################
###############################################################################

                       Folding@Home Client Version 6.02beta

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /etc/folding/1
Executable: ./fah6
Arguments: -local -forceasm -verbosity 9 -smp

Warning:
 By using the -forceasm flag, you are overriding
 safeguards in the program. If you did not intend to
 do this, please restart the program without -forceasm.
 If work units are not completing fully (and particularly
 if your machine is overclocked), then please discontinue
 use of the flag.

[14:21:40] - Ask before connecting: No
[14:21:40] - User name: nomad8u (Team 33)
[14:21:40] - User ID: 126F3C4E19B42D8D
[14:21:40] - Machine ID: 1
[14:21:40]
[14:21:40] Loaded queue successfully.
[14:21:40] - Autosending finished units...
[14:21:40] Trying to send all finished work units
[14:21:40] + No unsent completed units remaining.
[14:21:40] - Autosend completed
[14:21:40]
[14:21:40] + Processing work unit
[14:21:40] Core required: FahCore_a1.exe
[14:21:40] Core not found.
[14:21:40] - Core is not present or corrupted.
[14:21:40] - Attempting to download new core...
[14:21:40] + Downloading new core: FahCore_a1.exe
[14:21:40] Downloading core (/~pande/Linux/x86//Core_a1.fah from www.stanford.edu)
[14:21:41] Initial: AFDE; + 10240 bytes downloaded
[14:21:41] Initial: B54E; + 20480 bytes downloaded
[14:21:41] Initial: D6C2; + 30720 bytes downloaded
[14:21:41] Initial: 9F08; + 40960 bytes downloaded
[14:21:41] Initial: C6C3; + 51200 bytes downloaded
[14:21:41] Initial: EBA8; + 61440 bytes downloaded
[14:21:41] Initial: 3141; + 71680 bytes downloaded
[14:21:41] Initial: D218; + 81920 bytes downloaded
[14:21:41] Initial: F7AC; + 92160 bytes downloaded
[14:21:41] Initial: 820B; + 102400 bytes downloaded
[14:21:41] Initial: 1B1E; + 112640 bytes downloaded
[14:21:41] Initial: C249; + 122880 bytes downloaded
[14:21:42] Initial: 5EBD; + 133120 bytes downloaded
[14:21:42] Initial: CD6C; + 143360 bytes downloaded
[14:21:42] Initial: 221C; + 153600 bytes downloaded
[14:21:42] Initial: DB18; + 163840 bytes downloaded
[14:21:42] Initial: 237E; + 174080 bytes downloaded
[14:21:42] Initial: AEEC; + 184320 bytes downloaded
[14:21:42] Initial: 4C66; + 194560 bytes downloaded
[14:21:42] Initial: AE1E; + 204800 bytes downloaded
[14:21:42] Initial: A37E; + 215040 bytes downloaded
[14:21:42] Initial: 8193; + 225280 bytes downloaded
[14:21:42] Initial: 9F05; + 235520 bytes downloaded
[14:21:42] Initial: AAA5; + 245760 bytes downloaded
[14:21:42] Initial: 6400; + 256000 bytes downloaded
[14:21:42] Initial: 6E3D; + 266240 bytes downloaded
[14:21:42] Initial: EA6B; + 276480 bytes downloaded
[14:21:42] Initial: 820A; + 286720 bytes downloaded
[14:21:42] Initial: DE6D; + 296960 bytes downloaded
[14:21:42] Initial: B97B; + 307200 bytes downloaded
[14:21:42] Initial: 9D5D; + 317440 bytes downloaded
[14:21:43] Initial: 91D7; + 327680 bytes downloaded
[14:21:43] Initial: BB3B; + 337920 bytes downloaded
[14:21:43] Initial: 611B; + 348160 bytes downloaded
[14:21:43] Initial: B290; + 358400 bytes downloaded
[14:21:43] Initial: B0AA; + 368640 bytes downloaded
[14:21:43] Initial: 6A85; + 378880 bytes downloaded
[14:21:43] Initial: BF10; + 389120 bytes downloaded
[14:21:43] Initial: A818; + 399360 bytes downloaded
[14:21:43] Initial: 90E1; + 409600 bytes downloaded
[14:21:43] Initial: 2869; + 419840 bytes downloaded
[14:21:43] Initial: CAFE; + 430080 bytes downloaded
[14:21:43] Initial: 414B; + 440320 bytes downloaded
[14:21:43] Initial: 9B7A; + 450560 bytes downloaded
[14:21:43] Initial: 33AA; + 460800 bytes downloaded
[14:21:43] Initial: B1D5; + 471040 bytes downloaded
[14:21:44] Initial: 0206; + 481280 bytes downloaded
[14:21:44] Initial: 11F4; + 491520 bytes downloaded
[14:21:44] Initial: 31B5; + 501760 bytes downloaded
[14:21:44] Initial: 46B2; + 512000 bytes downloaded
[14:21:44] Initial: 3113; + 522240 bytes downloaded
[14:21:44] Initial: 525A; + 532480 bytes downloaded
[14:21:44] Initial: 66F9; + 542720 bytes downloaded
[14:21:44] Initial: 9672; + 552960 bytes downloaded
[14:21:44] Initial: 9058; + 563200 bytes downloaded
[14:21:44] Initial: 49ED; + 573440 bytes downloaded
[14:21:44] Initial: 515D; + 583680 bytes downloaded
[14:21:44] Initial: CAC0; + 593920 bytes downloaded
[14:21:44] Initial: 0B15; + 604160 bytes downloaded
[14:21:44] Initial: 5A89; + 614400 bytes downloaded
[14:21:44] Initial: 0F31; + 624640 bytes downloaded
[14:21:44] Initial: 2BC3; + 634880 bytes downloaded
[14:21:44] Initial: 3C06; + 645120 bytes downloaded
[14:21:44] Initial: 89C7; + 655360 bytes downloaded
[14:21:44] Initial: 6C54; + 665600 bytes downloaded
[14:21:45] Initial: 8D4D; + 675840 bytes downloaded
[14:21:45] Initial: EA59; + 686080 bytes downloaded
[14:21:45] Initial: C563; + 696320 bytes downloaded
[14:21:45] Initial: 8D45; + 706560 bytes downloaded
[14:21:45] Initial: 9BD0; + 716800 bytes downloaded
[14:21:45] Initial: 130C; + 727040 bytes downloaded
[14:21:45] Initial: CDA1; + 737280 bytes downloaded
[14:21:45] Initial: 7681; + 747520 bytes downloaded
[14:21:45] Initial: 1110; + 757760 bytes downloaded
[14:21:45] Initial: EE35; + 768000 bytes downloaded
[14:21:45] Initial: E5E1; + 778240 bytes downloaded
[14:21:45] Initial: 4B97; + 788480 bytes downloaded
[14:21:45] Initial: 4D75; + 798720 bytes downloaded
[14:21:45] Initial: E268; + 808960 bytes downloaded
[14:21:45] Initial: FAC6; + 819200 bytes downloaded
[14:21:45] Initial: A625; + 829440 bytes downloaded
[14:21:45] Initial: A12A; + 839680 bytes downloaded
[14:21:45] Initial: 83A3; + 849920 bytes downloaded
[14:21:46] Initial: 3BEA; + 860160 bytes downloaded
[14:21:46] Initial: 5298; + 870400 bytes downloaded
[14:21:46] Initial: 4811; + 880640 bytes downloaded
[14:21:46] Initial: EB07; + 890880 bytes downloaded
[14:21:46] Initial: 83FC; + 901120 bytes downloaded
[14:21:46] Initial: FA4E; + 911360 bytes downloaded
[14:21:46] Initial: 2945; + 921600 bytes downloaded
[14:21:46] Initial: 6BC9; + 931840 bytes downloaded
[14:21:46] Initial: E495; + 942080 bytes downloaded
[14:21:46] Initial: 1050; + 952320 bytes downloaded
[14:21:46] Initial: 2070; + 962560 bytes downloaded
[14:21:46] Initial: 1083; + 972800 bytes downloaded
[14:21:46] Initial: 96E5; + 983040 bytes downloaded
[14:21:46] Initial: 3EEE; + 993280 bytes downloaded
[14:21:46] Initial: 84AC; + 1003520 bytes downloaded
[14:21:46] Initial: 3B6B; + 1013760 bytes downloaded
[14:21:46] Initial: 3030; + 1024000 bytes downloaded
[14:21:46] Initial: 4B95; + 1034240 bytes downloaded
[14:21:47] Initial: D9BC; + 1044480 bytes downloaded
[14:21:47] Initial: C5B8; + 1054720 bytes downloaded
[14:21:47] Initial: A5EF; + 1064960 bytes downloaded
[14:21:47] Initial: 28DC; + 1075200 bytes downloaded
[14:21:47] Initial: 0943; + 1085440 bytes downloaded
[14:21:47] Initial: 338A; + 1095680 bytes downloaded
[14:21:47] Initial: ADFC; + 1105920 bytes downloaded
[14:21:47] Initial: ED39; + 1116160 bytes downloaded
[14:21:47] Initial: D284; + 1126400 bytes downloaded
[14:21:47] Initial: 0057; + 1136640 bytes downloaded
[14:21:47] Initial: 3E65; + 1146880 bytes downloaded
[14:21:47] Initial: FCB5; + 1157120 bytes downloaded
[14:21:47] Initial: A7D8; + 1167360 bytes downloaded
[14:21:47] Initial: A564; + 1177600 bytes downloaded
[14:21:47] Initial: 7654; + 1187840 bytes downloaded
[14:21:47] Initial: 0848; + 1198080 bytes downloaded
[14:21:47] Initial: 471E; + 1208320 bytes downloaded
[14:21:47] Initial: A7F3; + 1218560 bytes downloaded
[14:21:48] Initial: FA59; + 1228800 bytes downloaded
[14:21:48] Initial: FBF2; + 1239040 bytes downloaded
[14:21:48] Initial: F54E; + 1249280 bytes downloaded
[14:21:48] Initial: 3023; + 1259520 bytes downloaded
[14:21:48] Initial: AB37; + 1269760 bytes downloaded
[14:21:48] Initial: 0896; + 1280000 bytes downloaded
[14:21:48] Initial: 756D; + 1290240 bytes downloaded
[14:21:48] Initial: C1E7; + 1300480 bytes downloaded
[14:21:48] Initial: 9AAC; + 1310720 bytes downloaded
[14:21:48] Initial: E5AF; + 1320960 bytes downloaded
[14:21:48] Initial: BBE3; + 1331200 bytes downloaded
[14:21:48] Initial: 3596; + 1341440 bytes downloaded
[14:21:48] Initial: 924C; + 1351680 bytes downloaded
[14:21:48] Initial: 30B7; + 1361920 bytes downloaded
[14:21:48] Initial: AEB7; + 1372160 bytes downloaded
[14:21:48] Initial: 7D25; + 1382400 bytes downloaded
[14:21:48] Initial: 0FEB; + 1392640 bytes downloaded
[14:21:48] Initial: 3131; + 1402880 bytes downloaded
[14:21:48] Initial: 755F; + 1413120 bytes downloaded
[14:21:49] Initial: 4800; + 1423360 bytes downloaded
[14:21:49] Initial: 1282; + 1433600 bytes downloaded
[14:21:49] Initial: B2A3; + 1443840 bytes downloaded
[14:21:49] Initial: 21E9; + 1454080 bytes downloaded
[14:21:49] Initial: 789E; + 1464320 bytes downloaded
[14:21:49] Initial: 8542; + 1474560 bytes downloaded
[14:21:49] Initial: 3A56; + 1484800 bytes downloaded
[14:21:49] Initial: D4FE; + 1490945 bytes downloaded
[14:21:49] Verifying core Core_a1.fah...
[14:21:49] Signature is VALID
[14:21:49]
[14:21:49] Trying to unzip core FahCore_a1.exe
[14:21:49] Decompressed FahCore_a1.exe (3625104 bytes) successfully
[14:21:49] + Core successfully engaged
[14:21:54]
[14:21:54] + Processing work unit
[14:21:54] Core required: FahCore_a1.exe
[14:21:54] Core found.
[14:21:54] Working on Unit 01 [June 10 14:21:54]
[14:21:54] + Working ...
[14:21:54] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 01 -checkpoint 15 -forceasm -verbose -lifeline 442 -version 602'

[14:21:54]
[14:21:54] *------------------------------*
[14:21:54] Folding@Home Gromacs SMP Core
[14:21:54] Version 1.74 (November 27, 2006)
[14:21:54]
[14:21:54] Preparing to commence simulation
[14:21:54] - Ensuring status. Please wait.
[14:22:12] - Assembly optimizations manually forced on.
[14:22:12] - Not checking prior termination.
[14:22:12] - Expanded 2436318 -> 12886013 (decompressed 528.9 percent)
[14:22:13]
[14:22:13] Project: 2605 (Run 6, Clone 143, Gen 61)
[14:22:13]
[14:22:13] Assembly optimizations on if available.
[14:22:13] Entering M.D.
[14:22:19] Calling FAH init
[14:22:20] in POPC
[14:22:20] Writing local files
[14:22:20]  checkpoint)
[14:22:20] Read checkpoint
[14:22:20] steps  (1 percent)
[14:22:20] Extra SSE boost OK.
[14:22:20] files
[14:22:20] Completed 5000 out of 500000 steps  (1 percent)
[14:22:20] Extra SSE boost OK.
[14:34:32] Writing local files
[14:34:32] Completed 10000 out of 500000 steps  (2 percent)
[14:46:43] Writing local files
[14:46:44] Completed 15000 out of 500000 steps  (3 percent)
[14:58:55] Writing local files
[14:58:55] Completed 20000 out of 500000 steps  (4 percent)
[15:11:02] Writing local files
[15:11:02] Completed 25000 out of 500000 steps  (5 percent)
[15:23:06] Writing local files
[15:23:06] Completed 30000 out of 500000 steps  (6 percent)
[15:35:08] Writing local files
[15:35:08] Completed 35000 out of 500000 steps  (7 percent)
[16:59:44] Writing local files
[16:59:44] Completed 40000 out of 500000 steps  (8 percent)
[16:59:44] Timered checkpoint triggered.
[16:59:44] Writing local files
[16:59:44] Completed 45000 out of 500000 steps  (9 percent)
[16:59:44] Timered checkpoint triggered.
[16:59:44] Writing local files
[16:59:44] Completed 50000 out of 500000 steps  (10 percent)
[16:59:44] Timered checkpoint triggered.
[16:59:44] Writing local files
[16:59:44] Completed 55000 out of 500000 steps  (11 percent)
[16:59:44] Timered checkpoint triggered.
[17:00:55] Writing local files
[17:00:56] Completed 60000 out of 500000 steps  (12 percent)
[18:14:48] Timered checkpoint triggered.
[18:14:48] Writing local files
[18:14:48] Completed 65000 out of 500000 steps  (13 percent)
[18:14:48] Timered checkpoint triggered.
[18:14:48] Writing local files
[18:14:48] Completed 70000 out of 500000 steps  (14 percent)
[18:14:48] Timered checkpoint triggered.
[18:14:48] Writing local files
[18:14:48] Completed 75000 out of 500000 steps  (15 percent)
[18:14:48] Writing local files
[18:14:48] Completed 80000 out of 500000 steps  (16 percent)
[18:16:16] Writing local files
[18:16:16] Completed 85000 out of 500000 steps  (17 percent)
[18:28:27] Writing local files
[18:28:27] Completed 90000 out of 500000 steps  (18 percent)
[18:40:38] Writing local files
[18:40:38] Completed 95000 out of 500000 steps  (19 percent)
[18:52:46] Writing local files
[18:52:46] Completed 100000 out of 500000 steps  (20 percent)
[19:05:32] Writing local files
[19:05:32] Completed 105000 out of 500000 steps  (21 percent)
[19:17:53] Writing local files
[19:17:53] Completed 110000 out of 500000 steps  (22 percent)
[19:30:06] Writing local files
[19:30:06] Completed 115000 out of 500000 steps  (23 percent)
[19:42:22] Writing local files
[19:42:22] Completed 120000 out of 500000 steps  (24 percent)
[19:54:34] Writing local files
[19:54:34] Completed 125000 out of 500000 steps  (25 percent)
[20:06:40] Writing local files
[20:06:40] Completed 130000 out of 500000 steps  (26 percent)
[20:18:52] Writing local files
[20:18:52] Completed 135000 out of 500000 steps  (27 percent)
[20:21:40] - Autosending finished units...
[20:21:40] Trying to send all finished work units
[20:21:40] + No unsent completed units remaining.
[20:21:40] - Autosend completed
[20:31:00] Writing local files
[20:31:00] Completed 140000 out of 500000 steps  (28 percent)
[20:43:09] Writing local files
[20:43:09] Completed 145000 out of 500000 steps  (29 percent)
[20:55:18] Writing local files
[20:55:18] Completed 150000 out of 500000 steps  (30 percent)
[21:07:27] Writing local files
[21:07:27] Completed 155000 out of 500000 steps  (31 percent)
[21:19:40] Writing local files
[21:19:40] Completed 160000 out of 500000 steps  (32 percent)
[21:31:54] Writing local files
[21:31:54] Completed 165000 out of 500000 steps  (33 percent)
[21:44:05] Writing local files
[21:44:05] Completed 170000 out of 500000 steps  (34 percent)
[23:01:11] Writing local files
[23:01:11] Completed 175000 out of 500000 steps  (35 percent)
[23:01:11] Writing local files
[23:01:11] Completed 180000 out of 500000 steps  (36 percent)
[23:01:11] Writing local files
[23:01:11] Completed 185000 out of 500000 steps  (37 percent)
[23:01:11] Writing local files
[23:01:11] Completed 190000 out of 500000 steps  (38 percent)
[23:01:11] Writing local files
[23:01:11] Completed 195000 out of 500000 steps  (39 percent)
[23:01:11] Writing local files
[23:01:11] Completed 200000 out of 500000 steps  (40 percent)
[00:19:58] Writing local files
[00:19:58] Completed 205000 out of 500000 steps  (41 percent)
[00:19:58] Writing local files
[00:19:58] Completed 210000 out of 500000 steps  (42 percent)
[00:19:58] Writing local files
[00:19:58] Completed 215000 out of 500000 steps  (43 percent)
[00:19:58] Writing local files
[00:19:58] Completed 220000 out of 500000 steps  (44 percent)
[00:19:58] Writing local files
[00:19:58] Completed 225000 out of 500000 steps  (45 percent)
[00:19:58] Writing local files
[00:19:58] Completed 230000 out of 500000 steps  (46 percent)
[00:26:04] Writing local files
[00:26:05] Completed 235000 out of 500000 steps  (47 percent)
[00:37:46] Writing local files
[00:37:47] Completed 240000 out of 500000 steps  (48 percent)


It looked like it was starting to "sync" back up after 46%, but the jump from 47-48% is wrong..
The core continues to run at what appears to be an appropriate speed (other than the fact it's driving FAHSpy nuts :lol: ) and I'm aware that VMWare has some time issues, but I haven't seen anything like this before. Any clue?


I just setup and launched a second VA so we'll see if this is unique to the 1st instance I set up.
20.4 Ghz Folding for the [H]orde
nomad8u
Gerbil In Training
 
Posts: 7
Joined: Tue Jun 10, 2008 1:42 pm

Re: Diskless Folding Virtual Appliance

Postposted on Thu Jun 12, 2008 12:02 am

I did manage to get the USB stick to restore from inside VMWare Player. I posted the image of the VMWare Player, but it said something about only being allowed to save it as a draft.
Here's the output from the browser though....

[21:39:47] Project: 2605 (Run 7, Clone 268, Gen 61)
[21:39:47]
[21:39:48] Assembly optimizations on if available.
[21:39:48] Entering M.D.
[21:39:54] Calling FAH init
[21:39:54] Read topology
[21:39:55] (Starting from checkpoint)
[21:39:55] Read checkpoint
[21:39:56] Protein: Protein in POPC
[21:39:56] Writing local files
[21:39:57] Completed 19420 out of 500000 steps (3 percent)
[21:39:59] Extra SSE boost OK.

That's from VMWare Player, running notfreds, and restoring from a USB stick. It works! :P
LumberJack
Gerbil
 
Posts: 13
Joined: Thu Apr 10, 2008 6:14 pm

Re: Diskless Folding Virtual Appliance

Postposted on Thu Jun 12, 2008 7:55 am

I've been running the VM appliance since it came out and I've had this error on all of the 5 instances I'm running it on.

It appears that I've filled up the 512mb space and it wants more space. FAH continues to make progress while it says this in FAHLOG.txt. I reset each VM and it goes away for a while. But ends up coming back any amount of hours later.

Image
DriveEuro
Gerbil
 
Posts: 10
Joined: Tue Apr 29, 2008 10:02 pm

Re: Diskless Folding Virtual Appliance

Postposted on Thu Jun 12, 2008 9:02 am

nomad8u wrote:The core continues to run at what appears to be an appropriate speed (other than the fact it's driving FAHSpy nuts :lol: ) and I'm aware that VMWare has some time issues, but I haven't seen anything like this before. Any clue?

Sorry not seen anything like that before, that's pretty crazy.

DriveEuro wrote:It appears that I've filled up the 512mb space and it wants more space. FAH continues to make progress while it says this in FAHLOG.txt. I reset each VM and it goes away for a while. But ends up coming back any amount of hours later.
If you access the windows share of the hard drive image over the network, what does it look like? Does it show as full? Are there some giant files on it?
notfred
Grand Gerbil Poohbah
 
Posts: 3726
Joined: Tue Aug 10, 2004 10:10 am
Location: Ottawa, Canada

Re: Diskless Folding Virtual Appliance

Postposted on Thu Jun 12, 2008 9:26 am

Weirdest thing...
When I right click on a folder and hit properties, each individual folder only occupies so much space. But when I click properties on everything under "\\Fold-XXXX\c" I get a never ending file size. It continually increases and never stops. I cancelled out at 12gb. Obviously its not correct.

ImageImage

Either way, at the moment, none of my instances are giving the error that I showed above. I'll repost again later when the problem comes back up.



EDIT: I'm also have that time issue that nomad8u is having. It doesn't happen a lot. But it does show the same time for multiple frames.
DriveEuro
Gerbil
 
Posts: 10
Joined: Tue Apr 29, 2008 10:02 pm

Re: Diskless Folding Virtual Appliance

Postposted on Thu Jun 12, 2008 11:39 am

The numbers of files and folders are increasing as well, I suspect it is going in to a loop in the /proc directory.

I managed to post this in the wrong thread so thought I'd put it where it should be.
notfred
Grand Gerbil Poohbah
 
Posts: 3726
Joined: Tue Aug 10, 2004 10:10 am
Location: Ottawa, Canada

Re: Diskless Folding Virtual Appliance

Postposted on Thu Jun 12, 2008 10:09 pm

DriveEuro wrote:It appears that I've filled up the 512mb space and it wants more space. FAH continues to make progress while it says this in FAHLOG.txt. I reset each VM and it goes away for a while. But ends up coming back any amount of hours later.


I'm only running one virtual appliance right now, but have the same HD "filling up" issue, except it hasn't gone away and stay across an upload/start of a new unit.

Image


It hasn't seemed to stop or bother the client though. I tried running a second instance/appliance, but it grabbed a 2665 (actually it grabbed 5 in a row) and yakked all of them within the first 15 minutes of starting them. I didn't capture the info in time, but will try it again when I can. I'm going to be away for a couple weeks so it'll have to wait until I get back most likely. I'll be watching this thread for developments though, and hopefully the one VA and one CD ISO image I'm running in VM will chug along until then.....

One issue I saw (or didn't see) when setting up both the virtual appliances was no option on the boot menu to configure the client? Maybe I just missed it, but both of them started up with the default settings, and I had to go configure/reboot after they had D/L'd and started clients.
@DriveEuro, were you able to config at boot time?
20.4 Ghz Folding for the [H]orde
nomad8u
Gerbil In Training
 
Posts: 7
Joined: Tue Jun 10, 2008 1:42 pm

Re: Diskless Folding Virtual Appliance

Postposted on Thu Jun 12, 2008 10:29 pm

nomad8u wrote:@DriveEuro, were you able to config at boot time?

Type in the IP address assigned to the client in a browser. That's how you configure the client. Just as it was in the USB and CD version. Configure it, reboot, then that's all you ever have to configure.

Image
DriveEuro
Gerbil
 
Posts: 10
Joined: Tue Apr 29, 2008 10:02 pm

Re: Diskless Folding Virtual Appliance

Postposted on Thu Jun 12, 2008 10:34 pm

DriveEuro wrote:Type in the IP address assigned to the client in a browser. That's how you configure the client. Just as it was in the USB and CD version. Configure it, reboot, then that's all you ever have to configure.
Image


That's how I did it.... I was under the impression it would be selectabe at the boot menu like the type of "folding" you wanted to start before the 15 sec. timeout...
20.4 Ghz Folding for the [H]orde
nomad8u
Gerbil In Training
 
Posts: 7
Joined: Tue Jun 10, 2008 1:42 pm

Re: Diskless Folding Virtual Appliance

Postposted on Thu Jun 12, 2008 10:39 pm

notfred wrote:The numbers of files and folders are increasing as well, I suspect it is going in to a loop in the /proc directory.


I opened the appliance with file mangler, and if I do a "right click/properties" on any folder OTHER than "proc" the file/size count is normal. If you do that on the proc folder it's a constantly increasing number.. (I stopped @ 2.5G)
I then opened the proc folder and the same thing happenes if you select any individual folder under proc and do a "properties as well.

don't know if this info helps or not.. :wink:
20.4 Ghz Folding for the [H]orde
nomad8u
Gerbil In Training
 
Posts: 7
Joined: Tue Jun 10, 2008 1:42 pm

Re: Diskless Folding Virtual Appliance

Postposted on Fri Jun 13, 2008 12:43 am

Hey NotFred. Thanks for creating this method of folding. I already have 2 friends with farms that are using it.
I have managed to configure a perfectly working Virtual Machine running notfreds on a dual core CPU. It also saves to the USB stick. And can also restore from the USB stick. My method and configuration is different from yours though. But since I'm basically a "noob" on this forum I don't want to post the exact instructions unless you want me to. Thanks.
LumberJack
Gerbil
 
Posts: 13
Joined: Thu Apr 10, 2008 6:14 pm

Re: Diskless Folding Virtual Appliance

Postposted on Fri Jun 13, 2008 7:10 am

LumberJack wrote:Hey NotFred. Thanks for creating this method of folding. I already have 2 friends with farms that are using it.
I have managed to configure a perfectly working Virtual Machine running notfreds on a dual core CPU. It also saves to the USB stick. And can also restore from the USB stick. My method and configuration is different from yours though. But since I'm basically a "noob" on this forum I don't want to post the exact instructions unless you want me to. Thanks.

Post them anyways, there must be more people who are "noob-er" than you. Besides this is all about sharing information so more people can fold (for team 2630 and UnitedGerbilNation preferably ;)). Some of us may have never done this so some starting instructions will definitely help.
Image
The Model M is not for the faint of heart. You either like them or hate them.

Gerbils unite! Fold for UnitedGerbilNation, team 2630.
Flying Fox
Gerbil God
 
Posts: 24359
Joined: Mon May 24, 2004 2:19 am

Re: Diskless Folding Virtual Appliance

Postposted on Fri Jun 13, 2008 8:31 am

Image

More issues. I just rebooted the VM and this came up. Did another reboot and it seems to have gone away.


And this is an issue on another instance on a different compunter.
Image



This one occurred within a minute or two of resetting the VM.
Image
DriveEuro
Gerbil
 
Posts: 10
Joined: Tue Apr 29, 2008 10:02 pm

Re: Diskless Folding Virtual Appliance

Postposted on Fri Jun 13, 2008 5:28 pm

Ok Flying Fox. Thank you. Here goes...........

Part 1 of 2
Guide: Running notfred's in VMWare Player, with a USB flash drive, that saves and restores.

This setup uses Windows XP. A dual core cpu. And VMWare Player. Vista users can use this for a general blueprint.
This is a general guide that works for me. I am by no means an expert. Feel free to modify as needed.
My goal was to make it easy enough to understand, that even my grandmother could set it up.

1. Get a USB flash drive. 256 megs or more. Plug it in, and make sure Windows recognizes it.
We need to format it to FAT. Make sure all important info has been copied from the USB stick.
Go to Start -- My Computer -- and right click on the drive letter that has the USB stick.
Choose format -- change FAT32 to FAT -- then click start. Don't use quick format. We want a thorough FAT format.
Once finished formatting, close the window, and pull the stick out, and plug it back in.
Once again, make sure Windows recognizes it.

2. Make a folder on the hard drive and call it whatever you like. We'll call it -- notfreds
Go to notfred's CD generator http://reilly.homeip.net/folding/cd.html and generate an ISO and download it to that folder.

3. Download VMWare Player (currently 2.0.4) and install it. http://www.vmware.com/download/player/

4. In order for VMPlayer to recognize the USB stick. We need to get the VID (Vendor ID) and the PID (Product ID)
That's why I said to make sure Windows recognized the stick. That info is now in the registry. Let's grab it.
Go to Start -- run -- type in regedit and click ok. Now we are in the registry editor. Be careful not to change anything.
We are only looking for the VID and PID info. Navigate to HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Enum\USB\
In the USB directory search for something similar to "Vid_0c76&Pid_0005". You may have several of them.
Click the + sign to navigate 1 lower to "like" 2841074133B01BE5 and check the description. Look for the one that has your USB flash drive's name.
I found mine in the right pane under "LocationInformation". Above that it has the "HardwareID". Look for the VID and PID numbers.
Mine says USB\Vid_0c76&Pid_0005&Rev_0100 USB.etc,etc. So my VID is 0c76 and the PID is 0005.
This is product specific, so yours will be different. Drop the 0 from the VID. It's now c76 and the PID is still 0005
These will need to be in hex format. So we prefix the VID and PID with 0x. My VID and PID are now 0xc76:0x0005
This is what will help your VMPlayer to recognize your specific flash drive. Remember, use your VID and PID and not mine.

So now we have downloaded the fold.iso. Downloaded and installed VMWare Player. Have a fresh formatted USB stick. And know our VID and PID.

This concludes part 1 of 2.

Part 2 will have the text for your fold64.vmx file to configure VmWare Player to run notfreds.
This will simply be a matter of copy and paste into wordpad, and replace my VID and PID with yours.
The line you will be looking for says -> usb.autoConnect.device0 = "0xc76:0x0005"

In the usb.autoConnect.device0 = "0xc76:0x0005"<-- you'll replace the c76 with your VID and the 0005 with your PID

OK, onto part 2 of 2. Let's get this virtual machine fired up and folding
Last edited by LumberJack on Wed Jun 18, 2008 8:24 am, edited 2 times in total.
LumberJack
Gerbil
 
Posts: 13
Joined: Thu Apr 10, 2008 6:14 pm

Re: Diskless Folding Virtual Appliance

Postposted on Fri Jun 13, 2008 5:30 pm

Part 2 of 2
Guide: Running notfred's in VMWare Player, with a USB flash drive, that saves and restores.

Just copy and paste the following text and save it in wordpad as a text file and call it like fold64.vmx
Drop the fold64.vmx into the notfreds folder.

******************BEGIN COPY AND PASTE for fold64.vmx *************************

#!/usr/bin/vmplayer
config.version = "8"
virtualHW.version = "4"
usb.present = "TRUE"
usb.autoConnect.device0 = "0xc76:0x0005"
numvcpus = "2"
# Memory
memsize = "512"
ide1:0.present = "TRUE"
ide1:0.deviceType = "cdrom-image"
ide1:0.startConnected = "TRUE"
ide1:0.fileName = "fold.iso"
# Selected operating system for your virtual machine
guestOS = "other26xlinux-64"
# displayName is your own name for the virtual machine
displayName = "Making USB Work"
# First serial port, physical COM1 is not available
serial0.present = "FALSE"
# Optional second serial port, physical COM2 is not available
serial1.present = "FALSE"
# First parallel port, physical LPT1 is not available
parallel0.present = "FALSE"
# Settings for physical floppy drive
floppy0.present = "FALSE"
# Logging
logging = "TRUE"
# These settings decides interaction between your
# computer and the virtual machine
isolation.tools.hgfs.disable = "FALSE"
isolation.tools.dnd.disable = "FALSE"
isolation.tools.copy.enable = "FALSE"
isolation.tools.paste.enabled = "FALSE"
# First network interface card
ethernet0.present = "TRUE"
ethernet0.virtualDev = "e1000"
ethernet0.connectionType = "nat"
ethernet0.addressType = "generated"
ethernet0.generatedAddressOffset = "0"

******************END COPY AND PASTE for fold64.vmx *************************

Now we have the only 2 files needed for this to fire up the VMWare Player -> fold.iso and fold64.vmx
The last step is to modify the fold64.vmx file for your personal setup.
Go the the notfreds folder and right click on fold64.vmx and choose open with wordpad.

Change the line - usb.autoConnect.device0 = "0xc76:0x0005" to your VID and PID from part 1
Example - my "0xc76:0x0005" for you might be "0xd42:0x0001" depending on your VID and PID.

Change the line - displayName = "Making USB Work" to whatever you want between the quotes.
This will be the display name of your Player. example - displayName = "My Folding Monster"

Now just click file - save. Make sure to always save a vmx file in text format.

Inside the notfreds folder just double click fold64.vmx and watch it start the machine.

Everything should fire up and work automatically. It will pause at "USB Hub Found"
and give an error message. That's fine, let it continue. It will get towards the end
and say "Waiting 10 seconds for any USB drives to start". This is where it SHOULD,
HOPEFULLY, detect the USB Drive. When working this will save and restore from the USB stick.

A BIG THANKS to notfred (linux) and to Scott Burish (usb detection) for making this work.

I'm glad this method worked for so many of you. Good luck.
Last edited by LumberJack on Wed Jun 18, 2008 8:29 am, edited 1 time in total.
LumberJack
Gerbil
 
Posts: 13
Joined: Thu Apr 10, 2008 6:14 pm

Re: Diskless Folding Virtual Appliance

Postposted on Sat Jun 14, 2008 11:52 am

Image

Getting this error on one of my instances.... Very often and frequently after resetting the VM.
DriveEuro
Gerbil
 
Posts: 10
Joined: Tue Apr 29, 2008 10:02 pm

Re: Diskless Folding Virtual Appliance

Postposted on Sat Jun 14, 2008 1:29 pm

Image
I recently decided to try the diskless folding after my vmware installation of ubuntu crapped out. Keep getting this error though I don't know what it's supposed to mean.
Last edited by kitsura on Mon Jun 16, 2008 5:36 am, edited 2 times in total.
Intel i7 2700K @ 4.7GHz 1.35v | Megahalems Rev.C + 2x Gentle Typhoon AP15 | ASUS M4E-Z | Corsair Vengeance 16GB @ 1600MHz | MSI R6950 Twin Frozr III | OCZ Vertex 3 Max IOPS 120GB SSD | PCP&C Silencer Mk II 750W | Windows 7 Ultimate 64bit
kitsura
Gerbil Team Leader
 
Posts: 200
Joined: Sat Nov 09, 2002 11:39 pm
Location: In front of my computer, Duh...

Re: Diskless Folding Virtual Appliance

Postposted on Sat Jun 14, 2008 5:39 pm

DriveEuro wrote:Image

Getting this error on one of my instances.... Very often and frequently after resetting the VM.


Don't know what WU's you were getting that on, but now that I see it, that's the issue I mentioned above where I setup a second instance and had 5 - 2665 WU's yak in a row. I killed the instance after the second WU crashed, and increased the ram allocation to 896 and it still crashed 3 more before I stopped it. Since I had the first instance running with the default 512meg of ram, I didn't want to allocate any higher than 896 on the second for fear of stalling Windows.

I'm now wondering if this may be related to the "run away files" issue, and since the 2665's can be very demanding, it was trying to page out ram, but the hd issue was going on in the background at the same time.. Hmmmm.

Notfred, any ideas?
20.4 Ghz Folding for the [H]orde
nomad8u
Gerbil In Training
 
Posts: 7
Joined: Tue Jun 10, 2008 1:42 pm

Re: Diskless Folding Virtual Appliance

Postposted on Sun Jun 15, 2008 11:30 am

DriveEuro wrote:Image

Getting this error on one of my instances.... Very often and frequently after resetting the VM.
That's run out of memory and the notorious Linux OOM Killer is killing off processes. Try increasing the amount of memory available for the VM.

Not sure what's going on with the out of disk errors that have been reported though.
notfred
Grand Gerbil Poohbah
 
Posts: 3726
Joined: Tue Aug 10, 2004 10:10 am
Location: Ottawa, Canada

Re: Diskless Folding Virtual Appliance

Postposted on Sun Jun 15, 2008 7:19 pm

nomad8u wrote:Hey notfred... I seem to have an issue with a VA running in VMWare. It seems as though "time" is getting stuck per the FAH log. Hang check log looks normal with a check every 5 minutes.

It was progressing normally at around 12:16 - 12:28/frame or so until the 34% mark. Then it seemed to "lose" 2 hours and jumped several % at the same time


It looked like it was starting to "sync" back up after 46%, but the jump from 47-48% is wrong..
The core continues to run at what appears to be an appropriate speed (other than the fact it's driving FAHSpy nuts :lol: ) and I'm aware that VMWare has some time issues, but I haven't seen anything like this before. Any clue?


I just setup and launched a second VA so we'll see if this is unique to the 1st instance I set up.


I am having the same issue on one of my VM's. At one point my estimated PPD was over 1,000,000! I look into more later but since it's working and the clock seems to sync back up I'm not too worried.

LOG ADDED --Check it out I did 4% of a 2605 in 4 seconds!!! ;)
Code: Select all
-snip-
[15:46:22] Timered checkpoint triggered.
[15:46:22] Writing local files
[15:46:22] Completed 65000 out of 500000 steps  (13 percent)
[15:46:22] Timered checkpoint triggered.
[15:46:22] Writing local files
[15:46:22] Completed 70000 out of 500000 steps  (14 percent)
[15:46:22] Timered checkpoint triggered.
[15:46:22] Writing local files
[15:46:22] Completed 75000 out of 500000 steps  (15 percent)
[15:46:22] Timered checkpoint triggered.
[15:46:22] Writing local files
[15:46:22] Completed 80000 out of 500000 steps  (16 percent)
[15:46:22] Timered checkpoint triggered.
[15:46:26] Writing local files
[15:46:26] Completed 85000 out of 500000 steps  (17 percent)
-snip-


Log from another client
Code: Select all
[18:09:35] Timered checkpoint triggered.
[18:09:35] Writing local files
[18:09:35] Completed 120000 out of 500000 steps  (24 percent)
[18:09:35] Timered checkpoint triggered.
[18:09:35] Writing local files
[18:09:35] Completed 125000 out of 500000 steps  (25 percent)
[18:09:35] Timered checkpoint triggered.
[18:09:35] Writing local files
[18:09:35] Completed 130000 out of 500000 steps  (26 percent)
[18:09:35] Timered checkpoint triggered.
[18:09:35] Writing local files
[18:09:35] Completed 135000 out of 500000 steps  (27 percent)
[18:09:35] Timered checkpoint triggered.
[18:09:35] Writing local files
[18:09:35] Completed 140000 out of 500000 steps  (28 percent)
Last edited by theMASS on Sun Jun 15, 2008 9:30 pm, edited 2 times in total.
Image
theMASS
Gerbil First Class
 
Posts: 132
Joined: Thu Sep 27, 2007 3:24 am

Re: Diskless Folding Virtual Appliance

Postposted on Sun Jun 15, 2008 9:08 pm

nomad8u wrote:
DriveEuro wrote:Image

Getting this error on one of my instances.... Very often and frequently after resetting the VM.


Don't know what WU's you were getting that on, but now that I see it, that's the issue I mentioned above where I setup a second instance and had 5 - 2665 WU's yak in a row. I killed the instance after the second WU crashed, and increased the ram allocation to 896 and it still crashed 3 more before I stopped it. Since I had the first instance running with the default 512meg of ram, I didn't want to allocate any higher than 896 on the second for fear of stalling Windows.

I'm now wondering if this may be related to the "run away files" issue, and since the 2665's can be very demanding, it was trying to page out ram, but the hd issue was going on in the background at the same time.. Hmmmm.

Notfred, any ideas?


2665 needs almost 2x the memory compared to most SMP WUs. It won't run well on a system w/ 1GB RAM in a VM on an XP or Vista host.
Image
theMASS
Gerbil First Class
 
Posts: 132
Joined: Thu Sep 27, 2007 3:24 am

Re: Diskless Folding Virtual Appliance

Postposted on Sun Jun 15, 2008 9:46 pm

OH.... and excuse me for not giving a BIG THANKS to notfred! As always your work is greatly appreciated.

Restore from the virtual drive works!
Image
theMASS
Gerbil First Class
 
Posts: 132
Joined: Thu Sep 27, 2007 3:24 am

Re: Diskless Folding Virtual Appliance

Postposted on Mon Jun 16, 2008 9:24 am

To all those that PM'ed me. You are welcome. Yeah, it works really good ;)
It's nice to be able to run directly off the ISO and save and restore from the USB stick.
Good luck to all of you. And thanks for appreciating my guide. :)
So far my guide has a 100% success rate with zero errors!!!
LumberJack
Gerbil
 
Posts: 13
Joined: Thu Apr 10, 2008 6:14 pm

Re: Diskless Folding Virtual Appliance

Postposted on Tue Jun 17, 2008 7:52 am

new error
Image

This is with a 2605 WU.

Corresponding FAHlog.txt
Code: Select all
[08:34:43]
[08:34:43] *------------------------------*
[08:34:43] Folding@Home Gromacs SMP Core
[08:34:43] Version 1.74 (November 27, 2006)
[08:34:43]
[08:34:43] Preparing to commence simulation
[08:34:43] - Ensuring status. Please wait.
[08:35:00] - Assembly optimizations manually forced on.
[08:35:00] - Not checking prior termination.
[08:35:01] - Expanded 2420849 -> 12854153 (decompressed 530.9 percent)
[08:35:01]
[08:35:01] Project: 2605 (Run 0, Clone 540, Gen 46)
[08:35:01]
[08:35:01] Assembly optimizations on if available.
[08:35:01] Entering M.D.
[08:35:07] Calling FAH init
[08:35:08] in POPC
[08:35:08] Writing local files
[08:35:08]  checkpoint)
[08:35:08] Read checkpoint
[08:35:08] Protein: Protein in POPC
[08:35:08] Writing local files
[08:35:09] Extra SSE boost OK.
[08:35:09] Writing local files
[08:35:09] Completed 0 out of 500000 steps  (0 percent)
[08:35:09]
[08:35:09] Folding@home Core Shutdown: INTERRUPTED
[08:35:13] CoreStatus = 66 (102)
[08:35:13] + Shutdown requested by user. Exiting.***** Got a SIGTERM signal (15)
[08:35:13] Killing all core threads

Folding@Home Client Shutdown.
DriveEuro
Gerbil
 
Posts: 10
Joined: Tue Apr 29, 2008 10:02 pm

Re: Diskless Folding Virtual Appliance

Postposted on Tue Jun 17, 2008 8:52 am

That INTERRUPTED thing just happens on some WUs even on non-VM Linux SMP from what I have seen. Just restart and it should keep going.
notfred
Grand Gerbil Poohbah
 
Posts: 3726
Joined: Tue Aug 10, 2004 10:10 am
Location: Ottawa, Canada

Next

Return to TR Distributed Computing Effort

Who is online

Users browsing this forum: No registered users and 2 guests

cron