Page 1 of 1

Rosetta python project 1.02 (vbox64) application

Posted: Wed Jun 02, 2021 2:26 pm
by biodoc
These tasks caused boinc to crash on one of my computers with a disk full error.

If you want to avoid these tasks in the future, add this line to the "options" section of your cc_config.xml file and then restart the boinc client.

<dont_use_vbox>1</dont_use_vbox>

On my 3700X with 32 GB RAM, I've been making adjustments to an app_config.xml and have completed 2 resend tasks successfully.

Normally the creates a VM for each task using one thread and reserves 6.14 GB RAM. I'm not sure how much disk space is used per thread but I retrieved this info from one completed task:

Peak working set size 1,564.48 MB
Peak swap size 6,164.10 MB
Peak disk usage 12,930.47 MB

Code: Select all

<app_config>
<app_version>
    <app_name>rosetta_python_projects</app_name>
    <version_num>102</version_num>
    <platform>x86_64-pc-linux-gnu</platform>
    <avg_ncpus>2.000000</avg_ncpus>
    <plan_class>vbox64</plan_class>
    <api_version>7.7.0</api_version>
    <max_concurrent>2</max_concurrent>
    <dont_throttle/>
</app_version>
<app_version>
    <app_name>rosetta</app_name>
    <version_num>420</version_num>
    <platform>x86_64-pc-linux-gnu</platform>
    <avg_ncpus>1.000000</avg_ncpus>
    <api_version>7.9.0</api_version>
</app_version>
<project_max_concurrent>14</project_max_concurrent>
</app_config>
The max_concurrent value is critical depending on the hardware you have.
Would a VM task benefit by adding an extra thread to each VM to handle VM "overhead" processes? It's not a multi threaded app (vbox_mt) like the Cosmo camb_boinc2docker application.

Re: Rosetta python project 1.02 (vbox64) application

Posted: Wed Jun 02, 2021 2:52 pm
by crashtech
I don't mind vbox jobs, but those are pretty high requirements. I thought I had it figured out by running a limited number of tasks, but it wasn't limited enough!

Re: Rosetta python project 1.02 (vbox64) application

Posted: Wed Jun 02, 2021 3:18 pm
by StefanR5R
Did you have "Disk: Leave at least […] GB free" defined in the computing preferences?

If so, then the client must have had too little information, or/and too late, about the actual disk space requirements.

Re: Rosetta python project 1.02 (vbox64) application

Posted: Wed Jun 02, 2021 3:25 pm
by crashtech
The figure I had set was too high, 95% of disk space. I've lowered it a little, and am shopping for a larger SSD. 256GB is too small these days for a 56 thread host. In my case, so much space was consumed that I was unable to log in.

Re: Rosetta python project 1.02 (vbox64) application

Posted: Thu Jun 03, 2021 5:18 am
by biodoc
I wonder if the the "rosetta python projects" app is just PyRosetta.

Re: Rosetta python project 1.02 (vbox64) application

Posted: Thu Jun 03, 2021 6:39 am
by StefanR5R
Hmm, I recently read a user report in one of the project message boards about the disk filling more and more with data from crashed tasks. That is, the client did not delete files after a task terminated with an error according to this user report. Which project was that again . . . . . . . . Ah, yes, it was CPDN.
(CPN thread App not removing files for completed tasks on opensuse linux)