teamanandtech.org

See the other recent CPDN related threads in this News section: They are turning to models with much shorter task durations, but with big memory footprint and huge result files. Currently this is Linux only. Longer term they want to offer OS independent vboxwrapper based versions of this. (I.e., wit...

So far they emitted only about 7000 tasks, which are all assigned to hosts already (IOW, 0 tasks ready to send) and of which 1/3rd has already been completed. Their feeble upload server should survive such a small batch easily. But the announcement sounds like a bigger batch than that.

Whoa, about 1/3rd (edit: certainly less than half) of the task duration of the current oifs_43r3_ps batches, but almost the same result data size per task to upload? I should probably check their message board for whether they a) fixed their upload server¹, b) tripled its data throughput or added tw...

On January 19, the upload server filled its disk again. This time the reason is that the tape drive system went down, to which data were streamed off of the upload server. To make matters worse, when the tape drive system will be back up, for some unstated reason, it won't have enough space for the ...

Update from CPDN meeting 16/1/23 Upload http connections will be increased over the next 2 days back to the previous maximum of 300 simultaneous connections as most of the previous uploaded data has now been moved off. The 'grace period' for return of tasks has been changed from 'nothing' to 30 day...

Opening post edited: weekly_stats_dump.sh: – Don't look for OGR-28 updates anymore. fah_weekly_stats_dump.sh: – Use firefox's user agent string in the HTTP requests which are issued via the "links" browser. – Insert a small delay between HTTP requests, to go easy on the folding . extremeoverclocking...

The upload server outage continues — sort of — for another few days. And yes, the server remains seriously undersized. Hello All, Brief update on status. The upload server is back running and we are currently in the process of transferring ~24TB of built up project results from that system to the an...

I realize that the server has to catch up, but as poor as its performance is now, this will take a long while or may even never recover entirely. That's just my own pessimistic opinion, not fact, based on seeing server availability going down (and finally vanishing entirely) during the few hours ye...

It's not. xii5ku could upload some bits a few hours ago, but now 100% of the transfer attempts fail. parsnip could upload, but has an increasing rate of failed transfers too now and therefore shut everything off again (due to disk space constraints). I realize that the server has to catch up, but as...

Remove the dot before /home in the crontab line.

New ETA: Monday.

Based on their progress so far, I am not making any guess which Monday. :-|

The main reason (but not the only one) for this notice is this: If an OpenIFS task (of the current application version and workunit batches) is suspended to disk too often, it will take more disk space for its state files than allowed as per the corresponding workunit property. At that point, the bo...

A proposed fix is still in the making . Just out of a meeting with CPDN. They understand what the problem is. The upload server will be restarted but with reduced max http connections to keep it stable as best as possible. At some point very soon (today/tomorrow) they will move the upload server to ...

No. There certainly is no 3D acceleration hardware in it, and the kernel driver provides just a simple frame buffer device. The AST2510 has got an ARM CPU which runs the BMC firmware. But even if you rewrote that firmware so that you can run your own stuff on this CPU, this embedded computer would c...

Here is a 3.72 W video card: https://www.asrockrack.com/general/productdetail.asp?Model=TOMMY It is based on the ASPEED AST2510 chip, which is normally used as BMC. I am sure that its actual BMC functionality cannot be used via this add-in card, only the functionality as a VGA only video card remain...

Floppy disk drives are examples of block storage devices.
Perhaps they are migrating from 5.25" to 3.5" floppies now.

Glenn Carver wrote:The upload server has about 25Tb of storage,

OK, admittedly that'd be a *lot* of floppies.

According to the CPDN forum, they managed to revive the upload server today… only to have it fail again shortly thereafter. (Again no ssh access possible for the project admin.) Next try happens tomorrow. If it stays up, their network may be bottlenecked for a while when all the backlogged files co...

<r>Which user is running the cronjob?<br/> What is the working directory of the cronjob? (Supposedly, the home directory of the user which runs the cronjob.)<br/> <br/> If you are unsure of the above, or maybe in any case, specify the output file by a full absolute path, not just the name.<br/> <br/...

The upload server is down since >half a day ago. Take care that boinc's disk quota aren't reached. In theory, boinc will stop tasks. But if it doesn't work as designed, tasks would error out. Email sent but I do not see why Andy should sort this on Christmas day! it may well be the new year before i...

In this week so far: 88 valid, 0 errors.
Available CPUs/ RAM/ disk/ heating demand of the flat would allow me to do much more, but my Internet uplink doesn't.

Of my 20 + 2 newest completed tasks, the 20 on Epyc all had a peak working set size of 4.8 GB (varies by just a few MB), and the 2 on the Xeon E3 had a peak working set size of 4.4 GB (varying by just a few MB as well). Added in 12 minutes 35 seconds: PS: I watched the running tasks with htop for a ...

Hosts 1535089 and 1530059 do have some successful tasks at least. (Credit will be applied later.) But indeed, overall that's a *lot* of failures. As far as I looked through them, all the failed tasks quit at some more or less early timestep with "The child process terminated with status: 0", "..Fail...

results.php isn't working with a userid filter (except if logged in as this user). A hostid filter would work for other users though. FWIW, by now I completed 22 tasks of the newest batch which was issued yesterday, 20 on an Epyc with Opensuse, 2 on a Xeon E3 with Gentoo Linux, and they are all vali...

The usual reason for this is a series of error returns from the client. It will clear only if the client then delivers a few successful results (or just one?), or if the server admin manually removes this block. Due to the suspend bug of the earlier version of the application I had a series of failu...

OpenIFS Perturbed Surface batches The next set of batches for the OpenIFS Perturbed Surface application are going out today/tomorrow. CPDN have asked me to write a short item on them as the scientist running the project is away. He will write something more complete for the CPDN website in due cour...

StefanR5R wrote: ↑

Thu Dec 15, 2022 1:15 am

– the upload server was upgraded (it's a cloud server),

There is at least one user on their message board who reports high upload speeds. I on the other hand am still getting transient HTTP errors, like before.

During the last several days, – an application update was installed which should now survive suspend-to-disk/ resume from disk, – the upload server was upgraded (it's a cloud server), – a tiny batch of of "OpenIFS 43r3 Baroclinic Lifecycle" was sent. Run time and RAM footprint are similar to the pre...

<r><SPOILER title="OGR and RC5 files"><s>[SPOILER=OGR and RC5 files]</s> ${HOME}/Distributed_Computing/Weekly_Stats/OGR-28/11DEC2022.txt <CODE><s>[CODE]</s><i> </i>BPhantom - Team AnandTech 3,471,676,990 Participant #211,018 141,658,259 stefanlenz@hotmail.com 102,105,434 drdoug@techie.com 51,397,758...

<r>For what it's worth, here is a snapshot of the RAM usage on my computers:<br/> 26x oifs + 38x llrSGS = 94 GB RAM in use<br/> 29x oifs + 35x llrSGS = 110 GB<br/> 53x oifs + 11x llrSGS = 184 GB<br/> llrSGS's RAM footprint is actually negligible. There is nothing else running on these computers, e.g...

As far as I have seen, 1000 tasks came out late Monday, another 2000 tasks some time on Tuesday, and no other batch since. Therefore "tasks ready to send" went back to the usual 0 at some point yesterday. server_status.php shows runtimes of avg (min - max) of 16.4 (9 - 47) h, and of those, the avg a...