Search found 240 matches

by StefanR5R
Sun Jan 15, 2023 12:14 pm
Forum: DC Projects setup and tuning
Topic: Weekly DC Stats scripts
Replies: 48
Views: 77343

Re: Weekly DC Stats scripts

Opening post edited: weekly_stats_dump.sh: – Don't look for OGR-28 updates anymore. fah_weekly_stats_dump.sh: – Use firefox's user agent string in the HTTP requests which are issued via the "links" browser. – Insert a small delay between HTTP requests, to go easy on the folding . extremeov...
by StefanR5R
Fri Jan 13, 2023 1:08 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

The upload server outage continues — sort of — for another few days. And yes, the server remains seriously undersized. Hello All, Brief update on status. The upload server is back running and we are currently in the process of transferring ~24TB of built up project results from that system to the an...
by StefanR5R
Thu Jan 12, 2023 12:42 am
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

I realize that the server has to catch up, but as poor as its performance is now, this will take a long while or may even never recover entirely. That's just my own pessimistic opinion, not fact, based on seeing server availability going down (and finally vanishing entirely) during the few hours ye...
by StefanR5R
Wed Jan 11, 2023 3:54 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

It's not. xii5ku could upload some bits a few hours ago, but now 100% of the transfer attempts fail. parsnip could upload, but has an increasing rate of failed transfers too now and therefore shut everything off again (due to disk space constraints). I realize that the server has to catch up, but as...
by StefanR5R
Mon Jan 09, 2023 3:08 pm
Forum: DC Projects setup and tuning
Topic: Weekly DC Stats scripts
Replies: 48
Views: 77343

Re: Weekly DC Stats scripts

Remove the dot before /home in the crontab line.
by StefanR5R
Fri Jan 06, 2023 11:35 am
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

New ETA: Monday.

Based on their progress so far, I am not making any guess which Monday. :-|
by StefanR5R
Thu Jan 05, 2023 3:07 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Request to volunteers to please enable: 'Leave non-GPU tasks in memory'
Replies: 1
Views: 1687

Re: [climateprediction.net] Request to volunteers to please enable: 'Leave non-GPU tasks in memory'

The main reason (but not the only one) for this notice is this: If an OpenIFS task (of the current application version and workunit batches) is suspended to disk too often, it will take more disk space for its state files than allowed as per the corresponding workunit property. At that point, the bo...
by StefanR5R
Thu Jan 05, 2023 2:02 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

A proposed fix is still in the making . Just out of a meeting with CPDN. They understand what the problem is. The upload server will be restarted but with reduced max http connections to keep it stable as best as possible. At some point very soon (today/tomorrow) they will move the upload server to ...
by StefanR5R
Thu Jan 05, 2023 1:49 pm
Forum: Tripping the Breakers
Topic: Low power video card
Replies: 47
Views: 89398

Re: Low power video card

No. There certainly is no 3D acceleration hardware in it, and the kernel driver provides just a simple frame buffer device. The AST2510 has got an ARM CPU which runs the BMC firmware. But even if you rewrote that firmware so that you can run your own stuff on this CPU, this embedded computer would c...
by StefanR5R
Wed Jan 04, 2023 2:55 pm
Forum: Tripping the Breakers
Topic: Low power video card
Replies: 47
Views: 89398

Re: Low power video card

Here is a 3.72 W video card: https://www.asrockrack.com/general/productdetail.asp?Model=TOMMY It is based on the ASPEED AST2510 chip, which is normally used as BMC. I am sure that its actual BMC functionality cannot be used via this add-in card, only the functionality as a VGA only video card remain...
by StefanR5R
Wed Jan 04, 2023 1:57 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

Floppy disk drives are examples of block storage devices.
Perhaps they are migrating from 5.25" to 3.5" floppies now.
Glenn Carver wrote:The upload server has about 25Tb of storage,
OK, admittedly that'd be a *lot* of floppies.
by StefanR5R
Tue Jan 03, 2023 7:00 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

According to the CPDN forum, they managed to revive the upload server today… only to have it fail again shortly thereafter. (Again no ssh access possible for the project admin.) Next try happens tomorrow. If it stays up, their network may be bottlenecked for a while when all the backlogged files co...
by StefanR5R
Mon Jan 02, 2023 3:05 pm
Forum: DC Projects setup and tuning
Topic: Weekly DC Stats scripts
Replies: 48
Views: 77343

Re: Weekly DC Stats scripts

<r>Which user is running the cronjob?<br/> What is the working directory of the cronjob? (Supposedly, the home directory of the user which runs the cronjob.)<br/> <br/> If you are unsure of the above, or maybe in any case, specify the output file by a full absolute path, not just the name.<br/> <br/...
by StefanR5R
Sun Dec 25, 2022 1:55 am
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

The upload server is down since >half a day ago. Take care that boinc's disk quota aren't reached. In theory, boinc will stop tasks. But if it doesn't work as designed, tasks would error out. Email sent but I do not see why Andy should sort this on Christmas day! it may well be the new year before i...
by StefanR5R
Fri Dec 23, 2022 12:49 am
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

In this week so far: 88 valid, 0 errors.
Available CPUs/ RAM/ disk/ heating demand of the flat would allow me to do much more, but my Internet uplink doesn't.
by StefanR5R
Wed Dec 21, 2022 4:16 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

Of my 20 + 2 newest completed tasks, the 20 on Epyc all had a peak working set size of 4.8 GB (varies by just a few MB), and the 2 on the Xeon E3 had a peak working set size of 4.4 GB (varying by just a few MB as well). Added in 12 minutes 35 seconds: PS: I watched the running tasks with htop for a ...
by StefanR5R
Wed Dec 21, 2022 3:40 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

Hosts 1535089 and 1530059 do have some successful tasks at least. (Credit will be applied later.) But indeed, overall that's a *lot* of failures. As far as I looked through them, all the failed tasks quit at some more or less early timestep with "The child process terminated with status: 0"...
by StefanR5R
Wed Dec 21, 2022 3:06 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

results.php isn't working with a userid filter (except if logged in as this user). A hostid filter would work for other users though. FWIW, by now I completed 22 tasks of the newest batch which was issued yesterday, 20 on an Epyc with Opensuse, 2 on a Xeon E3 with Gentoo Linux, and they are all vali...
by StefanR5R
Wed Dec 21, 2022 1:53 am
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

The usual reason for this is a series of error returns from the client. It will clear only if the client then delivers a few successful results (or just one?), or if the server admin manually removes this block. Due to the suspend bug of the earlier version of the application I had a series of failu...
by StefanR5R
Tue Dec 20, 2022 2:44 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

OpenIFS Perturbed Surface batches The next set of batches for the OpenIFS Perturbed Surface application are going out today/tomorrow. CPDN have asked me to write a short item on them as the scientist running the project is away. He will write something more complete for the CPDN website in due cour...
by StefanR5R
Thu Dec 15, 2022 3:12 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

StefanR5R wrote: Thu Dec 15, 2022 1:15 am – the upload server was upgraded (it's a cloud server),
There is at least one user on their message board who reports high upload speeds. I on the other hand am still getting transient HTTP errors, like before.
by StefanR5R
Thu Dec 15, 2022 1:15 am
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

During the last several days, – an application update was installed which should now survive suspend-to-disk/ resume from disk, – the upload server was upgraded (it's a cloud server), – a tiny batch of of "OpenIFS 43r3 Baroclinic Lifecycle" was sent. Run time and RAM footprint are similar ...
by StefanR5R
Mon Dec 12, 2022 1:43 pm
Forum: DC Projects setup and tuning
Topic: Weekly DC Stats scripts
Replies: 48
Views: 77343

Re: Weekly DC Stats scripts

<r><SPOILER title="OGR and RC5 files"><s>[SPOILER=OGR and RC5 files]</s> ${HOME}/Distributed_Computing/Weekly_Stats/OGR-28/11DEC2022.txt <CODE><s>[CODE]</s><i> </i>BPhantom - Team AnandTech 3,471,676,990 Participant #211,018 141,658,259 stefanlenz@hotmail.com 102,105,434 drdoug@techie.com 51,397,758...
by StefanR5R
Sat Dec 03, 2022 1:44 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

<r>For what it's worth, here is a snapshot of the RAM usage on my computers:<br/> 26x oifs + 38x llrSGS = 94 GB RAM in use<br/> 29x oifs + 35x llrSGS = 110 GB<br/> 53x oifs + 11x llrSGS = 184 GB<br/> llrSGS's RAM footprint is actually negligible. There is nothing else running on these computers, e.g...
by StefanR5R
Thu Dec 01, 2022 12:21 am
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

As far as I have seen, 1000 tasks came out late Monday, another 2000 tasks some time on Tuesday, and no other batch since. Therefore "tasks ready to send" went back to the usual 0 at some point yesterday. server_status.php shows runtimes of avg (min - max) of 16.4 (9 - 47) h, and of those,...
by StefanR5R
Tue Nov 29, 2022 2:47 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

<r>In a few hours I'll have the first tasks completed but still uploading for a while. I will then know the real rate of result data generation and can adjust my logical CPU count at this project, based on my Internet uplink speed. (Or uplink slowness, for a better fitting term.) I already reduced t...
by StefanR5R
Tue Nov 29, 2022 7:32 am
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

Glenn Carver wrote:There's another 2000 ready to go as soon as Andy gets to it. And then there's plenty more after, the scientist needs to run a minimum of ~42000.
(post 66625)
by StefanR5R
Tue Nov 29, 2022 1:07 am
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

The first little batch of 1000 "OpenIFS 43r3 Perturbed Surface" tasks was released a few hours ago. All of these have been sent to hosts by now. (There is talk of 3000 tasks in the message board, but server status shows just 1000.) On Zen 2 @ 2.9 GHz, no SMT, projected task duration is 2.6...
by StefanR5R
Thu Nov 24, 2022 7:20 pm
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

The OpenIFS application is for Linux x86-64. SO, unlike other CPDN applications, 32 bit libraries are not required. Tasks which are currently tested by the project take ~half a day on modern cores, up to 8 GB RAM, and are presumably cache-intensive.
by StefanR5R
Fri Nov 18, 2022 1:10 am
Forum: Distributed Computing News
Topic: [climateprediction.net] Linux work *perhaps* coming up in quantity
Replies: 64
Views: 66325

Re: [climateprediction.net] Linux work *perhaps* coming up in quantity

The current batch of "UK Met Office HadSM4 at N144 resolution" takes 2 days per task. (All tasks of this batch were sent to hosts already.) I don't recall how long OpenIFS work used to take, and whether or not suspend-to-disk works reliably with those. In general, there is a bit of a risk ...