Oh, hello. I was out of town most of last week on vacation, then Jeff and I were at OSCON 2009 down in San Jose until today. Despite being billed as an open source developer conference we got all kinds of linux sysadmin and mysql tips and tricks from various experts that we may apply towards better diagnosing of system/network/database issues in the future.

That all said, I haven't had the time to catch up on the lengthy discussions here in this forum during my absence. I imagine it has been mostly about our continuing network struggles. This may all become quite moot quite fast as Eric started rolling out the updated scientific analysis configuration, which is an easy knob to turn as we can increase sensitivity, thus improving our science, with the additional happy side benefit of reducing demand on our servers. I think, though, that we have now just reached the limits of that particular knob before getting diminishing returns.

Apparently there were a few servers that needed to be kicked while I was away. Jeff and Eric took care of all that. Mount issues and the like. We also seem to have our new disk arrays set up both at Arecibo and here, so the raw data pipeline should be kicking into full swing again soon. This is good as we're down to our last 10 files that we've been bringing up from the archives (there are a lot more files, but they require the radar blanking software to work in order to be processed, and I haven't gotten around to that yet).

- Matt-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

I wonder why you are moving to higher sensitivity MB rather than weaning us off MB and onto AP, because I thought AP gave a richer science content. Perhaps it is that we can't actually get any more AP's from Arecibo.

I wonder why you are moving to higher sensitivity MB rather than weaning us off MB and onto AP, because I thought AP gave a richer science content.

AP and MB use the same exact data from Arecibo. However, the science from AP and MB are quite different, so it's not like one is an improvement over the other, and both are doing valid, useful work. AP also processes much faster than we can apparently feed it, so we are still dominated by MB processing.

- Matt-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

what happen to the result-page?, I can't view my pending credit for quite a time.

patience; it'll be back soon.... while your waiting for it, play a game like throw out a random # of credits each until it's back on and the day you were the closets; consider that the smartest you've been in the past month. bet against yourself... LOL!

All I know is that last post "Working as Expected (Jul 13 2009)" with 210 replies gave me a headache once I was done reading it. If we can put a man on the moon then we can fix this bandwith database issue. We just need the NASA $1 billion funding. Oh wait....DAMN! In the mean time use the force Matt!

Matt. Just a small tip, i dont know much of the stuff on your end as im a regular tech. But i only use the pending credit page to see the total number not a per result page. Which im sure alot of people only look at the total also. Maybe you can make a total than you can click thru to see individual results. I dont know what kinda power it takes to pull up those pages on some people (mine is 26,000 pending) But if it lowers the load on things by 1% its a bonus.

Matt. Just a small tip, i dont know much of the stuff on your end as im a regular tech. But i only use the pending credit page to see the total number not a per result page. Which im sure alot of people only look at the total also. Maybe you can make a total than you can click thru to see individual results. I dont know what kinda power it takes to pull up those pages on some people (mine is 26,000 pending) But if it lowers the load on things by 1% its a bonus.

I recall someone (Matt??) saying that keeping a running WU count on all the accounts was too hard on the database which is why it is no longer available.

Matt. Just a small tip, i dont know much of the stuff on your end as im a regular tech. But i only use the pending credit page to see the total number not a per result page. Which im sure alot of people only look at the total also. Maybe you can make a total than you can click thru to see individual results. I dont know what kinda power it takes to pull up those pages on some people (mine is 26,000 pending) But if it lowers the load on things by 1% its a bonus.

I recall someone (Matt??) saying that keeping a running WU count on all the accounts was too hard on the database which is why it is no longer available.

I think a count would be less stress than showing all of the workunits.. there numbers.. credit.. etc etc etc

Matt. Just a small tip, i dont know much of the stuff on your end as im a regular tech. But i only use the pending credit page to see the total number not a per result page. Which im sure alot of people only look at the total also. Maybe you can make a total than you can click thru to see individual results. I dont know what kinda power it takes to pull up those pages on some people (mine is 26,000 pending) But if it lowers the load on things by 1% its a bonus.

I recall someone (Matt??) saying that keeping a running WU count on all the accounts was too hard on the database which is why it is no longer available.

I think it was David Anderson who took out the task count from the host summary pages for that reason as part of a BOINC-wide redesign, at much the same time as Matt said that the database could handle the individual load of people clicking on web pages just fine, it was the bulk load of handling the results (and later the automated load of stats scrapers hitting the website) that caused problems.

Matt. Just a small tip, i dont know much of the stuff on your end as im a regular tech. But i only use the pending credit page to see the total number not a per result page. Which im sure alot of people only look at the total also. Maybe you can make a total than you can click thru to see individual results. I dont know what kinda power it takes to pull up those pages on some people (mine is 26,000 pending) But if it lowers the load on things by 1% its a bonus.

I recall someone (Matt??) saying that keeping a running WU count on all the accounts was too hard on the database which is why it is no longer available.

I think a count would be less stress than showing all of the workunits.. there numbers.. credit.. etc etc etc

Dont you agree?

Actually, no. A count has to go through all of the working of determining which rows to include in the count. This is just as much work as determining which rows to have in the result data set. The only savings is in building and transporting the result data set. Since the result data set is fairly small in this case, the savings are fairly small.BOINC WIKI

Matt. Just a small tip, i dont know much of the stuff on your end as im a regular tech. But i only use the pending credit page to see the total number not a per result page. Which im sure alot of people only look at the total also. Maybe you can make a total than you can click thru to see individual results. I dont know what kinda power it takes to pull up those pages on some people (mine is 26,000 pending) But if it lowers the load on things by 1% its a bonus.

I download the pending page (right click; save as) then pass it through
this awk script to get total pending as well as by individual computer: