Happy New Year 2012

DaB. <WP <at> daniel.baur4.info>
2012-01-01 14:58:52 GMT

Hello all,
we are should be in 2012 now, so I would like to wish you all a Happy New
Year. Let us hope that the toolserver will run smoothly, stable and fast in
this year, that it will be extended as far as it is needed, that new and old
users will write wonderfull tools, that people continue to use new and old
tools and that the roots will not cause more trouble than needed.
Happy New Year!
Sincerly,
DaB.
--
--
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

Hello all,
we are should be in 2012 now, so I would like to wish you all a Happy New
Year. Let us hope that the toolserver will run smoothly, stable and fast in
this year, that it will be extended as far as it is needed, that new and old
users will write wonderfull tools, that people continue to use new and old
tools and that the roots will not cause more trouble than needed.
Happy New Year!
Sincerly,
DaB.

Regular Maintenance on January 11th

Hello all,
like already announced after the last maintenance, the next maintenance will
be at
Wednesday, January 11, between 19:00 and 1:00 UTC.
The roots will collect what they will do at [1] until Sunday night. If you
have something for us to do (like a software-update) please open a bugreport
at JIRA and make sure to add the label "maintaince-window" until Sunday noon.
Cheers
Marlen

like already announced after the last maintenance, the next maintenance will
be at

Wednesday, January 11, between 19:00 and 1:00 UTC.

The roots will collect what they will do at [1] until Sunday night. If you
have something for us to do (like a software-update) please open a bugreport
at JIRA and make sure to add the label "maintaince-window" until Sunday noon.

<div>
<p>Hi:<br>
there isn't link in the mail or I don't see it :)</p>
<p>Dennis Tobar<br>
Superzerocool</p>
<div class="gmail_quote">El 10/01/2012 06:39, "Marlen Caemmerer" &lt;<a href="mailto:marlen.caemmerer <at> wikimedia.de">marlen.caemmerer <at> wikimedia.de</a>&gt; escribi&oacute;:<br type="attribution"><blockquote class="gmail_quote">
Hello all,<br><br>
like already announced after the last maintenance, the next maintenance will<br>
be at<br><br>
Wednesday, January 11, between 19:00 and 1:00 UTC.<br><br>
The roots will collect what they will do at [1] until Sunday night. If you<br>
have something for us to do (like a software-update) please open a bugreport<br>
at JIRA and make sure to add the label "maintaince-window" until Sunday noon.<br><br>
Cheers<br>
&nbsp; &nbsp; &nbsp; &nbsp;Marlen<br><br>
_______________________________________________<br>
Toolserver-l mailing list (<a href="mailto:Toolserver-l <at> lists.wikimedia.org">Toolserver-l <at> lists.wikimedia.org</a>)<br><a href="https://lists.wikimedia.org/mailman/listinfo/toolserver-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/toolserver-l</a><br>
Posting guidelines for this list: <a href="https://wiki.toolserver.org/view/Mailing_list_etiquette" target="_blank">https://wiki.toolserver.org/view/Mailing_list_etiquette</a><br>
</blockquote>
</div>
</div>

fatal: relocation error

Dmitry <dmitry89 <at> qip.ru>
2012-01-12 04:28:50 GMT

Hello all,
After yesterday's maintenance all my bots, that launched with mono, didn't work. Last successful run was
at 21:15 (UTC). Since 21:25 (UTC) I have received a lot of mails from Cron Daemon with similar content:
>> ld.so.1: mono: fatal: relocation error: file /opt/mono/bin/mono: symbol locale_charset:
referenced symbol not found
>> Killed
Can you explain what is it and how to solve this problem?
Dmitry.

interwiki.py

Maarten Dammers <maarten <at> mdammers.nl>
2012-01-14 21:21:34 GMT

Hi everyone,
Nightshade was a bit slow so I typed "top -c". I was amazed to see that
almost all the top processes seem to be interwiki related
(interwiki.py). Same seems to be the case at willow. Normally I wouldn't
really care, we have the servers so we should use them, but now the
login servers seem to be overloaded. Isn't this a bit too many interwiki
bots?
Maarten

Re: interwiki.py

In my opinion, the problem is not how many bots are working, but that
interwiki.py seems to use to overuse memory space. For example, my
interwiki.py was running, it was spending 982 megabyte and it was
killed. You may find a verbose log of its work at
http://toolserver.org/~nickanc/interwiki.log .
Nickanc
2012/1/14 Maarten Dammers <maarten <at> mdammers.nl>:
> Hi everyone,
>
> Nightshade was a bit slow so I typed "top -c". I was amazed to see that
> almost all the top processes seem to be interwiki related
> (interwiki.py). Same seems to be the case at willow. Normally I wouldn't
> really care, we have the servers so we should use them, but now the
> login servers seem to be overloaded. Isn't this a bit too many interwiki
> bots?
>
> Maarten
>
>
> _______________________________________________
> Toolserver-l mailing list (Toolserver-l <at> lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: interwiki.py

In my opinion, the problem is not how many bots are working, but that
interwiki.py seems to use to overuse memory space. For example, my
interwiki.py was running, it was spending 982 megabyte and it was
killed. You may find a verbose log of its work athttp://toolserver.org/~nickanc/interwiki.log .

No, that is not the problem. Multichill was referring to CPU usage, not memory usage. And although interwiki.py in general is using a large amount of memory, your specific case has a different origin (being the use of the ReferringPageGenerator, which results in a memory leak).

You may be able to partially mitigate your problem by using

interwiki_contents_on_disk = True,

but this will not solve the actual memory leak - it will only release memory used by the page contents.

<div><div class="gmail_quote">On 15 January 2012 00:32, Nickanc Wikipedia <span dir="ltr">&lt;<a href="mailto:nickanc.wiki <at> gmail.com">nickanc.wiki <at> gmail.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote">
In my opinion, the problem is not how many bots are working, but that<br>
interwiki.py seems to use to overuse memory space. For example, my<br>
interwiki.py was running, it was spending 982 megabyte and it was<br>
killed. You may find a verbose log of its work at<br><a href="http://toolserver.org/~nickanc/interwiki.log" target="_blank">http://toolserver.org/~nickanc/interwiki.log</a> .<br><br>
</blockquote>
<div>No, that is not the problem. Multichill was referring to CPU usage, not memory usage. And although interwiki.py in general is using a large amount of memory, your specific case has a different origin (being the use of the&nbsp;ReferringPageGenerator, which results in a memory leak).</div>
<div><br></div>
<div>You may be able to partially mitigate your problem by using</div>
<div>interwiki_contents_on_disk = True,</div>
<div>but this will not solve the actual memory leak - it will only release memory used by the page contents.</div>
<div><br></div>
<div>If you'd like to discuss details on your problem, please mail to the pywikipedia mailing list &lt;<a href="mailto:pywikipedia-l <at> lists.wikimedia.org">pywikipedia-l <at> lists.wikimedia.org</a>&gt; or visit on IRC.</div>
<div><br></div>
<div>Merlijn</div>
</div></div>

Re: interwiki.py

DaB. <WP <at> daniel.baur4.info>
2012-01-15 16:38:40 GMT

Hello,
At Sunday 15 January 2012 17:13:26 DaB. wrote:
> Isn't this a bit too many interwiki
> bots?
yes, there are, although not the cpu-load is the problem but the memory-usage.
The best solution would be if the mediawiki-devs finaly get rid of interwiki-
links in the article-text of course, but I have the fealing thta will not
happen soon. The second best solution would be, if the interwiki.py would fix
their code, but there I have also the fealing that will take some time.
So here is my plan to fix the problem on our (the TS) side:
1.) I create a MMP called interwiki-bot (or something).
2.) YOU (the ts-users) choose (by election, by appointing, by playing "Trip to
Jerusalem", I don't care) 5 of you who will become member of that MMP until
15th February. Only rule: 1 of the 5 has to be an active user of a non-
wikipedia-project (like wikisource or wiktionary or so).
3.) The members of the MMP create a wikimedia-project-account (like "ts-
interwikibot" or something) and request global-bot-status until 1. April.
4.) After 2. April no-one is allowed to run a interwiki-bot except the MMP.
Any problems with my plan?
Sincerly,
DaB.
--
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

Hello,
At Sunday 15 January 2012 17:13:26 DaB. wrote:
> Isn't this a bit too many interwiki
> bots?
yes, there are, although not the cpu-load is the problem but the memory-usage.
The best solution would be if the mediawiki-devs finaly get rid of interwiki-
links in the article-text of course, but I have the fealing thta will not
happen soon. The second best solution would be, if the interwiki.py would fix
their code, but there I have also the fealing that will take some time.
So here is my plan to fix the problem on our (the TS) side:
1.) I create a MMP called interwiki-bot (or something).
2.) YOU (the ts-users) choose (by election, by appointing, by playing "Trip to
Jerusalem", I don't care) 5 of you who will become member of that MMP until
15th February. Only rule: 1 of the 5 has to be an active user of a non-
wikipedia-project (like wikisource or wiktionary or so).
3.) The members of the MMP create a wikimedia-project-account (like "ts-
interwikibot" or something) and request global-bot-status until 1. April.
4.) After 2. April no-one is allowed to run a interwiki-bot except the MMP.
Any problems with my plan?
Sincerly,
DaB.
--
--
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885