Nova Resource Talk:Tools

Rendered with Parsoid
From Wikitech
Latest comment: 9 years ago by Wolbo in topic Edit Counters missing data

Requesting access to the Tool Labs?

Click here.

Other

Please add me to the project. I'd create some tools (from http://ricordisamoa.tk/wiki2ls/) and operate my bot. --Ricordisamoa 21:04, 15 May 2013 (UTC)Reply

Done  Coren/Marc (talk) 21:35, 15 May 2013 (UTC)Reply

A few requests

Howdy admin-guys. Firstly, good job with the setup - I've tried migrating a few simpler tools over from the toolserver and been impressed with how simple it's been so far. I've a few minor requests which I'll post here for now (I couldn't work out your preferred method of receiving jobs - a statement on the project page along the lines of "if you need an admin to do something, click here to submit a JIRA ticket" might be useful).

  • When creating a new project, it seems to need an hour or so before one is able to 'become' the project role user. Something odd with the propagation of accounts perhaps. Perfectly acceptable, but could use documenting to avoid confusing newbies like myself.
  • The toolserver had a 'toolserver' database available on all shards containing a handful of useful reference tables. While it's no biggie to copy these into a user database, enough tools depend on them that you might end up hosting a few hundred duplicates. Could we have a similar facility here?
  • I found by trial and error that you have a sensible sftp setup. A mention of this on the project 'getting started' guide might assist other incomers.

Cheers. - tb (talk) 09:45, 24 May 2013 (UTC)Reply

A few more, with apologies in advance and assurances that none of this is urgent - I know you're still setting up the 'big things':
  • I'm unable to explain queries in mysql ("ERROR 1345 (HY000): EXPLAIN/SHOW can not be issued; lacking privileges for underlying table"). In all fairness, the toolserver has the same quirk, but it does make testing and optimising a pain.
  • Can I check that user databases are being backed up, and that it's possible (in case of dire need only of course) to request a restore of such a backup to a temporary user database.
- tb (talk) 09:30, 25 May 2013 (UTC)Reply
(Self-response for those that come after me; use Bugzilla (product "Wikimedia Labs", component "tools") to raise non-urgent things with the project admins. Relevant bugzilla tikets for the queries above are:
  • Unable to explain queries; 48875
  • Toolserver meta-information database 48626 & 48625
AFAIK there are no backups of the user databases either on tools-db or the replication slaves. Personally, I work on the assumption that any crashes of the database servers would be so disruptive that the user databases were the smallest problem of them all, and so I don't care for data that can be reproduced (i. e. scanning a dump, executing queries, etc.), and check static data into the repository of the tool. If your tool has user data that needs to be preserved, I would schedule a daily cron job that dumps the tables that are important to a file in the tool's directory. The latter is (somewhat) backed up (cf. Nova Resource:Tools/Help#Backups). --Tim Landscheidt (talk) 23:40, 10 June 2013 (UTC)Reply

Remove tool wpb

Hi there, could you please remove the tool wpb? It is redundant to pb. Thanks! --ireas (talk) 14:19, 11 September 2013 (UTC)Reply

slow slow slow!

Hi!

I try to move my global contributions tool to Labs. But the Problem is, that this servers seems to be much slower than the toolserver? If I scan all wikis, I get a proxy error after +/- 1min. Now I have limited it to the first 100 wikis, it's working but very very slow. e.g. http://toolserver.org/~luxo/contributions/contributions.php?user=derHexer vs. http://tools.wmflabs.org/guc/index.php?user=derHexer

I use a new script on Labs, which should be faster because it uses MySQL JOIN's exept two querys like the old script.

From my point of view it will get hard to move the tool to here if the server speed doesn't get boosted.

Greetings, --Luxo (talk) 15:32, 6 October 2013 (UTC)Reply

Hallo Luxo, versuche doch mal, die indizierte Tabelle revision_userindex zu nutzen. Bei mir hat das wahre Wunder bewirkt, siehe Bug 54107. --ireas (talk) 21:38, 15 October 2013 (UTC)Reply

Current queue

Hi,
any chance that someone can find the time and work through the current queue before the weekend?
Thanks, Amalthea 11:43, 17 October 2013 (UTC)Reply

Pcount tool?

Hi! What happened to this tool? Is there a replacement or some idea of bringing it back into action? Best of wishe.--Paracel63 (talk) 16:16, 17 March 2014 (UTC)Reply

It's working and is stable now, please report the problems on https://github.com/x-Tools/xtools/issues. JackPotte (talk) 21:27, 25 August 2014 (UTC)Reply

Tools offline

I just noticed that a lot of tools are offline.

Also the tool that I'm responsible for is offline and it seems like all files in /data/project/svwiktionary/public_html/ have been deleted. Why? skalman (talk) 19:30, 17 March 2014 (UTC)Reply

Tools are in migration from pmtpa to eqiad right at this moment. See and Tool_Labs/Migration_to_eqiad. --Hedonil (talk) 19:35, 17 March 2014 (UTC)Reply

reverted

I reverted the most recent edit because I suspect the user of being a vandal (and have now blocked User:Helperf). Someone with more expertise on who should have what permissions: please check it out. sumanah (talk) 13:29, 15 May 2014 (UTC)Reply

Starting webservice... failed.

I have hosted https://tools.wmflabs.org/jackbot/snottywong/ because the developer has abandoned it and I needed to see if it would deserve to be maintained. However the HTTP server was unstable (so I should set a cron to relaunch it regularly) and since today the following command doesn't work anymore:

tools.jackbot@tools-login:~$ webservice restart
Starting webservice... failed.
tools.jackbot@tools-login:~$

Just before it stopped, access.log displayed many different connections, probably because wikipedia:Wikipedia:Wikimedia_Labs/Toolserver_replacements redirects to it.

The error.log is empty for many hours:

2014-08-25 02:37:00: (mod_cgi.c.590) cgi died, pid: 4762
2014-08-25 02:37:00: (mod_cgi.c.590) cgi died, pid: 4785
2014-08-25 02:37:00: (mod_cgi.c.590) cgi died, pid: 4776
2014-08-25 02:37:00: (mod_cgi.c.590) cgi died, pid: 4767
2014-08-25 02:37:00: (mod_cgi.c.590) cgi died, pid: 4772
2014-08-25 02:37:00: (mod_cgi.c.590) cgi died, pid: 4737
2014-08-25 02:37:00: (server.c.1512) server stopped by UID = 0 PID = 401

So the server seems to be shutdown, how could we solve this please? JackPotte (talk) 21:34, 25 August 2014 (UTC)Reply

Done I don't know why, but it's resolved now. JackPotte (talk) 20:52, 26 August 2014 (UTC)Reply
But this service has always been unstable and should be restarted regularly. JackPotte (talk) 10:19, 4 October 2014 (UTC)Reply
Now I see that every tools are out of order for at least one hour, there should be a more specific error than time out on https://tools.wmflabs.org/. JackPotte (talk) 22:57, 7 October 2014 (UTC)Reply
It's getting worse and worse:
tools.jackbot@tools-login:~$ qstat
error: commlib error: got select error (Connection refused)
error: unable to send message to qmaster using port 6444 on host "tools-master.eqiad.wmflabs": got send error
tools.jackbot@tools-login:~$

JackPotte (talk) 12:08, 11 October 2014 (UTC)Reply

Edit Counters missing data

The message below was posted at Village pump (technical) regarding an issue with the edit counters but so far no-one there seems able to help. Anyone here who can shed a light on this? Thx.--Wolbo (talk) 18:18, 1 November 2014 (UTC)Reply

Various reports have been made in the last week or so about the Xtools edit counter being down. While it seems to be operational again since a day or two I noticed that edit data from October 24 and following days appears to be missing. Example 1) I made 8 edits to the Rod Laver article on October 27 (see [revision history]) but these do not show up in the [Revision history statistics] or [Edits by user] overviews. Example 2) I made 18 edits to the All England Plate article on October 25 which do not show in the [Revision history statistics] or [Edits by user] and also do not appear on my user edit count overview (Contributions > Edit count > Top edited pages section). Note that the edits on October 24 (and the one on October 29) have been captured. Is this a known issue and will it be repaired?--Wolbo (talk) 02:16, 30 October 2014 (UTC)Reply
This may be the same issue that I reported here. --Redrose64 (talk) 08:14, 30 October 2014 (UTC)Reply
Perhaps. I reported the issue at Github but was informed that it was not a specific Xtools issue because other tools, like [Edits by user], also showed missing data and that it had "something to do with Labs Replication DBs". So are there people here who can take this issue on or else point me to the right place to follow-up? Thx.--Wolbo (talk) 20:46, 30 October 2014 (UTC)Reply