13:02 valhallasw`cloud: grrrit-wm1 is handled by k8s, and thus restarts nicely. I can't figure out where the other one is running, though...
12:58 valhallasw`cloud: I don't see it running anywhere else either. Odd. Let's kill the single one I see...
12:54 valhallasw`cloud: running on tools-worker-1005.tools.eqiad.wmflabs according to k8s (kubectl --user=lolrrit-wm --namespace=lolrrit-wm describe pod grrrit-sm8km)
12:52 valhallasw`cloud: two instances running, k8s is only aware of one of them
2015-09-07
11:08 ircnotifier: valhallasw: Deployed 4c9f323ff3baf90dd4a52ea12e5178cf5bf66ef4 Report WikimediaBadges changes to #wikidata-feed
11:07 ircnotifier: valhallasw: Deployed 4c9f323ff3baf90dd4a52ea12e5178cf5bf66ef4 Report WikimediaBadges changes to #wikidata-feed
2015-09-05
21:59 James_F: Ignore that, wrong project.
21:59 James_F: Deployed I39593c5 and I66bfa515
2015-09-01
21:11 valhallasw`cloud: and then we `fab start-job` and then hopefully everything is allright again....?
21:10 valhallasw`cloud: now qdel'ing the job, but there's still one left. ARRRGGHGH
16:51 valhallasw`cloud: gerrit was restarted, so that's probably the cause
16:50 valhallasw`cloud: ssh connection to gerrit seems dead; restarting
June 15
20:12 ircnotifier: valhallasw: Deployed 2f5de55ff75c3c268decfda7442dcdd62df0a42d Change #wikidata to #wikidata-feed
June 7
10:18 valhallasw: ran qmod -rj lolrrit-wm
June 5
19:04 legoktm: ori restarted the bot after it stopped working due to the gerrit restart
May 12
21:19 ircnotifier: valhallasw: Deployed 38a61981f2f894a19a2a9f0f65f0c0bee07dd16f Merge "Move Math repo from #mediawiki-visualeditor to #wikimedia-editing"
May 1
18:20 ircnotifier: valhallasw: Deployed 5b7fddd5ce468ced7f3d3ed5061a5a4ae62891a5 Remove definitions for #wikimedia-mobile
April 24
17:47 ircnotifier: yuvipanda: Deployed eb0c42177bf160a9990bde3b3a6d8500da786124 Return a unique list of channels (remove dupes).
April 17
21:10 legoktm: manually started it, why is bigbrother still disabled?
March 29
12:09 valhallasw: "2015-03-29T12:09:30.093Z - info: Connected to event stream!"
12:02 valhallasw: YES! Ok, connected to event stream now. The issue was A) not being able to join #wmt, which means the number of channels joined was wrong, and B) checking for config.nick, so testing with a second grrrit-wm didn't work
11:57 valhallasw: Added logging to log connecting to gerrit, but it doesn't seem to do that at all. What the heck?!
11:51 valhallasw: I also don't see any mention of connecting to gerrit.wikimedia.org in the log file. Last message was yesterday, 2015-03-28T10:57:47.422Z - info: Sent message from extensions/EducationProgram to #mediawiki-feed
11:49 valhallasw: *maybe* the issue is it can't join #wmt, although it's not clear to me why that should silently kill all output
11:44 valhallasw: grrrit-wm still looks broken. Trying to run manually on tools-bastion-02
March 28
16:58 valhallasw: allowed grrrit-wm to schedule on a trusty webgrid node for now (qalter -q webgrid-generic,webgrid-lighttpd,task,continuous 9420587)
16:21 valhallasw: restart fails because tools-exec-12 is severely overloaded. WTH?
16:20 valhallasw: seems the json parser got stuck in an error state; all kinds of " at Object.parse (native)...." errors
16:19 valhallasw: restarted grrrit-wm
March 11
15:44 ircnotifier: yuvipanda: Deployed 4d0fbb28c9ddf9dec60c03e1a1084fc3ad42cd60 Add some obvious repos to -releng (and scap to -operations too)
15:12 ircnotifier: yuvipanda: Deployed 163bac22f003c83443c69d03efed65d8c358ab8c Directly interface with gerrit stream-events
04:31 YuviPanda: restarted grrrit-wm and gerrit-to-redis
February 22
21:57 legoktm: for some reason two grrrit-wm's were running, even though there was only a single job. After qdel, both lolrrits died, and a fab start_job later everything looks OK again
21:52 ircnotifier: legoktm: Deployed c06fb25dbd4ece9e8493393bae7081e42ba9ddbe Merge "Add MoodBar and WikiLove to #wikimedia-collaboration"
12:49 valhallasw`cloud: for some reason two grrrit-wm's were running, even though there was only a single job. After qdel, both lolrrits died, and a fab start_job later everything looks OK again
12:46 ircnotifier: valhallasw: Deployed f4a809b6b6ddb5dac25c27d26e1d20967ee6816c Add MoodBar, WikiLove to #wikimedia-collaboration
12:43 ircnotifier: valhallasw: Deployed ca0427db5c7482a4a825c67db7e098d5047d53cd Set password
