Release Engineering/SAL

2016-01-17

21:47 legoktm: deploying https://gerrit.wikimedia.org/r/264489
21:36 legoktm: deploying https://gerrit.wikimedia.org/r/264488
21:29 legoktm: deploying https://gerrit.wikimedia.org/r/264487
21:21 legoktm: deploying https://gerrit.wikimedia.org/r/264483 https://gerrit.wikimedia.org/r/264485
20:58 legoktm: deploying https://gerrit.wikimedia.org/r/264492
18:55 jzerebecki: reloadin zuul for 996c558..5f8eb50
09:12 legoktm: deploying https://gerrit.wikimedia.org/r/264448
09:01 legoktm: deploying https://gerrit.wikimedia.org/r/264446 and https://gerrit.wikimedia.org/r/264447
07:46 legoktm: sudo -u jenkins-deploy mv /mnt/jenkins-workspace/workspace/mediawiki-core-phplint /mnt/jenkins-workspace/workspace/mediawiki-core-php53lint on all precise slaves
07:17 legoktm: deploying https://gerrit.wikimedia.org/r/264444
06:31 legoktm: deploying https://gerrit.wikimedia.org/r/264441
06:10 legoktm: added phpflavor-php53 label to all phpflavor-zend slaves

12:17 hashar: restarting Jenkins for plugins updates
02:49 bd808: Trying to fix submodules in deployment-bastion:/srv/mediawiki-staging/php-master/extensions for T123701

21:06 hashar: beta cluster code is up to date again. Got delayed by roughly 4 hours.
20:55 hashar: unlocked Jenkins jobs for beta cluster by disabling/reenabling Jenkins Gearman client
10:15 hashar: beta: fixed puppet on deployment-elastic06 . Was still using cert/hostname without .deployment-prep. .... Mass update occurring.

23:30 legoktm: deploying https://gerrit.wikimedia.org/r/263757 https://gerrit.wikimedia.org/r/263756
13:32 hashar: beta cluster: running /usr/local/sbin/cleanup-pam-config
13:29 hashar: integration running /usr/local/sbin/cleanup-pam-config on slaves

22:24 hashar: Deleting old references on Zuul-merger for mediawiki/core : /usr/share/python/zuul/bin/python /home/hashar/zuul-clear-refs.py --until 15 /srv/ssd/zuul/git/mediawiki/core
22:21 hashar: gallium in /srv/ssd/zuul/git/mediawiki/core$ git gc --prune=all && git remote update --prune
22:21 hashar: scandium in /srv/ssd/zuul/git/mediawiki/core$ git gc --prune=all && git remote update --prune
07:35 legoktm: deploying https://gerrit.wikimedia.org/r/263319

23:16 legoktm: deleted /mnt/jenkins-workspace/workspace/mediawiki-extensions-qunit/src/extensions/PdfHandler/.git/refs/heads/wmf/1.26wmf16.lock on slave 1013
06:32 legoktm: deploying https://gerrit.wikimedia.org/r/262868
02:24 legoktm: deploying https://gerrit.wikimedia.org/r/262855
01:25 jzerebecki: reloading zuul for b0a5335..c16368a

21:13 thcipriani: kicking integration puppetmaster, weird node unable to find definition.
21:11 jzerebecki: on scandium: sudo -u zuul rm -rf /srv/ssd/zuul/git/mediawiki/services/mathoid
21:04 legoktm: ^ on gallium
21:04 legoktm: manually deleted /srv/ssd/zuul/git/mediawiki/services/mathoid to force zuul to re-clone it
20:17 hashar: beta: dropped a few more /etc/apt/apt.conf.d/*-proxy files. webproxy is no more reachable from labs
09:44 hashar: CI/beta: deleting all git tags from /var/lib/git/operations/puppet and doing git repack
09:39 hashar: restoring puppet hacks on beta cluster puppetmaster.
09:35 hashar: beta/CI: salt -v '*' cmd.run 'rm -v /etc/apt/apt.conf.d/*-proxy' https://phabricator.wikimedia.org/T122953

21:06 hashar: gallium has puppet enabled again
20:53 hashar: stopping puppet on gallium and live hacking Zuul configuration for https://phabricator.wikimedia.org/T122656

22:17 bd808: No nodepool ci-jessie-* hosts seen in Jenkins interface and rake-jessie jobs backing up