Nova Resource:Math

Resource Type	Resource Type::project
Project Name	[[Project::math]]
Monitoring	nagf
Admins	{{#arraymap:User:hcohl,User:jiabao,User:mobrovac,User:novaadmin,User:physikerwelt,User:yuvipanda|,|x|* Member::x|\n}}
Members	{{#arraymap:User:hcohl,User:jiabao,User:mobrovac,User:novaadmin,User:physikerwelt,User:yuvipanda|,|x|* Member::x|\n}}

Documentation

{{#formlink:form=Nova Project Documentation |target=Nova Resource:Math/Documentation |link text=Edit documentation }}

Math

Willing to take contributors or not

willing

Subject area narrow or broad

broad {{#arraymap:Math, Wikidata, MathML, HTML5, W3C|,|x|}}

This project has the following purposes:

1. Improve the rendering quality of math
2. Make math searchable
3. Add semantic information to the mathematical content

data-set

As a test data-set we use the subsection of the English wikipedia that contains math tags. The size of the dataset is about 28k Articles with about 450k ${\displaystyle }$ tags, and about 280k unique ${\displaystyle }$ tags.

Overview

The public entry point for a demo is

• http://math2.beta.wmflabs.org/wiki

The enabled plugins are visible at http://math2.beta.wmflabs.org/wiki/Special:Version

Comparision of rendering methods

A comparison of the rendering methods can be seen at

• http://math2.beta.wmflabs.org/wiki/Special:MathDebug?length=10&offset=20&page=Short+test&action=show

info about math2

Setup

• Wait until first successful puppet run
• Reboot
• enable labs::vagrant puppet module
• create localhome for vagrant user
• run sudo labs-vagrant provision
• run sudo labs-vagrent enable-role mathsearch
• provision again
• import Wikipedia articles that contain math from http://demo.formulasearchengine.com/images/enwikimath.xml.bz2
• move mysql data directory
  • enable role::labs::lvm::mnt puppet module
  • shutdown mysql
  • move /var/lib/mysql to /mnt/mysql
  • update /etc/mysql/my.conf and /etc/apparmor.d/usr.sbin.mysqld
  • start mysql

Todo

• move mysql directory to a place with sufficient space

physikerwelt@math2:/etc/mysql$ df -h
Filesystem                                      Size  Used Avail Use% Mounted on
/dev/vda1                                       7.6G  1.9G  5.3G  26% /
udev                                            2.0G  8.0K  2.0G   1% /dev
tmpfs                                           792M  256K  791M   1% /run
none                                            5.0M     0  5.0M   0% /run/lock
none                                            2.0G     0  2.0G   0% /run/shm
/dev/vda2                                       1.9G  577M  1.3G  32% /var
labstore.svc.eqiad.wmnet:/dumps                 9.1T  8.0T  1.2T  88% /public/dumps
labstore.svc.eqiad.wmnet:/scratch               7.3T  871M  7.3T   1% /data/scratch
labstore.svc.eqiad.wmnet:/keys                  960M   30M  930M   4% /public/keys
labstore.svc.eqiad.wmnet:/project/math/project   30T   14T   17T  46% /data/project
labstore.svc.eqiad.wmnet:/backups                20T     0   20T   0% /public/backups
labstore.svc.eqiad.wmnet:/project/math/home      30T   14T   17T  46% /home

• make mysql database accessible from within the math test cluster i.e. for stratosphere
• evaluate performance metrics again

DRMF

The purpose of the NIST Digital Repository of Mathematical Formulae (DRMF) is to create a digital compendium of mathematical formulae for orthogonal polynomials and special functions (OPSF) and of associated mathematical data. The DRMF provides a platform for publication and interaction with OPSF formulae on the web. Using MediaWiki extensions and other existing technology (such as software and macro collections developed for the NIST Digital Library of Mathematical Functions), the DRMF acts as an interactive web domain for OPSF formulae. Whereas Wikipedia and other web authoring tools manifest notions or descriptions as first class objects, the DRMF does that with mathematical formulae.

This project has many goals which are directly in line with important goals of MediaWiki. In order to develop this resource we are adding features to the MediaWiki math extension and in conjunction with these, building MediaWiki extensions specific to DRMF. By using these features we will add accessibility to the math extension. The use of semantic macros will lead to improved capabilities for search and accessibility. Not only that, we are developing formula search which have the potential to add to the future capabilities of MediaWiki for large databases such as Wikipedia.

Users of instances

drmf-ecf

Yusuf

drmf2015

Akash

drmf

hcohl

drmf-beta

physikerwelt

drmf-test

unassigned

mlp

jimmy, norman, alexey

mathosphere

physikerwelt

Server admin log

March 4

• 21:35 andrewbogott: (and also because Howie requested it)
• 21:34 andrewbogott: moved http://drmf-beta.wmflabs.org to point to the drmf-beta instance, and http://drmf.wmflabs.org to point to the drmf instance. Because previously it was the other way around which was super confusing.

September 16

• 19:36 andrewbogott: moving and rebooting mws instance

January 17

• 08:57 andrewbogott: moving math-semantics to a new virt host to avoid a storage crunch. This will reboot the instance.

===... (more)

Instances for this project

{{#ask:Resource Type::instance[[Project::math]] |?Instance Type |?Image Id |?Public IP |?Number of CPUs |?RAM Size |?Amount of Storage |?Modification date |mainlabel=FQDN |format=broadtable |limit=20 |order=DESC |sort=Modification date |offset=0 }}