X-Git-Url: https://iankelling.org/git/?p=mediawiki-setup;a=blobdiff_plain;f=Mediawiki_Setup_Guide;h=d17fa35edaa7b0d74bb3fcae8eae9906f3b4d6c6;hp=580ea3cb90f92302f4ad1ff336fd8e82cf2930e5;hb=e8ca8d27f45d2585bb8fba1d9d60a1f56fb170d6;hpb=129494ebc3e9e0a99477e9f99b61672237612935 diff --git a/Mediawiki_Setup_Guide b/Mediawiki_Setup_Guide index 580ea3c..d17fa35 100644 --- a/Mediawiki_Setup_Guide +++ b/Mediawiki_Setup_Guide @@ -1,6 +1,6 @@ == Introduction == -'''tldr''': For Gnu/Linux (with a bit of Debian bias), a more concise, holistic and automated install than the official Mediawiki docs. Do some initial configuration then download this page and run it, or execute it as you read. +'''tldr''': For GNU/Linux (with a bit of Debian bias), a more concise, holistic and automated install than the official Mediawiki docs. Do some initial configuration then download this page and run it, or execute it as you read. ''' Goals / Why use this guide? ''' @@ -9,14 +9,14 @@ * Explicit automation support wherever practical * Used to setup this site (style optional) * Contributions welcome and will be updated/tested on this very site! -* Support for multiple linux distros +* Support for multiple gnu/linux distros * Holistic scope (backups, server setup), but sections stand on their own * Explicit support for production & local testing instance. Additions for production like https and web analytics. * Edits to this page are closely monitored by the original author. '''Assumptions''' -* Self hosting, single Linux system with Bash shell +* Self hosting, single GNU/Linux system with Bash shell * Root shell is assumed throughout * Code blocks are [https://en.wikipedia.org/wiki/Idempotent idempotent] @@ -37,7 +37,7 @@ The most common route and the one taken by this site is buying a domain name fro '''Email Setup''' -Setting up email can be an involved process. Mediawiki is perfectly happy to disable email with 1 setting (no password reminders or notifications), but it is a nice feature to have. You could run your own mail server (on the mediawiki server, or elsewhere), or use one of many services which sends mail for very cheap, or free within limits (popular examples [http://www.mailgun.com/ mailgun], [https://mandrillapp.com/ mandrill], [http://www.mailjet.com/pricing mailjet], [https://aws.amazon.com/ses/ aws]), or connect to a full featured send/receive mail provider like [https://fastmail.com fastmail] (this server is setup that way). How we did that is for a future wiki page. +Setting up email can be an involved process, and this guide assumes that a some program (usually postfix or exim) is implementing a functional sendmail interface. Mediawiki uses email with to send password reminders or notifications, and this guide includes cronjobs for updating mediawiki and doing backups which will send mail in the case of an error. Email is also the recommended way to get notifications of package updates which require manual steps such as restarting of services. If you are not setting up your server to send mail with a program that uses the default sendmail interface, see these pages when you are configuring mediawiki: [[mediawikiwiki:Manual:$wgEnableEmail|Manual:$wgEnableEmail]], [https://www.mediawiki.org/wiki/Configuration_settings#Email_settings Manual:Email_settings], [[mediawikiwiki:Manual:$wgSMTP|Manual:$wgSMTP]] @@ -61,31 +61,32 @@ export wikipass=REPLACE_ME # root password for the mysql database export dbpass=REPLACE_ME -# git branch for mediawiki + extensions. -# This guide has only been tested with 1_27. -# branch names: https://git.wikimedia.org/branches/mediawiki%2Fcore.git -export mw_branch=REL1_27 +export mwdomain=REPLACE_ME # domain name. for this site, it's ofswiki.org -# customize these questions to something your contributors would know, -# and at least doesn't have the answer directly in the question +# customize these questions. Try not to have the answer be a word in the question. captchaArray() { if ! grep -Fx '$localSettingsQuestyQuestions = array (' $mwc; then tee -a $mwc <<'EOF' $localSettingsQuestyQuestions = array ( "What is the name of the wiki software this site (and wikipedia) uses?" => "Mediawiki", - "What does f in ofswiki.org stand for?" => "Free" + "REPLACE_ME with a question" => "REPLACE_ME with an answer" ); EOF fi } +# The rest of this section will work fine with no changes. + +# git branch for mediawiki + extensions. +# This guide has only been tested with 1_27. +# branch names: https://git.wikimedia.org/branches/mediawiki%2Fcore.git +export mw_branch=REL1_27 + # As set by gui installer when choosing cc by sa. export mw_RightsUrl='https://creativecommons.org/licenses/by-sa/4.0/' export mw_RightsText='Creative Commons Attribution-ShareAlike' export mw_RightsIcon='$wgScriptPath/resources/assets/licenses/cc-by-sa.png' - -export mwdomain=REPLACE_ME # domain name. for this site, it's ofswiki.org # Alphanumeric site name for pywikibot. # Here we use the domain minus the dots, which should work fine without changing. export mwfamily=${mwdomain//./} @@ -161,7 +162,7 @@ mw-ext () { mw-clone https://gerrit.wikimedia.org/r/p/mediawiki/extensions/$ext if [[ -e $mw/ext/$ext/extension.json ]]; then # new style extension. remove old style declaration - sed -i '#^require_once( "\\\$IP/extensions/\$ext/\$ext\.php" );#d' $mwc + sed -i --follow-symlinks '#^require_once( "\\\$IP/extensions/\$ext/\$ext\.php" );#d' $mwc teeu $mwc </dev/null; then # in debian wheezy time-frame distros, mediawiki was packaged. - apt-get -y install php-apc mediawiki + apt-get -y install php-apc mediawiki php-mbstring else # https://www.mediawiki.org/wiki/Manual:Installation_requirements if apt-get install -s php7.0 &>/dev/null; then # note, 7.0 is untested by the editor here, since it's not # available in debian 8. it's listed as supported # in the mediawiki page. - # noninteractive to avoid mysql password prompt + # noninteractive to avoid mysql password prompt. DEBIAN_FRONTEND=noninteractive apt-get install -y apache2 mysql-server \ php7.0 php7.0-mysql libapache2-mod-php7.0 php7.0-xml \ - php7.0-apcu + php7.0-apcu php7.0-mbstring else + # note: mbstring is recommended, but it's not available for php5 in + # debian jessie. DEBIAN_FRONTEND=noninteractive apt-get install -y apache2 mysql-server \ php5 php5-mysql libapache2-mod-php5 php5-apcu fi @@ -377,7 +380,7 @@ git clone $git_site/acme-tiny-wrapper l=$mw/../../logs mkdir -p $l -acme-tiny-wrapper/acme-tiny-wrapper $mwdomain +acme-tiny-wrapper/acme-tiny-wrapper -t $mwdomain git clone $git_site/basic-https-conf { cat </dev/null; then - git remote add ian-kelling https://iankelling.org/git/Vector + git remote add ian-kelling https://iankelling.org/git/forks/Vector fi git fetch ian-kelling git checkout ian-kelling/REL1_27-toolbox-in-dropdown @@ -726,7 +729,7 @@ fi Enable account creation that we initially disabled. -sed -i "/\\\$wgGroupPermissions\\['\\*'\\]\\['createaccount'\\] = false;/d" $mwc +sed -i --follow-symlinks "/\\\$wgGroupPermissions\\['\\*'\\]\\['createaccount'\\] = false;/d" $mwc == Additional Configuration with Pywikibot == @@ -871,7 +874,8 @@ div#mw-content-text { """) EOF -python pwb.py ${mwfamily}_setup +# this can spam a warning, so uniq it +python pwb.py ${mwfamily}_setup |& uniq @@ -893,10 +897,13 @@ sudo dd of=$backup_script <<'EOFOUTER' last_error=0 trap 'last_error=$?' ERR source ~/mw_vars +# No strict because the host is likely not named the same as +# the domain. +ssh="ssh -oStrictHostKeyChecking=no" logfile=/var/log/${mwdomain}_backup.log { echo "#### starting backup at $(date) ####" -ssh root@$mwdomain < ~/wiki_backups/wiki_db_backup sed -i '\$ d' $mwc # delete read only setting ENDSSH +# add no strict option to the defaults + +rdiff() { rdiff-backup --remote-schema "$ssh -C %s rdiff-backup --server" "$@"; } set -x -rdiff-backup root@$mwdomain::/root/wiki_backups ~/backup/${mwdomain}_wiki_db_backup -rdiff-backup root@$mwdomain::$mw ~/backup/${mwdomain}_wiki_file_backup +rdiff root@$mwdomain::/root/wiki_backups ~/backup/${mwdomain}_wiki_db_backup +rdiff root@$mwdomain::$mw ~/backup/${mwdomain}_wiki_file_backup set +x echo "=== ending backup at $(date) ====" } &>>$logfile @@ -924,7 +934,7 @@ If you are like most people and don't use the old-school mail spool, setup the b '''Optional & requires additional steps''' -sed -i "/^root:/d" /etc/aliases +sed -i --follow-symlinks "/^root:/d" /etc/aliases echo "root: EXAMPLE_ONLY_REPLACE_ME@gmail.com" >> /etc/aliases newaliases @@ -933,7 +943,7 @@ newaliases '''Whenever you implement a backup system, you should test that restoring the backup works.''' -You ''should'' be able to restore your wiki to a new machine by repeating all install steps, then restoring the database and the images directory. However, we backup the entire Mediawiki directory in case you forget to record a step, or some misbehaving code stores some state in a file. Since most people don't record the steps they took to setup Mediawiki, this is also the officially recommended method. Here we restore only the database and images folder, which should help identify any of those aforementioned issues. See [[mediawikiwiki:Manual:Restoring a wiki from backup]] if you run into any problems. +You ''should'' be able to restore your wiki to a new machine by repeating all install steps, then restoring the database and the images directory. I've done this many times. However, we backup the entire Mediawiki directory in case you forget to record a step or some corner case happens. Since most people don't record the steps they took to setup Mediawiki, this is also the officially recommended method. In the code below we restore only the database and images folder from the full backup. You can try this after setting up a wiki from scratch. If it doesn't work, you know your fresh setup is not replicating your backed up wiki correctly. In that case, you can fall back to doing a full restore by copying the full directory instead of just the images. See [[mediawikiwiki:Manual:Restoring a wiki from backup]] if you run into any problems. To test a backup restore: # Do a backup of your wiki with some content in it, as described in the previous section @@ -946,16 +956,19 @@ To test a backup restore: #!/bin/bash source ~/mw_vars -HOSTNAME=REPLACE_ME source ~/mw_vars -rdiff-backup -r now ~/backup/${mwdomain}_wiki_file_backup /tmp/wiki_file_restore -scp -r /tmp/wiki_file_restore/images root@$mwdomain:$mw/images -rdiff-backup -r now ~/backup/${mwdomain}_wiki_db_backup /tmp/wiki_db_restore -scp -r /tmp/wiki_db_restore root@$mwdomain:/tmp -ssh root@$mwdomain < Then browse to your wiki and see if everything appears to work. @@ -975,21 +988,24 @@ dd of=$s<<'EOF' #!/bin/bash source ~/mw_vars cd $mw -git fetch --all -git checkout origin/$mw_branch -git rebase ian/REL1_23-toolbox-in-dropdown -cd extensions -for x in *; do - if [[ -d $x ]]; then - cd $x - git fetch --all - git checkout origin/$mw_branch || git checkout -qf origin/master - cd .. +for dir in extensions/* skins/* $mw; do + [[ -d $dir ]] || continue + cd $dir + branch=$(git describe --all) + branch=${branch#remotes/} + git fetch --all -q + new_head=$(git rev-parse $branch) + log=$(git log HEAD..$new_head) + if [[ $log ]]; then + pwd + echo "$log" fi + git checkout -q $new_head + cd $mw done php $mw/maintenance/update.php -q EOF -chmod +x $s + == Upgrading Major Versions == @@ -1052,7 +1068,7 @@ I do not recommend using google analytics: it's proprietary software and gives p Overall the documentation is good, but like wikipedia, it depends. -The closer a topic is to core functionality and commonly used features, the better the documentation is likely to be. My guess is that Wikimedia Foundation (WMF) has a competing priority of being a good upstream to mediawiki users and being good for their own sites. That, plus the multitude of unconnected extension developers, and official documentation is sometimes neglected in favor of bug reports, readme files, comments, code, and unpublished knowledge. User's edits vary in quality, and often aren't reviewed by anyone. If you run into an issue, try viewing/diffing the most recent version of a page by the last few editors. +The closer a topic is to core functionality and commonly used features, the better the documentation is likely to be. Wikimedia Foundation (WMF) has a competing priority of being a good upstream to mediawiki users and being good for their own sites. That, plus the multitude of unconnected extension developers, and official documentation is sometimes neglected in favor of bug reports, readme files, comments, code, and unpublished knowledge. User's documentation edits vary in quality, and often aren't reviewed by anyone. If you run into an issue, try viewing/diffing the most recent version of a page by the last few editors. One issue is that mediawiki.org needs a lot of organizing, deleting, and verifying of material, and that is relatively unpopular, tedious, and sometimes difficult work. The discussion pages of mediawiki.org are a wasteland of unanswered questions and outdated conversations, which is [https://www.mediawiki.org/wiki/Help:Talk_pages poor form] for a wiki. However, if you communicate well, you can get great help from their [https://www.mediawiki.org/wiki/Communication support forum, irc, and mailing list].