View source for Manual:Importing external content

{{merge|commons:Commons:Convert tables and charts to wiki code or image files}}
:''To import a wiki XML file, see [[Manual:Importing XML dumps]]''

Existing sites are difficult to move to MediaWiki. 

"Wikifying" existing content from text files, HTML websites, or even office documents can be automated, but you'll have to write appropriate scripts on your own, and almost always must edit manually. 

Learn MediaWiki's [[wikitext]] language first, because you will want to be sure to do all manual edits correctly, once, using every notable feature. 

Consider installing [[Semantic Bundle]] and other extensions that extend markup before devoting a lot of manual effort to what may end up being an unsupportable set of conventions. Semantic Bundle deals well with page and object properties.

There are no general-user ready-to-run scripts available for data imports that anyone supports on more than a case-by-case basis.  Any wiki farm or MediaWiki administrator usually knows some ways to convert data to SQL or to supportable files, and a number of commercial forks of MediaWiki (like [[BlueSpice]]) claim to offer some additional facilities for commonly used formats.  ''These are commercial efforts and documenting them is beyond the scope of this manual.''

Unlike proprietary CMSes like Hyperwave or HTML editors like Microsoft FrontPage, MediaWiki (and most open source software except WordPress) includes few import filters.  With tens of millions of some of the most heavily accessed and trusted content in the world already in MediaWiki format, it is generally up to those maintaining data in incompatible formats to make it accessible in MediaWiki, not the other way around.  MediaWiki is focused on presenting its own [[wikitext]] effectively and in every language and device, it is fundamentally not focused on old or obsolete database import.  It is not contemplated to "sync" MediaWiki to anything but other MediaWiki based sites.  Conversion to MediaWiki should be one-time and data maintained in its format thereafter, with a few exceptions discussed below.  

''One notable glaring lack is any ability to easily mirror LDAP, SMB or NFS directories into wiki pages, the best workaround at present is to link an HTML page on the same server since HTML browsers usually make pages on the fly for this.''

{{RightTOC}}

== MediaWiki and wikitext-based compatibles ==

To do a one-time import from another MediaWiki wiki, please see [[Manual:Importing XML dumps]], [[Manual:Importing revisions]], and [[Manual:Restoring a wiki from backup]]. XML dumps are required, as to import an older MediaWiki's SQL requires significant expertise with MySQL etc. To restore an old SQL version, it's best to install the original MediaWiki it was for, restore the database in phpMyAdmin, and then forward-upgrade the code. A riskier method is to install a new MediaWiki, rename its database in phpMyAdmin, import the older one, rename it to match the name used in the newer install expected in its code, and carefully restore privileges from the renamed DB to match. Then run mw-config update (not the maintenance script, it may not work) and export the MediaWiki wiki to XML properly as backup.

=== Live mirroring ===

There is at present no facility for current MediaWiki wikis similar to the old [http://getwiki.net/-GetWiki:Overview GetWiki 1.0 live XML importing] which mirrored another (usually Wikipedia) MediaWiki and used its page content as default unless edited at the new (mirroring) MediaWiki.  This feature however can be weakly simulated with frequent import of XML dumps for pages that don't exist on an importing wiki, ignoring versions of pages that do or over-writing them from a backup just prior to importing the XML dump.

Wikipedia did not support the GetWiki approach to live mirroring for load reasons and perhaps to avoid early forks of "community". These are historical and do not prevent pursuing this approach for current extensions.  The feature would be immensely useful for intranet purposes, for instance, having more and less secure versions of the same wiki content, with extra details added for the more trusted users.

Ironically it's easier to [https://wordpress.org/plugins/wiki-embed/ embed MediaWiki content in WordPress] than in MediaWiki itself.  Some users of both like [http://prwatch.org PRwatch]/[http://sourcewatch.org SourceWatch] make use of this approach.

So-called "embedded wikis" [https://stackoverflow.com/questions/7328805/embed-wiki-content-in-a-website are never MediaWiki-based] due to this lack of capability, developers who want to embed wiki into other social media or websites almost never use MediaWiki.

=== JAMWiki ===

[https://sourceforge.net/projects/jamwiki/ JAMWiki] was developed between 2006 and 2013<ref>https://sourceforge.net/p/jamwiki/mailman/message/34289882/</ref>, was written in Java, and aimed to be mostly MediaWiki-compatible. Its major selling point was ease of installation. It is no longer actively developed.<ref>https://web.archive.org/web/20170926190156/http://jamwiki.org/wiki/en/JAMWiki;jsessionid=0A1DE59839691D9E1895DD6FA1002DC2</ref>

Its underlying file format, being standard wikitext, should be able to be copy-pasted from its flat-file document storage into a running MediaWiki instance. Have a look at tools like [[Manual:Pywikibot|pywikibot]] if you need to automate this for a large JAMWiki site.

== Incompatible (non-wikitext) wikis ==

MediaWiki's [[wikitext]] markup is among the most commonly used in the world, supporting most natural languages and character sets. Various efforts at standardizing wiki markup<ref>For example, http://www.wikicreole.org</ref> have been attempted, but the fact remains that no "universal wiki" converter exists.

Most conversion tools are one-way, rather than bidirectional, requiring you to abandon the legacy wiki after the import is completed. However, many good options now exist for self-hosting (e.g., [[Docker]] containers and [[software bundles]]) or cloud-hosting (e.g., Fandom) your own MediaWiki instance. Good out-of-the-box support for setting up new wikis on shared hosting providers (e.g., DreamHost), more powerful desktops and LAN servers, and improved XML based backup and restore tools, have made it possible to maintain a MediaWiki instance without special expertise.

=== Converting content from a UseMod Wiki ===

Prior to MediaWiki (''Wikipedia Software Phase III'' and ''Phase II''), Wikipedia ran on the [http://www.usemod.com/cgi-bin/wiki.pl?UseModWiki UseMod Wiki] software written by Clifford Adams. UseModWiki is a Perl script which uses a database of text files to generate a WikiWiki site. It usually runs as a [[w:Common_Gateway_Interface|CGI]] script in response to web requests, but can be called directly by other Perl programs. 

The storage format of UseMod Wiki is [http://www.usemod.com/cgi-bin/wiki.pl?DataBase well documented].

=== Converting content from a PHPWiki ===

[https://sourceforge.net/projects/phpwiki/ PHPWiki] is a clone of the original WikiWikiWeb in PHP.<ref>https://web.archive.org/web/20050630002228/http://phpwiki.sourceforge.net/</ref> It is still receiving updates, and works with PHP 8.x.

Isaac Wilcox wrote a [https://web.archive.org/web/20060321190337/https://www.iwilcox.me.uk/2005/07/php2mediawiki/ Perl script] which converts all the commonly used PHPWiki markup to MediaWiki wikitext, although some tweaking of the results may be necessary. It was written in the MediaWiki 1.4.x – 1.5.x days, and it's likely to have problems with more recent MediaWiki releases, due to schema changes. At that time, though, it was reputed to do <q>an excellent job of preserving almost all of the formatting</q>, so it could still be a useful resource, even if minor changes are necessary to make it compatible with recent versions.

See [[Manual:PhpWiki conversion|PhpWiki conversion]] for a solution using <code>sed</code>. For another solution, combining the already mentioned ones, see [[User:Atrox~mediawikiwiki/Phpwiki2Mediawiki]].

For a PHP-based solution, [https://web.archive.org/web/20110426150010/http://www.webforce.co.nz:80/phpwiki2mediawiki.php.txt this script] (by a now-defunct New Zealand web design shop) might be workable, after some cleanup to remove the archive.org banners and analytics.

=== Converting MoinMoin format to MediaWiki format ===

There are various scripts for this, all dodgy. See [[MoinMoin]].

=== Converting WackoWiki to MediaWiki ===

There is [[Manual:WackoWiki Conversion|WackoWiki converter]] (developed for http://freesource.info/ migration to http://altlinux.org/), however it will need additional tweaking before use.

=== Converting TikiWiki format to MediaWiki format ===
You can convert [https://tiki.org/ TikiWiki] pages to MediaWiki format using [[Manual:TikiWiki Conversion|this script]].

=== Converting GoogleCode Wiki to MediaWiki ===
There is example of migrating site to MediaWiki, with remaining storage of pages in SNV - http://ahuman.org, code in http://usvn.ahuman.org/svn/ahwiki/tools.

It allows to store pages in both formats - <tt>.gw</tt> (googlecode) and <tt>.mw</tt> (MediaWiki), and scripts to support bidirectional SVN&harr;MediaWiki transfer.

=== Converting WikiSpaces format to MediaWiki<span id="Converting_WikiSpaces_format_to_MediaWiki."></span> ===
See [[Wikispaces]].

== Converting content from tabular (row/column) formats ==
See [[c:Commons:Convert_tables_and_charts_to_wiki_code_or_image_files|Commons methods of converting tables and charts]]. This includes LibreOffice Calc, Excel, OpenOffice.org formats, and etc. - ''it's been proposed to merge that page with this one.''

Most simple tabular formats can be exported to "comma-separated" CSV files so these are commonly 

=== Linux ===
On Linux [https://www.linux.com/news/two-handy-mediawiki-extensions csv2wiki] [https://organicdesign.nz/Import_CSV_data_into_a_wiki] imports CSV format.

=== Windows ===

==== from/on Windows CSV text file ====
If you are using Windows you can try [https://sourceforge.net/projects/csv2other/ csv2other]. It produces an output file with .txt extension containing code for a wiki table.    

==== from/on Windows directory/folder listing ====
[https://www.addictivetips.com/windows-tips/how-to-convert-a-directory-into-html-index-file-or-create-a-sitemap/ Dir2html] creates simple HTML pages from Windows directories, so that these may be treated like any other HTML when imported below:

== Converting content from HTML ==
* [https://pandoc.org/demos.html Pandoc] has an [https://pandoc.org/try/ online demo]. It has command line tool, integration to Python/Ruby and written in Haskell.
* [https://bitbucket.org/axelclk/info.bliki.wiki/wiki/HTML2Mediawiki HTML2Mediawiki] Java library with [http://wiki-conv.appspot.com/ online demo].

=== Older tools ===
* https://magnustools.toolforge.org/html2wiki.php can convert HTML tables into MediaWiki table syntax
* [https://metacpan.org/dist/HTML-WikiConverter HTML-WikiConverter] Perl module 
* [https://www.donationcoder.com/software/mouser/obsolete-stuff/mwimporter MwImporter], a PHP script for importing entire websites; it uses html2wiki and other MediaWiki maintenance scripts to import entire directories of static html and image files while preserving relative links, etc.
* The [[Extension:Html2Wiki|Html2Wiki]] extension. The (unmaintained) extension is a wrapper around Pandoc.

== Converting content from a MS-Word document ==

[http://www.microsoft.com/en-us/download/details.aspx?id=12298 Microsoft Office Word Add-in For MediaWiki] saves documents from Microsoft Office Word straight into MediaWiki.

[[:en:LibreOffice|LibreOffice]] also does a good job of reading MS Word and a usable job of exporting as MediaWiki wikitext.

== Converting content from plain text files ==
You can use the [[Manual:ImportTextFiles.php|importTextFiles.php]] maintenance script.

== Converting content from other sources ==

If you are able and willing to do some scripting by yourself, it is possible to import almost any existing textual content with a documented file format into MediaWiki.

=== Example: CIA World Factbook 2002 ===
As an example, there is the public domain data from the [https://www.cia.gov/library/publications/the-world-factbook/index.html CIA World Factbook 2002] which was imported into the MediaWiki [http://wikitravel.org/en/Wikitravel:CIA_World_Factbook_2002_import Wikitravel]. 

This is a one-time script; most paths and coding are hard-coded, and lots of the code is for parsing the ''CIA World Factbook'' print pages, but it might serve as a good example of what can be done.

== Importing content in Windows PowerShell ==

[[Manual:Importing XML dumps]] describes various tools to import XML dumps of wiki pages, including the Special:Import wiki page.

[[Category:MediaWiki administration|{{PAGENAME}}]]

==References==
<references/>