Wordman/ProjectGezlak - Revision history

Wordman: How you can help

2010-06-09T13:20:08Z

How you can help

Wordman: Script run completed

2010-06-09T12:59:30Z

Script run completed

Nikink: /* Comments */ Thanks to Wordman

2010-06-09T01:59:30Z

‎Comments: Thanks to Wordman

Wordman: Script running now

2010-06-08T14:16:20Z

Script running now

Nikink: /* Comments */

2010-06-08T06:09:07Z

‎Comments

Wordman: READ ME - potential link Armageddon coming

2010-06-07T19:05:13Z

READ ME - potential link Armageddon coming

Show changes

Wordman: READ ME - potential link Armageddon coming

2010-06-07T18:59:41Z

READ ME - potential link Armageddon coming

New page

__NOTOC__
* Back to [[Wordman/CommissionEngine]]

I'm starting Project Gezlak (named after a type of metal elemental that roams Autochthonia) to try to automatically fix the links that were broken during the process of [[Xyphoid/MediawikiConversion|converting to MediaWiki]]. This would probably be a lot easier with direct access to the server, but I don't have that.

The idea is to use the [http://pywikipediabot.sourceforge.net/ Python wikipedia robot framework] to examine page content, detect certain kinds of damaged links, and repair them.

The script has been tested on a handful of pages, and seems to work; however, I can't rule out all mistakes. Tell me about these in the following sections:

== Errors ==

If you notice the script had errors, list them here.

* error

== Opt-out ==

If you'd rather keep a certain page out of this automatic cleanup, list it here:

* page

== Comments ==

@@ Line 18: / Line 18: @@
 <pre>
 #!/usr/bin/python
 import wikipedia as pywikibot
@@ Line 63: / Line 86: @@
     # NOTE: Put a good description here, and add translations, if possible!
     msg = {
-       'en': u'Testing script to fix links messed up in conversion'
+       'en': u'Script: fix links messed up in conversion'
+    }
@@ Line 152: / Line 175: @@
        else:
           print "   ...no changes."
     def treatLine(self, line):
@@ Line 168: / Line 190: @@
              newLink = link
           start = match.start(1)
-          str_list.append(line[lastPos:start])
+          if (newLink[0] == '|'):
-         str_list.append(newLink)
+            #The link is now empty, which means to strip it out entirely, including brackets
           lastPos = end
           if not self.quiet and link != newLink:
@@ Line 187: / Line 216: @@
        if not self.pageExists(link):
           (link,label,sourceLast) = self.repairMissingLink(line, link, label, sourceLast)
-       #if self.pageExists(link):
+       if self.pageExists(link):
-      #   (link,label,sourceLast) = self.repairExistingLink(line, link, label, sourceLast)
+         (link,label,sourceLast) = self.repairExistingLink(line, link, label, sourceLast)
        else:
           print "   Warning: after repairs, link %s still not found. Using anyway." % (link)
@@ Line 197: / Line 226: @@
     def pageExists(self, link):
        cleanLink = link.replace('_',' ')
        cleanLink = cleanLink[0].capitalize() + cleanLink[1:]
@@ Line 202: / Line 233: @@
     def repairExistingLink(self, line, link, label, end):
-       # "Prettify links starting with 'wordman'
+       # "Pretify links starting with 'Lexicon'
-       if link.startswith('Wordman') and not label:
+       if link.startswith('Lexicon') and not label:
           levels = self.levelPat.split(link)
           if len(levels) > 1:
@@ Line 218: / Line 249: @@
        if len(levels) > 2:
           (link, label, end) = self.repairMultiLevelLink(line, link, label, end, levels)
        return (link, label, end)
@@ Line 260: / Line 298: @@
        link = testlink;
        return (link, label, end)
     def space_out_camel_case(self, str, delimiter=' '):

← Older revision		Revision as of 01:59, 9 June 2010
Line 335:		Line 335:

	Screw it. Script running now. I probably could have done this better as an export/alter/import, but the hell with it. - [[Wordman]]		Screw it. Script running now. I probably could have done this better as an export/alter/import, but the hell with it. - [[Wordman]]
		+
		+	Seems to have worked a treat, as far as I can tell on my pages anyway. :) Thanks again! [[nikink]] ''Saved me a lot of work!''

@@ Line 13: / Line 13: @@
 * error
 == Code ==
@@ Line 337: / Line 331: @@
 == Comments ==
 Great! I look forward to seeing the results. Thankyou! :) [[nikink]]

← Older revision		Revision as of 06:09, 8 June 2010
Line 337:		Line 337:

	== Comments ==		== Comments ==
		+	Great! I look forward to seeing the results. Thankyou! :) [[nikink]]

@@ Line 4: / Line 4: @@
 I'm starting Project Gezlak (named after a type of metal elemental that roams Autochthonia) to try to automatically fix the links that were broken during the process of [[Xyphoid/MediawikiConversion|converting to MediaWiki]]. This would probably be a lot easier with direct access to the server, but I don't have that.
-The idea is to use the [http://pywikipediabot.sourceforge.net/ Python wikipedia robot framework] to examine page content, detect certain kinds of damaged links, and repair them.
+The idea is to use the [http://pywikipediabot.sourceforge.net/ Python wikipedia robot framework] to examine page content, detect certain kinds of damaged links, and repair them. The script is not perfect, so now that it has been run, there may be things that are either still damaged or got damaged by the script.
-The script has been tested on a handful of pages, and seems to work; however, I can't rule out all mistakes. Tell me about these in the following sections:
+== How You Can Help ==
 == Errors ==