wiki/jogobot-red
1
0
Fork 0
Code Issues 4 Pull Requests Releases Wiki Activity
296 Commits 2 Branches 14 Tags
master
Commit Graph
56 Commits
Author SHA1 Message Date
golderweb 1b82de1eab Fix #72: Markpages terminates with error 
Filtering templates with wikicode as match param does not work anymore,
explicitly cast to string
 2019-06-08 13:38:25 +02:00
golderweb 5cdccaeec6 missingnotice: Add RedFam counter output 
Signalize bot is working, since processing RedFams takes about
15 minutes with out any output right now

Issue #64 (#64)
 2018-09-25 17:51:01 +02:00
golderweb 54d8b8ea3b missingnotice: Disable verbose logging of sqlalchemy 
Issue #64 (#64)
 2018-09-18 16:29:54 +02:00
golderweb dea5a393ad missingnotice: Call RedFamWorker.flush_db_cache 
To write status changes to db

Issue #64 (#64)
 2018-09-18 16:29:50 +02:00
golderweb f021a13202 missingnotice: Implement run() 
The bots working sequence, using previously implemented methods to
update the list of missing notices

Issue #64 (#64)
 2018-09-18 16:29:45 +02:00
golderweb 4c8ba95534 missingnotice: Implement update_page() 
This method updates the content of the configured or given wikipage with
the generated lines

Issue #64 (#64)
 2018-09-18 16:29:40 +02:00
golderweb 9804db212f missingnotice: Implement format_row() 
With this method, the links to redundance discussions and articles
missining notice are concatenated and formated

Issue #64 (#64)
 2018-09-18 16:29:34 +02:00
golderweb 68b81b1111 missingnotice: Implement treat_redfam 
For each redfam, we need to check weather related redundance discussion
exists and if there are missing notices. For those redfams return links
to discussion and articles missing notice.

Issue #64 (#64)
 2018-09-18 16:29:28 +02:00
golderweb 95af95aca6 missingnotice: Implement article selection 
Issue #64 (#64)
 2018-09-18 16:29:17 +02:00
golderweb dbcc2717d7 missingnotice: Implement article query 
Issue #64 (#64)
 2018-09-18 16:28:56 +02:00
golderweb cfb3e8e37c bots: Add basic structure for MissingNoticeBot 
Issue #64 (#64)
 2018-09-18 16:28:29 +02:00
golderweb 93447d8dc6 Prepare release v1.0 
Update Copyright Notices
Version information
 2017-11-05 12:25:13 +01:00
golderweb 9640467f69 markpages: Use redarticle attribute of Page 
Instead of trying to reconstruct our db article title, use the one added
to Page-object by redfam.article_generator

Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161)
 2017-11-05 11:22:43 +01:00
golderweb bfec2abf98 markpages: Get rid of PageWithTalkPageGenerator 
Since redfam.article_generator can yield talkpage with additional
information about redfam and current article from db, we do not need it
anymore.

Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161)
 2017-11-05 11:20:55 +01:00
golderweb bdccc8417c Set always in Pywikibot.Basebot 
If cmdline param -always is set, set the related option in
Pywikibot.Basebot Object for automatic edits with out further requests

Related Task: [FS#152](https://fs.golderweb.de/index.php?do=details&task_id=152)
 2017-09-23 23:49:41 +02:00
golderweb b3cfcdc259 Improve title detection to get correct behaviour 
Make sure that categorie links are starting with colon and non article
pages are returned with namespace.

Related Task: [FS#154](https://fs.golderweb.de/index.php?do=details&task_id=154)
 2017-09-02 15:59:34 +02:00
golderweb f8002c85da Do not search for templates recursivly 
Since nested templates did not get an index in global wikicode object
searching for index of an nested template results in ValueError

Related Task: [FS#153](https://fs.golderweb.de/index.php?do=details&task_id=153)
 2017-09-02 14:23:25 +02:00
golderweb 8a26b6d92a Normalize article titles with anchors 
In our db article titles with anchors are stored with underscores in
anchor string. Therefore we need to replace spaces in anchor string
given by pywikibot.Page.title().

Related Task: [FS#151](https://fs.golderweb.de/index.php?do=details&task_id=151)
 2017-08-25 18:11:41 +02:00
golderweb 49a8230d76 Merge branch 'fs#141-place-notice-after-comment' into develop 2017-08-25 17:11:28 +02:00
golderweb 31c10073a2 Prevent index errors searching for comments 
Make sure not to exceed existing indexes of wikicode object while trying
to search for comments

Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141)
 2017-08-25 17:09:38 +02:00
golderweb 642a29b022 Improve regex for blank lines 
Do not match consecutive linebreaks as one

Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141)
 2017-08-24 18:47:18 +02:00
golderweb 024be69fe1 Use famhash as generator 
If famhash is defined, fetch explicitly that redfam from db and work
only on this

Related Task: [FS#146](https://fs.golderweb.de/index.php?do=details&task_id=146)
 2017-08-24 12:27:13 +02:00
golderweb 3aa6c5fb1c Disable PreloadingGenerator temporarily 
PreloadingGenerator mixes up yielded Pages. This is very unconvenient
for semi-automatic workflow with manual checks as the articles of the
RedFams were not following each other.

Related Task: [FS#148](https://fs.golderweb.de/index.php?do=details&task_id=148)
 2017-08-24 12:23:17 +02:00
golderweb 41e5cc1a9d Merge branch 'fs#141-place-notice-after-comment' into develop 2017-08-24 12:06:03 +02:00
golderweb 9b9d50c4d2 Improve detection of empty lines 
Search with RegEx as empty lines could also contain spaces

Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141)
 2017-08-24 12:04:45 +02:00
golderweb cc02006fd2 Do not exclude redirects from beeing marked 
In accordance with Zulu55 redirect discussion pages should also get
a notice, therefore do not exclude redirects.

Related Task: [FS#140](https://fs.golderweb.de/index.php?do=details&task_id=140)
 2017-08-22 21:59:07 +02:00
golderweb 4137d72468 Look for existing notice by simple in-check 
To detect maybe uncommented notices already present, check for them
using just a simple python x in y check over whole wikicode

Related Task: [FS#138](https://fs.golderweb.de/index.php?do=details&task_id=138)
 2017-08-22 21:56:43 +02:00
golderweb 47b85a0b5e Add missing line break if there is no template 
To make sure our notice template resides in its own line in every case

Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141)
 2017-08-21 22:09:59 +02:00
golderweb 8422d08cb6 Keep comments and leading templates together 
Prevent spliting up existing comments and templates as often those are
documenting archiv templates behaviour

Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141)
 2017-08-21 13:49:34 +02:00
golderweb 34e7e0d3be Prevent index Error if no template in leadsec 
Check if there is a template in leadsec before accessing list item to
prevent IndexErrors

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=115 FS#115]
 2017-03-11 12:22:10 +01:00
golderweb 37704c6661 Replace pywikibot.showDiff with patched version 
Pywikibot.bot.userPut does not support setting the value of diff context
so it is always zero. Therefore we need to patch either userPut or
showDiff to get some context.

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=113 FS#113]
 2017-03-11 10:39:31 +01:00
golderweb 3e69a1c77e Remove problem indicating stati when set marked 
Remove states which are indicating problems in previous runs if
successfully marked article and also whole RedFam

[https://fs.golderweb.de/index.php?do=details&task_id=112 FS#112]

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=110 FS#110]
 2017-03-11 00:03:42 +01:00
golderweb 868894a38b Format fixes 
Set locale to de_DE.utf-8 for whole Task

Make sure Template is added in own source line
 2017-03-10 23:28:24 +01:00
golderweb 65de6decb2 markpages: Filter redirects 
Do not mark redirects discussion pages
 2017-03-10 21:51:59 +01:00
golderweb 147e96d388 Add Wrapperclass for Parser to RedPage 
Add a wrapper class to overwrite type of Items returned by
RedPage.redfams relationship

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=109 FS#109]
 2017-03-09 15:30:51 +01:00
golderweb e16925197c Fix pep8.. compliance 
To be concordant with the coding styles fix pep8 compliance
 2017-03-09 00:12:31 +01:00
golderweb 844fee52ae Make markpages using new DB/Class structure 
Update markpages and RedFamWorker-Code to use the new sqlalchemy based
DB ORM Interface
 2017-03-09 00:10:51 +01:00
golderweb 89b50e3312 Remove old status API 
Now we use the methods of status object directly
 2017-03-09 00:10:50 +01:00
golderweb 467f829af2 Some cleanups 
Remove old commented out code from manual mysql solution
 2017-03-09 00:10:50 +01:00
golderweb 6e973369cd sqlalchemy working for parser 
Needs some testing, presumably contains some bugs
 2017-03-09 00:08:48 +01:00
golderweb 0ebf307bb8 Add markpages as subtask 
Markpages is a subtask of our Red-Bot

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=89 FS#89]

# The following line will be added automatically
# Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
 2016-11-05 19:41:22 +01:00
golderweb d55c81c97b Set article status when worked on talkpage 
To detect whole redfam status after run over all articles

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=89 FS#89]
 2016-08-30 18:05:51 +02:00
golderweb 870ed4bf25 Update redfam.article_generator use article status 
To be able to filter articles by status of that article

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=89 FS#89]
 2016-08-30 17:47:02 +02:00
golderweb 6149dcdb8b Apply changes to data structure 
See related ticket

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=94 FS#94]
 2016-08-30 14:28:28 +02:00
golderweb 20b811bc2a Make sure edit summary starts with bot 
Due to bot policy all edit summaries of bot edits have to start with
"Bot:"

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=92 FS#92]
 2016-08-30 11:48:07 +02:00
golderweb 59d4d23c83 Set edit summary for each edit 
Each edit of bot needs a edit summary

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=92 FS#92]
 2016-08-30 11:33:54 +02:00
golderweb 2b93e4cf16 Check if notice is present before add 
To prevent duplications we need to check wether notice is already
present on talkpage

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
 2016-08-28 21:39:54 +02:00
golderweb 9beca7f6c9 Implement method to add notice to disk page 
Adds the generated notice to the talkpage and starts the saving of
the page

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
 2016-08-28 21:33:36 +02:00
golderweb c4d8a95672 Implement build_generator-method 
Build_generator will add the redfam_talkpages_generator to the
genFactory, build a generator of the genFactory and sets self.gen
which is used as generator for run()

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
 2016-08-28 18:13:27 +02:00
golderweb da4f9b5d6b Add wrapper-generator to redfam.article_generator 
We need a wrapper around redfam.article_generator to pass it to
pagegenerators.PageWithTalkPageGenerator and to add a reference to
related redfam to each pywikibot.page-object before yielding it

Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
 2016-08-28 18:09:04 +02:00