Jonathan Golder
4e4be1c6d0
Merge branch 'fs#110-markpages-status-problems' into test-v3
7 years ago
Jonathan Golder
3e69a1c77e
Remove problem indicating stati when set marked
Remove states which are indicating problems in previous runs if
successfully marked article and also whole RedFam
[https://fs.golderweb.de/index.php?do=details&task_id=112 FS#112]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=110 FS#110]
7 years ago
Jonathan Golder
56f326b568
Fix error all current redfams marked when quit
Restructure update_status to make sure, marked is only set when all
articles are marked or gone (means deleted or redirect)
[https://fs.golderweb.de/index.php?do=details&task_id=111 FS#111]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=110 FS#110]
7 years ago
Jonathan Golder
868894a38b
Format fixes
Set locale to de_DE.utf-8 for whole Task
Make sure Template is added in own source line
7 years ago
Jonathan Golder
65de6decb2
markpages: Filter redirects
Do not mark redirects discussion pages
7 years ago
Jonathan Golder
889be30a47
Merge branch 'fs#109-redpage-redfam-join-type' into test-v3
7 years ago
Jonathan Golder
147e96d388
Add Wrapperclass for Parser to RedPage
Add a wrapper class to overwrite type of Items returned by
RedPage.redfams relationship
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=109 FS#109]
7 years ago
Jonathan Golder
76666aa294
Merge branch 'fs#25-mark-done' into test-v3
7 years ago
Jonathan Golder
db39bb5ff4
Merge branch 'fs#88-mark-pages-bot' into fs#25-mark-done
7 years ago
Jonathan Golder
ec7880207b
Merge branch 'fs#95-sqlalchemy' into fs#88-mark-pages-bot
7 years ago
Jonathan Golder
4aaacf1443
Add redfams to redpage-obj after parsing
To have redfams available for updates immediately after parsing. Double
redfams then will be seen as Update.
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=108 FS#108]
7 years ago
Jonathan Golder
281f1c49a8
mysqlred: Set family via pywikibot
Get family/language part of table names from PyWikiBot Site
7 years ago
Jonathan Golder
3fe47e666f
Fix polymorphism problem with relationships
Since we are using subclasses of the ORM mapped classes, disable
typechecks for ORM relations
7 years ago
Jonathan Golder
e16925197c
Fix pep8.. compliance
To be concordant with the coding styles fix pep8 compliance
7 years ago
Jonathan Golder
9ba7d2e517
Change redfam generator filters
Change and clear up the filters in redfam generator to keep track of
article status and use positive conditionals
7 years ago
Jonathan Golder
844fee52ae
Make markpages using new DB/Class structure
Update markpages and RedFamWorker-Code to use the new sqlalchemy based
DB ORM Interface
7 years ago
Jonathan Golder
43e31c108a
Working RedFamWorker query
Modify RedfamWorker class to work with new DB API
7 years ago
Jonathan Golder
89b50e3312
Remove old status API
Now we use the methods of status object directly
7 years ago
Jonathan Golder
bf8e47f916
Improve new status API
Make sure state changes are only detected as such by sqlalchemy if they
are real changes
7 years ago
Jonathan Golder
467f829af2
Some cleanups
Remove old commented out code from manual mysql solution
7 years ago
Jonathan Golder
6e973369cd
sqlalchemy working for parser
Needs some testing, presumably contains some bugs
8 years ago
Jonathan Golder
0ebf307bb8
Add markpages as subtask
Markpages is a subtask of our Red-Bot
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=89 FS#89]
# The following line will be added automatically
# Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
4e4d5005fd
Merge branch 'fs#89-article-status' into fs#88-mark-pages-bot
8 years ago
Jonathan Golder
65fb2ecb28
Generate Fam status based on article status
Some article states should be reflected in the RedFam status
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=89 FS#89]
8 years ago
Jonathan Golder
d55c81c97b
Set article status when worked on talkpage
To detect whole redfam status after run over all articles
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=89 FS#89]
8 years ago
Jonathan Golder
870ed4bf25
Update redfam.article_generator use article status
To be able to filter articles by status of that article
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=89 FS#89]
8 years ago
Jonathan Golder
e13320820c
Add API to manage status per article
To be able to track changes to articles to update redfam status
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=89 FS#89]
8 years ago
Jonathan Golder
4ae562590e
Merge branch 'fs#94-data-structure' into fs#88-mark-pages-bot
8 years ago
Jonathan Golder
6149dcdb8b
Apply changes to data structure
See related ticket
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=94 FS#94]
8 years ago
Jonathan Golder
f021f2ea60
Merge branch 'fs#93-update-talkpage-template' into fs#88-mark-pages-bot
8 years ago
Jonathan Golder
8c56125a7b
Update talkpage notice template
Exact date is not necessary and end could be ommited if of the same
month
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=93 FS#93]
8 years ago
Jonathan Golder
c19f642d11
Merge branch 'fs#92-mark-done-edit-summary' into fs#88-mark-pages-bot
8 years ago
Jonathan Golder
20b811bc2a
Make sure edit summary starts with bot
Due to bot policy all edit summaries of bot edits have to start with
"Bot:"
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=92 FS#92]
8 years ago
Jonathan Golder
59d4d23c83
Set edit summary for each edit
Each edit of bot needs a edit summary
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=92 FS#92]
8 years ago
Jonathan Golder
2b93e4cf16
Check if notice is present before add
To prevent duplications we need to check wether notice is already
present on talkpage
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
9beca7f6c9
Implement method to add notice to disk page
Adds the generated notice to the talkpage and starts the saving of
the page
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
c4d8a95672
Implement build_generator-method
Build_generator will add the redfam_talkpages_generator to the
genFactory, build a generator of the genFactory and sets self.gen
which is used as generator for run()
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
da4f9b5d6b
Add wrapper-generator to redfam.article_generator
We need a wrapper around redfam.article_generator to pass it to
pagegenerators.PageWithTalkPageGenerator and to add a reference to
related redfam to each pywikibot.page-object before yielding it
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
ecc78bef96
Import needed modules and add redfams-generator
We will need a couple of modules to build the needed generator
Also we will need a generator with redfams to work with
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
efa919ff27
Add new bot with basic structure
We need a bot to work on pages which are subjects of redfams and on the
belonging talk page
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
72c6165de8
Merge branch 'fs#87-redfam-article-generator' into fs#25-mark-done
8 years ago
Jonathan Golder
c0b18f88e5
Add filter options to redfam.article_generator
To give the posibility to filter not existing pages or redirect pages or
vice versa.
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=87 FS#87]
8 years ago
Jonathan Golder
e5989305a4
Add a generator to redfam yielding article pages
To work on articles of a redfam a generator which yields belonging
articles is necessary
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=87 FS#87]
8 years ago
Jonathan Golder
8ce6f03641
Merge branch 'fs#29-generate-articledisc-notice' into fs#25-mark-done
8 years ago
Jonathan Golder
6717fa4fba
Add method to generate notice for article discpage
We need a method to generate the template to add to article discpages
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=29 FS#29]
8 years ago
Jonathan Golder
8acba7d0f9
Merge branch 'fs#81-get-reddisc-link' into fs#25-mark-done
8 years ago
Jonathan Golder
3723aba578
Add a method to get link to related reddisc
To generate notices or other stuff it is necessary to add links to the
related reddisc.
This method returns a wikilink to text the redfam's reddisc.
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=81 FS#81]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=81 FS#81]
8 years ago
Jonathan Golder
9d3bc74c80
Merge branch 'fs#26-done-redfam-gen' into fs#25-mark-done
8 years ago
Jonathan Golder
b36dc250d2
Request information about reddisc page for redfams
To generate links to related reddisc it is necessary to get at least the
Title of the related reddisc page. As saving the same data in db is
worse, we retreive it via join from red_pages table
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
4055dc52d8
Make it possible to get a RedPage-Object by pageid
When working on redfams it is necessary to have information about redpage
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
