Jonathan Golder
1b82de1eab
Fix #72 : Markpages terminates with error
Filtering templates with wikicode as match param does not work anymore,
explicitly cast to string
5 years ago
Jonathan Golder
5cdccaeec6
missingnotice: Add RedFam counter output
Signalize bot is working, since processing RedFams takes about
15 minutes with out any output right now
Issue #64 (https://git.golderweb.de/wiki/jogobot-red/issues/64 )
6 years ago
Jonathan Golder
54d8b8ea3b
missingnotice: Disable verbose logging of sqlalchemy
Issue #64 (https://git.golderweb.de/wiki/jogobot-red/issues/64 )
6 years ago
Jonathan Golder
dea5a393ad
missingnotice: Call RedFamWorker.flush_db_cache
To write status changes to db
Issue #64 (https://git.golderweb.de/wiki/jogobot-red/issues/64 )
6 years ago
Jonathan Golder
f021a13202
missingnotice: Implement run()
The bots working sequence, using previously implemented methods to
update the list of missing notices
Issue #64 (https://git.golderweb.de/wiki/jogobot-red/issues/64 )
6 years ago
Jonathan Golder
4c8ba95534
missingnotice: Implement update_page()
This method updates the content of the configured or given wikipage with
the generated lines
Issue #64 (https://git.golderweb.de/wiki/jogobot-red/issues/64 )
6 years ago
Jonathan Golder
9804db212f
missingnotice: Implement format_row()
With this method, the links to redundance discussions and articles
missining notice are concatenated and formated
Issue #64 (https://git.golderweb.de/wiki/jogobot-red/issues/64 )
6 years ago
Jonathan Golder
68b81b1111
missingnotice: Implement treat_redfam
For each redfam, we need to check weather related redundance discussion
exists and if there are missing notices. For those redfams return links
to discussion and articles missing notice.
Issue #64 (https://git.golderweb.de/wiki/jogobot-red/issues/64 )
6 years ago
Jonathan Golder
95af95aca6
missingnotice: Implement article selection
Issue #64 (https://git.golderweb.de/wiki/jogobot-red/issues/64 )
6 years ago
Jonathan Golder
dbcc2717d7
missingnotice: Implement article query
Issue #64 (https://git.golderweb.de/wiki/jogobot-red/issues/64 )
6 years ago
Jonathan Golder
cfb3e8e37c
bots: Add basic structure for MissingNoticeBot
Issue #64 (https://git.golderweb.de/wiki/jogobot-red/issues/64 )
6 years ago
Jonathan Golder
93447d8dc6
Prepare release v1.0
Update Copyright Notices
Version information
6 years ago
Jonathan Golder
9640467f69
markpages: Use redarticle attribute of Page
Instead of trying to reconstruct our db article title, use the one added
to Page-object by redfam.article_generator
Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161 )
6 years ago
Jonathan Golder
bfec2abf98
markpages: Get rid of PageWithTalkPageGenerator
Since redfam.article_generator can yield talkpage with additional
information about redfam and current article from db, we do not need it
anymore.
Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161 )
6 years ago
Jonathan Golder
bdccc8417c
Set always in Pywikibot.Basebot
If cmdline param -always is set, set the related option in
Pywikibot.Basebot Object for automatic edits with out further requests
Related Task: [FS#152](https://fs.golderweb.de/index.php?do=details&task_id=152 )
7 years ago
Jonathan Golder
b3cfcdc259
Improve title detection to get correct behaviour
Make sure that categorie links are starting with colon and non article
pages are returned with namespace.
Related Task: [FS#154](https://fs.golderweb.de/index.php?do=details&task_id=154 )
7 years ago
Jonathan Golder
f8002c85da
Do not search for templates recursivly
Since nested templates did not get an index in global wikicode object
searching for index of an nested template results in ValueError
Related Task: [FS#153](https://fs.golderweb.de/index.php?do=details&task_id=153 )
7 years ago
Jonathan Golder
8a26b6d92a
Normalize article titles with anchors
In our db article titles with anchors are stored with underscores in
anchor string. Therefore we need to replace spaces in anchor string
given by pywikibot.Page.title().
Related Task: [FS#151](https://fs.golderweb.de/index.php?do=details&task_id=151 )
7 years ago
Jonathan Golder
31c10073a2
Prevent index errors searching for comments
Make sure not to exceed existing indexes of wikicode object while trying
to search for comments
Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141 )
7 years ago
Jonathan Golder
642a29b022
Improve regex for blank lines
Do not match consecutive linebreaks as one
Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141 )
7 years ago
Jonathan Golder
024be69fe1
Use famhash as generator
If famhash is defined, fetch explicitly that redfam from db and work
only on this
Related Task: [FS#146](https://fs.golderweb.de/index.php?do=details&task_id=146 )
7 years ago
Jonathan Golder
3aa6c5fb1c
Disable PreloadingGenerator temporarily
PreloadingGenerator mixes up yielded Pages. This is very unconvenient
for semi-automatic workflow with manual checks as the articles of the
RedFams were not following each other.
Related Task: [FS#148](https://fs.golderweb.de/index.php?do=details&task_id=148 )
7 years ago
Jonathan Golder
9b9d50c4d2
Improve detection of empty lines
Search with RegEx as empty lines could also contain spaces
Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141 )
7 years ago
Jonathan Golder
cc02006fd2
Do not exclude redirects from beeing marked
In accordance with Zulu55 redirect discussion pages should also get
a notice, therefore do not exclude redirects.
Related Task: [FS#140](https://fs.golderweb.de/index.php?do=details&task_id=140 )
7 years ago
Jonathan Golder
4137d72468
Look for existing notice by simple in-check
To detect maybe uncommented notices already present, check for them
using just a simple python x in y check over whole wikicode
Related Task: [FS#138](https://fs.golderweb.de/index.php?do=details&task_id=138 )
7 years ago
Jonathan Golder
47b85a0b5e
Add missing line break if there is no template
To make sure our notice template resides in its own line in every case
Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141 )
7 years ago
Jonathan Golder
8422d08cb6
Keep comments and leading templates together
Prevent spliting up existing comments and templates as often those are
documenting archiv templates behaviour
Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141 )
7 years ago
Jonathan Golder
34e7e0d3be
Prevent index Error if no template in leadsec
Check if there is a template in leadsec before accessing list item to
prevent IndexErrors
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=115 FS#115]
7 years ago
Jonathan Golder
37704c6661
Replace pywikibot.showDiff with patched version
Pywikibot.bot.userPut does not support setting the value of diff context
so it is always zero. Therefore we need to patch either userPut or
showDiff to get some context.
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=113 FS#113]
7 years ago
Jonathan Golder
3e69a1c77e
Remove problem indicating stati when set marked
Remove states which are indicating problems in previous runs if
successfully marked article and also whole RedFam
[https://fs.golderweb.de/index.php?do=details&task_id=112 FS#112]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=110 FS#110]
7 years ago
Jonathan Golder
868894a38b
Format fixes
Set locale to de_DE.utf-8 for whole Task
Make sure Template is added in own source line
7 years ago
Jonathan Golder
65de6decb2
markpages: Filter redirects
Do not mark redirects discussion pages
7 years ago
Jonathan Golder
147e96d388
Add Wrapperclass for Parser to RedPage
Add a wrapper class to overwrite type of Items returned by
RedPage.redfams relationship
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=109 FS#109]
7 years ago
Jonathan Golder
e16925197c
Fix pep8.. compliance
To be concordant with the coding styles fix pep8 compliance
7 years ago
Jonathan Golder
844fee52ae
Make markpages using new DB/Class structure
Update markpages and RedFamWorker-Code to use the new sqlalchemy based
DB ORM Interface
7 years ago
Jonathan Golder
89b50e3312
Remove old status API
Now we use the methods of status object directly
7 years ago
Jonathan Golder
467f829af2
Some cleanups
Remove old commented out code from manual mysql solution
7 years ago
Jonathan Golder
6e973369cd
sqlalchemy working for parser
Needs some testing, presumably contains some bugs
7 years ago
Jonathan Golder
0ebf307bb8
Add markpages as subtask
Markpages is a subtask of our Red-Bot
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=89 FS#89]
# The following line will be added automatically
# Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
d55c81c97b
Set article status when worked on talkpage
To detect whole redfam status after run over all articles
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=89 FS#89]
8 years ago
Jonathan Golder
870ed4bf25
Update redfam.article_generator use article status
To be able to filter articles by status of that article
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=89 FS#89]
8 years ago
Jonathan Golder
6149dcdb8b
Apply changes to data structure
See related ticket
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=94 FS#94]
8 years ago
Jonathan Golder
20b811bc2a
Make sure edit summary starts with bot
Due to bot policy all edit summaries of bot edits have to start with
"Bot:"
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=92 FS#92]
8 years ago
Jonathan Golder
59d4d23c83
Set edit summary for each edit
Each edit of bot needs a edit summary
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=92 FS#92]
8 years ago
Jonathan Golder
2b93e4cf16
Check if notice is present before add
To prevent duplications we need to check wether notice is already
present on talkpage
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
9beca7f6c9
Implement method to add notice to disk page
Adds the generated notice to the talkpage and starts the saving of
the page
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
c4d8a95672
Implement build_generator-method
Build_generator will add the redfam_talkpages_generator to the
genFactory, build a generator of the genFactory and sets self.gen
which is used as generator for run()
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
da4f9b5d6b
Add wrapper-generator to redfam.article_generator
We need a wrapper around redfam.article_generator to pass it to
pagegenerators.PageWithTalkPageGenerator and to add a reference to
related redfam to each pywikibot.page-object before yielding it
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
ecc78bef96
Import needed modules and add redfams-generator
We will need a couple of modules to build the needed generator
Also we will need a generator with redfams to work with
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
efa919ff27
Add new bot with basic structure
We need a bot to work on pages which are subjects of redfams and on the
belonging talk page
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago