Jonathan Golder
20103d589d
redfam: article_generator add redfam info to page
Add reference to redfam object and article title from db to Page object
since Page.title() may differe (short Namespaces, anchors, special chars)
Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161 )
7 years ago
Jonathan Golder
e18aa96a84
redfam: article_generator can return talkpage
To make pywikibot.pagegenerators.PageWithTalkPageGenerators unneccessary
so we can manipulate talkpage object directly
Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161 )
7 years ago
Jonathan Golder
1dd4c7f87e
Merge branch 'test-v7' back into develop
7 years ago
Jonathan Golder
33b2e47312
Describe version test-v7
7 years ago
Jonathan Golder
3bd17ce692
Merge branch 'fs#160-urlencoded-chars' into develop
7 years ago
Jonathan Golder
5f4640d5ff
Replace urlencoded chars with unicode equivalent
Otherwise we get value errors while marking since pwb replaces those
Related Task: [FS#160](https://fs.golderweb.de/index.php?do=details&task_id=160 )
7 years ago
Jonathan Golder
7e0456ae4f
Merge branch 'test-v6' back into develop
7 years ago
Jonathan Golder
108b7aa331
Describe version test-v6
7 years ago
Jonathan Golder
a3adf31b89
Merge branch 'fs#86-activate-status-api' into develop
7 years ago
Jonathan Golder
614f288bb9
Activate jogobot status api for onwiki disabling
Related Task: [FS#86](https://fs.golderweb.de/index.php?do=details&task_id=86 )
7 years ago
Jonathan Golder
c450a045bf
Merge branch 'fs#159-space-before-anchor' into develop
7 years ago
Jonathan Golder
84802cf521
Remove leading or trailing spaces in articles
Some articles contain spaces between title and anchor part which will
be stripped now
Related Task: [FS#159](https://fs.golderweb.de/index.php?do=details&task_id=159 )
7 years ago
Jonathan Golder
5f6c443ba8
Merge branch 'test-v5' back into develop
7 years ago
Jonathan Golder
0c135ef1bb
Describe version test-v5
7 years ago
Jonathan Golder
8b8221cfcd
Merge branch 'fs#152-respect-always-flag' into develop
7 years ago
Jonathan Golder
bdccc8417c
Set always in Pywikibot.Basebot
If cmdline param -always is set, set the related option in
Pywikibot.Basebot Object for automatic edits with out further requests
Related Task: [FS#152](https://fs.golderweb.de/index.php?do=details&task_id=152 )
7 years ago
Jonathan Golder
a70835c58a
Merge back branch 'test-v4' into develop
7 years ago
Jonathan Golder
ec2b84df2a
Add requirements
To make setup of environment for this module easier
7 years ago
Jonathan Golder
88848cb084
Prepare Version test-v4 for release
Add a README.md file for this project
7 years ago
Jonathan Golder
5057aed0d3
Merge branch 'fs#157-lowercase-title' into develop
7 years ago
Jonathan Golder
02e53475f1
Prevent lowercase article titles in Parser
Since real lowercase article titles are not allowed, make sure to
convert all first letters of article titles to uppercase. This is
neccessary since pywikibot will return article titles like this.
Related Task: [FS#157](https://fs.golderweb.de/index.php?do=details&task_id=157 )
7 years ago
Jonathan Golder
d6f9b460c9
Merge branch 'fs#156-dbapi-charset' into develop
7 years ago
Jonathan Golder
ff03ca8f13
Explicitly set charset for PyMySQL-Connection
Since PyMySQL-Connection otherwise uses charset 'latin-1', explicitly
set connection charset to 'utf8'
http://docs.sqlalchemy.org/en/rel_1_0/dialects/mysql.html#charset-selection
http://docs.sqlalchemy.org/en/rel_1_0/core/engines.html?highlight=url#sqlalchemy.engine.url.URL
Related Task: [FS#156](https://fs.golderweb.de/index.php?do=details&task_id=156 )
7 years ago
Jonathan Golder
88692ca678
Merge branch 'fs#155-article-surouding-space' into develop
7 years ago
Jonathan Golder
d9b4fcc0bd
Strip spaces before adding articles to redfam
Some article links have surounding spaces in their linktext. Remove them
before adding article to RedFam to have a cannonical title
Related Task: [FS#155](https://fs.golderweb.de/index.php?do=details&task_id=155 )
7 years ago
Jonathan Golder
22ff78ea98
Merge branch 'fs#154-categorie-colons-missing' into develop
7 years ago
Jonathan Golder
b3cfcdc259
Improve title detection to get correct behaviour
Make sure that categorie links are starting with colon and non article
pages are returned with namespace.
Related Task: [FS#154](https://fs.golderweb.de/index.php?do=details&task_id=154 )
7 years ago
Jonathan Golder
b3e0ace2f4
Merge branch 'fs#153-nested-templates' into develop
7 years ago
Jonathan Golder
f8002c85da
Do not search for templates recursivly
Since nested templates did not get an index in global wikicode object
searching for index of an nested template results in ValueError
Related Task: [FS#153](https://fs.golderweb.de/index.php?do=details&task_id=153 )
7 years ago
Jonathan Golder
49bc05d29b
Merge branch 'fs#151-normalize-article-titles-anchor' into develop
7 years ago
Jonathan Golder
8a26b6d92a
Normalize article titles with anchors
In our db article titles with anchors are stored with underscores in
anchor string. Therefore we need to replace spaces in anchor string
given by pywikibot.Page.title().
Related Task: [FS#151](https://fs.golderweb.de/index.php?do=details&task_id=151 )
7 years ago
Jonathan Golder
49a8230d76
Merge branch 'fs#141-place-notice-after-comment' into develop
7 years ago
Jonathan Golder
31c10073a2
Prevent index errors searching for comments
Make sure not to exceed existing indexes of wikicode object while trying
to search for comments
Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141 )
7 years ago
Jonathan Golder
642a29b022
Improve regex for blank lines
Do not match consecutive linebreaks as one
Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141 )
7 years ago
Jonathan Golder
2f90751dc2
Merge branch 'fs#146-famhash-generator' into develop
7 years ago
Jonathan Golder
024be69fe1
Use famhash as generator
If famhash is defined, fetch explicitly that redfam from db and work
only on this
Related Task: [FS#146](https://fs.golderweb.de/index.php?do=details&task_id=146 )
7 years ago
Jonathan Golder
b6d7268a7f
select by famhash: Add methods to get param in bot
We need a method as callback to get bot specific params passed through
to our bot class.
Introduce -famhash parameter to work on specific famhash
Related Task:[FS#146](https://fs.golderweb.de/index.php?do=details&task_id=146 )
7 years ago
Jonathan Golder
526184c1e1
Merge branch 'fs#148-articles-mixed-up' into develop
7 years ago
Jonathan Golder
3aa6c5fb1c
Disable PreloadingGenerator temporarily
PreloadingGenerator mixes up yielded Pages. This is very unconvenient
for semi-automatic workflow with manual checks as the articles of the
RedFams were not following each other.
Related Task: [FS#148](https://fs.golderweb.de/index.php?do=details&task_id=148 )
7 years ago
Jonathan Golder
ec8f459db5
Merge branch 'fs#138-marked-articles-shown-again' into develop
7 years ago
Jonathan Golder
3b2cb95f36
Do not fetch marked redfams from db
Exclude marked Redfams from DB-Query to prevent marking them again
Related Task: [FS#138](https://fs.golderweb.de/index.php?do=details&task_id=138 )
7 years ago
Jonathan Golder
41e5cc1a9d
Merge branch 'fs#141-place-notice-after-comment' into develop
7 years ago
Jonathan Golder
9b9d50c4d2
Improve detection of empty lines
Search with RegEx as empty lines could also contain spaces
Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141 )
7 years ago
Jonathan Golder
a755288700
Merge branch 'fs#147-templates-in-heading' into develop
7 years ago
Jonathan Golder
14ec71dd09
Rewrite get_disc_link to handle special cases
Use methods of pywikibot site-object and mwparser to get rid of any
special elements like templates or links in headings for construction
of our disc link.
Replace by hand as it otherwise will occur as normal space and
wont work
Related Task: [FS#147](https://fs.golderweb.de/index.php?do=details&task_id=147 )
7 years ago
Jonathan Golder
e283eb78ac
Merge branch 'fs#140-also-mark-redirects' into develop
7 years ago
Jonathan Golder
cc02006fd2
Do not exclude redirects from beeing marked
In accordance with Zulu55 redirect discussion pages should also get
a notice, therefore do not exclude redirects.
Related Task: [FS#140](https://fs.golderweb.de/index.php?do=details&task_id=140 )
7 years ago
Jonathan Golder
37b0cbef08
Merge branch 'fs#138-marked-articles-shown-again' into develop
7 years ago
Jonathan Golder
4137d72468
Look for existing notice by simple in-check
To detect maybe uncommented notices already present, check for them
using just a simple python x in y check over whole wikicode
Related Task: [FS#138](https://fs.golderweb.de/index.php?do=details&task_id=138 )
7 years ago
Jonathan Golder
cd87d1c2bb
Fix already marked articles was reshown bug
Since we search for matching states for articles to include or exclude
in a loop, we could not control the outer loop via default break/
continue. Python docs recommend using Exceptions and try/except
structures to realise that most conveniently.
https://docs.python.org/3/faq/design.html#why-is-there-no-goto
Related Task: [FS#138](https://fs.golderweb.de/index.php?do=details&task_id=138 )
7 years ago
