562e689418
Merge branch 'release-1.0' back into develop
2017-11-05 12:30:18 +01:00
93447d8dc6
Prepare release v1.0
...
Update Copyright Notices
Version information
2017-11-05 12:25:13 +01:00
1b6faf9e53
Use own db for red-task
...
Since we have several tables and sometimes need to create a copy on
replication servers.
2017-11-05 12:17:05 +01:00
b4c193eedc
Disable echoing of SQLAlchemy Egine
...
We don't need this extensive output for production
2017-11-05 12:07:38 +01:00
788a3df0cd
Update jogobot-submodule to v0.1
2017-11-05 12:00:28 +01:00
04f591b466
Merge branch 'fs#161-add-article-titles' into develop
2017-11-05 11:24:15 +01:00
9640467f69
markpages: Use redarticle attribute of Page
...
Instead of trying to reconstruct our db article title, use the one added
to Page-object by redfam.article_generator
Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161 )
2017-11-05 11:22:43 +01:00
bfec2abf98
markpages: Get rid of PageWithTalkPageGenerator
...
Since redfam.article_generator can yield talkpage with additional
information about redfam and current article from db, we do not need it
anymore.
Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161 )
2017-11-05 11:20:55 +01:00
20103d589d
redfam: article_generator add redfam info to page
...
Add reference to redfam object and article title from db to Page object
since Page.title() may differe (short Namespaces, anchors, special chars)
Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161 )
2017-11-05 11:18:53 +01:00
e18aa96a84
redfam: article_generator can return talkpage
...
To make pywikibot.pagegenerators.PageWithTalkPageGenerators unneccessary
so we can manipulate talkpage object directly
Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161 )
2017-11-05 11:15:04 +01:00
1dd4c7f87e
Merge branch 'test-v7' back into develop
2017-11-02 18:57:59 +01:00
33b2e47312
Describe version test-v7
2017-10-28 22:43:53 +02:00
3bd17ce692
Merge branch 'fs#160-urlencoded-chars' into develop
2017-10-28 22:36:55 +02:00
5f4640d5ff
Replace urlencoded chars with unicode equivalent
...
Otherwise we get value errors while marking since pwb replaces those
Related Task: [FS#160](https://fs.golderweb.de/index.php?do=details&task_id=160 )
2017-10-28 22:35:25 +02:00
7e0456ae4f
Merge branch 'test-v6' back into develop
2017-10-28 22:34:30 +02:00
108b7aa331
Describe version test-v6
2017-10-28 18:46:30 +02:00
a3adf31b89
Merge branch 'fs#86-activate-status-api' into develop
2017-10-28 18:44:42 +02:00
614f288bb9
Activate jogobot status api for onwiki disabling
...
Related Task: [FS#86](https://fs.golderweb.de/index.php?do=details&task_id=86 )
2017-10-28 18:44:05 +02:00
c450a045bf
Merge branch 'fs#159-space-before-anchor' into develop
2017-10-28 18:43:13 +02:00
84802cf521
Remove leading or trailing spaces in articles
...
Some articles contain spaces between title and anchor part which will
be stripped now
Related Task: [FS#159](https://fs.golderweb.de/index.php?do=details&task_id=159 )
2017-10-28 18:41:06 +02:00
5f6c443ba8
Merge branch 'test-v5' back into develop
2017-10-28 18:17:01 +02:00
0c135ef1bb
Describe version test-v5
2017-09-23 23:50:42 +02:00
8b8221cfcd
Merge branch 'fs#152-respect-always-flag' into develop
2017-09-23 23:49:59 +02:00
bdccc8417c
Set always in Pywikibot.Basebot
...
If cmdline param -always is set, set the related option in
Pywikibot.Basebot Object for automatic edits with out further requests
Related Task: [FS#152](https://fs.golderweb.de/index.php?do=details&task_id=152 )
2017-09-23 23:49:41 +02:00
a70835c58a
Merge back branch 'test-v4' into develop
2017-09-23 23:48:25 +02:00
ec2b84df2a
Add requirements
...
To make setup of environment for this module easier
2017-09-23 21:09:58 +02:00
88848cb084
Prepare Version test-v4 for release
...
Add a README.md file for this project
2017-09-23 20:32:13 +02:00
5057aed0d3
Merge branch 'fs#157-lowercase-title' into develop
2017-09-09 21:47:03 +02:00
02e53475f1
Prevent lowercase article titles in Parser
...
Since real lowercase article titles are not allowed, make sure to
convert all first letters of article titles to uppercase. This is
neccessary since pywikibot will return article titles like this.
Related Task: [FS#157](https://fs.golderweb.de/index.php?do=details&task_id=157 )
2017-09-09 21:35:36 +02:00
d6f9b460c9
Merge branch 'fs#156-dbapi-charset' into develop
2017-09-02 22:13:20 +02:00
ff03ca8f13
Explicitly set charset for PyMySQL-Connection
...
Since PyMySQL-Connection otherwise uses charset 'latin-1', explicitly
set connection charset to 'utf8'
http://docs.sqlalchemy.org/en/rel_1_0/dialects/mysql.html#charset-selection
http://docs.sqlalchemy.org/en/rel_1_0/core/engines.html?highlight=url#sqlalchemy.engine.url.URL
Related Task: [FS#156](https://fs.golderweb.de/index.php?do=details&task_id=156 )
2017-09-02 22:10:25 +02:00
88692ca678
Merge branch 'fs#155-article-surouding-space' into develop
2017-09-02 22:08:31 +02:00
d9b4fcc0bd
Strip spaces before adding articles to redfam
...
Some article links have surounding spaces in their linktext. Remove them
before adding article to RedFam to have a cannonical title
Related Task: [FS#155](https://fs.golderweb.de/index.php?do=details&task_id=155 )
2017-09-02 22:06:30 +02:00
22ff78ea98
Merge branch 'fs#154-categorie-colons-missing' into develop
2017-09-02 16:02:45 +02:00
b3cfcdc259
Improve title detection to get correct behaviour
...
Make sure that categorie links are starting with colon and non article
pages are returned with namespace.
Related Task: [FS#154](https://fs.golderweb.de/index.php?do=details&task_id=154 )
2017-09-02 15:59:34 +02:00
b3e0ace2f4
Merge branch 'fs#153-nested-templates' into develop
2017-09-02 14:25:21 +02:00
f8002c85da
Do not search for templates recursivly
...
Since nested templates did not get an index in global wikicode object
searching for index of an nested template results in ValueError
Related Task: [FS#153](https://fs.golderweb.de/index.php?do=details&task_id=153 )
2017-09-02 14:23:25 +02:00
49bc05d29b
Merge branch 'fs#151-normalize-article-titles-anchor' into develop
2017-09-02 13:36:17 +02:00
8a26b6d92a
Normalize article titles with anchors
...
In our db article titles with anchors are stored with underscores in
anchor string. Therefore we need to replace spaces in anchor string
given by pywikibot.Page.title().
Related Task: [FS#151](https://fs.golderweb.de/index.php?do=details&task_id=151 )
2017-08-25 18:11:41 +02:00
49a8230d76
Merge branch 'fs#141-place-notice-after-comment' into develop
2017-08-25 17:11:28 +02:00
31c10073a2
Prevent index errors searching for comments
...
Make sure not to exceed existing indexes of wikicode object while trying
to search for comments
Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141 )
2017-08-25 17:09:38 +02:00
642a29b022
Improve regex for blank lines
...
Do not match consecutive linebreaks as one
Related Task: [FS#141](https://fs.golderweb.de/index.php?do=details&task_id=141 )
2017-08-24 18:47:18 +02:00
2f90751dc2
Merge branch 'fs#146-famhash-generator' into develop
2017-08-24 12:27:54 +02:00
024be69fe1
Use famhash as generator
...
If famhash is defined, fetch explicitly that redfam from db and work
only on this
Related Task: [FS#146](https://fs.golderweb.de/index.php?do=details&task_id=146 )
2017-08-24 12:27:13 +02:00
b6d7268a7f
select by famhash: Add methods to get param in bot
...
We need a method as callback to get bot specific params passed through
to our bot class.
Introduce -famhash parameter to work on specific famhash
Related Task:[FS#146](https://fs.golderweb.de/index.php?do=details&task_id=146 )
2017-08-24 12:27:13 +02:00
526184c1e1
Merge branch 'fs#148-articles-mixed-up' into develop
2017-08-24 12:26:53 +02:00
3aa6c5fb1c
Disable PreloadingGenerator temporarily
...
PreloadingGenerator mixes up yielded Pages. This is very unconvenient
for semi-automatic workflow with manual checks as the articles of the
RedFams were not following each other.
Related Task: [FS#148](https://fs.golderweb.de/index.php?do=details&task_id=148 )
2017-08-24 12:23:17 +02:00
ec8f459db5
Merge branch 'fs#138-marked-articles-shown-again' into develop
2017-08-24 12:19:24 +02:00
3b2cb95f36
Do not fetch marked redfams from db
...
Exclude marked Redfams from DB-Query to prevent marking them again
Related Task: [FS#138](https://fs.golderweb.de/index.php?do=details&task_id=138 )
2017-08-24 12:09:43 +02:00
41e5cc1a9d
Merge branch 'fs#141-place-notice-after-comment' into develop
2017-08-24 12:06:03 +02:00
