Jonathan Golder
93447d8dc6
Prepare release v1.0
Update Copyright Notices
Version information
7 years ago
Jonathan Golder
147e96d388
Add Wrapperclass for Parser to RedPage
Add a wrapper class to overwrite type of Items returned by
RedPage.redfams relationship
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=109 FS#109]
7 years ago
Jonathan Golder
e16925197c
Fix pep8.. compliance
To be concordant with the coding styles fix pep8 compliance
7 years ago
Jonathan Golder
89b50e3312
Remove old status API
Now we use the methods of status object directly
7 years ago
Jonathan Golder
467f829af2
Some cleanups
Remove old commented out code from manual mysql solution
7 years ago
Jonathan Golder
6e973369cd
sqlalchemy working for parser
Needs some testing, presumably contains some bugs
8 years ago
Jonathan Golder
2be0a8903d
Adjust constructor for wrapper-script
The new wrapper-script calls a standardized API
We need to be conform with that
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=83 FS#83]
8 years ago
Jonathan Golder
0ceb2e6e83
Add methods to build gen to DiscussionParser
With the new wrapper script the Bot gets a GenFactory and has to build
a generator out of it by its own
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=83 FS#83]
8 years ago
Jonathan Golder
b88efb6bdd
Reflect stucture changes in Code
Since bot class is moved to separate dir/file we need to do some changes
to rebuild functionality
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
177a8f920f
Prepare new structure to use subtasks
To have only one entry point for the bot we want to have a single file
(red.py) which is calling the specfic task class from bots dir with a
standardized call
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
e28acf88d1
Introduce new directory structure
To clarify which is a bot and which are helper scripts
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=74 FS#74]
8 years ago
Jonathan Golder
95be313859
Pass reddisc pywikibot.page object to redfam
To access page information like page title (eg. to get dates from it)
of the reddisc page
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=76 FS#76]
8 years ago
Jonathan Golder
bd2d221c48
Prevent flush from creating cursor without con
MysqlRed.flush() tried to create a cursor in any case. If there was no
connection (because the subclasses haven't been instantiated an oursql
Error occured.
Instead, check before if there is a connection and otherwise raise an Error
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=75 FS#75]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=75 FS#75]
8 years ago
Jonathan Golder
ee8ebbc8bc
Make sure only flush db if there are redfams
To prevent from doing unnecessary stuff and trying to use not existing
db connection
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=75 FS#75]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=75 FS#75]
8 years ago
Jonathan Golder
dcc4851513
Check reddisc page titles against regex
To prevent parsing Pages which have been categorized in configured cats
wrong or are given via cmd params
Parsing them results in unexpected behaviour
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=75 FS#75]
8 years ago
Jonathan Golder
2f878ee901
Correct filename in header
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=72 FS#72]
8 years ago
Jonathan Golder
17bfb32ded
Building generators of config cats in sep Function
Since the main()-Function was too complex the logic to build generators
out of categories provided in jogobot.conf was moved in a separate
function
[https://fs.golderweb.de/index.php?do=details&task_id=73 FS#73]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=72 FS#72]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=72 FS#72]
8 years ago
Jonathan Golder
6cb92c1da7
Rewrite parse control using pywikibot.bot classes
To use the default pywikibot.classes making life easier at some point
Beeing standardconform with pywikibot in handling args
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=72 FS#72]
8 years ago
Jonathan Golder
a8605bcee6
Mv pages-parser.py to reddiscparser.py
New, more meaningfull naming conventions, from redpage to reddisc (page)
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=72 FS#72]
8 years ago
Jonathan Golder
a24f208449
Add parse-pages.py Script
8 years ago
Jonathan Golder