Jonathan Golder
8acba7d0f9
Merge branch 'fs#81-get-reddisc-link' into fs#25-mark-done
8 years ago
Jonathan Golder
3723aba578
Add a method to get link to related reddisc
To generate notices or other stuff it is necessary to add links to the
related reddisc.
This method returns a wikilink to text the redfam's reddisc.
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=81 FS#81]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=81 FS#81]
8 years ago
Jonathan Golder
9d3bc74c80
Merge branch 'fs#26-done-redfam-gen' into fs#25-mark-done
8 years ago
Jonathan Golder
b36dc250d2
Request information about reddisc page for redfams
To generate links to related reddisc it is necessary to get at least the
Title of the related reddisc page. As saving the same data in db is
worse, we retreive it via join from red_pages table
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
4055dc52d8
Make it possible to get a RedPage-Object by pageid
When working on redfams it is necessary to have information about redpage
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
594130c8a6
Restore changes from 45df35431
Documented to prevent deleting again
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
b271a0b0b1
Add generator wrapper to fetch RedFams by status and ending
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
ad088126e7
Define method to update Status after Working with RedFam
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
151c22a735
Add fetched mysql_data to _mysql-Object of parent class for using change-method to update db
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
a97d8c722e
Move handling of mysql-Connection from RedFamParser and RedFamWorker to RedFam-Class and make it protected instead of private
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
58dfd8c86a
For RedFamilies not fetched individually we need to provide the fam hash as index
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
9481116777
Add new generator-method to fetch RedFams by Status and Ending
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
eaa7596a8f
Merge branch 'fs#70-refactoring' into test-v3
8 years ago
Jonathan Golder
449d83d7b5
Merge branch 'fs#82-subtask-wrapper' into fs#70-refactoring
8 years ago
Jonathan Golder
4ac9b305f5
Merge branch 'fs#85-move-start-api-to-jogobot' into fs#82-subtask-wrapper
8 years ago
Jonathan Golder
604b7bd8b7
Now use Bot-Start API from jogobot framework
API was moved to jogobot to share with other tasks
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=85 FS#85]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=85 FS#85]
8 years ago
Jonathan Golder
d0fa15d0ed
Update jogobot module to get standart Start-API
[FS#84]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=85 FS#85]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=85 FS#85]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=85 FS#85]
8 years ago
Jonathan Golder
71e41bfed3
Merge branch 'fs#83-wrapper-compatibility' into fs#82-subtask-wrapper
8 years ago
Jonathan Golder
2be0a8903d
Adjust constructor for wrapper-script
The new wrapper-script calls a standardized API
We need to be conform with that
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=83 FS#83]
8 years ago
Jonathan Golder
0ceb2e6e83
Add methods to build gen to DiscussionParser
With the new wrapper script the Bot gets a GenFactory and has to build
a generator out of it by its own
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=83 FS#83]
8 years ago
Jonathan Golder
3540cc2a7d
Move functional sections to functions in main()
To make main() function less complicated functional sections are moved
to dedicated functions
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
460d2db183
Add Bot run with exception handling
Errors, especially caused by missing run-method, need to be catched to
provide information in Logfile.
And also to get information wether bot run was successfull
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
156f117b18
Add Bot initiation with exception handling
Bot initiation needs to catch errors by Bot to enforce at least a basic
logging.
And also to be sure Init was successfull before starting bot.
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
1679e2ad6a
Prepare environment for starting subtasks
Before init and run bot we need to provide a environment for it,
like parsed args
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
b88efb6bdd
Reflect stucture changes in Code
Since bot class is moved to separate dir/file we need to do some changes
to rebuild functionality
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
177a8f920f
Prepare new structure to use subtasks
To have only one entry point for the bot we want to have a single file
(red.py) which is calling the specfic task class from bots dir with a
standardized call
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
0549cbd2c2
Merge branch 'fs#80-remove-deprecated-methods' into fs#70-refactoring
8 years ago
Jonathan Golder
78eda10562
Remove deprecated methods
Deprecated functions which are not used anymore can be removed to make
code more clearer and improve maintainability
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=80 FS#80]
8 years ago
Jonathan Golder
510771509b
Merge branch 'fs#79-mysql-table-prefix' into fs#70-refactoring
8 years ago
Jonathan Golder
71b99b5f58
Delay definition of db_table_prefix
db_table_prefix should be defined at init of MysqlRed and not at import
to have cmdline args already parsed
Otherwise it uses default family
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=79 FS#79]
8 years ago
Jonathan Golder
77d1de4473
Add a tablename prefix depending on Site
To be able to run the bot on different wikis the db tables should be
named pywikibot.Site dependend and changed automatically
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=79 FS#79]
8 years ago
Jonathan Golder
cac04f344f
Merge branch 'fs#74-helpermodules-lib' into fs#70-refactoring
8 years ago
Jonathan Golder
e28acf88d1
Introduce new directory structure
To clarify which is a bot and which are helper scripts
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=74 FS#74]
8 years ago
Jonathan Golder
af48888535
Merge branch 'fs#78-redfam-section-false-positives' into fs#70-refactoring
8 years ago
Jonathan Golder
ac54aea698
Use callback to detect redfam.section
Detecting redfam-Sections via RegExp caused some false positives due to
wrong formated things in wikisyntax. See Task
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=78 FS#78]
8 years ago
Jonathan Golder
2deb02fe47
Merge branch 'fs#77-errors-on-old-archives' into fs#70-refactoring
8 years ago
Jonathan Golder
1e4c8646bf
Reparse redfam-heading with mwparser
See related ticked for detailed failure explanation
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=77 FS#77]
8 years ago
Jonathan Golder
fe2810f07c
Merge branch 'fs#76-redfam-without-dates' into fs#70-refactoring
8 years ago
Jonathan Golder
ab430e0085
Use month of reddisc as beginning if missing
Construct a fictive but sensfull beginning if we cant detect one
Needed since beginning is mandatory
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=76 FS#76]
8 years ago
Jonathan Golder
95be313859
Pass reddisc pywikibot.page object to redfam
To access page information like page title (eg. to get dates from it)
of the reddisc page
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=76 FS#76]
8 years ago
Jonathan Golder
0bb0b2d957
Make sure var beginning is always defined
To prevent unbound Errors caused by using undeclared variable beginning
if the redfam-section does not contain any timestamp
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=76 FS#76]
8 years ago
Jonathan Golder
db32c9e8f6
Merge branch 'fs#75-mysql-flush-error-false-reddisc' into fs#70-refactoring
8 years ago
Jonathan Golder
bd2d221c48
Prevent flush from creating cursor without con
MysqlRed.flush() tried to create a cursor in any case. If there was no
connection (because the subclasses haven't been instantiated an oursql
Error occured.
Instead, check before if there is a connection and otherwise raise an Error
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=75 FS#75]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=75 FS#75]
8 years ago
Jonathan Golder
ee8ebbc8bc
Make sure only flush db if there are redfams
To prevent from doing unnecessary stuff and trying to use not existing
db connection
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=75 FS#75]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=75 FS#75]
8 years ago
Jonathan Golder
dcc4851513
Check reddisc page titles against regex
To prevent parsing Pages which have been categorized in configured cats
wrong or are given via cmd params
Parsing them results in unexpected behaviour
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=75 FS#75]
8 years ago
Jonathan Golder
0ea1b0039d
Merge branch 'fs#72-rewrite-reddiscparser' into fs#70-refactoring
8 years ago
Jonathan Golder
2f878ee901
Correct filename in header
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=72 FS#72]
8 years ago
Jonathan Golder
17bfb32ded
Building generators of config cats in sep Function
Since the main()-Function was too complex the logic to build generators
out of categories provided in jogobot.conf was moved in a separate
function
[https://fs.golderweb.de/index.php?do=details&task_id=73 FS#73]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=72 FS#72]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=72 FS#72]
8 years ago
Jonathan Golder
6cb92c1da7
Rewrite parse control using pywikibot.bot classes
To use the default pywikibot.classes making life easier at some point
Beeing standardconform with pywikibot in handling args
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=72 FS#72]
8 years ago
Jonathan Golder
a8605bcee6
Mv pages-parser.py to reddiscparser.py
New, more meaningfull naming conventions, from redpage to reddisc (page)
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=72 FS#72]
8 years ago