Jonathan Golder
da4f9b5d6b
Add wrapper-generator to redfam.article_generator
We need a wrapper around redfam.article_generator to pass it to
pagegenerators.PageWithTalkPageGenerator and to add a reference to
related redfam to each pywikibot.page-object before yielding it
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
ecc78bef96
Import needed modules and add redfams-generator
We will need a couple of modules to build the needed generator
Also we will need a generator with redfams to work with
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
efa919ff27
Add new bot with basic structure
We need a bot to work on pages which are subjects of redfams and on the
belonging talk page
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=88 FS#88]
8 years ago
Jonathan Golder
72c6165de8
Merge branch 'fs#87-redfam-article-generator' into fs#25-mark-done
8 years ago
Jonathan Golder
c0b18f88e5
Add filter options to redfam.article_generator
To give the posibility to filter not existing pages or redirect pages or
vice versa.
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=87 FS#87]
8 years ago
Jonathan Golder
e5989305a4
Add a generator to redfam yielding article pages
To work on articles of a redfam a generator which yields belonging
articles is necessary
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=87 FS#87]
8 years ago
Jonathan Golder
8ce6f03641
Merge branch 'fs#29-generate-articledisc-notice' into fs#25-mark-done
8 years ago
Jonathan Golder
6717fa4fba
Add method to generate notice for article discpage
We need a method to generate the template to add to article discpages
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=29 FS#29]
8 years ago
Jonathan Golder
8acba7d0f9
Merge branch 'fs#81-get-reddisc-link' into fs#25-mark-done
8 years ago
Jonathan Golder
3723aba578
Add a method to get link to related reddisc
To generate notices or other stuff it is necessary to add links to the
related reddisc.
This method returns a wikilink to text the redfam's reddisc.
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=81 FS#81]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=81 FS#81]
8 years ago
Jonathan Golder
9d3bc74c80
Merge branch 'fs#26-done-redfam-gen' into fs#25-mark-done
8 years ago
Jonathan Golder
b36dc250d2
Request information about reddisc page for redfams
To generate links to related reddisc it is necessary to get at least the
Title of the related reddisc page. As saving the same data in db is
worse, we retreive it via join from red_pages table
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
4055dc52d8
Make it possible to get a RedPage-Object by pageid
When working on redfams it is necessary to have information about redpage
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
594130c8a6
Restore changes from 45df35431
Documented to prevent deleting again
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
b271a0b0b1
Add generator wrapper to fetch RedFams by status and ending
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
ad088126e7
Define method to update Status after Working with RedFam
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
151c22a735
Add fetched mysql_data to _mysql-Object of parent class for using change-method to update db
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
a97d8c722e
Move handling of mysql-Connection from RedFamParser and RedFamWorker to RedFam-Class and make it protected instead of private
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
58dfd8c86a
For RedFamilies not fetched individually we need to provide the fam hash as index
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
9481116777
Add new generator-method to fetch RedFams by Status and Ending
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=26 FS#26]
8 years ago
Jonathan Golder
eaa7596a8f
Merge branch 'fs#70-refactoring' into test-v3
8 years ago
Jonathan Golder
449d83d7b5
Merge branch 'fs#82-subtask-wrapper' into fs#70-refactoring
8 years ago
Jonathan Golder
4ac9b305f5
Merge branch 'fs#85-move-start-api-to-jogobot' into fs#82-subtask-wrapper
8 years ago
Jonathan Golder
604b7bd8b7
Now use Bot-Start API from jogobot framework
API was moved to jogobot to share with other tasks
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=85 FS#85]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=85 FS#85]
8 years ago
Jonathan Golder
d0fa15d0ed
Update jogobot module to get standart Start-API
[FS#84]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=85 FS#85]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=85 FS#85]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=85 FS#85]
8 years ago
Jonathan Golder
71e41bfed3
Merge branch 'fs#83-wrapper-compatibility' into fs#82-subtask-wrapper
8 years ago
Jonathan Golder
2be0a8903d
Adjust constructor for wrapper-script
The new wrapper-script calls a standardized API
We need to be conform with that
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=83 FS#83]
8 years ago
Jonathan Golder
0ceb2e6e83
Add methods to build gen to DiscussionParser
With the new wrapper script the Bot gets a GenFactory and has to build
a generator out of it by its own
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=83 FS#83]
8 years ago
Jonathan Golder
3540cc2a7d
Move functional sections to functions in main()
To make main() function less complicated functional sections are moved
to dedicated functions
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
460d2db183
Add Bot run with exception handling
Errors, especially caused by missing run-method, need to be catched to
provide information in Logfile.
And also to get information wether bot run was successfull
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
156f117b18
Add Bot initiation with exception handling
Bot initiation needs to catch errors by Bot to enforce at least a basic
logging.
And also to be sure Init was successfull before starting bot.
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
1679e2ad6a
Prepare environment for starting subtasks
Before init and run bot we need to provide a environment for it,
like parsed args
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
b88efb6bdd
Reflect stucture changes in Code
Since bot class is moved to separate dir/file we need to do some changes
to rebuild functionality
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
177a8f920f
Prepare new structure to use subtasks
To have only one entry point for the bot we want to have a single file
(red.py) which is calling the specfic task class from bots dir with a
standardized call
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=82 FS#82]
8 years ago
Jonathan Golder
0549cbd2c2
Merge branch 'fs#80-remove-deprecated-methods' into fs#70-refactoring
8 years ago
Jonathan Golder
78eda10562
Remove deprecated methods
Deprecated functions which are not used anymore can be removed to make
code more clearer and improve maintainability
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=80 FS#80]
8 years ago
Jonathan Golder
510771509b
Merge branch 'fs#79-mysql-table-prefix' into fs#70-refactoring
8 years ago
Jonathan Golder
71b99b5f58
Delay definition of db_table_prefix
db_table_prefix should be defined at init of MysqlRed and not at import
to have cmdline args already parsed
Otherwise it uses default family
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=79 FS#79]
8 years ago
Jonathan Golder
77d1de4473
Add a tablename prefix depending on Site
To be able to run the bot on different wikis the db tables should be
named pywikibot.Site dependend and changed automatically
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=79 FS#79]
8 years ago
Jonathan Golder
cac04f344f
Merge branch 'fs#74-helpermodules-lib' into fs#70-refactoring
8 years ago
Jonathan Golder
e28acf88d1
Introduce new directory structure
To clarify which is a bot and which are helper scripts
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=74 FS#74]
8 years ago
Jonathan Golder
af48888535
Merge branch 'fs#78-redfam-section-false-positives' into fs#70-refactoring
8 years ago
Jonathan Golder
ac54aea698
Use callback to detect redfam.section
Detecting redfam-Sections via RegExp caused some false positives due to
wrong formated things in wikisyntax. See Task
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=78 FS#78]
8 years ago
Jonathan Golder
2deb02fe47
Merge branch 'fs#77-errors-on-old-archives' into fs#70-refactoring
8 years ago
Jonathan Golder
1e4c8646bf
Reparse redfam-heading with mwparser
See related ticked for detailed failure explanation
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=77 FS#77]
8 years ago
Jonathan Golder
fe2810f07c
Merge branch 'fs#76-redfam-without-dates' into fs#70-refactoring
8 years ago
Jonathan Golder
ab430e0085
Use month of reddisc as beginning if missing
Construct a fictive but sensfull beginning if we cant detect one
Needed since beginning is mandatory
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=76 FS#76]
8 years ago
Jonathan Golder
95be313859
Pass reddisc pywikibot.page object to redfam
To access page information like page title (eg. to get dates from it)
of the reddisc page
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=76 FS#76]
8 years ago
Jonathan Golder
0bb0b2d957
Make sure var beginning is always defined
To prevent unbound Errors caused by using undeclared variable beginning
if the redfam-section does not contain any timestamp
Related Task: [https://fs.golderweb.de/index.php?do=details&task_id=76 FS#76]
8 years ago
Jonathan Golder
db32c9e8f6
Merge branch 'fs#75-mysql-flush-error-false-reddisc' into fs#70-refactoring
8 years ago