Commit Graph

59 Commits

Author SHA1 Message Date
523d029fdc Fix bug causing db table cells containing empty strings 2015-09-19 19:45:34 +02:00
4518efc504 Fix bug (Cached querys not executed) caused by class attribute protection level --> changed from private to protected
Reformat MySQL querys to remove whitespace generated by indetation
2015-09-18 18:08:13 +02:00
b1b37f9b9e Implement functions for flushing db query caches 2015-09-17 20:00:13 +02:00
8dc7fe678d Fix bug caused by adding fam_hash to repr of RedFam class since it was not defined yet while output of warning caused by to many articles 2015-09-17 19:57:53 +02:00
53f53ddb8b Implement cached querys in MysqlRedFam 2015-09-17 19:56:39 +02:00
26f5912f88 Collect writing db querys for running once in MysqlRedPage
Add classmethod to MysqlRed for executing collected querys
2015-09-16 21:02:02 +02:00
1dea5d7e84 NOT WORKING Cache SQL querys to reduce amount of querys 2015-09-16 18:31:54 +02:00
b514eb5c42 Move configuration to jogobot module
Use custom Error classes
2015-09-15 21:21:05 +02:00
db5bb7401e Update RedFam class to rebuild the whole structure of RedFamPaser generated object
Move fam_hash() method from RedFamParser to RedFam
Define custom Error classes
2015-09-15 21:19:07 +02:00
be0041804a Clean up test-v1 2015-09-13 13:19:22 +02:00
af6d483280 Use a additional module to store custom config ... 2015-09-13 13:14:37 +02:00
7c9061d37f Use redundances as python package 2015-09-13 13:13:28 +02:00
74b2dc727c Clean up PEP8 styleguide compatibility with flake8 2015-09-13 11:53:47 +02:00
cafe08dd7f Added license GPLv3 + Reworked code
Better compatibility with https://www.mediawiki.org/wiki/Manual:Pywikibot/Development_guidelines
2015-09-13 01:22:27 +02:00
ad100e96eb Remove timezone from timestamp patterns since it is not stored and causes errors on labs 2015-09-12 22:35:12 +02:00
c78480a75d Use mysql config from pywikibot user-config.py 2015-09-12 22:33:44 +02:00
6e0d3200c2 Change visibility of attributes changed and parsed in RED_PAGE to protected 2015-09-12 14:24:45 +02:00
f50f4b664f Add additional possibilities to detect wether a red_page is an archive or not 2015-09-12 13:48:01 +02:00
e70655f679 Catch sections with more then 8 articles 2015-09-12 12:42:23 +02:00
14e865c6e6 We need to save the red_fam section heading in database for generating section links since format is not consistent 2015-09-12 00:50:04 +02:00
a97e2cea5a Since some timestamps are broken we need to reconstruct them by regex match groups
Prevents ValueErrors of datetime.strptime in most cases
2015-09-11 23:47:35 +02:00
6e64d8448e Prevent RED_PAGE from resetting status if parser is not fired 2015-09-11 22:29:16 +02:00
deaa1d855b Fix bug which prevents detecting of red_fam sectionheading when there is whitespace after closing heading tags (===) 2015-09-11 22:27:25 +02:00
90da231712 Move the code for instanciating of RED_FAM_PARSER to the end of loop 2015-09-11 17:05:18 +02:00
529ed09702 Use pywikibot.output instead of print 2015-09-11 16:42:12 +02:00
1892c6d015 Fix wrong intendet line (RED_FAM_PARSER only was instantiated when ending-datetime workaround fired) 2015-09-11 16:41:04 +02:00
99f050acd3 Add workaround to detect ending datetime if there is no done notice 2015-09-11 16:22:19 +02:00
8b7dc5dbf2 Improve sectionheading regex to reduce false positives, require at least two links 2015-09-11 16:18:46 +02:00
5e39ea0b06 Correct use of pywikibot page.title() 2015-09-11 14:12:26 +02:00
f8dacb53e1 Add param to RED_PAGE for predefining page status archived when using cat of archives 2015-09-11 14:10:33 +02:00
ebf7a8fe0b Add alternative syntax for done_notice 2015-09-11 13:56:16 +02:00
47238f0f96 On archived red_fams do not delete possibly existing ending 2015-09-11 13:37:58 +02:00
907ccad63a Detect if red_fam is archived but has no detectable ending, set status 2 anyway 2015-09-11 13:12:29 +02:00
31ea512c41 Prevent overwriting of ending with None by only calling RED_FAM_PARSER if there was no ending before 2015-09-11 13:01:04 +02:00
4f7cfc65cc Catch ValueErrors caused by missing points after month abreviation in RED_PAGE_PARSER.__timestamp 2015-09-10 23:09:35 +02:00
a26b92082b Implement parsing process in RED_PAGE.parse() 2015-09-10 23:08:51 +02:00
984c269aa4 Implement classmethods for detecting sectionheading, beginning and ending in class RED_FAM_PARSER 2015-09-10 23:06:54 +02:00
0f4ce7c4c9 Add workaround to get mysql.data dictionary while adding new pages/fams 2015-09-10 23:02:38 +02:00
7535172d30 Update mysql db if anything of re_fam changes 2015-09-10 11:57:35 +02:00
9e865e1c2f Some clean ups 2015-09-10 11:57:10 +02:00
79e232d52b Add gitignore file 2015-09-10 11:46:05 +02:00
ea92415b37 Add dummy -method for parsing to RED_PAGE 2015-09-10 11:24:25 +02:00
30e1672557 Implement methods for parsing red_fams
Add Interfaces for RED_FAM
2015-09-10 11:23:15 +02:00
6d1ed33699 Add methods for MySQL actions while parsing RED_FAMs 2015-09-10 11:20:20 +02:00
45df354315 Prevent descendant classes of MYSQL_RED from deleting connection to db 2015-09-10 11:18:22 +02:00
73b5d87e8d Implemment handling of changed page meta data (rev_id, page_title, status) 2015-09-07 22:51:07 +02:00
cef90e4fac Handle building of MYSQL_RED_PAGE objects 2015-09-07 19:04:16 +02:00
c800a13f0c Change behavior of MYSQL_RED(_PAGE), handle save requested data in object for simple update handling 2015-09-07 19:00:04 +02:00
0beb97d67d Use qmark parametrization style for mysql query 2015-09-07 16:21:57 +02:00
773557a591 Use DictCursor ouf oursql to get better readability in MYSQL_RED_PAGE 2015-09-06 16:02:30 +02:00