Commit Graph

287 Commits

Author SHA1 Message Date
b80f5bd2c9 Prepare release v1.2 2018-10-05 12:36:49 +02:00
ff2421b63e Merge branch 'remove-jogobot-submodule' into develop 2018-10-05 11:42:08 +02:00
236ba6a870 Update requirements 2018-10-05 11:40:25 +02:00
0df2017387 Remove submodule jogobot
As now installable via pip
2018-10-05 11:37:56 +02:00
b9faed8847 Merge branch 'i#64-missingnotice' into develop 2018-10-05 11:35:50 +02:00
5cdccaeec6 missingnotice: Add RedFam counter output
Signalize bot is working, since processing RedFams takes about
15 minutes with out any output right now

Issue #64 (#64)
2018-09-25 17:51:01 +02:00
54d8b8ea3b missingnotice: Disable verbose logging of sqlalchemy
Issue #64 (#64)
2018-09-18 16:29:54 +02:00
dea5a393ad missingnotice: Call RedFamWorker.flush_db_cache
To write status changes to db

Issue #64 (#64)
2018-09-18 16:29:50 +02:00
f021a13202 missingnotice: Implement run()
The bots working sequence, using previously implemented methods to
update the list of missing notices

Issue #64 (#64)
2018-09-18 16:29:45 +02:00
4c8ba95534 missingnotice: Implement update_page()
This method updates the content of the configured or given wikipage with
the generated lines

Issue #64 (#64)
2018-09-18 16:29:40 +02:00
9804db212f missingnotice: Implement format_row()
With this method, the links to redundance discussions and articles
missining notice are concatenated and formated

Issue #64 (#64)
2018-09-18 16:29:34 +02:00
68b81b1111 missingnotice: Implement treat_redfam
For each redfam, we need to check weather related redundance discussion
exists and if there are missing notices. For those redfams return links
to discussion and articles missing notice.

Issue #64 (#64)
2018-09-18 16:29:28 +02:00
389c48605e redfam: Make get_disc_link() able to return wikilink
Issue #64 (#64)
2018-09-18 16:29:22 +02:00
95af95aca6 missingnotice: Implement article selection
Issue #64 (#64)
2018-09-18 16:29:17 +02:00
99adad873e missingnotice_test: Test article query
Issue #64 (#64)
2018-09-18 16:29:01 +02:00
dbcc2717d7 missingnotice: Implement article query
Issue #64 (#64)
2018-09-18 16:28:56 +02:00
e5a45fa692 tests: Add test script for missingnotice
Issue #64 (#64)
2018-09-18 16:28:44 +02:00
63d3f837e9 red.py: Introduce subtask missingnotice
Issue #64 (#64)
2018-09-18 16:28:38 +02:00
cfb3e8e37c bots: Add basic structure for MissingNoticeBot
Issue #64 (#64)
2018-09-18 16:28:29 +02:00
dfffe97200 redfam: Add method to check disc section
Sometimes disc sections are disapering since the heading is changed
and the famhash changes, so we get a new redfam. Mark those as absent

Issue #64 (#64)
2018-09-18 16:28:22 +02:00
246e94c228 redfam: Add generator for open redfams to Worker
Issue #64 (#64)
2018-09-18 16:27:51 +02:00
181486c718 Merge branch 'release-1.1.1' back into develop 2018-09-17 17:23:12 +02:00
3fbfd4ccd7 Prepare release-1.1.1 2018-08-12 11:46:40 +02:00
50b0e142ec Merge branch 'i#71-moved-page-exists' into develop 2018-08-12 11:43:18 +02:00
14db996a43 redfam: Check if moved page exists
To prevent creation of orphaned diskpages in case of special movement
constructs

Issue #71 (#71)
2018-08-12 11:41:50 +02:00
110589cb5b Merge branch 'release-1.1' back into develop 2018-08-12 11:15:30 +02:00
a466ab4e74 Prepare release-1.1 2018-05-17 12:41:06 +02:00
860a285ab0 Merge branch 'i#68-exclude-users' into develop 2018-05-17 12:36:37 +02:00
2c105336b0 RedFamWorker: Exclude users and user talkpages
Users can't be part of valid redundances

Issue #68 (#68)
2018-05-17 12:35:38 +02:00
ea85ca731f Merge branch 'i#69-already-talkpage' into develop 2018-05-17 12:28:17 +02:00
6e119ea98f RedFamWorker: Improve talkpagetoggling
Do not toggle to main page if we have already a talkpage and vice versa

Issue #69 (#69)
2018-05-17 12:26:37 +02:00
67aaf3cbbe Merge branch 'i#70-follow-moved-pages' into develop 2018-05-17 12:24:00 +02:00
fa13e2a5cf Follow moved pages
Keep notice together with content
https://de.wikipedia.org/w/index.php?title=Benutzer_Diskussion:Jogo.obb&oldid=176464377#Redundanzhinweis_zu_zwischenzeitlich_verschobenen_Artikeln

Issue #70 (#70)
2018-05-17 12:18:13 +02:00
562e689418 Merge branch 'release-1.0' back into develop 2017-11-05 12:30:18 +01:00
93447d8dc6 Prepare release v1.0
Update Copyright Notices
Version information
2017-11-05 12:25:13 +01:00
1b6faf9e53 Use own db for red-task
Since we have several tables and sometimes need to create a copy on
replication servers.
2017-11-05 12:17:05 +01:00
b4c193eedc Disable echoing of SQLAlchemy Egine
We don't need this extensive output for production
2017-11-05 12:07:38 +01:00
788a3df0cd Update jogobot-submodule to v0.1 2017-11-05 12:00:28 +01:00
04f591b466 Merge branch 'fs#161-add-article-titles' into develop 2017-11-05 11:24:15 +01:00
9640467f69 markpages: Use redarticle attribute of Page
Instead of trying to reconstruct our db article title, use the one added
to Page-object by redfam.article_generator

Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161)
2017-11-05 11:22:43 +01:00
bfec2abf98 markpages: Get rid of PageWithTalkPageGenerator
Since redfam.article_generator can yield talkpage with additional
information about redfam and current article from db, we do not need it
anymore.

Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161)
2017-11-05 11:20:55 +01:00
20103d589d redfam: article_generator add redfam info to page
Add reference to redfam object and article title from db to Page object
since Page.title() may differe (short Namespaces, anchors, special chars)

Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161)
2017-11-05 11:18:53 +01:00
e18aa96a84 redfam: article_generator can return talkpage
To make pywikibot.pagegenerators.PageWithTalkPageGenerators unneccessary
so we can manipulate talkpage object directly

Related Task: [FS#161](https://fs.golderweb.de/index.php?do=details&task_id=161)
2017-11-05 11:15:04 +01:00
1dd4c7f87e Merge branch 'test-v7' back into develop 2017-11-02 18:57:59 +01:00
33b2e47312 Describe version test-v7 test-v7 2017-10-28 22:43:53 +02:00
3bd17ce692 Merge branch 'fs#160-urlencoded-chars' into develop 2017-10-28 22:36:55 +02:00
5f4640d5ff Replace urlencoded chars with unicode equivalent
Otherwise we get value errors while marking since pwb replaces those

Related Task: [FS#160](https://fs.golderweb.de/index.php?do=details&task_id=160)
2017-10-28 22:35:25 +02:00
7e0456ae4f Merge branch 'test-v6' back into develop 2017-10-28 22:34:30 +02:00
108b7aa331 Describe version test-v6 test-v6 2017-10-28 18:46:30 +02:00
a3adf31b89 Merge branch 'fs#86-activate-status-api' into develop 2017-10-28 18:44:42 +02:00