Wikipedia:Bots/Requests for approval/KiranBOT 7

Add links
From Wikipedia, the free encyclopedia
The following discussion is an archived debate. Please do not modify it. To request review of this BRFA, please start a new section at Wikipedia:Bots/Noticeboard. The result of the discussion was  Approved.

KiranBOT 7[edit]

Operator: Usernamekiran (talk · contribs · SUL · edit count · logs · page moves · block log · rights log · ANI search)

Time filed: 16:37, Sunday, June 4, 2023 (UTC)

Automatic, Supervised, or Manual: automatic

Programming language(s): pywikibot

Source code available:

Function overview: replace football players related old categories with new categories, and create new categories with predefined content (see "function details" subsection for in-depth details)

Links to relevant discussions (where appropriate): Wikipedia:Bot requests/Archive 85#Help with creating/populating men's footballer categories based on this RfC.

Edit period(s): one time run

Estimated number of pages affected: 1,138 categories, and around 190,435 articles

Exclusion compliant (Yes/No): Yes

Already has a bot flag (Yes/No): Yes

Function details[edit]

The categories have been divided in five types:

  1. Footballers in <country> (244 categories, 68 articles)
  2. <nationality> footballers (241 categories, ~188,791 articles)
  3. Expatriate footballers in <country> (207 categories, ~66,500 articles)
  4. Footballers in <country> by club (224 categories, no articles (container categories))
  5. <nationality> expatriate footballers (222 categories, ~63,500 articles)

In total, around 190,000 articles would be edited (some of them would be edited twice or thrice). A list of all the categories to be moved is given below, along with the new content of the category. Currently, the bot is set to create new categories, and edit only the mainspace pages, with exception of "Footballers in <country> by club". These are container categories, and they will be updated as well. eg: for Category:Stade Plabennécois players, the category will be changed from Category:Footballers in France by club → Category:Men's footballers in France by club.

There are hardcoded lists of "old category" → "new category". The bot first goes through the list of old categories, and if new category doesnt exists, then creates it with appropriate content (given below). After the categories are created, then the bot goes through all the articles of each "old category", and replaces the old category with new category, if an article from old category has category(s) containing "women" in it, then the bot skips that article, and adds the skipped entry to a text file. In the same file the bot also adds the articles with "nobots" template on it. —usernamekiran (talk) 16:43, 4 June 2023 (UTC)[reply]

categories to update, with new category's content

Footballers in <country>

Category wikitext: 

[[Category:Footballers in <country>|+Men]]
[[Category:Men's association football players by country|<country>]]

<nationality> footballers

Category wikitext: 

{{CatAutoTOC}}
[[Category:<nationality> footballers|+Men]]
[[Category:<nationality> sportsmen|Footballers]]
[[Category:Men's association football players by nationality|<nationality>]]
[[Category:Men's footballers in <country>|<nationality>]]

Expatriate footballers in <country>

Category wikitext: 

This category is for non-<nationality> men's footballers who currently play or have played in <country>.
{{CatAutoTOC}}
[[Category:Expatriate footballers in <country>|+Men]]
[[Category:Men's footballers in <country>]]
[[Category:Expatriate men's association football players by country of residence|<country>]]

Footballers in <country> by club

Category wikitext: 

{{CatAutoTOC}}
[[Category:Footballers in <country> by club|+Men]]
[[Category:Men's footballers in <country>|Club]]
[[Category:Men's association football players by club|<country>]]

<nationality> expatriate footballers

Category wikitext: 

{{non-diffusing|<nationality> men's footballers}}
The is a page for <nationality> men's [[Association football|footballers]] who have played abroad at any time during their career.
{{CatAutoTOC}}
[[Category:<nationality> expatriate footballers|+Men]]
[[Category:<nationality> men's footballers|Expatriate]]
[[Category:Expatriate men's association football players by nationality|<nationality>]]

Discussion[edit]

some of them would be edited twice or thrice - are you saying that if done manually it would be edited multiple times, or are you saying that this bot run will edit certain pages multiple times? (please do not ping on reply) Primefac (talk) 08:30, 7 June 2023 (UTC)[reply]

I did not exactly understand first part regarding being "done manually", but I understood the spirit of complete query I think. For example, the article Patrice Abanda is part of Category:Cameroonian footballers so when updating categories for type "<nationality> footballers", the first edit by bot on that article would be "Category:Cameroonian footballers → Cameroonian men's footballers". For this particular article of Patrice Abanda, the second batch/type would be "<Expatriate footballers in <country>", and the bot's edit would be "Expatriate footballers in Albania → Expatriate men's footballers in Albania". There are a lot of articles that belong to multiple categories which needs to be updated, so there would be multiple edits. Even if there are multiple edits on the same article, they will not be in rapid succession (there will be significant gap, maybe minutes or even hours), as the bot will go through all the articles of one particular category of a type/batch one by one, then it will go through the next type/batch similarly. —usernamekiran (talk) 10:40, 7 June 2023 (UTC)[reply]
in short: if an article belongs belongs to two different categories, then the bot will update all the articles from first category, and later it will handle the second category. So one article will be edited twice, with significant gap between the edits. —usernamekiran (talk) 11:26, 7 June 2023 (UTC)[reply]
Would you be able to chunk out your lists so that you only edit each page once? In other words, edit pages that are in only one category, then two categories, then three categories, etc. Primefac (talk) 09:20, 14 June 2023 (UTC)[reply]
No, that will not be possible. The program takes input in form of categories (all the articles from that category(s).) Sorting the articles based on number of categories they belong to would be illogical. The original proposed method is the most logical/feasible. —usernamekiran (talk) 14:11, 14 June 2023 (UTC)[reply]
if a 50 or preferably 100 edit trial is granted, we can see how it will actually pan out. —usernamekiran (talk) 00:26, 15 June 2023 (UTC)[reply]

{{BAG assistance needed}} Except the large number of page to be affected, this is a straight-forward task of replacing categories. The program already has been tested on the bot's subpage, requesting a trial with 2+100 edits (will create two new categories, and replace categories on 50 pages from these two categories). —usernamekiran (talk) 15:58, 23 June 2023 (UTC)[reply]

Considering the large number of pages affected, can you make it such that each page would be edited only once? It's written in pywikibot and not AWB, so I don't see why it wouldn't be possible. The community has expressed opposition in the past towards bots that make repeated edits instead of batching them. – SD0001 (talk) 07:07, 30 June 2023 (UTC)[reply]
I was just taking another read of this, and yes, it should be possible. From what I'm reading of the task description, it's basically a find/replace operation, and I guess I'm not seeing why one can't replace (for example) "Footballers in Albania" and "Albanian footballers" in one edit on a page. Primefac (talk) 07:47, 30 June 2023 (UTC)[reply]
Perhaps if usernamekiran posted their source code, it would be clearer what the issue is with this? — Qwerfjkltalk 10:16, 30 June 2023 (UTC)[reply]
on a second/refreshed look, this seems possible. Kindly give me a few hours. —usernamekiran (talk) 10:51, 1 July 2023 (UTC)[reply]
  • @SD0001 and Primefac: I updated the code, now it will make only one edit per page. —usernamekiran (talk) 13:50, 1 July 2023 (UTC)[reply]
  • Approved for trial (100 edits). Please provide a link to the relevant contributions and/or diffs when the trial is complete. – SD0001 (talk) 19:29, 1 July 2023 (UTC)[reply]
  • Trial complete. the 100 edits. I sampled a few edits, I could not find any errors/undesired edits. Edits on Rachid Aït-Atmane, and Mouloud Akloul had most category replacements. Also, should I make any changes to the edit summary, or should I keep it as it was for these edits? I also manually copy-pasted the content of bot's change_file to User:KiranBOT/football/log 2. I can either program the bot to copy-paste entire log in one edit, or do it manually later. Also, User:KiranBOT/football/log 1 is reserved for log of new category creation along with their content. —usernamekiran (talk) 03:21, 2 July 2023 (UTC)[reply]
    Rachid Aït-Atmane has been left with red-linked categories. Is there an easy way for the bot to detect it's adding red links? I would suggest first generating a full list of missing categories, and whenever the bot adds a category which is in this set, create the category page as well with createonly=1 API flag (to avoid overwriting existing content if someone had created the page in between).
    The edit summary and logging are up to you. – SD0001 (talk) 07:31, 2 July 2023 (UTC)[reply]
    @SD0001: in the original program, the bot created non-existent categories (that's why there was that log page 1). I updated the current program to create all the required categories if they don't exist before it starts updating the articles. I had tested this thoroughly on bot's sandbox, and given there were unexpected categories to be updated with 100 edits trial, I didn't create the categories. We can have another 100 edits trial for category creation if you'd like. —usernamekiran (talk) 11:25, 2 July 2023 (UTC)[reply]
    If all categories are created in advance, wouldn't they get tagged for C1 deletion? They'll actually get deleted only if the category remain empty for 7 days – is the bot run expected to complete within that period? – SD0001 (talk) 20:13, 2 July 2023 (UTC)[reply]
    @SD0001: yes, the bot should finish the run in less than seven days. It will probably take 2-3 days. —usernamekiran (talk) 20:21, 2 July 2023 (UTC)[reply]
  • Approved for extended trial (2,000 edits). Please provide a link to the relevant contributions and/or diffs when the trial is complete. This would cover creation of all categories, plus some article edits. – SD0001 (talk) 20:28, 2 July 2023 (UTC)[reply]
  • Trial complete. In total, 1,103 categories were created, that left 897 articles to be updated. I randomly sampled a lot of the edits, and all of them were as desired. link to 2000 edits. —usernamekiran (talk) 08:23, 3 July 2023 (UTC)[reply]
  •  Approved. Looks good to me. Thanks for taking on this task! – SD0001 (talk) 15:16, 3 July 2023 (UTC)[reply]
The above discussion is preserved as an archive of the debate. Please do not modify it. To request review of this BRFA, please start a new section at Wikipedia:Bots/Noticeboard.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Wikipedia:Bots/Requests_for_approval/KiranBOT_7&oldid=1169288739"