Wikipedia:Bots/Requests for approval/EranBot

The following discussion is an archived debate. Please do not modify it. To request review of this BRFA, please start a new section at WT:BRFA. The result of the discussion was  Approved.

EranBot

Operator: ערן (talk · contribs · SUL · edit count · logs · page moves · block log · rights log · ANI search) Was developed based on the request of User:Jmh649 among others.

Time filed: 01:24, Friday August 22, 2014 (UTC)

Automatic edits but not to main space

Programming language(s): Python

Source code available: source in github

Function overview: This bot submits newly added text to medical articles to the iThenticate API which determines if other sources are similar to it. This information is than placed on this page Wikipedia:MED/Copyright for human followup. The bot run on period basis.

  • Links to relevant discussions (where appropriate): An entire project surrounds the creation of this bot with many subpages. This can be seen here Wikipedia:Turnitin. A memorandum of understanding has been signed with Turnitin. User:Ocaasi can send it to anyone who wishes it

Edit period(s): A few times per day

Estimated number of pages affected: 1

Exclusion compliant (Yes/No): N/A

Already has a bot flag (Yes/No): No (using autopatrolled for trial)

Function details: Bot only changes one page and that is Wikipedia:MED/Copyright

Discussion

As this bot does not edit mainspace and their is no plan for it to ever edit mainspace the discussion at Wikimania was that it does not need official approval to run but should get it eventually. Happy to provide more details and to be corrected if this was a misunderstanding. Would appreciate the help of those who know the bot approval process better than I in correcting any malformed answers. Doc James (talk · contribs · email) (if I write on your page reply on mine) 01:29, 22 August 2014 (UTC)[reply]

All bot edits are ultimately the responsibility of the operator, but the updates are being done by others.— xaosflux Talk 03:00, 22 August 2014 (UTC)[reply]
That's not the policy here at enwiki, Doc James. WP:BOTPOL excludes only edits to the bot's own userspace or the operator's own userspace; edits to other non-mainspace pages do require approval. Anomie⚔ 03:09, 22 August 2014 (UTC)[reply]
I do not think anyone cares were exactly the edits go. We can move this to the bot's userspace. Doc James (talk · contribs · email) (if I write on your page reply on mine) 04:42, 22 August 2014 (UTC)[reply]
  • What is your criteria to determine if an article is a "medical article"? — xaosflux Talk 03:07, 22 August 2014 (UTC)[reply]
It is tagged with the WP:MED tag on the talk page. Doc James (talk · contribs · email) (if I write on your page reply on mine) 04:42, 22 August 2014 (UTC)[reply]
Can you provide the current, approximate, count of these ? — xaosflux Talk 15:44, 22 August 2014 (UTC)[reply]
I assume that means talk pages which transclude {{WikiProject Medicine}}. There are over 25 thousand transclusions of that template. – Wbm1058 (talk) 13:24, 11 September 2014 (UTC)[reply]
  • Do you plan on only look at current articles in whole, certain diffs, or every diff (even ones already reverted?) — xaosflux Talk 03:23, 22 August 2014 (UTC)[reply]
Certain new diffs over a certain size. Doc James (talk · contribs · email) (if I write on your page reply on mine) 04:42, 22 August 2014 (UTC)[reply]
  • Do you plan to notify editors that you are creating reports about their edits? — xaosflux Talk 03:26, 22 August 2014 (UTC)[reply]
Only if their are concerns. Doc James (talk · contribs · email) (if I write on your page reply on mine) 04:42, 22 August 2014 (UTC)[reply]
Currently done manually by Jmh649 or other patrollers of the report page. However, the bot may add [in future] signature (~~~~) to its edits and then editors will be notified using the notification system ("someone mentioned you..."). Eran (talk) 07:50, 22 August 2014 (UTC)[reply]
Looking for additional community feedback on this, conducting automated investigations of editors without involving them may be problematic. — xaosflux Talk 12:40, 22 August 2014 (UTC)[reply]
(If this aspect has already had a community discussion, please provide a link to it here). — xaosflux Talk 15:44, 22 August 2014 (UTC)[reply]
You will notice that this tool is in the pilot phase. We need to determine how accurate it is before we consider having it provide feedback directly. Doc James (talk · contribs · email) (if I write on your page reply on mine) 21:36, 22 August 2014 (UTC)[reply]
Resolved discussion over initial trial pages
  • information Note: This bot appears to have edited since this BRFA was filed. Bots may not edit outside their own or their operator's userspace unless approved or approved for trial. AnomieBOT⚡ 03:54, 22 August 2014 (UTC)[reply]
We can have the bot only edit in their user-space. Doc James (talk · contribs · email) (if I write on your page reply on mine) 04:42, 22 August 2014 (UTC)[reply]
See above answers. Please approve the bot to edit in Wikipedia namespace, and not in a user page as WP NS is the correct place for "public" pages. The report page is public page that other editors should feel free to edit, e.g. to remove edits that they don't see as concern of copyright violation. It edits only 1 page per 3 hours, so even without bot rights for now it doesn't overflow the RC. Eran (talk) 07:50, 22 August 2014 (UTC)[reply]
I am happy to have this content in your user space Eran and than edit your user space. Most others at WP:MED are also happy to edit others user spaces. This is a bit of a technicality it seems. Doc James (talk · contribs · email) (if I write on your page reply on mine) 07:53, 22 August 2014 (UTC)[reply]
Psychologically users feel more free to edit a page not in a user space which some editors may consider as private page. (though I have no technical problem with moving it to user NS) Eran (talk) 08:02, 22 August 2014 (UTC)[reply]
Great lets move it to your user NS and I will unblock your bot account. Doc James (talk · contribs · email) (if I write on your page reply on mine) 09:00, 22 August 2014 (UTC)[reply]

Bot blocked pending the operator's response here. — xaosflux Talk 03:58, 22 August 2014 (UTC)[reply]

Any Admin should feel free to unblock upon the operator arriving and stopping the bot prior to approval. — xaosflux Talk 04:02, 22 August 2014 (UTC)[reply]
N.B. In general, I don't see anything preventing a short trial from getting approved, after the operator is responsive and initial questions are answered. — xaosflux Talk 04:02, 22 August 2014 (UTC)[reply]
User:Xaosflux you appear to be over reacting. We can move this to the persons user space. The bot operator speaks Hebrew. Doc James (talk · contribs · email) (if I write on your page reply on mine) 04:42, 22 August 2014 (UTC)[reply]
Do you mean that the bot operator is not able to communicate in English? As far as I know, policy doesn't require language proficiency, however they are responsible for the operations of the bot and all edits it makes to the English Wikipedia. Will someone be able to translate all communications for him so he can reply back? Is the communications plan once this bot is in full operations to always require an interpreter for responses from the operator? If the edits can at least temporary be redirected to a user sandbox, any admin can revert the block once that is confirmed. — xaosflux Talk 04:52, 22 August 2014 (UTC)[reply]
Xaosflux, I guess Jmh649 means I'm mainly editing in Hebrew Wikipedia and not English Wikipedia. Of course there is is no requirement for a translator. Regarding user space vs WP NS, please see the above comment (above {{OperatorAssistanceNeeded}}). Eran (talk) 07:50, 22 August 2014 (UTC)[reply]

((BotTrial|edits=100|days=10|userspace=yes)) Initial approval for user-space technical trial, there are some community-interaction components that need further exploration, but a trial is a good way to gather the type of output that is expected. — xaosflux Talk 12:36, 22 August 2014 (UTC)[reply]

The bot is picking up true positives. The number of false positives is still a bit high and will need further tweaking but this was to be expected. Doc James (talk · contribs · email) (if I write on your page reply on mine) 04:48, 23 August 2014 (UTC)[reply]

Consensus from WP:MED for this bot is [1]. Doc James (talk · contribs · email) (if I write on your page reply on mine) 02:01, 27 August 2014 (UTC)[reply]

Jmh649 did you finish bot trial? Is anything to be done to reduce false positives? Du you want one more trial? -- Magioladitis (talk) 16:25, 8 September 2014 (UTC)[reply]

Efforts to reduce false positives are coming along nicely. We now have a blacklist that is machine readable. As this list is improved false positives will decrease. Other improvements are listed here [2] A 50/50 rate of false positives to true positives I deem to be a huge success.
Plans are not to have the bot do anything other than create a list of possible concerning edits. There is no discussion of having automated warnings or editing. That would be years out if at all.
At this point I hope the bot could be approved to operate on medical articles going forwards ( and expanded to pharmacology and anatomy articles ). I would want proof of a community willing to follow up on concerns if it was to expand to other topic areas. Doc James (talk · contribs · email) (if I write on your page reply on mine) 10:38, 10 September 2014 (UTC)[reply]

The trial has been underway at two locations:

I suggest that the next step should be to approve for an extended trial at Wikipedia:MED/Copyright, and merge User:EranBot/Copyright into that page. I learned of this trial from reading The Signpost here, so that high-profile notice should draw more attention to this trial. – Wbm1058 (talk) 14:13, 11 September 2014 (UTC)[reply]

Yes that would be excellent. Doc James (talk · contribs · email) (if I write on your page reply on mine) 23:39, 11 September 2014 (UTC)[reply]

((BotExtendedTrial|edits=100|days=10|userspace=yes)) Approved for extended trial. Please next time post a BotTrialCompleted after bot trial is done. -- Magioladitis (talk) 14:38, 14 September 2014 (UTC)[reply]

Doc James when bot trial ends please notify using {{BotTrialComplete}} and provide diffs. -- Magioladitis (talk) 08:21, 15 September 2014 (UTC)[reply]

Provide diffs of what exactly? Doc James (talk · contribs · email) (if I write on your page reply on mine) 06:28, 16 September 2014 (UTC)[reply]
Whichever edits (or other log entries) the bot made as part of its trial. In this case, you could probably just link to Special:Contributions/EranBot with appropriate offset and limit URL parameters since the bot hasn't made any edits other than for this trial, or maybe to the history of User:EranBot/Copyright with appropriate offset and limit. Anomie⚔ 11:26, 16 September 2014 (UTC)[reply]

Doc James is bot trial done? It's been 20 days. -- Magioladitis (talk) 22:14, 8 October 2014 (UTC)[reply]

Trial complete. Bots working wellish. Of the last 36 edits 18 have been true positive copyright issues. 18 have been false positive copyright issues. Has allowed us to keep a fair number of copy and paste issues out of Wikipedia and given us the ability to educate new editors. More tweaking is needed but that is not unsurprising.
We have two long term editors who are doing the follow up of all edits that are flagged. The number of concerns brought to our attention is not unreasonable for us to handle. We are getting 2 to 8 concerning edits per day from ~30,000 articles.
Before this bot were to expand to other topic areas there would first need to be dedicated editors who wish to do the review. The list of sites that the bot ignores as they are known mirrors of Wikipedia has grown nicely [User:EranBot/Copyright/Blacklist]
Unclear what you are wishing before bot is approved to function in an ongoing manner? Doc James (talk · contribs · email) (if I write on your page reply on mine) 00:47, 9 October 2014 (UTC)[reply]
User:Magioladitis were are we at with respect to this? Doc James (talk · contribs · email) (if I write on your page reply on mine) 17:55, 23 October 2014 (UTC)[reply]
Doc James If you are satisfied with the result and the minor issues can be handled I will aproove the bot. -- Magioladitis (talk) 19:45, 23 October 2014 (UTC)[reply]
Thank you. Would appreciate that. Doc James (talk · contribs · email) (if I write on your page reply on mine) 21:18, 23 October 2014 (UTC)[reply]

 Approved. -- Magioladitis (talk) 09:02, 24 October 2014 (UTC)[reply]

The above discussion is preserved as an archive of the debate. Please do not modify it. To request review of this BRFA, please start a new section at WT:BRFA.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Wikipedia:Bots/Requests_for_approval/EranBot&oldid=1074096436"