Viewing filter 1,163: Repeated text
Filter parameters
Filter ID:
1,163
Description:
(publicly viewable)
Filter hits:
62,165 hits
Statistics:
Of the last 169,086 actions, this filter has matched 20 (0.01%). On average, its run time is 0.17 ms, and it consumes 1.3 conditions of the condition limit.
Conditions:
(documentation)
!("confirmed" in user_groups) & page_namespace == 0 & ( exp := "(?i)(?<!\S)([^\s|]++(?: [^\s|]++)*?)(?:\s++\1){2}(?!\S)"; matched := get_matches(exp, added_lines); matched[0] & !(removed_lines irlike exp) & new_wikitext irlike ("(?:" + rescape(matched[1]) + "\s*){3}") & /* Avoid edits to multiple non-contiguous lines */ matched[1] irlike "\p{L}" & /* Exclude numeric data */ !(matched[1] irlike "^[!|{*#]") & /* Exclude some lists, tables and templates */ !(added_lines irlike "syntaxhighlight|\{\|") )
!("confirmed" in user_groups) & page_namespace == 0 & ( exp := "(?i)(?<!\S)([^\s|]++(?: [^\s|]++)*?)(?:\s++\1){2}(?!\S)"; matched := get_matches(exp, added_lines); matched[0] & !(removed_lines irlike exp) & new_wikitext irlike ("(?:" + rescape(matched[1]) + "\s*){3}") & /* Avoid edits to multiple non-contiguous lines */ matched[1] irlike "\p{L}" & /* Exclude numeric data */ !(matched[1] irlike "^[!|{*#]") & /* Exclude some lists, tables and templates */ !(added_lines irlike "syntaxhighlight|\{\|") )
Notes:
Split from test filter [[Special:AbuseFilter/2]], comments there: ---- Testing generic catching of repeated phrases. Unsure of efficiency, but we'll find out! With thanks to some folks from IRC for helping craft and test variations (digitok & Me-me) --ProcrastinatingReader 14:19 24 Aug 2021 Remove ccnorm for now to prevent some table FPs. Will still be more table issues; still thinking how to get around them. --ProcrastinatingReader 15:55 24 Aug 2021 Tweak for better table support. --ProcrastinatingReader 16:31 24 Aug 2021 ---- (proc @ 23:44 28 Aug 2021) Disable throttle and making public per [[Wikipedia:Edit_filter_noticeboard#Suitability_of_1163_->_disallow]]. --ProcrastinatingReader 23:54 10 Nov 2021 Try exclude some table-related FPs --ProcrastinatingReader 14:57 16 Nov 2021 rv change - introduced too many false positives --ProcrastinatingReader 14:59 16 Nov 2021 retry change with adjustment --ProcrastinatingReader 15:14 16 Nov 2021 TODO: probably try to exclude anything that seems like it's just formatting (<br>s, bullets, lots of |), and also adjustments to data if possible (changing numerical data) --ProcrastinatingReader 15:19 16 Nov 2021 Might need some more tuning to be disallowable, but definitely good enough filter (>80-90% edits problematic) to tag the edits as possible vandalism. --Galobtter 05:32 1 Apr 2023 Exclude table additions/some modifications and some template additions. --Galobtter 18:27 2 Apr 2023 Also exclude code. --Galobtter 20:48 2 Apr 2023 Attempt to reduce FPs so this can be set to disallow. Require at least one letter (in any script). Avoid lists. Also require that some repeated text appear in new_wikitext; if it doesn't, the edit was to multiple lines that got crammed together in added_lines. --Suffusion of Yellow 21:49 24 Apr 2024
Flags:
Hide details of this filter from public view
Enable this filter
Mark as deleted
Filter last modified:
21:51, 24 April 2024
by
Suffusion of Yellow
(
talk
|
contribs
)
History:
View this filter's history
Tools:
Export this filter to another wiki
{"data":{"rules":"!(\"confirmed\" in user_groups) \u0026\r\npage_namespace == 0 \u0026\r\n(\r\n exp := \"(?i)(?\u003C!\\S)([^\\s|]++(?: [^\\s|]++)*?)(?:\\s++\\1){2}(?!\\S)\";\r\n matched := get_matches(exp, added_lines);\r\n matched[0] \u0026\r\n !(removed_lines irlike exp) \u0026\r\n new_wikitext irlike (\"(?:\" + rescape(matched[1]) + \"\\s*){3}\") \u0026 /* Avoid edits to multiple non-contiguous lines */\r\n matched[1] irlike \"\\p{L}\" \u0026 /* Exclude numeric data */\r\n !(matched[1] irlike \"^[!|{*#]\") \u0026 /* Exclude some lists, tables and templates */\r\n !(added_lines irlike \"syntaxhighlight|\\{\\|\")\r\n)","name":"Repeated text","comments":"Split from test filter [[Special:AbuseFilter/2]], comments there:\r\n----\r\nTesting generic catching of repeated phrases. Unsure of efficiency, but we'll find out! With thanks to some folks from IRC for helping craft and test variations (digitok \u0026 Me-me) --ProcrastinatingReader 14:19 24 Aug 2021\r\n\r\nRemove ccnorm for now to prevent some table FPs. Will still be more table issues; still thinking how to get around them. --ProcrastinatingReader 15:55 24 Aug 2021\r\n\r\nTweak for better table support. --ProcrastinatingReader 16:31 24 Aug 2021\r\n---- (proc @ 23:44 28 Aug 2021)\r\n\r\nDisable throttle and making public per [[Wikipedia:Edit_filter_noticeboard#Suitability_of_1163_-\u003E_disallow]]. --ProcrastinatingReader 23:54 10 Nov 2021\r\n\r\nTry exclude some table-related FPs --ProcrastinatingReader 14:57 16 Nov 2021\r\n\r\nrv change - introduced too many false positives --ProcrastinatingReader 14:59 16 Nov 2021\r\n\r\nretry change with adjustment --ProcrastinatingReader 15:14 16 Nov 2021\r\n\r\nTODO: probably try to exclude anything that seems like it's just formatting (\u003Cbr\u003Es, bullets, lots of |), and also adjustments to data if possible (changing numerical data) --ProcrastinatingReader 15:19 16 Nov 2021\r\n\r\nMight need some more tuning to be disallowable, but definitely good enough filter (\u003E80-90% edits problematic) to tag the edits as possible vandalism. --Galobtter 05:32 1 Apr 2023\r\n\r\nExclude table additions/some modifications and some template additions. --Galobtter 18:27 2 Apr 2023\r\n\r\nAlso exclude code. --Galobtter 20:48 2 Apr 2023\r\n\r\nAttempt to reduce FPs so this can be set to disallow. Require at least one letter (in any script). Avoid lists. Also require that some repeated text appear in new_wikitext; if it doesn't, the edit was to multiple lines that got crammed together in added_lines. --Suffusion of Yellow 21:49 24 Apr 2024","group":"default","actions":{"tag":["possible vandalism"]},"enabled":true,"deleted":false,"hidden":false,"global":false},"actions":{"tag":["possible vandalism"]}}
Actions to take when matched
Trigger actions only if the user trips a rate limit
Number of actions to allow:
Period of time (in seconds):
Group throttle by:
user
See the documentation on mediawiki.org.
Trigger these actions after giving the user a warning
System message to use for warning:
abusefilter-warning
Other message
Page name of other message:
(without "MediaWiki:" prefix)
Show/Hide preview of selected message
Prevent the user from performing the action in question
System message to use for disallowing:
abusefilter-disallowed
Other message
Page name of other message:
(without "MediaWiki:" prefix)
Show/Hide preview of selected message
Revoke the user's autoconfirmed status
Tag the edit in contributions lists and page histories
Tags to apply:
(see
Wikipedia:Tags
for use and formatting)
(please don't rename a tag here, see link above)
(one per line, no commas, publicly visible)
possible vandalism