Conversation
i just blocked 10,240 IPs hbu
5
0
1
another microsoft ASN down, many more to go
0
0
0
@kett who is it and why are you rawdogging them
1
0
0
lewd
Show content

@alexia@shrimp.starlightnet.work

i gotta make a script that watches my http logs for scraper user agents and hook it up to a buttplug so they're not just fucking my servers, but me, as well.

1
0
1
lewd
Show content
@kett perfect. hooking up a rate(nam_shub_of_enki_ruleset_hits[5m]) to a buttplug. majestic.
1
0
1
long
Show content

@alexia@shrimp.starlightnet.work

possibly slightly over blocking:

locals {
  bad_ips = [
    "1.178.32.0/19",
    "14.137.132.0/22",
    "14.137.136.0/21",
    "14.137.152.0/23",
    "14.137.155.0/24",
    "14.137.156.0/23",
    "14.137.161.0/24",
    "14.137.169.0/24",
    "14.137.170.0/23",
    "14.137.172.0/22",
    "27.106.0.0/17",
    "27.255.0.0/21",
    "27.255.8.0/23",
    "27.255.12.0/22",
    "27.255.16.0/22",
    "27.255.20.0/23",
    "27.255.28.0/23",
    "27.255.32.0/21",
    "27.255.40.0/22",
    "27.255.46.0/23",
    "27.255.48.0/22",
    "27.255.52.0/23",
    "27.255.60.0/23",
    "42.201.128.0/17",
    "43.225.140.0/22",
    "43.255.104.0/22",
    "45.194.104.0/21",
    "45.199.144.0/22",
    "45.202.128.0/18",
    "45.203.40.0/21",
    "46.250.160.0/19",
    "49.0.192.0/20",
    "49.0.224.0/19",
    "62.245.0.0/19",
    "80.238.132.0/22",
    "80.238.136.0/22",
    "80.238.148.0/22",
    "80.238.172.0/22",
    "80.238.176.0/21",
    "80.238.184.0/22",
    "80.238.190.0/24",
    "80.238.192.0/18",
    "83.101.0.0/21",
    "83.101.8.0/23",
    "83.101.16.0/20",
    "83.101.32.0/21",
    "83.101.48.0/21",
    "83.101.56.0/23",
    "83.101.64.0/20",
    "83.101.80.0/21",
    "83.101.96.0/20",
    "87.119.12.0/24",
    "89.150.192.0/19",
    "94.45.160.0/23",
    "94.45.163.0/24",
    "94.74.64.0/18",
    "94.244.128.0/18",
    "101.44.0.0/18",
    "101.44.64.0/19",
    "101.44.96.0/20",
    "101.44.144.0/20",
    "101.44.160.0/19",
    "101.44.192.0/18",
    "101.46.0.0/20",
    "101.46.32.0/19",
    "101.46.64.0/19",
    "101.46.128.0/18",
    "101.46.192.0/19",
    "101.46.224.0/22",
    "101.46.232.0/21",
    "101.46.240.0/20",
    "103.84.110.0/24",
    "103.198.203.0/24",
    "103.215.0.0/23",
    "103.215.3.0/24",
    "103.240.157.0/24",
    "103.255.61.0/24",
    "103.255.62.0/24",
    "110.41.90.0/24",
    "110.41.208.0/23",
    "110.41.210.0/24",
    "110.238.64.0/19",
    "110.238.96.0/24",
    "110.238.98.0/23",
    "110.238.100.0/22",
    "110.238.104.0/21",
    "110.238.112.0/20",
    "110.239.64.0/18",
    "111.91.0.0/17",
    "111.119.192.0/18",
    "114.119.128.0/18",
    "115.30.32.0/19",
    "119.8.0.0/20",
    "119.8.18.0/24",
    "119.8.21.0/24",
    "119.8.22.0/23",
    "119.8.24.0/21",
    "119.8.32.0/19",
    "119.8.64.0/18",
    "119.8.128.0/18",
    "119.8.192.0/19",
    "119.8.224.0/24",
    "119.8.227.0/24",
    "119.8.228.0/22",
    "119.8.232.0/21",
    "119.8.240.0/21",
    "119.8.248.0/23",
    "119.8.250.0/24",
    "119.8.252.0/24",
    "119.8.254.0/23",
    "119.12.160.0/20",
    "119.13.32.0/21",
    "119.13.64.0/18",
    "119.13.160.0/20",
    "121.91.152.0/21",
    "121.91.168.0/21",
    "122.8.128.0/18",
    "124.71.248.0/23",
    "124.71.250.0/24",
    "124.71.252.0/23",
    "124.81.0.0/16",
    "124.243.156.0/22",
    "139.9.98.0/23",
    "146.174.128.0/19",
    "148.145.224.0/23",
    "149.232.128.0/19",
    "150.40.128.0/17",
    "154.81.16.0/20",
    "154.83.0.0/23",
    "154.86.32.0/19",
    "154.93.100.0/23",
    "154.93.104.0/23",
    "154.220.192.0/19",
    "156.227.22.0/23",
    "156.230.32.0/20",
    "156.230.64.0/18",
    "156.232.16.0/20",
    "156.240.128.0/18",
    "156.249.32.0/20",
    "156.253.16.0/20",
    "157.254.211.0/24",
    "157.254.212.0/24",
    "159.138.0.0/18",
    "159.138.64.0/21",
    "159.138.76.0/22",
    "159.138.80.0/20",
    "159.138.96.0/19",
    "159.138.128.0/19",
    "159.138.160.0/20",
    "159.138.176.0/21",
    "159.138.188.0/22",
    "159.138.192.0/20",
    "159.138.208.0/21",
    "159.138.216.0/22",
    "159.138.220.0/23",
    "159.138.224.0/19",
    "166.108.192.0/18",
    "176.52.128.0/19",
    "180.87.192.0/18",
    "182.160.0.0/20",
    "182.160.16.0/22",
    "182.160.20.0/24",
    "182.160.24.0/21",
    "182.160.36.0/22",
    "182.160.49.0/24",
    "182.160.52.0/22",
    "182.160.56.0/22",
    "182.160.60.0/23",
    "182.160.62.0/24",
    "183.87.32.0/19",
    "183.87.64.0/18",
    "183.87.128.0/19",
    "188.119.192.0/18",
    "188.239.0.0/18",
    "189.1.192.0/18",
    "189.28.96.0/19",
    "190.92.192.0/18",
    "201.77.32.0/20",
    "202.76.144.0/20",
    "202.170.88.0/21",
    "203.123.80.0/20",
    "203.167.20.0/23",
    "203.167.22.0/24",
    "212.34.192.0/19",
    "213.250.128.0/18",
    "219.83.0.0/19",
    "219.83.32.0/20",
    "47.79.0.0/16",
    "57.141.0.0/24",
    "57.141.1.0/24",
    "57.141.2.0/24",
    "57.141.3.0/24",
    "57.141.4.0/24",
    "57.141.5.0/24",
    "57.141.6.0/24",
    "57.141.7.0/24",
    "57.141.8.0/24",
    "57.141.9.0/24",
    "57.141.10.0/24",
    "57.141.11.0/24",
    "57.141.12.0/24",
    "57.141.13.0/24",
    "57.141.14.0/24",
    "57.141.15.0/24",
    "57.141.16.0/24",
    "57.141.17.0/24",
    "57.141.18.0/24",
    "57.141.19.0/24",
    "57.141.20.0/24",
    "57.141.21.0/24",
  ]
}
1
0
0
long
Show content
@jcm lol we have like easily 20 times that list of bad IPs neofox_upside_down
1
0
0
re: lewd
Show content

@alexia @kett

I’m 100% sure someone at fedi has already done this

0
0
1
re: long
Show content

@alexia

Even whole /16 subnets?

1
0
0
re: long
Show content
@jcm I analyze the output of our logs quite often, usually piping them into goaccess or jq to find repeat and consistent offenders, together with data that iocaine+NSOE gives me about scrapers

using this I can more accurately figure out who the offenders are and firewall 'em off, especially if I already know Microsoft just owns a whole /16 block
1
0
0
re: long
Show content
@jcm additionally, I can configure NSOE to signal to iocaine's firewall to temporarily block IPs that hit certain rulesets, e.g those that spend a lot of time in the maze or are easy-to-spot spoofed browsers
0
0
0
re: long
Show content

@alexia

I’ve always wanted to just do that too, but I currently don’t have any software able to do that :/

1
0
0
re: long
Show content
@jcm iocaine+NSOE happens to be able to do that, mostly by necessity. Give it a database of ASN-IP mappings and it'll poison those entire ASNs.
1
0
0
re: long
Show content

@alexia

I don’t wanna use Iocaine for various reasons, so I’ll most likely eventually end up finding/writing a plugin for my ingress controller (Traefik).

1
0
1
re: long
Show content
@jcm that's fair too, though ig one hacky way to do it is just disabling all NSOE modules except asn lol
0
0
0
@lexi we have like 7000+ and that's just the ones that iocaine automatically classified, not even counting the 10K of the entire microsoft ASN I just blocked

😭
1
0
1

@alexia blocking amazon, microsoft, alibaba, and facebook ASNs is a necessity for any server
alibaba in particular is possibly the most aggressive of them all

1
0
0
@lexi already got most of those blocked (amazon and alibaba especially)
0
0
1

@alexia rapidly approaching the end of ipv4

0
0
0