Posts and replies

Nobody owes you their stats, and when their robots.txt tells you don't scrape my stats and you do it anyway you can't complain that the stats were bad

Honestly looking at FediDBs GitHub there's a lot of complaints about it's scraping behavior in general. Like it will keep repeatedly hitting domains that don't even have fedi servers anymore

https://github.com/fedidb/issues/issues/47

And with a server as big as Universeodon missing how good are these stats anyway?

https://github.com/fedidb/issues/issues/48

Ultimately the real problem we aren't discussing though is that Dansup is accusing the GTS devs of doing this "for clout", when they are doing this for "leave me alone", which is the opposite of clout.

It's complete bullshit and he should be embarrassed to say it.

Guy steadily gaining more influence over the fediverse with his software and massively unmanageable instance sizes spends most of his time beefing with other fedi devs...I don't think this is actually GOOD for the fediverse.

"This isn't about my scraper ignoring robots.txt and pounding instances that don't even exist anymore with requests indefinitely, it's about them trying to get clout by randomizing numbers (that I shouldn't have been scraping) so big nobody would even believe them!"

And if his accusation is that this completely optional feature was added with "suspicious timing" to hurt him specifically

Then he's probably being overly optimistic about how quickly people update GTS

I'm definitely many updates behind because I am:

- lazy

I also chose GTS in the first place because I am:

- lazy

And it seemed like an easy install (and largely was)