[FYI] Tips on URL filtering (blacklist URLs)
Hello,
SER has a way to skip sites where certain words found on the web pages or URLs. However this approach may not be able to find unwanted sites (such as adult or porn sites) that don't have these black-listed words.
I thought that I'd share a method to screen harvested URLs from the known adult sites available on free web filtering sources, such as http://urlblacklist.com/?sec=download
I'd like to share a list of 547K adult-related URLs (extracted a couple of days ago and dupes removed) that can be bumped against your harvested URLs. Personally, I use this method as I don't want to post links on these sites. Hope this is useful.
SER has a way to skip sites where certain words found on the web pages or URLs. However this approach may not be able to find unwanted sites (such as adult or porn sites) that don't have these black-listed words.
I thought that I'd share a method to screen harvested URLs from the known adult sites available on free web filtering sources, such as http://urlblacklist.com/?sec=download
I'd like to share a list of 547K adult-related URLs (extracted a couple of days ago and dupes removed) that can be bumped against your harvested URLs. Personally, I use this method as I don't want to post links on these sites. Hope this is useful.
Tagged: