Something about a link

[Squirrel]

(10-15-2018, 07:26 PM)7shoes Wrote: Hello,
I would like to know if someone knows how to code a script or a "bot" to find special words link on a forum.
I explain : a friend challenged me to find a special link on a forum, he gave me many tips but I can't find this link. There is around 60 000 post on this forum so even whit the tips it's a bit hard.
Well I though it was probably possible to make a bot whose can find all the post whose contains a link and create a file whit all what it  has been found.



But there is one problem, the link can be on a picture, in a word and other. (BBC code) I do not know if it's possible to make something whose find all the picture and word swhose contains a link (in my mind it should be possible but maybe it's more hard to do lol)

So if you know how, can you explain me?
It's a forumactif forum, maybe it will help you.

I guess what you're looking for, would be described as a "web crawler" -- no, not SpiderMan, but more like the bot that Google unleashes on the world, trying to find every last link that exists.

But Google's bot assumes that links worthy of going to are advertised somehow. It starts by examining DNS tables, and discovers as many legitimate TLD addresses as possible, including every domain name that exists, and browses to every top page. From there, it looks for links within each site, to discover more.

Alas, if someone is NOT trying to advertise a link, it can still exist! It may be as simple as a company with "hidden pages" on their corporate web server (you can view it, if you know the complete address, but otherwise there's no way to know what that address is), to entire domain names (ie: 'the dark web') that they don't wish advertised, and even hidden pages on any single server that runs Apache/some other server-side WEB service. You could even have to know the specific IP address, and then know the full name of the page from there.

To sum, your task is daunting, and if someone doesn't want you to see a page, it's very easy to arrange, using a variety iof different methods.

You could spend a lot of time coding something, and never find what you were looking for.