(35 802)

Update: 21-09-16

SEO Spider Bot

@seospiderbot

This is Telegram bot with SEO web-crawler application functionality. It's a non-profit research project.
Bot can help you automate the process of collecting information about titles, meta-tags and links on the pages of your site. Just send a message with URL or host name of your web site.

After a while in response you get archive that contain two files:
1. %site_domain%_url_features.txt
This file contains the following information for each page that has a link on your site:
* URL
* Response code
* Title
* Meta tags
2. %site_domain%_page_links.txt
This file contains information about links present on every page of your site:
* Link URL
* Response code
This information can be useful to detect "broken" links (with response code other than 200) on the site. Users and search engines don't like it.