Recently I came across BuiltWith Technology Lookup tool to find the web technologies used by the websites. The results of the tool is impressive and it gave some thought process to come up with my own technology lookup tool. Just for fun I started this project to find out the web technologies used by the websites. This tool uses response headers, meta tags, link tags, and the script tags to find the JS/CSS libraries used, Web servers info, hosting solutions etc.. The initial version of the tool source code is hosted on GitHub and the code should get evolve to achieve comprehensive technology lookup.
The tool is built by using Spring framework, Jsoup etc.. Primarily it is a web application which will take the website URL to find out the technologies. Behind the scenes we will make HTTP request to the URL to get the response headers. The response headers will provide some information about the back end technology/servers used by the site. In addition to that we will scrape the website homepage to get to know the JS/CSS libraries, meta information etc…
If you want to try web technology profiling , download the code from GitHub and deploy. Let me know your suggestions to enhance the tool.
Leave a Reply