Abstract
It has been recognized that most of the Internet is not accessible through regular search engines and web browsers. This part of the web is known as dark web, and the surface is about 400 to 500 times larger than the size of the web that we know [1]. The goal of this project is to design a dark web crawler that can uncover any suspicious and malicious websites from the TOR (The Onion Router) network. The proposed system will create a database of suspicious and malicious websites by scraping relative linking attributes that may be contained within TOR network web pages. The proposed database automatically updates itself and it will archive previous versions of TOR sites while saving available working links. This will give law enforcement authorities the ability to search both the current TOR database and previous versions of the Database to detect suspicious and malicious websites.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Staff, C.: The Deep Web Is The 99% of The Internet You Don’t See (2016). Curiosity. https://curiosity.com/topics/the-deep-web-is-the-99-of-the-internet-you-dont-see-curiosity. Accessed 01 Mar 2017
Balduzzi, M.: Ciancaglini, V.: Cybercrime in the Deep Web. Report by Black Hat EU, Amsterdam (2015)
Finklea, K.: Dark Web. Report Published by Congressional Research Service (2017)
Finklea, K.: Cybercrime: Conceptual Issues for Congress and U.S. Law Enforcement. Report Published by Congressional Research Service (2015)
Poulsen, K.: FBI Admits It Controlled Tor Servers Behind Mass Malware Attack. Published in Wired.com (2013)
Aliens, C.: Anonymous Hacks Freedom Hosting II, Bringing Down Almost 20% of Active Darknet Sites. Report published by DeepDot.Web (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Pannu, M., Kay, I., Harris, D. (2019). Using Dark Web Crawler to Uncover Suspicious and Malicious Websites. In: Ahram, T., Nicholson, D. (eds) Advances in Human Factors in Cybersecurity. AHFE 2018. Advances in Intelligent Systems and Computing, vol 782. Springer, Cham. https://doi.org/10.1007/978-3-319-94782-2_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-94782-2_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-94781-5
Online ISBN: 978-3-319-94782-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)