View article

Tor is a popular anonymous network that provides the dark web called the hidden service not accessible with traditional web browsers. The number of hidden services using Tor's anonymous network has been steadily increasing every year with the demand of user privacy concerns as well as illegal services that abuse Tor's anonymity. As a result, how to collect and analyze the contents of Tor hidden service is not yet in full swing. In addition, due to the slow access speed of the Tor browser, it is difficult to observe the dynamics of the hidden services. In this work, we present an efficient Tor hidden service crawling method that can monitor the status of hidden services for the analysis of authentic hidden service contents. We have designed our Tor crawler with the virtualization software, Docker, and parallel Tor browsers to improve the crawling performance. In order to maximize the utilization, we analyzed the …