From: Hybrid focused crawling on the Surface and the Dark Web
Methods | Conditions |
---|---|
1 | score l  ≥ t |
2 | (score d  ≥ t 1 AND link ∈ {Tor, Freenet, I2P}) OR (score l  ≥ t 2 AND link ∉ {Tor, Freenet, I2P}) |
3 | score l  ≥ t 2 OR (t 1 < score l  < t 2 AND link ∈ {Tor, Freenet} AND score d  ≥ t) OR (t 1 < score l  < t 2 AND link ∉ {Tor, Freenet} AND score l  ≥ t) |
4 | score l  ≥ t 2 OR (t 1 < score l  < t 2 AND score d  ≥ t) |
5 | score l  ≥ t 2 OR (t 1 < score l  < t 2 AND link ∈ {Tor, Freenet} AND score p  ≥ t) OR (t 1 < score l  < t 2 AND link ∉ {Tor, Freenet} AND score l  ≥ t) |
6 | score l  ≥ t 2 OR (t 1 < score l  < t 2 AND link ∈ {Tor, Freenet} AND score sc  ≥ t) OR (t 1 < score l  < t 2 AND link ∉ {Tor, Freenet} AND score l  ≥ t) |
7 | \( scor e=\left\{\begin{array}{ccc}\hfill scor{e}_l,\hfill & \hfill if\hfill & \hfill \left| sw\right|\ge 3\hfill \\ {}\hfill scor{e}_d,\hfill & \hfill \hfill & \hfill otherwise\hfill \end{array}\right. \) |
8 | \( scor e=\left\{\begin{array}{ccc}\hfill scor{e}_l,\hfill & \hfill if\hfill & \hfill \left| sw\right|\ge 3\hfill \\ {}\hfill scor{e}_p,\hfill & \hfill \hfill & \hfill otherwise\hfill \end{array}\right. \) |
9 | score sc  ≥ t |
10 | score dc  ≥ t |
11 | (score l  ≥ t AND link ∉ {Tor, Freenet, I2P}) (score dc  ≥ t AND link ∈ {Tor, Freenet, I2P}) OR |