Wikipedia / SimRank
Wikipedia / SimRank
SimRank is a general similarity measure, based on a simple and intuitive graph-theoretic model. SimRank is applicable in any domain with object-to-object relationships, that measures similarity of the structural context in which objects occur, based on their relationships with other objects. Effectively, SimRank is a measure that says that two objects are considered to be similar if they are referenced by similar objects. Although SimRank is widely adopted, it may output unreasonable similarity scores which are influenced by different factors, and can be solved in several ways, such as introducing an evidence weight factor, inserting additional terms that are neglected by SimRank or using PageRank-based alternatives.
Introduction
Many applications require a measure of "similarity" between objects. One obvious example is the "find-similar-document" query, on traditional text corpora or the World-Wide Web. More generally, a similarity measure can be used to cluster objects, such as for collaborative filtering in a recommender system, in which “similar” users and items are grouped based on the users’ preferences.
Various aspects of objects can be used to determine similarity, usually depending on the domain and the appropriate definition of similarity for that domain. In a document corpus, matching text may be used, and for collaborative filtering, similar users may be identified by common preferences. SimRank is a general approach that exploits the object-to-object relationships found in many domains of interest. On the Web, for example, two pages are related if there are hyperlinks between them. A similar approach can be applied to scientific papers and their citations, or to any other document corpus with cross-reference information. In the case of recommender systems, a user’s preference for an item constitutes a relationship between the user and the item. Such domains are naturally modeled as graphs, with nodes representing objects and edges representing relationships.
are themselves similar. The base case is that objects are maximally similar to themselves .
SimRank is a general algorithm that determines only the similarity of structural context. SimRank applies to any domain where there are enough relevant relationships between objects to base at least some notion of similarity on relationships. Obviously, similarity of other domain-specific aspects are important as well; these can — and should be combined with relational structural-context similarity for an overall similarity measure. For example, for Web pages SimRank can be combined with traditional textual similarity; the same idea applies to scientific papers or other document corpora. For recommendation systems, there may be built-in known similarities between items (e.g., both computers, both clothing, etc.), as well as similarities between users (e.g., same gender, same spending level). Again, these similarities can be combined with the similarity scores that are computed based on preference patterns, in order to produce an overall similarity measure.
Basic SimRank equation
.
. Otherwise,
.
Matrix representation of SimRank
be the column normalized adjacency matrix, and 0 otherwise. Then, in matrix notations, SimRank can be formulated as
is an identity matrix.
Computing SimRank
can be reached by iteration to a fixed-point:
, we use the basic SimRank equation to get:
are nondecreasing increases. It was shown in that the values converge to limits.
of iterations to perform. However, the recent research generally imply relatively low accuracy) or taking more iterations.
CoSimRank
CoSimRank is a variant of SimRank with the advantage of also having a local formulation, i.e. CoSimRank can be computed for a single node pair. be the column normalized adjacency matrix. Then, in matrix notations, CoSimRank can be formulated as:
being a vector of the standard basis-th entry is 1 and all other entries are 0. Then, CoSimRank can be computed in two steps:
Step one can be seen a simplified version of Personalized PageRank.
Further research on SimRank
Fogaras and Racz suggested speeding up SimRank computation through probabilistic computation using the Monte Carlo method.
Antonellis et al. extended SimRank equations to take into consideration (i) evidence factor for incident nodes and (ii) link weights.
Yu et al. further improved SimRank computation via a fine-grained memoization method to share small common parts among different partial sums.
Chen and Giles discussed the limitations and proper use cases of SimRank.
Partial Sums Memoization
Lizorkin et al. proposed three optimization techniques for speeding up the computation of SimRank:
Essential nodes selection may eliminate the computation of a fraction of node pairs with a-priori zero scores.
Partial sums memoization can effectively reduce repeated calculations of the similarity among different node pairs by caching part of similarity summations for later reuse.
A threshold setting on the similarity enables a further reduction in the number of node pairs to be computed.
is the number of nodes in a graph. The central idea of partial sums memoization consists of two steps:
are memoized as
as
as the first argument.
See also
Citations
Sources