## Supervised Random Walks: Predicting and Recommending Links in Social Networks

Citations: | 74 - 0 self |

### BibTeX

@MISC{Backstrom_supervisedrandom,

author = {Lars Backstrom and Jure Leskovec},

title = {Supervised Random Walks: Predicting and Recommending Links in Social Networks},

year = {}

}

### OpenURL

### Abstract

Predicting the occurrence of links is a fundamental problem in networks. In the link prediction problem we are given a snapshot of a network and would like to infer which interactions among existing members are likely to occur in the near future or which existing interactions are we missing. Although this problem has been extensively studied, the challenge of how to effectively combine the information from the network structure with rich node and edge attribute data remains largely open. We develop an algorithm based on Supervised Random Walks that naturally combines the information from the network structure with node and edge level attributes. We achieve this by using these attributes to guide a random walk on the graph. We formulate a supervised learning task where the goal is to learn a function that assigns strengths to edges in the network such that a random walker is more likely to visit the nodes to which new links will be created in the future. We develop an efficient training algorithm to directly learn the edge strength estimation function. Our experiments on the Facebook social graph and large collaboration networks show that our approach outperforms state-of-theart unsupervised approaches as well as approaches that are based on feature extraction.

### Citations

2908 |
The Strengh of Weak Ties
- Granovetter
- 1973
(Show Context)
Citation Context ...C Training Loss Testing Loss Figure 7: Performance of Supervised Random Walks as a function of the number of steps of parameter estimation procedure. range weak ties help in access to new information =-=[14]-=- (i.e., s is more likely to link tov2 thanv1 of Fig 6). Having two independent paths is a stronger connection in the co-authorship graph, as this indicates that s has written papers with two people, o... |

2591 | Emergence of scaling in random networks
- Barabási, Albert
- 1999
(Show Context)
Citation Context ...ons—Data mining General Terms: Algorithms; Experimentation. Keywords: Link prediction, Social networks 1. INTRODUCTION Large real-world networks exhibit a range of interesting properties and patterns =-=[7, 20]-=-. One of the recurring themes in this line of research is to design models that predict and reproduce the emergence of such network structures. Research then seeks to develop models that will accurate... |

2513 | The pagerank citation ranking: Bringing order to the web
- Page, Brin, et al.
- 1998
(Show Context)
Citation Context ...ink about it as a task to rank the nodes of the network. The idea is to design an algorithm that will assign higher scores to nodes whichscreated links to than to those thatsdid not link to. PageRank =-=[25]-=- and variants like Personalized PageRank [17, 15] and Random Walks with Restarts [31] are popular methods for ranking nodes on graphs. Thus, one simple idea would be to start a random walk at node s a... |

2060 | Social capital in the creation of human capital
- Coleman
- 1988
(Show Context)
Citation Context ...metric except for the fact that the two paths connecting s to v1 are connected themselves. Now we ask, is s more likely to link tov1 or tov2? Building on the theory of embeddedness and social capital =-=[10]-=- one would postulate that s is more likely to link to v1 than to v2. However, the result of an edge (u1,u2) is that when α > 0, v2 ends up with a higher PageRank score than v1. This is somewhat counte... |

572 | The link prediction problem for social networks
- Liben-Nowell, Kleinberg
- 2003
(Show Context)
Citation Context ...volve at the level of individual edges is a fundamental question that is still not well understood, and it forms the motivation for our work here. We consider the classical problem of link prediction =-=[21]-=- where we are given a snapshot of a social network at time t, and we seek to accurately predict the edges that will be added to the network during the interval from timetto a given future time t ′ . M... |

549 | On the limited memory BFGS method for large scale optimization
- Liu, Nocedal
- 1989
(Show Context)
Citation Context ...om the previous position (in the gradient descent) as initialization for the eigenvector and derivative calculations in Alg. 1. Our implementation of Supervised Random Walks uses the L-BFGS algorithm =-=[22]-=-. Given a function and its partial derivatives, the solver iteratively improves the estimate of w, converging to a local optima. The exact runtime of the method depends on how many iterations are requ... |

465 | Topic-sensitive pagerank
- Haveliwala
- 2002
(Show Context)
Citation Context ...he network. The idea is to design an algorithm that will assign higher scores to nodes whichscreated links to than to those thatsdid not link to. PageRank [25] and variants like Personalized PageRank =-=[17, 15]-=- and Random Walks with Restarts [31] are popular methods for ranking nodes on graphs. Thus, one simple idea would be to start a random walk at node s and compute the proximity of each other node to no... |

346 | Graphs over time: densification laws, shrinking diameters and possible explanations
- Leskovec, Kleinberg, et al.
(Show Context)
Citation Context ...ons—Data mining General Terms: Algorithms; Experimentation. Keywords: Link prediction, Social networks 1. INTRODUCTION Large real-world networks exhibit a range of interesting properties and patterns =-=[7, 20]-=-. One of the recurring themes in this line of research is to design models that predict and reproduce the emergence of such network structures. Research then seeks to develop models that will accurate... |

335 | Group formation in large social networks: membership, growth, and evolution
- Backstrom, Huttenlocher, et al.
- 2006
(Show Context)
Citation Context ...esearch is to design models that predict and reproduce the emergence of such network structures. Research then seeks to develop models that will accurately predict the global structure of the network =-=[7, 20, 19, 6]-=-. Many types of networks and especially social networks are highly dynamic; they grow and change quickly through the additions of new edges which signify the appearance of new interactions bePermissio... |

334 | Scaling personalized web search
- Jeh, Widom
- 2003
(Show Context)
Citation Context ...he network. The idea is to design an algorithm that will assign higher scores to nodes whichscreated links to than to those thatsdid not link to. PageRank [25] and variants like Personalized PageRank =-=[17, 15]-=- and Random Walks with Restarts [31] are popular methods for ranking nodes on graphs. Thus, one simple idea would be to start a random walk at node s and compute the proximity of each other node to no... |

252 | Stochastic models for the web graph
- Kumar, Raghavan, et al.
- 2000
(Show Context)
Citation Context ...thetic graphs, edge features and training data (triples (s,D,L)) and then try to recover the original model. Synthetic data. We generate scale-free graphs G on 10,000 nodes by using the Copying model =-=[18]-=-: Graph starts with three nodes connected in a triad. Remaining nodes arrive one by one, each creating exactly three edges. When a node u arrives, it adds three edges (u,vi). Existing node vi is selec... |

142 |
Hierarchical structure and prediction of missing links in networks. Nature 453
- Moore, C, et al.
- 2008
(Show Context)
Citation Context ...context link prediction can be used to suggest the most likely links that may form in the future. Similarly, link prediction can also be used for prediction of missing or unobserved links in networks =-=[9]-=- or to suggest which individuals may be working together even though their interaction has yet been directly observed. Applications go well beyond social networks, as our techniques can be used to pre... |

126 | Microscopic evolution of social networks
- Leskovec, Backstrom, et al.
(Show Context)
Citation Context ...esearch is to design models that predict and reproduce the emergence of such network structures. Research then seeks to develop models that will accurately predict the global structure of the network =-=[7, 20, 19, 6]-=-. Many types of networks and especially social networks are highly dynamic; they grow and change quickly through the additions of new edges which signify the appearance of new interactions bePermissio... |

124 | Link prediction in relational data
- Taskar, Wong, et al.
- 2003
(Show Context)
Citation Context ...roaches based on network community detection [9, 16] have been tested on small networks. Link prediction in supervised machine learning setting was mainly studied by the relational learning community =-=[28, 26]-=-. However, the challenge with these approaches is primarily scalability. Random walks on graphs have been considered for computing node proximities in large graphs [31, 30, 29, 27]. They have also bee... |

111 | Fast random walk with restart and its applications
- Tong
- 2006
(Show Context)
Citation Context ...lational learning community [28, 26]. However, the challenge with these approaches is primarily scalability. Random walks on graphs have been considered for computing node proximities in large graphs =-=[31, 30, 29, 27]-=-. They have also been used for learning to rank nodes in graphs [3, 2, 23, 11]. 2. SUPERVISED RANDOM WALKS Next we describe our algorithm for link prediction and recommendation. The general setting is... |

73 | Statistical relational learning for link prediction
- Popescul, Popescul, et al.
- 2003
(Show Context)
Citation Context ...roaches based on network community detection [9, 16] have been tested on small networks. Link prediction in supervised machine learning setting was mainly studied by the relational learning community =-=[28, 26]-=-. However, the challenge with these approaches is primarily scalability. Random walks on graphs have been considered for computing node proximities in large graphs [31, 30, 29, 27]. They have also bee... |

63 | Friends and neighbors on the web
- Adamic, Adar
(Show Context)
Citation Context ... predicting new links in networks. The unsupervised methods for link prediction were extensively evaluated by Liben-Nowell and Kleinberg [21] who found that the Adamic-Adar measure of node similarity =-=[1]-=- performed best. More recently approaches based on network community detection [9, 16] have been tested on small networks. Link prediction in supervised machine learning setting was mainly studied by ... |

62 | A (2010) Inferring networks of diffusion and influence
- M, Leskovec, et al.
(Show Context)
Citation Context ...including all those with whom s has previously coauthored. Further related work. The link prediction problem in networks comes in many flavors and variants. For example, the network inference problem =-=[13, 24]-=- can be cast as a link prediction problem where no knowledge of the network is given. Moreover, even models of complex networks, like Preferential Attachment [7], Forest Fire model [20] and models bas... |

58 | Center-piece subgraphs: problem definition and fast solutions
- Tong, Faloutsos
(Show Context)
Citation Context ...lational learning community [28, 26]. However, the challenge with these approaches is primarily scalability. Random walks on graphs have been considered for computing node proximities in large graphs =-=[31, 30, 29, 27]-=-. They have also been used for learning to rank nodes in graphs [3, 2, 23, 11]. 2. SUPERVISED RANDOM WALKS Next we describe our algorithm for link prediction and recommendation. The general setting is... |

45 | R.: Optimizing classifier performance via an approximation to the Wilcoxon-Mann-Whitney statistic
- Yan, Dodier, et al.
- 2003
(Show Context)
Citation Context ...and window z > b: ⎧ ⎪⎨ 0 ifx ≤ −b, h(x) = (x+b) ⎪⎩ 2 /(2z) if−b < x ≤ z −b, (7) (x+b)−z/2 ifx > z −b • Wilcoxon-Mann-Whitney (WMW) loss with width b (Proposed to be used when one aims to maximize AUC =-=[32]-=-): 1 h(x) = 1+exp(−x/b) Each of these loss functions is differentiable and needs to be evaluated for all pairs of nodes d ∈ D and l ∈ L (see Eq. 2). Performing this naively takes approximatelyO(c 2 ) ... |

42 | Learning to rank networked entities
- Agarwal, Chakrabarti, et al.
- 2006
(Show Context)
Citation Context ...es of the network into a unified link prediction algorithm. We develop a method based on Supervised Random Walks that in a supervised way learns how to bias a PageRank-like random walk on the network =-=[3, 2]-=- so that it visits given nodes (i.e., positive training examples) more often than the others. We achieve this by using node and edge features to learn edge strengths (i.e., random walk transition prob... |

36 | Fast direction-aware proximity for graph mining
- Tong, Faloutsos, et al.
(Show Context)
Citation Context ...lational learning community [28, 26]. However, the challenge with these approaches is primarily scalability. Random walks on graphs have been considered for computing node proximities in large graphs =-=[31, 30, 29, 27]-=-. They have also been used for learning to rank nodes in graphs [3, 2, 23, 11]. 2. SUPERVISED RANDOM WALKS Next we describe our algorithm for link prediction and recommendation. The general setting is... |

30 | On the convexity of latent social network inference
- Myers, Leskovec
- 2010
(Show Context)
Citation Context ...including all those with whom s has previously coauthored. Further related work. The link prediction problem in networks comes in many flavors and variants. For example, the network inference problem =-=[13, 24]-=- can be cast as a link prediction problem where no knowledge of the network is given. Moreover, even models of complex networks, like Preferential Attachment [7], Forest Fire model [20] and models bas... |

20 | Learning web page scores by error back-propagation
- Diligenti, Gori, et al.
- 2005
(Show Context)
Citation Context ...es is primarily scalability. Random walks on graphs have been considered for computing node proximities in large graphs [31, 30, 29, 27]. They have also been used for learning to rank nodes in graphs =-=[3, 2, 23, 11]-=-. 2. SUPERVISED RANDOM WALKS Next we describe our algorithm for link prediction and recommendation. The general setting is that we are given a graph and a node s for which we would like to predict/rec... |

17 | Learning random walks to rank nodes in graphs
- Agarwal, Chakrabarti
- 2007
(Show Context)
Citation Context ...es of the network into a unified link prediction algorithm. We develop a method based on Supervised Random Walks that in a supervised way learns how to bias a PageRank-like random walk on the network =-=[3, 2]-=- so that it visits given nodes (i.e., positive training examples) more often than the others. We achieve this by using node and edge features to learn edge strengths (i.e., random walk transition prob... |

16 | Overview of the 2003 kdd cup
- Gehrke, Ginsparg, et al.
(Show Context)
Citation Context ...it is not practical to incorporate them (a user may have as many as a hundred million nodes at 3 hops). Co-authorship networks. First we consider the co-authorship networks from arXiv e-print archive =-=[12]-=- where we have a time-stamped list of all papers with author names and titles submitted to arXiv during 1992 and 2002. We consider co-authorship networks from four different areas of physics: Astro-ph... |

13 | A random-surfer web-graph model
- Blum, Chan, et al.
- 2006
(Show Context)
Citation Context ...ink prediction problem where no knowledge of the network is given. Moreover, even models of complex networks, like Preferential Attachment [7], Forest Fire model [20] and models based on random walks =-=[19, 8]-=-, can be viewed as ways for predicting new links in networks. The unsupervised methods for link prediction were extensively evaluated by Liben-Nowell and Kleinberg [21] who found that the Adamic-Adar ... |

13 | Learning to rank typed graph walks: Local and global approaches
- Minkov, Cohen
- 2007
(Show Context)
Citation Context ...es is primarily scalability. Random walks on graphs have been considered for computing node proximities in large graphs [31, 30, 29, 27]. They have also been used for learning to rank nodes in graphs =-=[3, 2, 23, 11]-=-. 2. SUPERVISED RANDOM WALKS Next we describe our algorithm for link prediction and recommendation. The general setting is that we are given a graph and a node s for which we would like to predict/rec... |

11 | Applying latent Dirichlet allocation to group discovery in large graphs
- Henderson, Eliassi-Rad
(Show Context)
Citation Context ...re extensively evaluated by Liben-Nowell and Kleinberg [21] who found that the Adamic-Adar measure of node similarity [1] performed best. More recently approaches based on network community detection =-=[9, 16]-=- have been tested on small networks. Link prediction in supervised machine learning setting was mainly studied by the relational learning community [28, 26]. However, the challenge with these approach... |

6 | Fast dynamic reranking in large graphs
- Sarkar, Moore
- 2009
(Show Context)
Citation Context |

3 |
Convergence of an iterative method for derivatives of eigensystems
- Andrew
- 1978
(Show Context)
Citation Context ...ts) between iterations. We arrive at Algorithm 1 that iteratively computes the eigenvector p as well as the partial derivatives of p. Convergence of Algorithm 1 is similar to those of power-iteration =-=[5]-=-. To solve Eq. 4 we further need to compute ∂Qju which is the ∂w partial derivative of entryQju (Eq. 3). This calculation is straightforward. When(j,u) ∈ E we find ∂Qju (1−α) ∂fw(ψ (∑ ju) ∂w and other... |

1 |
Iterative computation of derivatives of eigenvalues and eigenvectors
- Andrew
- 1979
(Show Context)
Citation Context ...ju and taking the derivative now gives: ∂pu ∂w Notice that pu and ∂pu ∂w = ∑ j ∂pj Qju ∂w +pj ∂Qju ∂w are recursively entangled in the equation. However, we can still compute the gradient iteratively =-=[4, 3]-=-. By (5) (6) Initialize PageRank scores p and partial derivatives ∂pu : ∂wk foreach u ∈ V dop (0) u = 1 |V | foreach u ∈ V,k = 1,...,|w| do ∂pu (0) = 0 ∂wk t = 1 while not converged do foreach u ∈ V d... |