Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2021
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2108.01727 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914804913930240 |
|---|---|
| author | Jones, Timothy Ward, Owen G. Jiang, Yiran Paisley, John Zheng, Tian |
| author_facet | Jones, Timothy Ward, Owen G. Jiang, Yiran Paisley, John Zheng, Tian |
| contents | The mixed membership stochastic blockmodel (MMSB) is a popular Bayesian network model for community detection. Fitting such large Bayesian network models quickly becomes computationally infeasible when the number of nodes grows into hundreds of thousands and millions. In this paper we propose a novel mini-batch strategy based on aggregated relational data that leverages nodal information to fit MMSB to massive networks. We describe a scalable inference method that can utilize nodal information that often accompanies real-world networks. Conditioning on this extra information leads to a model that admits a parallel stochastic variational inference algorithm, utilizing stochastic gradients of bipartite graph formed from aggregated network ties between node subpopulations. We apply our method to a citation network with over two million nodes and 25 million edges, capturing explainable structure in this network. Our method recovers parameters and achieves better convergence on simulated networks generated according to the MMSB. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2108_01727 |
| institution | arXiv |
| publishDate | 2021 |
| record_format | arxiv |
| spellingShingle | Scalable Community Detection in Massive Networks Using Aggregated Relational Data Jones, Timothy Ward, Owen G. Jiang, Yiran Paisley, John Zheng, Tian Social and Information Networks The mixed membership stochastic blockmodel (MMSB) is a popular Bayesian network model for community detection. Fitting such large Bayesian network models quickly becomes computationally infeasible when the number of nodes grows into hundreds of thousands and millions. In this paper we propose a novel mini-batch strategy based on aggregated relational data that leverages nodal information to fit MMSB to massive networks. We describe a scalable inference method that can utilize nodal information that often accompanies real-world networks. Conditioning on this extra information leads to a model that admits a parallel stochastic variational inference algorithm, utilizing stochastic gradients of bipartite graph formed from aggregated network ties between node subpopulations. We apply our method to a citation network with over two million nodes and 25 million edges, capturing explainable structure in this network. Our method recovers parameters and achieves better convergence on simulated networks generated according to the MMSB. |
| title | Scalable Community Detection in Massive Networks Using Aggregated Relational Data |
| topic | Social and Information Networks |
| url | https://arxiv.org/abs/2108.01727 |