Revealing connectivity structural patterns among web objects based on co-clustering of bipartite request dependency graph

Document Type

Article

Publication Date

2-1-2018

Abstract

Web objects are the entities retrieved from websites by users to compose the web pages. Therefore, exploring the relationships among web objects has theoretical and practical significance for many important applications, such as content recommendation, web page classification, and network security. In this paper, we propose a graph model named Bipartite Request Dependency Graph (BRDG) to investigate the relationships among web objects. To build the BRDG from massive network traffic data, we design and implement a parallel algorithm by leveraging the MapReduce programming model. Based on the study of a number of BRDGs derived from real wireless network traffic datasets, we find that the BRDG is large, sparse and complex, implying that it is very hard to derive the structural characteristics of the BRDG. Towards this end, we propose a co-clustering algorithm to decompose and extract coherent co-clusters from the BRDG. The co-clustering results of the experimental dataset reveal a number of interesting and interpretable connectivity structural patterns among web objects, which are useful for more comprehensive understanding of web page architecture and provide valuable data for e-commerce, social networking, search engine, etc.

Identifier

84982890307 (Scopus)

Publication Title

Wireless Networks

External Full Text Location

https://doi.org/10.1007/s11276-016-1345-5

e-ISSN

15728196

ISSN

10220038

First Page

439

Last Page

451

Issue

2

Volume

24

Grant

B08004

Fund Ref

Beijing University of Posts and Telecommunications

This document is currently not available here.

Share

COinS