Automatic generation of ontology from the Deep Web
Document Type
Conference Proceeding
Publication Date
12-1-2007
Abstract
The term "Deep Web" refers to Web pages that are not accessible to search engines, e.g., because those Web pages are dynamically generated in response to queries through Web forms or Web services. The existing automated Web crawlers cannot index these pages, thus they are hidden from the Web search engines. Our goal is to properly annotate such Deep Web services (i.e. content generation interfaces of hidden Web sources) with semantic indexing by constructing domain-specific ontologies to represent the contents of the Deep Web sources. The fully automatic derivation of ontologies from Web sources without human review is to date a challenging research issue. We present a novel approach to automatically building a large, yet domain-specific, ontology by interweaving sub-taxonomies of WordNet with domain-specific information extracted from Deep Web service pages. Our algorithms extract domain concepts from Deep Web sources which are augmented with concepts and relationships from WordNet to construct ontology fragments. Structurally, these are Directed Acyclic Graphs (DAGs). An iterative process of extracting WordNet concepts and relationships and bridging concept gaps is used to tie together disparate domain concepts and ontology fragments into one ontology. Using eight domains (airfares, jobs, etc.) from a well-known test-bed, our algorithms constructed an ontology of 1692 concepts from Deep Web sources and 4434 concepts from WordNet. This ontology is expressed in the OWL format to support semantic Web searches. © 2007 IEEE.
Identifier
47849128923 (Scopus)
ISBN
[0769529321, 9780769529325]
Publication Title
Proceedings International Workshop on Database and Expert Systems Applications DEXA
External Full Text Location
https://doi.org/10.1109/DEXA.2007.43
ISSN
15294188
First Page
470
Last Page
474
Recommended Citation
Yoo, Jung An; Geller, James; Wu, Yi Ta; and Soon, Ae Chun, "Automatic generation of ontology from the Deep Web" (2007). Faculty Publications. 13207.
https://digitalcommons.njit.edu/fac_pubs/13207
