• Home
  • Search
  • Deep Web Data Integration System Based on Scrapy Framework
  • Cite Icon1
  • https://doi.org/10.1109/acie55485.2022.00012Copy DOI Icon

Deep Web Data Integration System Based on Scrapy Framework

  • Jan 1, 2022
  • Haifei Zhang +4 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

At present, most of the data on the World Wide Web is hidden in the database behind the web form that the traditional search engine cannot reach. Users can only use the query interface provided by the site to access these deep web data. Different sites often have different query interfaces for users. Therefore, the data integration of deep web is largely the integration of query interfaces. This paper is aimed at the online bookstore field using Python language and Scrapy framework to design and implement the crawling algorithms of multiple bookstores which is successfully applied to the deep web data integration system. The system's running shows: the user only needs to input the keyword query in the unified query interface of the system, so that the integrated bookstore can be searched, the book information is obtained, and the search results are automatically sorted according to the price. The use of this system not only saves the time for users for switching between websites, but also provides users with cost-effective services.

Similar Papers
  • Conference Article

Heuristics-Based Schema Extraction for Deep Web Query Interfaces

  • Aug 01, 2017
  • Chichang Jou +1
  • Research Article

Deep Web Data Integration with near Duplicate Free

  • Sep 01, 2013
  • Advanced Materials Research
  • Meng Juan Li +4
  • Book Chapter

Search Engine

  • Jan 01, 2018
  • Dilip Kumar Sharma +1
  • Research Article
  • Citations10

Search Engine

  • Apr 01, 2011
  • International Journal of Information Communication Technologies and Human Development
  • Dilip Kumar Sharma +1
  • Conference Article
  • Citations6

Quality-based data source selection for web-scale Deep Web data integration

  • Jul 01, 2009
  • Xue-Feng Xian +4
  • Conference Article
  • Citations2

Research on Middleware of Automatic Finding and Integration of Deep Web Query Interface

  • Nov 01, 2008
  • Peiguang Lin +2
  • Conference Article
  • Citations6

English

  • Jan 01, 2008
  • Thomas Hornung +2
  • Book Chapter

Discovering the Biomedical Deep Web

  • Jan 01, 2005
  • Rajesh Ramanand +1
  • Research Article
  • Citations17

An evidential approach to query interface matching on the deep Web

  • Sep 10, 2009
  • Information Systems
  • Jun Hong +2
  • Conference Article
  • Citations14

Research on Automatic Classification for Deep Web Query Interfaces

  • May 01, 2008
  • Peiguang Lin +3
  • Book Chapter

A Review on Semantic Text and Multimedia Retrieval and Recent Trends

  • Jan 01, 2016
  • Oğuzhan Menemencioğlu +1
  • Research Article

MedNar: Free Specialty Database for Accessing the Deep Web

  • Jul 03, 2021
  • Medical Reference Services Quarterly
  • Ann Veloso
  • Research Article
  • Citations1

How does the credibility of vaccine information compare across traditional search engines and AI-based conversational agents?

  • Oct 01, 2025
  • Public health
  • Amalie Dyda +4
  • Research Article
  • Citations14

ETTA-IM: A deep web query interface matching approach based on evidence theory and task assignment

  • Feb 06, 2011
  • Expert Systems with Applications
  • Yongquan Dong +3
  • Conference Article
  • Citations1

Semantics-Assisted Deep Web Query Interface Classification

  • Jan 01, 2008
  • Chichang Jou
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.