Acquiring geographical data with web harvesting

Background: Epidemiological investigations define the prevalence and distribution of the various types of malocclusions, and can help to identify etiological factors and set the most correct orthodontic therapy. Aim: The goal of this study was to verify the prevalence and distribution of various types of malocclusions in the pediatric population. Methods: The study was performed on a sample of 350 patients (ages 5-9) being treated at the ASST Grande Ospedale Metropolitano Niguarda in Milan. A comparison was presented with one similar epidemiological investigation conducted 22 years earlier by the same researchers. The values of the malocclusion indices were reported from the cephalometric analyzes of the patients and were differentiated on the basis of gender and ethnicity. Results: The predominant traits of malocclusion in the general population of the analyzed sample were: skeletal class II (47.43%), hyper-divergence (40.86%), maxillary retrusion (46%), mandibular retrusion (66%), maxillary hypoplasia (50%), mandibular hypoplasia (49.14%), Wits index > 2 mm (22.57%); overjet > 4 mm (31.1%) and overbite > 4 mm (24.86%). Substantial differences were found between Italian patients and patients belonging to different ethnic groups in almost all parameters, and between the male and female genders in some of them. Patients in the 2000 study had a higher prevalence of Class II and hyper-divergence. Conclusions: This epidemiological investigation can suggest different approaches in setting the orthodontic treatment plan based on the ethnic group of the patient taken in charge and encourage more specific and large-scale analytical studies on the subject.

With vertical search engines, it is possible to search the web pages on a specific domain such as products, restaurants or academic papers and present the users only the interested information. Gathering and integrating such objects from multiple web pages into a single system provides a useful facility for users. Placing the extracted objects from multiple data sources into a single hierarchical structure is a challenging classification problem, especially if there are limited object attributes. In this work, we propose a confidence-based incremental Naive Bayesian approach for categorization, focusing on the product domain. Incremental approach is based on extending the training set and retraining the classifier as new objects are assigned to a category with high confidence. The ordering of product data is taken into account as well. The proposed approach is applied on a vertical search engine that collects product data from several online stores.

Работа посвящена анализу основных тенденций в пространственном распределении различных типов экономической активности в Якутии. Для региона была разработана матрица транспортных расстояний наземным сообщением в зимний период. На ее основе были получены панельные данные по географическому потенциалу, а также предложен обратный показатель – агломерационное влияние. На основе расчета индексов Тейла был проведен анализ неоднородности в пространственном распределении различных типов экономической активности. Впервые для Якутии методом географически взвешенной регрессии были протестированы гипотезы: о взаимосвязи между объемами производства сельскохозяйственной продукции и доступностью рынков сбыта, а также обеспеченностью сельскохозяйственными угодьями; о влиянии доходов населения и агломерационного влияния на динамику показателей малого бизнеса; о взаимосвязи между объемами производства крупных и средних предприятий, агломерационного влияния и инвестиций. Статья написана в рамках НИР «Социально-экономическая безопасность регионов Восточной Арктики: проблемы взаимообусловленности и трансформации в современных условиях, мониторинг, оценка, разработка комплекса государственных мер по ее повышению (на примере Республики Саха (Якутия))» (№ 0374-2019-0005) Программы ФНИ государственных академий наук на 2013-2020 годы. The article is written within the project of the Russian Academy of Sciences № 0374-2016-0001 «Socio-economic security of the Eastern Arctic regions: issues of interdependence and transformation in modern conditions. Monitoring, evaluation, development of a set of government measures to improve it (case of the Republic of Sakha (Yakutia))»Abstract: The paper is devoted to the analysis of the main trends in the spatial distribution of various types of economic activity in Yakutia. A matrix of transport distances by land in winter period was developed for the region. On its basis, panel data on the geographical potential were obtained, and the reverse indicator – agglomeration effect – was proposed. The analysis of heterogeneity in the spatial distribution of different types of economic activity was carried out on the basis of the calculation of the Theil indices. For the first time in Yakutia, the geographically weighted regression method was used to test hypotheses: on the relationship between the volume of agricultural production and the availability of markets, as well as the provision of agricultural land; on the impact of people’s income and agglomeration influence on the dynamics of small business; on the relationship between the volume of production of large and medium-sized enterprises, agglomeration influence and investment.

The conceptual framework of evolutionary morphology in the studies of Ernst Haeckel and Fritz Müller

Conventional Web search engines rank their searched results page by page. That is, conventionally, the information unit for both searching and ranking is a single Web page. There are, however, cases where a set of searched pages shows a better similarity (relevance) to a given (keyword) query than each individually searched page. This is because the information a user wishes to have is sometimes distributed on multiple Web pages. In such cases, the information unit used for ranking should be a set of pages rather than a single page. In this paper, we propose the notion of a “page set ranking”, which is to rank each pertinent set of searched Web pages. We describe our new algorithm of the page set ranking to efficiently construct and rank page sets. We present some experimental results and the effectiveness of our approach.

This paper describes an information personalization system, called Internet Scrapbook, which enables users to create a personal page by clipping and merging their necessary data gathered from multiple Web pages. Even when the source Web pages are modified, the system updates the personal page, replacing with the latest data extracted from the source pages. Therefore, once a user creates their personal pages, she can browse her necessary information only.

An eye tracking study was conducted to evaluate specific design features for a prototype web portal application. This software serves independent web content through separate, rectangular, user-modifiable portlets on a web page. Each of seven participants navigated across multiple web pages while conducting six specific tasks, such as removing a link from a portlet. Specific experimental questions included (1) whether eye tracking-derived parameters were related to page sequence or user actions preceding page visits, (2) whether users were biased to traveling vertically or horizontally while viewing a web page, and (3) whether specific sub-features of portlets were visited in any particular order. Participants required 2-15 screens, and from 7-360+ seconds to complete each task. Based on analysis of screen sequences, there was little evidence that search became more directed as screen sequence increased. Navigation among portlets, when at least two columns exist, was biased towards horizontal search (across columns) as opposed to vertical search (within column). Within a portlet, the header bar was not reliably visited prior to the portlet's body, evidence that header bars are not reliably used for navigation cues. Initial design recommendations emphasized the need to place critical portlets on the left and top of the web portal area, and that related portlets do not need to appear in the same column. Further experimental replications are recommended to generalize these results to other applications.

Objective: To develop a generic web scraping tool that can extract cricket player’s data for research purposes. Methods: Cricket as a sport has greatly plagued the world with its importance and entertaining nature. For a team the performance of each individual player has great importance for their victory. In this paper, an automated data scraping mechanism is devised to extract and store data of cricket players from a cricket website. This website contain web-enabled database of cricket players where the data is contained on multiple web pages and proposed mechanism is designed to extract this variation as per requirement of researcher. Findings: This tool will be helpful for data scientists/researchers to extract dataset as per their requirements. Applications: This generic tool will be applicable in analyzing the formation of cricket team as per rating of individual player. Moreover, this tool will contribute as an essential ingredient for research related in the domain of cricket analytics. Keywords: Cricket Analytics, Information Extraction, Scrapper, Web Content Extraction

In this chapter, we’ll go through the basic building blocks of web pages such as HTML and CSS and demonstrate scraping structured information from them using popular Python libraries such as Beautiful Soup and lxml. Later, we’ll expand our knowledge and tackle issues that will make our scraper into a full-featured web crawler capable of fetching information from multiple web pages.

Ontology based Data Integration (ONDINE) is an approach to integrate web data from heterogeneous resources with the help of ontologies. The ONDINE system is enhanced for querying the data warehouse opened in the web and updating the data. Using the ontological and terminological resources (OTR) we can load and query the data from the data warehouse. Especially, the system extracts the tables from multiple web pages and annotates the symbols and numeric constants in separated columns. The output in XML/RDF formats represents the fuzzy annotation of the integrated data tables. Using SPARQL, the fuzzy sets from the fuzzy RDF annotations are retrieved. In the proposed SEFOS system, fuzzy DL is used for querying. Thus the time to finish the task would be reduced and a decent precision rate is obtained on using fuzzy DL.

Variation in Results of Three Biology‐Focused Search Engines: A Case Study Using North American Tree Species

The article is devoted to the analysis of the attributive structure of two poetic collections of well-known authors – «The Angel of Armenia» by Sergei Gorodetsky and «Armenia» by Osip Mandelstam. These poems occupy an important place among the works of Russian poets about Armenia, making it possible to form the perception of the history and culture of Armenia, its artistic representation in Russian poetry.
 The article sets the task of a quantitative analysis of the distribution and nature of the use of attributes of various types. Attribute types are determined by the part-of-speech filling of the syntactic position of the definition and by its position relative to the word being defined.
 In the course of the study, various statistical methods were used, which include the chi-square test, correlation coefficients, variance, Euclidean distance. 
 As a result of the analysis, data were obtained that characterize the authors' approaches to the description, similarities and differences in the distribution of various types of attributes, the degree of intensity of the description, the level of inversion of attributive structures.

The paper is devoted to the analysis of Internet media monitoring for the dissemination of destructive content and the comparison of the identified types of information of aggressive and (auto)destructive nature with legally fixed prohibitions and restrictions on the right to freedom of information dissemination. The author considers the issues of networking and decentralization of destructive communities in Runet and the development of radical movements using the Ingamasi technology. Taking into account the patterns of distribution of various types of destructive content revealed during the study, including the peculiarities of communication in network communities of different types, the refraction of the «Overton window» theory to the media field of the dissemination of destructive information in Internet media was scientifically justified.Despite the existence of a regulatory framework for ensuring the information security of the individual, the realities of the development of communication in the digital environment demonstrate the presence of many gray areas. New communication and content risks require a systemic transformation and updating of the legal regulation of the digital environment in order to ensure the information and ideological security of the individual. Given the trends in the spread of new types of aggressive and depressive-suicidal content discussed in the paper, the author concludes that it is necessary to normalize new types of prohibited and restricted information by making systemic changes to the Federal Law «On Information, Information Technologies and Information Protection», the Federal Law «On the Protection of Children from Information that causes Harm their health and development», the Law of the Russian Federation «On Mass Media», as well as the improvement of administrative and criminal legislation, including through the introduction of new elements of offenses (crimes).

A catalog of 2678 galaxies within an area of about 40 sq deg centered on the Fornax Cluster has been compiled based on 26 deep large-scale plates obtained with the 2.5-m Las Campanas Observatory reflector. The catalog includes 340 likely cluster members and 2338 likely background galaxies. Radial velocities are given for 89 of the galaxies. The spatial distributions of various types of galaxies have been modeled as the sum of a King (1962) model cluster component superimposed on a uniform background. Using maximum-likelihood fits to these distributions, a core radius of 0.7 deg is found for a King model fit to the cluster, suggesting that there are few cluster members contained in the sample of background galaxies.

The Prairie Ecozone contains 5% of Canada's land area and represents 16% of the Great Plains of North America. Current estimates indicate that 25-30% of original Canadian grassland habitats remain, largely concentrated in southeastern Alberta and southwestern Saskatchewan with fragments distributed throughout southern Manitoba. The size, distribution and condition of native grasslands serve as valuable indicators of the ecological integrity and the sustainability of those landscape types. With so little native grasslands remaining, areas that conserve grasslands serve as core sites for indicators such as gaps in ecosystem and wildlife habitat protection, i.e. which ecosystems are well-represented, poorly represented or have no representation. Such gap analyses helps to determine where protection efforts need to be placed in the future. Overall, about 3.5% of the Prairie Ecozone of Canada is under some form of conservation area status. This paper reports, relative to the ecoregions and political jurisdictions of the Prairie Ecozone, on the amount and distribution of various types of conservation areas and native grasslands. Relationships between the occurrence of conservation areas and grasslands are presented. Implications for conservation area planning and management are discussed within regional, national and international contexts. The issue of which characteristics of conservation areas should be assessed and monitored to address conservation objectives for sustainability is also discussed.