Permutation property testing under different metrics with low query complexity

ABSTRACTUncertainty in the spatial distribution of projected climate changes can be represented along with the magnitudes of those changes using coincident‐bivariate maps. While these maps are popular in climate change assessment reports, limited empirical research has tested which combinations of colour (including variation in the visual variables of hue, lightness, and saturation) and pattern (including variation in the visual variables of size, shape, spacing, orientation, and arrangement) are best suited to mapping projected changes coincident with uncertainty. We evaluate eight coincident‐bivariate techniques for mapping global temperature (CMIP5 ensemble using RCP8.5 and RCP4.5 scenarios) and its uncertainty, each using 20‐classes: five temperature change classes combined with four uncertainty classes. Subjects ranked rectangular map regions by overall amounts of temperature change and uncertainty; response accuracy was evaluated using Kendall's Tau Distance. Maps using colour for representing temperature change and pattern for uncertainty appear most suitable for retaining separability of temperature and uncertainty information. Spot symbols for uncertainty (combining arrangement and lightness) overlaid on hue/lightness for temperature performed best for uncertainty ranking, second best for temperature ranking, and were map users' preferred representation. If colour alone must be used for both variables, then a classed overlay of lightness/saturation differences for uncertainty with hue/lightness for temperature change was preferred; such maps were strong performers on the uncertainty‐ranking task but interfered with map users' ability to rank temperature change. Such a masking approach may be the best choice if the goal is to actively prevent map users from making erroneous inferences based on highly uncertain model output for climate change.

Comparing and ranking information is an important topic in social and information sciences, and in particular on the web. Its objective is to measure the difference of the preferences of voters on a set of candidates and to compute a consensus ranking. Commonly, each voter provides a total order or a bucket order of all candidates, where bucket orders allow ties. In this work we consider the generalization of total and bucket orders to partial orders and compare them by the nearest neighbor and the Hausdorff Kendall tau distances. For total and bucket orders these distances can be computed in $\mathcal{O}(n \log n)$ time. We show that the computation of the nearest neighbor Kendall tau distance is NP-hard, 2-approximable and fixed-parameter tractable for a total and a partial order. The computation of the Hausdorff Kendall tau distance for a total and a partial order is shown to be coNP-hard. The rank aggregation problem is known to be NP-complete for total and bucket orders, even for four voters and solvable in $\mathcal{O}(n\log n)$ for two voters. It is NP-complete for two partial orders and the nearest neighbor Kendall tau distance. For the Hausdorff Kendall tau distance it is in $\mathbf{\Sigma_2^p}$ , but not in NP or coNP unless $\ensuremath{\mathbf{NP}} = \ensuremath{\mathbf{coNP}} $ , even for four voters.

Focusing on property testing tasks that have query complexity that is independent of the size of the tested object (i.e., depends on the proximity parameter only), we prove the existence of a rich hierarchy of the corresponding complexity classes. That is, for essentially any function $$q : (0, 1] \rightarrow \mathbb{N}$$ , we prove the existence of properties for which $$\epsilon$$ -testing has query complexity $$\Theta(q(\Theta(\epsilon)))$$ . Such results are proved in three standard domains that are often considered in property testing: generic functions, adjacency predicates describing (dense) graphs, and incidence functions describing bounded-degree graphs. These results complement hierarchy theorems of Goldreich, Krivelevich, Newman, and Rozenberg (Computational Complexity, 2012), which refer to the dependence of the query complexity on the size of the tested object, and focus on the case that the proximity parameter is set to some small positive constant. We actually combine both flavors and get tight results on the query complexity of testing when allowing the query complexity to depend on both the size of the object and the proximity parameter.

Testing membership in lattices is of practical relevance, with applications to integer programming, error detection in lattice-based communication and cryptography. In this work, we initiate a systematic study of local testing for membership in lattices, complementing and building upon the extensive body of work on locally testable codes. In particular, we formally define the notion of local tests for lattices and present the following: 1. We show that in order to achieve low query complexity, it is sufficient to design one-sided non-adaptive canonical tests. This result is akin to, and based on an analogous result for error-correcting codes due to Ben-Sasson et al. (SIAM J. Computing, 35(1):1-21). 2. We demonstrate upper and lower bounds on the query complexity of local testing for membership in code formula lattices. We instantiate our results for code formula lattices constructed from Reed-Muller codes to obtain nearly-matching upper and lower bounds on the query complexity of testing such lattices. 3. We contrast lattice testing from code testing by showing lower bounds on the query complexity of testing low-dimensional lattices. This illustrates large lower bounds on the query complexity of testing membership in knapsack lattices. On the other hand, we show that knapsack lattices with bounded coefficients have low-query testers if the inputs are promised to lie in the span of the lattice.

We consider the problem of distribution-free testing of the class of monotone monomials and the class of monomials over n variables.0 While there are very efficient algorithms for testing a variety of functions classes when the underlying distribution is uniform, designing distribution-free algorithms (which must work under any arbitrary and unknown distribution), tends to be a more challenging task. When the underlying distribution is uniform, Parnas et al. (SIAM Journal on Discrete Math, 2002) give an algorithm for testing (monotone) monomials whose query complexity does not depends on n, and whose dependence on the distance parameter is (inverse) linear. In contrast, Glasner and Servedio (in Proceedings of RANDOM, 2007) prove that every distribution-free testing algorithm for monotone monomials as well as for general monomials must have query complexity Ω(n1/5) (for a constant distance parameter e). In this paper we present distribution-free testing algorithms for these classes where the query complexity of the algorithms is O(n1/2/e). We note that as opposed to previous results for distribution-free testing, our algorithms do not build on the algorithms that work under the uniform distribution. Rather, we define and exploit certain structural properties of monomials (and functions that differ from them in a nonnegligible manner), which were not used in previous work on property testing.

We investigate the polynomial-time approximability of the multistage version of Min-Sum Set Cover (Mult-MSSC), a natural and intriguing generalization of the classical List Update problem. In Mult-MSSC, we maintain a sequence of permutations (π⁰, π¹, …, π^T) on n elements, based on a sequence of requests ℛ = (R¹, …, R^T). We aim to minimize the total cost of updating π^{t-1} to π^{t}, quantified by the Kendall tau distance d_{KT}(π^{t-1}, π^t), plus the total cost of covering each request R^t with the current permutation π^t, quantified by the position of the first element of R^t in π^t. Using a reduction from Set Cover, we show that Mult-MSSC does not admit an O(1)-approximation, unless P = NP, and that any o(log n) (resp. o(r)) approximation to Mult-MSSC implies a sublogarithmic (resp. o(r)) approximation to Set Cover (resp. where each element appears at most r times). Our main technical contribution is to show that Mult-MSSC can be approximated in polynomial-time within a factor of O(log² n) in general instances, by randomized rounding, and within a factor of O(r²), if all requests have cardinality at most r, by deterministic rounding.

Rank modulation is a way of encoding information to correct errors in flash memory devices as well as impulse noise in transmission lines. Modeling rank modulation involves construction of packings of the space of permutations equipped with the Kendall tau distance. We present several general constructions of codes in permutations that cover a broad range of code parameters. In particular, we show that a code that corrects Hamming errors can be used to construct a code for correcting Kendall errors. For instance, from BCH codes we obtain codes correcting t Kendall errors in n memory cells that support the order of n!/ logt n! messages, for any t = 1, 2, ‥‥ We also construct families of codes that correct a number of errors that grows with n at varying rates, from Θ(n) to Θ(n2).

Codes for rank modulation have been recently proposed as a means of protecting flash memory devices from errors. We study basic coding theoretic problems for such codes, representing them as subsets of the set of permutations of $n$ elements equipped with the Kendall tau distance. We derive several lower and upper bounds on the size of codes. These bounds enable us to establish the exact scaling of the size of optimal codes for large values of $n$. We also show the existence of codes whose size is within a constant factor of the sphere packing bound for any fixed number of errors.

We investigate the lossy compression of the permutation space by analyzing the trade-off between the size of a source code and the distortion with respect to either Kendall tau distance or ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> distance of the inversion vectors. For both distortion measures, we characterize the rate-distortion functions and provide explicit code designs that achieve them. Finally, we provide bounds on the higher order terms in the codebook size when the distortion levels lead to degenerate code rates (0 or 1).

This communication presents an educational experience with pre-universitary students consisting of the creation of a video game in the classroom through the computer application "Scratch". From a qualitative approach, a measure of pair documents similarity PDMS through Kendall Tau distance is applied in order to analyze students´ perception with regard to the implementation of this resource based on block programming. The results show that the most relevant positive aspects are: the increase of support between colleagues and group work, as well as the resolution of doubts. Aspects to be improved or less positive are related to its repetitive nature in the technical procedure and its reduced application in real life. Additionally, the students perceive limitations as its development is mostly constrained to tablets and smartphones, excluding mobile phones from the process. Finally, with regard to its didactic features, benefits for students in relation to their motivation towards study and greater interactivity in the work in the classroom are perceived.

We study property testing of properties that are definable in first-order logic (FO) in the bounded-degree graph and relational structure models. We show that any FO property that is defined by a formula with quantifier prefix ∃∗∀∗ is testable (i.e., testable with constant query complexity), while there exists an FO property that is expressible by a formula with quantifier prefix ∀∗∃∗ that is not testable. In the dense graph model, a similar picture is long known (Alon, Fischer, Krivelevich, Szegedy, Combinatorica 2000), despite the very different nature of the two models. In particular, we obtain our lower bound by a first-order formula that defines a class of bounded-degree expanders, based on zig-zag products of graphs. We expect this to be of independent interest. We then prove testability of some first-order properties that speak about isomorphism types of neighbourhoods, including testability of 1-neighbourhood-freeness, and r-neighbourhood-freeness under a mild assumption on the degrees.

In Genetic Programming (GP), the fitness of individuals is normally computed by using a set of fitness cases (FCs). Research on the use of FCs in GP has primarily focused on how to reduce the size of these sets to, for instance, reduce the fitness evaluation time. However, often, only a small set of FCs is available and there is no need to reduce it. In this work, we are interested in using the whole FCs set, but rather than adopting the commonly used GP approach of presenting the entire set of FCs to the system from the beginning of the search, referred as static FCs, we allow the GP system to build it over time, named as dynamic FCs, to make the search more amenable. Moreover, to the best of our knowledge, there is no study on the use/impact of FCs in Dynamic Optimisation Problems (DOPs). To this end, we also propose the Kendall Tau Distance (KTD) approach, which quantifies pairwise dissimilarities among two lists of fitness values. KTD aims to capture the degree of a change in DOPs and we use this to promote diversity, which has constantly reported to be beneficial in a dynamic setting. Results on eight symbolic regression functions indicate that both approaches are highly beneficial in GP.

Consider property testing on bounded degree graphs and let $\\varepsilon&gt;0$\ndenote the proximity parameter. A remarkable theorem of Newman-Sohler (SICOMP\n2013) asserts that all properties of planar graphs (more generally hyperfinite)\nare testable with query complexity only depending on $\\varepsilon$. Recent\nadvances in testing minor-freeness have proven that all additive and monotone\nproperties of planar graphs can be tested in $poly(\\varepsilon^{-1})$ queries.\nSome properties falling outside this class, such as Hamiltonicity, also have a\nsimilar complexity for planar graphs. Motivated by these results, we ask: can\nall properties of planar graphs can be tested in $poly(\\varepsilon^{-1})$\nqueries? Is there a uniform query complexity upper bound for all planar\nproperties, and what is the "hardest" such property to test? We discover a\nsurprisingly clean and optimal answer. Any property of bounded degree planar\ngraphs can be tested in $\\exp(O(\\varepsilon^{-2}))$ queries. Moreover, there is\na matching lower bound, up to constant factors in the exponent. The natural\nproperty of testing isomorphism to a fixed graph needs\n$\\exp(\\Omega(\\varepsilon^{-2}))$ queries, thereby showing that (up to\npolynomial dependencies) isomorphism to an explicit fixed graph is the hardest\nproperty of planar graphs. The upper bound is a straightforward adapation of\nthe Newman-Sohler analysis that tracks dependencies on $\\varepsilon$ carefully.\nThe main technical contribution is the lower bound construction, which is\nachieved by a special family of planar graphs that are all mutually far from\neach other. We can also apply our techniques to get analogous results for\nbounded treewidth graphs. We prove that all properties of bounded treewidth\ngraphs can be tested in $\\exp(O(\\varepsilon^{-1}\\log \\varepsilon^{-1}))$\nqueries. Moreover, testing isomorphism to a fixed forest requires\n$\\exp(\\Omega(\\varepsilon^{-1}))$ queries.\n

The primary problem in property testing is to decide whether a given function satisfies a certain property, or is far from any function satisfying it. This crucially requires a notion of distance between functions. The most prevalent notion is the Hamming distance over the {\em uniform} distribution on the domain. This restriction to uniformity is more a matter of convenience than of necessity, and it is important to investigate distances induced by more general distributions. In this paper, we make significant strides in this direction. We give simple and optimal testers for {\em bounded derivative properties} over {\em arbitrary product distributions}. Bounded derivative properties include fundamental properties such as monotonicity and Lipschitz continuity. Our results subsume almost all known results (upper and lower bounds) on monotonicity and Lipschitz testing. We prove an intimate connection between bounded derivative property testing and binary search trees (BSTs). We exhibit a tester whose query complexity is the sum of expected depths of optimal BSTs for each marginal. Furthermore, we show this sum-of-depths is also a lower bound. A fundamental technical contribution of this work is an {\em optimal dimension reduction theorem} for all bounded derivative properties, which relates the distance of a function from the property to the distance of restrictions of the function to random lines. Such a theorem has been elusive even for monotonicity for the past 15 years, and our theorem is an exponential improvement to the previous best known result.

Constant-time algorithms are powerful tools, since they run by reading only a constant-sized part of each input. Property testing is the most popular research framework for constant-time algorithms. In property testing, an algorithm determines whether a given instance satisfies some predetermined property or is far from satisfying the property with high probability by reading a constant-sized part of the input. A property is said to be testable if there is a constant-time testing algorithm for the property. This chapter covers property testing on graphs and games. The fields of graph algorithms and property testing are two of the main streams of research on discrete algorithms and computational complexity. In the section on graphs in this chapter, we present some important results, particularly on the characterization of testable graph properties. At the end of the section, we show results that we published in 2020 on a complete characterization (necessary and sufficient condition) of testable monotone or hereditary properties in the bounded-degree digraphs. In the section on games, we present results that we published in 2019 showing that the generalized chess, Shogi (Japanese chess), and Xiangqi (Chinese chess) are all testable. We believe that this is the first results for testable EXPTIME-complete problems.