Results 1  10
of
2,606
Manifold regularization: A geometric framework for learning from labeled and unlabeled examples
 JOURNAL OF MACHINE LEARNING RESEARCH
, 2006
"... We propose a family of learning algorithms based on a new form of regularization that allows us to exploit the geometry of the marginal distribution. We focus on a semisupervised framework that incorporates labeled and unlabeled data in a generalpurpose learner. Some transductive graph learning al ..."
Abstract

Cited by 509 (13 self)
 Add to MetaCart
(Show Context)
We propose a family of learning algorithms based on a new form of regularization that allows us to exploit the geometry of the marginal distribution. We focus on a semisupervised framework that incorporates labeled and unlabeled data in a generalpurpose learner. Some transductive graph learning algorithms and standard methods including Support Vector Machines and Regularized Least Squares can be obtained as special cases. We utilize properties of Reproducing Kernel Hilbert spaces to prove new Representer theorems that provide theoretical basis for the algorithms. As a result (in contrast to purely graphbased approaches) we obtain a natural outofsample extension to novel examples and so are able to handle both transductive and truly semisupervised settings. We present experimental evidence suggesting that our semisupervised algorithms are able to use unlabeled data effectively. Finally we have a brief discussion of unsupervised and fully supervised learning within our general framework.
Wavelet and Multiscale Methods for Operator Equations
 Acta Numerica
, 1997
"... this paper is to highlight some of the underlying driving analytical mechanisms. The price of a powerful tool is the effort to construct and understand it. Its successful application hinges on the realization of a number of requirements. Some space has to be reserved for a clear identification of th ..."
Abstract

Cited by 211 (39 self)
 Add to MetaCart
(Show Context)
this paper is to highlight some of the underlying driving analytical mechanisms. The price of a powerful tool is the effort to construct and understand it. Its successful application hinges on the realization of a number of requirements. Some space has to be reserved for a clear identification of these requirements as well as for their realization. This is also particularly important for understanding the severe obstructions, that keep us at present from readily materializing all the principally promising perspectives.
Semicontinuity problems in the calculus of variations
 ARCH. RATIONAL MECH. ANAL
, 1984
"... ..."
(Show Context)
Multilayer Feedforward Networks With a Nonpolynomial Activation Function Can Approximate Any Function
, 1993
"... Several researchers characterized the activation fimction under which multilayer feedforward networks can act as universal approximators. We show that most of all the characterizations that were reported thus far in the literature are special cases of the following general result: A standard multila ..."
Abstract

Cited by 148 (3 self)
 Add to MetaCart
Several researchers characterized the activation fimction under which multilayer feedforward networks can act as universal approximators. We show that most of all the characterizations that were reported thus far in the literature are special cases of the following general result: A standard multilayer feedforward network with a locally bounded piecewise continuous activation fimction can approximate an3, continuous function to any degree of accuracy if and only if the network's activation function is not a polynomial. We also emphasize the important role of the threshold, asserting that without it the last theorem does not hold.
Finite elements in computational electromagnetism
, 2002
"... This article discusses finite element Galerkin schemes for a number of linear model problems in electromagnetism. The finite element schemes are introduced as discrete differential forms, matching the coordinateindependent statement of Maxwell’s equations in the calculus of differential forms. Th ..."
Abstract

Cited by 115 (6 self)
 Add to MetaCart
This article discusses finite element Galerkin schemes for a number of linear model problems in electromagnetism. The finite element schemes are introduced as discrete differential forms, matching the coordinateindependent statement of Maxwell’s equations in the calculus of differential forms. The asymptotic convergence of discrete solutions is investigated theoretically. As discrete differential forms represent a genuine generalization of conventional Lagrangian finite elements, the analysis is based upon a judicious adaptation of established techniques in the theory of finite elements. Risks and difficulties haunting finite element schemes that do not fit the framework of discrete dif
Multilevel Preconditioning
 Numer. Math
, 1992
"... This paper is concerned with multilevel techniques for preconditioning linear systems arising from Galerkin methods for elliptic boundary value problems. A general estimate is derived which is based on the characterization of Besov spaces in terms of weighted sequence norms related to corresponding ..."
Abstract

Cited by 110 (18 self)
 Add to MetaCart
(Show Context)
This paper is concerned with multilevel techniques for preconditioning linear systems arising from Galerkin methods for elliptic boundary value problems. A general estimate is derived which is based on the characterization of Besov spaces in terms of weighted sequence norms related to corresponding multilevel expansions. The result brings out clearly how the various ingredients of a typical multilevel setting affect the growth rate of the condition numbers. In particular, our analysis indicates how to realize even uniformly bounded condition numbers. For example, the general results are used to show that the BramblePasciakXu preconditioner for piecewise linear finite elements gives rise to uniformly bounded condition numbers even when the refinements of the underlying triangulations are highly nonuniform. Furthermore, they are applied to a general multivariate setting of refinable shiftinvariant spaces, in particular, covering those induced by various types of wavelets. Key words: G...
Biorthogonal SplineWavelets on the Interval  Stability and Moment Conditions
 Appl. Comp. Harm. Anal
, 1997
"... This paper is concerned with the construction of biorthogonal multiresolution analyses on [0; 1] such that the corresponding wavelets realize any desired order of moment conditions throughout the interval. Our starting point is the family of biorthogonal pairs consisting of cardinal Bsplines and co ..."
Abstract

Cited by 96 (47 self)
 Add to MetaCart
This paper is concerned with the construction of biorthogonal multiresolution analyses on [0; 1] such that the corresponding wavelets realize any desired order of moment conditions throughout the interval. Our starting point is the family of biorthogonal pairs consisting of cardinal Bsplines and compactly supported dual generators on IR developed by Cohen, Daubechies and Feauveau. In contrast to previous investigations we preserve the full degree of polynomial reproduction also for the dual multiresolution and prove in general that the corresponding modifications of dual generators near the end points of the interval still permit the biorthogonalization of the resulting bases. The subsequent construction of compactly supported biorthogonal wavelets is based on the concept of stable completions. As a first step we derive an initial decomposition of the spline spaces where the complement spaces between two successive levels are spanned by compactly supported splines which form uniformly...
Wavelets on Manifolds I: Construction and Domain Decomposition
 SIAM J. Math. Anal
, 1998
"... The potential of wavelets as a discretization tool for the numerical treatment of operator equations hinges on the validity of norm equivalences for Besov or Sobolev spaces in terms of weighted sequence norms of wavelet expansion coefficients and on certain cancellation properties. These features ar ..."
Abstract

Cited by 94 (22 self)
 Add to MetaCart
(Show Context)
The potential of wavelets as a discretization tool for the numerical treatment of operator equations hinges on the validity of norm equivalences for Besov or Sobolev spaces in terms of weighted sequence norms of wavelet expansion coefficients and on certain cancellation properties. These features are crucial for the construction of optimal preconditioners, for matrix compression based on sparse representations of functions and operators as well as for the design and analysis of adaptive solvers. However, for realistic domain geometries the relevant properties of wavelet bases could so far only be realized to a limited extent. This paper is concerned with concepts that aim at expanding the applicability of wavelet schemes in this sense. The central issue is to construct wavelet bases with the desired properties on manifolds which can be represented as the disjoint union of smooth parametric images of the standard cube. The approach considered here is conceptually different though from o...