Sparse Gaussian Processes with Spherical Harmonic Features

Vincent Dutordoir; Nicolas Durrande; James Hensman

Back to publications

Sparse Gaussian Processes with Spherical Harmonic Features

Vincent Dutordoir, Nicolas Durrande, James Hensman

Proceedings of the 37th International Conference on Machine Learning, 2020.

Abstract

We introduce a new class of inter-domain variational Gaussian processes (GP) where data is mapped onto the unit hypersphere in order to use spherical harmonic representations. Our inference scheme is comparable to variational Fourier features, but it does not suffer from the curse of dimensionality, and leads to diagonal covariance matrices between inducing variables. This enables a speed-up in inference, because it bypasses the need to invert large covariance matrices. Our experiments show that our model is able to fit a regression model for a dataset with 6 million entries two orders of magnitude faster compared to standard sparse GPs, while retaining state of the art accuracy. We also demonstrate competitive performance on classification with non-conjugate likelihoods.

Links

Cite this Paper

BibTeX


@InProceedings{publications/sparse-gaussian-processes-with-spherical-harmonic-features,
  title = 	 {Sparse Gaussian Processes with Spherical Harmonic Features},
  author = 	 {Dutordoir, Vincent and Durrande, Nicolas and Hensman, James},
  booktitle = 	 {Proceedings of the 37th International Conference on Machine Learning},
  year = 	 {2020},
  pdf = 	 {http://proceedings.mlr.press/v119/dutordoir20a/dutordoir20a.pdf},
  url = 	 {/publications/sparse-gaussian-processes-with-spherical-harmonic-features.html},
  abstract = 	 {We introduce a new class of inter-domain variational Gaussian processes (GP) where data is mapped onto the unit hypersphere in order to use spherical harmonic representations. Our inference scheme is comparable to variational Fourier features, but it does not suffer from the curse of dimensionality, and leads to diagonal covariance matrices between inducing variables. This enables a speed-up in inference, because it bypasses the need to invert large covariance matrices. Our experiments show that our model is able to fit a regression model for a dataset with 6 million entries two orders of magnitude faster compared to standard sparse GPs, while retaining state of the art accuracy. We also demonstrate competitive performance on classification with non-conjugate likelihoods.}
}

Endnote

%0 Conference Paper
%T Sparse Gaussian Processes with Spherical Harmonic Features
%A Vincent Dutordoir
%A Nicolas Durrande
%A James Hensman
%B Proceedings of the 37th International Conference on Machine Learning
%D 2020	
%F publications/sparse-gaussian-processes-with-spherical-harmonic-features
%U /publications/sparse-gaussian-processes-with-spherical-harmonic-features.html
%X We introduce a new class of inter-domain variational Gaussian processes (GP) where data is mapped onto the unit hypersphere in order to use spherical harmonic representations. Our inference scheme is comparable to variational Fourier features, but it does not suffer from the curse of dimensionality, and leads to diagonal covariance matrices between inducing variables. This enables a speed-up in inference, because it bypasses the need to invert large covariance matrices. Our experiments show that our model is able to fit a regression model for a dataset with 6 million entries two orders of magnitude faster compared to standard sparse GPs, while retaining state of the art accuracy. We also demonstrate competitive performance on classification with non-conjugate likelihoods.

RIS


TY  - CPAPER
TI  - Sparse Gaussian Processes with Spherical Harmonic Features
AU  - Vincent Dutordoir
AU  - Nicolas Durrande
AU  - James Hensman
BT  - Proceedings of the 37th International Conference on Machine Learning
DA  - 2020/05/24	
ID  - publications/sparse-gaussian-processes-with-spherical-harmonic-features
L1  - http://proceedings.mlr.press/v119/dutordoir20a/dutordoir20a.pdf
UR  - /publications/sparse-gaussian-processes-with-spherical-harmonic-features.html
AB  - We introduce a new class of inter-domain variational Gaussian processes (GP) where data is mapped onto the unit hypersphere in order to use spherical harmonic representations. Our inference scheme is comparable to variational Fourier features, but it does not suffer from the curse of dimensionality, and leads to diagonal covariance matrices between inducing variables. This enables a speed-up in inference, because it bypasses the need to invert large covariance matrices. Our experiments show that our model is able to fit a regression model for a dataset with 6 million entries two orders of magnitude faster compared to standard sparse GPs, while retaining state of the art accuracy. We also demonstrate competitive performance on classification with non-conjugate likelihoods.
ER  -

APA


Dutordoir, V., Durrande, N. & Hensman, J.. (2020). Sparse Gaussian Processes with Spherical Harmonic Features. Proceedings of the 37th International Conference on Machine Learning Available from /publications/sparse-gaussian-processes-with-spherical-harmonic-features.html.