Extensions of the conjugate prior through the Kullback-Leibler separators

Takemi Yanagimoto, Toshio Ohnishi

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

The conjugate prior for the exponential family, referred to also as the natural conjugate prior, is represented in terms of the Kullback-Leibler separator. This representation permits us to extend the conjugate prior to that for a general family of sampling distributions. Further, by replacing the Kullback-Leibler separator with its dual form, we define another form of a prior, which will be called the mean conjugate prior. Various results on duality between the two conjugate priors are shown. Implications of this approach include richer families of prior distributions induced by a sampling distribution and the empirical Bayes estimation of a high-dimensional mean parameter.

Original languageEnglish
Pages (from-to)116-133
Number of pages18
JournalJournal of Multivariate Analysis
Volume92
Issue number1
DOIs
Publication statusPublished - Jan 1 2005
Externally publishedYes

Fingerprint

Conjugate prior
Separator
Separators
Sampling
Sampling Distribution
Empirical Bayes Estimation
Exponential Family
Prior distribution
Duality
High-dimensional

All Science Journal Classification (ASJC) codes

  • Statistics and Probability
  • Numerical Analysis
  • Statistics, Probability and Uncertainty

Cite this

Extensions of the conjugate prior through the Kullback-Leibler separators. / Yanagimoto, Takemi; Ohnishi, Toshio.

In: Journal of Multivariate Analysis, Vol. 92, No. 1, 01.01.2005, p. 116-133.

Research output: Contribution to journalArticle

@article{3d1bc2f2839a430699f5e7081b3b310b,
title = "Extensions of the conjugate prior through the Kullback-Leibler separators",
abstract = "The conjugate prior for the exponential family, referred to also as the natural conjugate prior, is represented in terms of the Kullback-Leibler separator. This representation permits us to extend the conjugate prior to that for a general family of sampling distributions. Further, by replacing the Kullback-Leibler separator with its dual form, we define another form of a prior, which will be called the mean conjugate prior. Various results on duality between the two conjugate priors are shown. Implications of this approach include richer families of prior distributions induced by a sampling distribution and the empirical Bayes estimation of a high-dimensional mean parameter.",
author = "Takemi Yanagimoto and Toshio Ohnishi",
year = "2005",
month = "1",
day = "1",
doi = "10.1016/S0047-259X(03)00133-7",
language = "English",
volume = "92",
pages = "116--133",
journal = "Journal of Multivariate Analysis",
issn = "0047-259X",
publisher = "Academic Press Inc.",
number = "1",

}

TY - JOUR

T1 - Extensions of the conjugate prior through the Kullback-Leibler separators

AU - Yanagimoto, Takemi

AU - Ohnishi, Toshio

PY - 2005/1/1

Y1 - 2005/1/1

N2 - The conjugate prior for the exponential family, referred to also as the natural conjugate prior, is represented in terms of the Kullback-Leibler separator. This representation permits us to extend the conjugate prior to that for a general family of sampling distributions. Further, by replacing the Kullback-Leibler separator with its dual form, we define another form of a prior, which will be called the mean conjugate prior. Various results on duality between the two conjugate priors are shown. Implications of this approach include richer families of prior distributions induced by a sampling distribution and the empirical Bayes estimation of a high-dimensional mean parameter.

AB - The conjugate prior for the exponential family, referred to also as the natural conjugate prior, is represented in terms of the Kullback-Leibler separator. This representation permits us to extend the conjugate prior to that for a general family of sampling distributions. Further, by replacing the Kullback-Leibler separator with its dual form, we define another form of a prior, which will be called the mean conjugate prior. Various results on duality between the two conjugate priors are shown. Implications of this approach include richer families of prior distributions induced by a sampling distribution and the empirical Bayes estimation of a high-dimensional mean parameter.

UR - http://www.scopus.com/inward/record.url?scp=6444220756&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=6444220756&partnerID=8YFLogxK

U2 - 10.1016/S0047-259X(03)00133-7

DO - 10.1016/S0047-259X(03)00133-7

M3 - Article

AN - SCOPUS:6444220756

VL - 92

SP - 116

EP - 133

JO - Journal of Multivariate Analysis

JF - Journal of Multivariate Analysis

SN - 0047-259X

IS - 1

ER -