Proper learning algorithm for functions of κ terms under smooth distributions

Yoshifumi Sakai, Eiji Takimoto, Akira Maruoka

研究成果: 著書/レポートタイプへの貢献会議での発言

7 引用 (Scopus)

抄録

Algorithms for learning feasibly Boolean functions from examples are explored. A class of functions we deal with is written as F1 oF2 k = {g(f1(v),...fk(v)) g ∈ F1, f1...,fk ∈ F2} for classes F1 and F2 given by somewhat "simple" description. Letting Γ = {0,1}, we denote by F1 and F2 a class of functions from Γk to Γ and that of functions from Γn to Γ, respectively. For exa.mple, let FOr consist of an OR function of k variables, and let Fn be the class of all monomials of n variables. In the distribution free setting, it is known that FORo Fn k, denoted usually k-term DNF, is not learnable unless P≠NP In this paper, we first introduce a probabilistic distribution, called a smooth distribution, which is a generalization of both q-bounded distribution and product distribution, and define the learnability under this distribution. Then, we give an algorithm that properly learns FkoTn k under smooth distribution in polynomial time for constant k, where Fk is the class of all Boolean functions of k variables. The class FkoTn k is called the functions of k terms and although it was shown by Blum and Singh to be learned using DNF as a hypothesis class, it remains open whether it is properly learnable under distribution free setting.

元の言語英語
ホスト出版物のタイトルProceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995
出版者Association for Computing Machinery, Inc
ページ206-213
ページ数8
ISBN(電子版)0897917235, 9780897917230
出版物ステータス出版済み - 7 5 1995
外部発表Yes
イベント8th Annual Conference on Computational Learning Theory, COLT 1995 - Santa Cruz, 米国
継続期間: 7 5 19957 8 1995

出版物シリーズ

名前Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995
1995-January

その他

その他8th Annual Conference on Computational Learning Theory, COLT 1995
米国
Santa Cruz
期間7/5/957/8/95

Fingerprint

Learning algorithms
Learning Algorithm
Term
Boolean functions
Distribution-free
Boolean Functions
Learnability
Class
Polynomials
Polynomial time
Denote

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Artificial Intelligence
  • Software

これを引用

Sakai, Y., Takimoto, E., & Maruoka, A. (1995). Proper learning algorithm for functions of κ terms under smooth distributions. : Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995 (pp. 206-213). (Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995; 巻数 1995-January). Association for Computing Machinery, Inc.

Proper learning algorithm for functions of κ terms under smooth distributions. / Sakai, Yoshifumi; Takimoto, Eiji; Maruoka, Akira.

Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995. Association for Computing Machinery, Inc, 1995. p. 206-213 (Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995; 巻 1995-January).

研究成果: 著書/レポートタイプへの貢献会議での発言

Sakai, Y, Takimoto, E & Maruoka, A 1995, Proper learning algorithm for functions of κ terms under smooth distributions. : Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995. Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995, 巻. 1995-January, Association for Computing Machinery, Inc, pp. 206-213, 8th Annual Conference on Computational Learning Theory, COLT 1995, Santa Cruz, 米国, 7/5/95.
Sakai Y, Takimoto E, Maruoka A. Proper learning algorithm for functions of κ terms under smooth distributions. : Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995. Association for Computing Machinery, Inc. 1995. p. 206-213. (Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995).
Sakai, Yoshifumi ; Takimoto, Eiji ; Maruoka, Akira. / Proper learning algorithm for functions of κ terms under smooth distributions. Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995. Association for Computing Machinery, Inc, 1995. pp. 206-213 (Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995).
@inproceedings{e5146775893045399f1c4ececac4674d,
title = "Proper learning algorithm for functions of κ terms under smooth distributions",
abstract = "Algorithms for learning feasibly Boolean functions from examples are explored. A class of functions we deal with is written as F1 oF2 k = {g(f1(v),...fk(v)) g ∈ F1, f1...,fk ∈ F2} for classes F1 and F2 given by somewhat {"}simple{"} description. Letting Γ = {0,1}, we denote by F1 and F2 a class of functions from Γk to Γ and that of functions from Γn to Γ, respectively. For exa.mple, let FOr consist of an OR function of k variables, and let Fn be the class of all monomials of n variables. In the distribution free setting, it is known that FORo Fn k, denoted usually k-term DNF, is not learnable unless P≠NP In this paper, we first introduce a probabilistic distribution, called a smooth distribution, which is a generalization of both q-bounded distribution and product distribution, and define the learnability under this distribution. Then, we give an algorithm that properly learns FkoTn k under smooth distribution in polynomial time for constant k, where Fk is the class of all Boolean functions of k variables. The class FkoTn k is called the functions of k terms and although it was shown by Blum and Singh to be learned using DNF as a hypothesis class, it remains open whether it is properly learnable under distribution free setting.",
author = "Yoshifumi Sakai and Eiji Takimoto and Akira Maruoka",
year = "1995",
month = "7",
day = "5",
language = "English",
series = "Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995",
publisher = "Association for Computing Machinery, Inc",
pages = "206--213",
booktitle = "Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995",

}

TY - GEN

T1 - Proper learning algorithm for functions of κ terms under smooth distributions

AU - Sakai, Yoshifumi

AU - Takimoto, Eiji

AU - Maruoka, Akira

PY - 1995/7/5

Y1 - 1995/7/5

N2 - Algorithms for learning feasibly Boolean functions from examples are explored. A class of functions we deal with is written as F1 oF2 k = {g(f1(v),...fk(v)) g ∈ F1, f1...,fk ∈ F2} for classes F1 and F2 given by somewhat "simple" description. Letting Γ = {0,1}, we denote by F1 and F2 a class of functions from Γk to Γ and that of functions from Γn to Γ, respectively. For exa.mple, let FOr consist of an OR function of k variables, and let Fn be the class of all monomials of n variables. In the distribution free setting, it is known that FORo Fn k, denoted usually k-term DNF, is not learnable unless P≠NP In this paper, we first introduce a probabilistic distribution, called a smooth distribution, which is a generalization of both q-bounded distribution and product distribution, and define the learnability under this distribution. Then, we give an algorithm that properly learns FkoTn k under smooth distribution in polynomial time for constant k, where Fk is the class of all Boolean functions of k variables. The class FkoTn k is called the functions of k terms and although it was shown by Blum and Singh to be learned using DNF as a hypothesis class, it remains open whether it is properly learnable under distribution free setting.

AB - Algorithms for learning feasibly Boolean functions from examples are explored. A class of functions we deal with is written as F1 oF2 k = {g(f1(v),...fk(v)) g ∈ F1, f1...,fk ∈ F2} for classes F1 and F2 given by somewhat "simple" description. Letting Γ = {0,1}, we denote by F1 and F2 a class of functions from Γk to Γ and that of functions from Γn to Γ, respectively. For exa.mple, let FOr consist of an OR function of k variables, and let Fn be the class of all monomials of n variables. In the distribution free setting, it is known that FORo Fn k, denoted usually k-term DNF, is not learnable unless P≠NP In this paper, we first introduce a probabilistic distribution, called a smooth distribution, which is a generalization of both q-bounded distribution and product distribution, and define the learnability under this distribution. Then, we give an algorithm that properly learns FkoTn k under smooth distribution in polynomial time for constant k, where Fk is the class of all Boolean functions of k variables. The class FkoTn k is called the functions of k terms and although it was shown by Blum and Singh to be learned using DNF as a hypothesis class, it remains open whether it is properly learnable under distribution free setting.

UR - http://www.scopus.com/inward/record.url?scp=33646907847&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33646907847&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:33646907847

T3 - Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995

SP - 206

EP - 213

BT - Proceedings of the 8th Annual Conference on Computational Learning Theory, COLT 1995

PB - Association for Computing Machinery, Inc

ER -