Abstract
A system of probably and approximately correct learners of Valiant type that infer concepts from a sample is considered. Each learner had been trained by a sample using the methods of minimizing the empirical error, and no examples are available to the fuser. A majority fuser is known to make the composite system better than the best of the learners in terms of normalized confidence (that corresponds to the same precision value). An analysis of general majority fusers is carried out to obtain bounds on actual and expected errors. Conditions under which the r_of_N fuser performs better, in terms of normalized confidence or precision, than best of the individual learners are obtained. For a special class of statistically independent learners, slightly weaker conditions are obtained. Two fusers that use the location information of a test point are proposed, and are shown to be better than a learner with least empirical error.
Original language | English |
---|---|
Pages (from-to) | 713-727 |
Number of pages | 15 |
Journal | IEEE Transactions on Systems, Man, and Cybernetics |
Volume | 24 |
Issue number | 5 |
DOIs | |
State | Published - May 1994 |
Funding
Manuscript received September 22, 1992; revised June 23, 1993. This paper was funded in part by the Basic Energy Sciences Program, Department of Energy and the Intelligent Systems Program, Office of Naval Research. The first author is partially funded by National Science Foundation under grant #IRI-9 1086 10. The authors gratefully acknowledge the continuing financial support of the learning research by Oscar Manley of the Basic Energy Sciences Program in the Department of Energy and Teresa McMullen in the Intelligent Systems Program of the Office of Naval Research in the Department of Defense. We thank the anonymous reviewer who pointed out errors in the original conditions of Theorem 3.3 and Theorem 3.7. We thank all the anonymous reviewers who contributed to the readability of this paper.
Funders | Funder number |
---|---|
Basic Energy Sciences Program | |
Department of Energy and Teresa McMullen | |
Office of Naval Research in the Department of Defense | |
National Science Foundation | #IRI-9 1086 10 |
Office of Naval Research | |
U.S. Department of Energy |
Keywords
- Computational learnability
- General majority rule location_based fusers
- N-learners problem