Estimation of Shannon Differential Entropy with Applications: An Extensive Review

Người báo cáo:

Thời gian: 14h Thứ 5, ngày 2/11/2023

Địa điểm: Phòng 507 nhà A6

Tóm tắt: In this work, more than 40 different estimators of the Shannon differential entropy based on different estimation techniques are reviewed. The estimation techniques considered include the sample spacings, kernel density estimation and the k−nearest neighbour. The performance of the estimators based on the three techniques is known to depend on the window size (m), bandwidth (h), and the number of nearest neighbours (k), respectively. Optimal values of these parameters are considered in each technique for different sample sizes and variable dimensions. The estimators are compared empirically through extensive simulation studies. The empirical comparisons are carried out at different sample sizes and different variable dimensions for different groups of continuous distributions. The asymptotic behaviour of the estimators are also compared theoretically for different d−dimensional spaces. Based on the results, different procedures for testing d−dimensional normality are proposed.

Keywords: asymptotic behaviour, extensive simulation, k−nearest neighbour, kernel density estimation, window size spacing, bias and mean square error of an estimator.

Mathematics Subject Classi cation: 62E10; 62G05; 62G20; 62H12.

  Hoạt động tuần
Hội thảo sắp diễn ra
Xuất bản mới
Vo Si Trong Long, Nguyễn Mậu Nam, Jacob Sharkansky, Nguyễn Đông Yên, Qualitative properties of k-center problems, Journal of Optimization Theory and Applications Vol. 207 (2025), Paper 1, 23 pages (SCI-E, Scopus) .
Nguyễn Khoa Sơn, Nguyễn Thị Hồng, Lê Văn Ngọc, Stability conditions for a class of nonlinear timevarying switched systems with delays and sectortype nonlinearities, International Journal of Systems Science, Volume 57(2), (2025), 441-461 (SCI(-E); Scopus) .
Trần Văn Thắng, Lê Xuân Thanh, Đỗ Thị Thùy, A monotonic optimization approach to mixed variational inequality problems, Optimization Letters, Volume 19, pages 1779–1800, (2025) (SCI-E, Scopus) .