kernel density estimation (1d)

 Kernel density estimation is an alternative to histograms for estimating probability density functions (pdf's). Unlike histograms, it is smooth. The basic idea is to add a "kernel" (e.g. a Gaussian) for each point and sum and normalize. Igor does not (yet) support these operations, but 
 FastGaussTransform
can be used to create a wrapper routine. The routine below is a minimal implementation. The attached experiment shows how to use it on simulated data.

Caution: 
 FastGaussTransform
saves time for large n by clustering nearby points. The cluster algorithm needs parameters (e.g., the /RX flag...) and the value chosen here probably does not always work. One symptom of "failure" is a jump discontinuity in the resulting pdf estimate. (It should be smooth.)

kde is particularly nice for 2d (bivariate) data. One advantage is that you can generate smooth contours from the estimated pdf. 
 FastGaussTransform
can handle such data, but it is not implemented below.




Function kde(w,bw)							// 1d kernel density estimation (Gaussian kernel)
	wave w; variable bw                                           // w must not contain NaNs
	variable n=numpnts(w),kde_norm,  xmin=wavemin(w)-2*bw, xmax=wavemax(w)+2*bw
	variable nx = min(round(100*(xmax-xmin)/bw),100)
	make /d/free/n=(n) wweights=1
	FastGaussTransform /WDTH=(bw)/RX=(4*bw) /OUT1={xmin,nx,xmax} w,wweights 	// you may need to tweak /RX flag value
	wave M_FGT;  kde_norm=sum(M_FGT)*deltax(M_FGT);		M_FGT /= kde_norm
	string wn=NameofWave(w)+"_kde";	duplicate /d/o M_FGT $wn 
	killwaves M_FGT
End
kde_demo.pxp (81.16 KB)

Forum

Support

Gallery

Igor Pro 10

Learn More

Igor XOP Toolkit

Learn More

Igor NIDAQ Tools MX

Learn More