aboutsummaryrefslogtreecommitdiff
path: root/noao/imred/crutil/doc/crmedian.hlp
blob: 3147b676e170c818bb483cbc6b77be6a283d2fcc (plain) (blame)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
.help crmedian Apr98 noao.imred.crutil
.ih
NAME
crmedian -- detect, fix, and flag cosmic rays using median filtering
.ih
USAGE   
.nf
crmedian input output
.fi
.ih
PARAMETERS
.ls input
Input image in which to detect cosmic rays.
.le
.ls output
Output image in which cosmic rays are replaced by the median value.
If no output image name is given then no output image will be created.
.le
.ls crmask = ""
Output cosmic ray mask.  Detected cosmic rays (and other deviant pixels)
are identified in the mask with values of one and good pixels with a values
of zero.  If no output cosmic ray mask is given then no mask will be
created.
.le
.ls median = ""
Output median filtered image.  If no image name is given then no output will be
created.
.le
.ls sigma = ""
Output sigma image.  If no image name is given then no output will be
created.
.le
.ls residual = ""
Output residual image.  This is the input image minus the median filtered
image divided by the sigma image.  Thresholds in this image determine the
cosmic rays detected.  If no image name is given then no output will be
created.
.le
.ls var0 = 0., var1 = 0., var2 = 0.
Variance coefficients for the variance model.  The variance model is

.nf
    variance = var0 + var1 * data + var2 * data^2
.fi

where data is the maximum of zero and median pixel value and the variance
is in data numbers.  All the coefficients must be positive or zero.  If
they are all zero then empirical data sigmas are estimated by a percentile
method in boxes of size given by \fIncsig\fR and \fInlsig\fR.
.le
.ls lsigma = 10, hsigma = 3
Positive sigma factors to use for selecting pixels below and above
the median level based on the local percentile sigma.  Cosmic rays will
appear above the median level.
.le
.ls ncmed = 5, nlmed = 5
The column and line size of a moving median rectangle used to estimate the
uncontaminated local image.
.le
.ls ncsig = 25, nlsig = 25
The column and line size of regions used to estimate the uncontaminated
local sigma using a percentile.  The size of the box should contain
of order 100 pixels or more.
.le
.ih
DESCRIPTION
\fBCrmedian\fR detects cosmic rays from pixels deviating by a specified
statistical amount from the median at each pixel.  It outputs and set of
the following: a copy of the input image with cosmic rays replaced by the
median value, a cosmic ray mask identifying the cosmic rays, the median
filtered image, a sigma image where each pixel has the estimated sigma, and
the residual image used in detecting the cosmic rays.

The residual image is computed by subtracting a median filtered version
of the input data from the unfiltered input data and dividing by an
estimate of the pixel sigmas.  The median filter
box size is given by the \fIncmed\fR and \fInlmed\fR parameters.
If a name for the median image is specified the median filtered image
will be output.  The variance at each pixel is determined either from
a variance model or empirically.  If a name for the sigma image is specified
then the sigma values (the square root of the variance) will be output.
If a name for the residual image is given then the residual image
will be output.

The empirical variance model is given by the formula

.nf
    variance = var0 + var1 * data + var2 * data^2
.fi

where data is the maximum of zero and median pixel value and the variance
is in data numbers.  This model can be related to common detector
parameters.  For CCDs var0 is the readout noise expressed as a variance in
data numbers and var1 is the inverse gain (DN/electrons).  The second order
coefficient has the interpretation of flat field introduced variance.

If all the coefficients are zero then an empirical sigma is estimated
as follows.  The input image is divided into blocks of size
\fIncsig\fR and \fInlsig\fR.  The pixel values in a block are sorted
and the pixel values nearest the 15.9 and 84.1 percentiles are
selected.  These are the one sigma points in a Gaussian distribution.
The sigma estimate is the difference of these two values divided by
two.  This algorithm is used to avoid contamination of the sigma
estimate by the bad pixel values.  The block size must be at least 10
pixels in each dimension to provide sufficient pixels for a good estimate
of the percentile points.  The sigma estimate for a pixel is the sigma
from the nearest block.  A moving box is not used for efficiency.

The residual image is divided by the sigma estimate at each pixel.
Cosmic rays are identified by finding those pixels in the
residual image which have values greater than \fIhsigma\fR and bad
pixels with values below \fIlsigma\fR are also identified.

If an output image name is specified then the output image is produced as a
copy of the input image but with the identified cosmic ray pixels replaced
by the median value.  If an output cosmic ray mask is specified a cosmic
ray mask will be produced with values of zero for good pixels and one for
bad pixels.  The cosmic ray mask is used to display the cosmic ray
positions found and the cosmic rays can be replaced by interpolation (as
opposed to the median value) using the task \fIcrfix\fR.

The \fBcrmedian\fR detections are very simple and do not take into account
real structure with scales of a pixel.  Thus this may clip the cores of
stars and narrow nebular features in the data.  More sophisticated
algorithms are found in \fBcosmicrays\fR, \fIcraverage\fR, and
\fBcrnebula\fR.  The median, sigma, and residual images are available as
output to evaluate the various aspects of the algorithm.
.ih
EXAMPLES
This example illustrates using the \fBcrmedian\fR task to
give a cosmic ray removed image and examining the results with an image
display.  The image is a CCD image with a readout noise of 5 electrons
and a gain of 3 electrons per data number.  This implies variance
model coefficients of

.nf
    var0 = (5/3)^2 = 2.78
    var1 = 1/3 = 0.34
.fi

.nf
    cl> display obj001 1                  # Display in first frame
    cl> # Determine output image, cosmic ray mask, and residual image
    cl> crmedian obj001 crobj001 crmask=mask001 resid=res001\
    >>> var0=2.78 var1=0.34
    cl> display crobj001 2                # Display final image
    cl> display mask001 3 zs- zr- z1=-1 z2=2 # Display mask
    cl> display res001 4 zs- zr- z1=-5 z2=5  # Display residuals
.fi

By looking at the residual image the sigma clippig threshold can be
adjusted and the noise parameters can be tweaked to minimize clipping
of real extended structure.
.ih
SEE ALSO
cosmicrays, craverage, crnebula, median, crfix, crgrow
.endhelp