Results
This pages contains the results of various tests we have performed to determine the reliability and accuracy of the results output by the LSS. Most of these tests are based on the analysis of simulated images as they allow us to compare the outputs against known inputs.
One of the primary goals of GOTO is to accurately measure absolute and differential photometry. As such, a key test for the LSS is to assess how reliably and accurately it can measure source photometry. The LSS provides a number of methods to measure photometry. These include:
- Aperture photometry in a range of circular apertures;
- PSF photometry using the PSF characterised (by the LSS) from selected point sources distributed around the image;
- Kron photometry;
- Gaussian fit photometry, in which a 2D-Gaussian is fit to the source;
- CModel photometry, in which a linear combination of a deVaucouliers and exponential light profile is fit to the source;
While the first two (aperture and PSF) work well for point sources, they typically fail to give reliable results for extended objects. The latter three (Kron, Gaussian, and CModel) have been developed to overcome this problem.
The following plots show the input vs. output magnitudes obtain by running LSS on the simulated image: GOTO_01_20170525_0001_01.fits using v13.0 of the stack. These are the output photometry obtained by running singleFrameDriver.py with commit 7c8419b of obs_goto.
First, aperture photometry using a 12 pixel diameter (i.e., ~15 arcsec diameter) aperture:
There's clearly something odd going on around 16th mag; we've not determined what's going on here. It's possible that for bright sources, some of the flux extends outside the aperture, leading to flux loss, but I don't know why this would like to such an abrupt break. We can investigate this by considering the aperture corrections that the LSS spits out. Another possibility is that those are saturated sources; we can check this using the flags that are output by the stack.
Next, PSF photometry:
This works well for stars (blue points in all plots), but a lot less well for galaxies (red points). Of course, this is somewhat to be expected. Again, there seems to be a problem with sources brighter than (input) 16th mag. It's hard to tell from this image, but it seems that not all of these brightest sources have a measured PSF mag in the LSS output.
Finally (for now) CModel:
We think this produces impressively good magnitudes for both stars and galaxies, with only a handful of outliers at (input) magnitudes fainter than about 16.5 mags. Most of these outliers are galaxies, and for most of them the LSS measures brighter sources than the input. Again, we have the problem of spurious measured magnitudes for sources brighter than 16th mag.
In all of the above cases, there is a systematic offset between the input and measured mags. We need to investigate this further. One possibility is incorrect colour terms in our config files, which would be fairly straightfoward to check and change.
We are currently working on getting the LSS working with real data. On doing so, we'll be able to run the same tests comparing measured mags against archival data.
One of the most effective means of identifying variable and transient sources in imaging data is via the technique of Difference Imaging. This involves subtracting a reference image from the image in which one is attempting to identify variable or transient sources. The LSS has a difference imaging module that aligns, PSF-convolves and flux-matches the reference image, subtracts it, and performs positive and negative source detection and characterisation.
While not really a test, I thought it may be insightful to give an example of a difference image produced by the LSS. The following shows a simulated image (GOTO_01_20170803_0001.fits) on the left and the resulting difference image (produced by subtracting GOTO_01_20170803_0001.fits, which has the same PSF, but shifted astrometrically) on the right. For the record, the latter was produced using commit 7c8419b of obs_goto. Green and red regions indicate the positions of variable and transient sources, respectively.
