Skip to content

Results

James Mullaney edited this page Aug 2, 2017 · 29 revisions

The results of tests of the LSST Software Stack outputs

This pages contains the results of various tests we have performed to determine the reliability and accuracy of the results output by the LSS. Most of these tests are based on the analysis of simulated images as they allow us to compare the outputs against known inputs.

Photometric accuracy

One of the primary goals of GOTO is to accurately measure absolute and differential photometry. As such, a key test for the LSS is to assess how reliably and accurately it can measure source photometry. The LSS provides a number of methods to measure photometry. These include:

  • Aperture photometry in a range of circular apertures;
  • PSF photometry using the PSF characterised (by the LSS) from selected point sources distributed around the image;
  • Kron photometry;
  • Gaussian fit photometry, in which a 2D-Gaussian is fit to the source;
  • CModel photometry, in which a linear combination of a deVaucouliers and exponential light profile is fit to the source;

While the first two (aperture and PSF) work well for point sources, they typically fail to give reliable results for extended objects. The latter three (Kron, Gaussian, and CModel) have been developed to overcome this problem.

The following plots show the input vs. output magnitudes obtain by running LSS on the simulated image: GOTO_01_20170525_0001_01.fits using v13.0 of the stack. These are the output photometry obtained by running singleFrameDriver.py with commit 7c8419b of obs_goto.

First, aperture photometry using a 12 pixel diameter (i.e., ~15 arcsec diameter) aperture: There's clearly something odd going on around 16th mag; we've not determined what's going on here. It's possible that for bright sources, some of the flux extends outside the aperture, leading to flux loss, but I don't know why this would like to such an abrupt break. We can investigate this by considering the aperture corrections that the LSS spits out.

Next, PSF photometry: This works well for stars (blue points in all plots), but a lot less well for galaxies (red points). Of course, this is somewhat to be expected. Again, there seems to be a problem with sources brighter than (input) 16th mag. It's hard to tell from this image, but it seems that not all of these brightest sources have a measured PSF mag in the LSS output.

Finally (for now) CModel: We think this produces impressively good magnitudes for both stars and galaxies, with only a handful of outliers at (input) magnitudes fainter than about 16.5 mags. Most of these outliers are galaxies, and for most of them the LSS measures brighter sources than the input. Again, we have the problem of spurious measured magnitudes for sources brighter than 16th mag.

In all of the above cases, there is a systematic offset between the input and measured mags. We need to investigate this further. One possibility is incorrect colour terms in our config files, which would be fairly straightfoward to check and change.

We are currently working on getting the LSS working with real data. On doing so, we'll be able to run the same tests comparing measured mags against archival data.

Clone this wiki locally