2001-10-15 Carlos Jimenez * qpack-0-0-27 * New Q-field: OEM_GA_UPPER_LIMIT to set an upper limit to gamma, some inversions can go funny -numerical problems?-. qcls.m udpated. * New function qcls_batch.m, as qcls but taking as input a structure used to generate a random set instead of y and doing the inversion of all the spectra in the random set. See the function help. * qp_Hd updated by including hRedKx.m and hRedLimb.m as subfunctions, also updated. * qp_H updated, removing do_reduction check and using defalult values from qpack. * qp_rnd_atm and qp_rnd_sensor updated to include the possibility of give a previous random structure Qr to copy rnd realizations for the new Q instead of generating them for Q (valid e.g if Q and Qr have different sensor but the rnd realizations are needed to be the same) * new Q field: LRED_INDTAGS, for the limb reduction, set to 1 uses for in the reduction only the Kx for the corresponding retrieval tag, set to 0 uses the whole Kx. 2001-10-15 Patrick Eriksson * qpack-0-0-26 * Big internal changes, but just small changes in the control files. Starting with Q-field changes: * New Q-field: RETRIEVAL_METHOD The retrieval method must now be specified. So far is 'oem' the only allowed option, but there will bemore later (see below for CLS). * New Q-field: RECALC_ABS_ON See README. Can be left out. * Big news! The do-levels 1 and 2 are now fully working (before it was only do-level 2 for noise that worked). Accordingly, much more variables can now be placed in Se. For variables beside noise, this is done by adding H*Kb*Sb*Kb'*H to Se (for variables with _DO=2). Note that data reduction can be needed to have enough memory. * The inversion characteristion is now handled in a general function called qp_invchar. For CLS, use qpcls_invchar. In the inversion characterization, variables with _DO = 1 or 2 are included in Se. * As Se is not needed for doing an inversion and in the inversion characterization Se can be different, Se is not longer saved by QP_SE and input/output of QP_SE is changed. If you will do an OEM (CLS) inversion, you shall now use QP_SEINV (qp_Seinv). See further below. * OEM functions and folder renamed to CLS. CLS stands for constrained least squares which will be used as a common name for OEM, Tikhonov regularization and (ordinary, weighted) least squares. So far is only OEM handled, but I plan to include the other two options some day (or night, as right now?) in the future. The functions qpcls and qpcls_invchar are used exactly as qpoem and qpoem_invchar. * Some parts are moved out from qpcls and are called qp_x2arts and qp_x2X. * qp_ycalc renamed to qp_y to be consistent. * Started implementation of ground emission but not yet finished. * To summerize, the standard set of function calls to make an OEM inversion is now: qp_Sx(Q); qp_H(Q); qp_Seinv(Q); qpcls(Q,y); To simylate a measurent: y = qp_y(Qy); 2001-10-10 Carlos Jimenez * qpack-0-0-25 * qp_rnd_atm fixed to be able to get parameterizatrions as retrieval tags e.g. rnd realizations of H2O-PWR98 means disturbing H2O profiles, not H2O_PWR98 profiles! 2001-10-09 Carlos Jimenez * qpack-0-0-24 * Changes in qp_rnd_atm, hse added to the rnd realizations, so if Q.HSE_IN_ON is set to 1 and temperature rnd realizations are done, the correponding z_abs for each t_abs fulfill hse according to the Q.HSE fields given in the Q srtucture defining the rnd data. The hse is calculated by arts/ami/physics/hseCalc, mscript that mimics the hse calculations inside arts, to get consistent results. Q.ALTIUDE_DO added in Templates/rnd.tmplt to flag do_z. * Changes in qp_rnd_atm, Q.POINTING_PDF added so the pointing offset can be defined as 'gaussian' or 'uniform'. As it will be nearly always gaussian, as default is set to 'gaussian', so if Q.POINTING_PDF is not given 'gaussian' is assumed. 2001-10-05 Patrick Eriksson * qpack-0-0-23 * Just included some references to AUG in README 2001-09-28 Patrick Eriksson * qpack-0-0-22 * Mainly changes to sync Qpack with all changes in ARTS. * qpoem can be runed for non-linear inversions again. * Continued work on retrieval of continuum absorption, but not finished. * ycalc.tmplt replaced with basic.tmplt. 2001-09-28 Patrick Eriksson * qpack-0-0-21 * Kx is now an output argument beside Dy when calling qpoem with only one input argumnent. 2001-09-27 Carlos Jimenez * qpack-0-0-20 * cleaning in /Main, qp_rnd, qp_rndxH, not in use any more 2001-09-20 Patrick Eriksson * qpack-0-0-20 * Small modifications in qpoem_invchar. The vertical resolution is not longer a return argument. 2001-09-17 Carlos Jimenez * qpack-0-0-19 * qp_rnd_sensor updated _DO > 0 makes realizations 2001-09-17 Carlos Jimenez * qpack-0-0-18 * qp_H saving also Hs (sensor matrix without reduction) * qp_Hd alowing all + hRedKx or hRedLimb * README updated in NUMBER_DO 2001-09-17 Patrick Eriksson * qpack-0-0-17 * Piecewise polynomial baseline fit included (PPOLYFIT). See README for more details. * The code of qp_Sx changed, but not the functionality (I hope). * The code of qp_Se also changed. The definition of the MEASNOISE_DO field changed to be consistent with the other do fields. Calibration noise can now be used again, but there is now no variable to tune the correlation between different viewing angles. A perfect correlation is assumed. * The field APRIORI_VMR_DIR changed to APRIORI_VMR as the field does not give the name of a directory. I know that this results in that you have to change a lot of control files, but this thing has been bugging for a long time and it is better do the change now than later. * The Sample directory updated to work with the new way of defining the thermal noise. 2001-09-03 Carlos Jimenez * qpack-0-0-16 * Big changes!!! * added qp_rnd_atm, qp_rnd_sensor, qp_rnd_atm_sensor mscripts to generate random sets, see the mscripts help to find out about their usage. The qp_rnd, qp_rndxH and qp_rndcheck are removed. The new mscripts do practically the same, but now the random realizations are done by Matlab mscripts, as the corresponidng part in arts is going to be removed. rnd.tmplt has also been updated to remove the old stuff and generate spectra in brightness temperature, after Qpack change of emission unit. * qp_H and qp_Hd slighly modified to allow the use of /ami/hmatrix/hRedKx and /ami/hmatrix/hRedLimb, the 1st one is reduction based on Kx, the 2nd a special reduction to use with limb observations optimized for each retrieval point and tag (obviously only to be used with a suitable reduction method, e.g an ensemble of neural nets). See the hRedKx and hRedLimb help and README for info. Notice that hRedLimb is still under tests, so do not use till further notice. * qp_Se updated to do rnd realizations using mscript sFromFile Major change, definition of measurement noise, check README. Only measurement noise, calibration to be decided how to implement it, other _DO = 2 also not implemented as in original qp_Se. * qp_Sx updated to also use sFromFile polynomial fit incorporated, continua still not implemented. * README is updated detailing new fields and so on. 2001-08-31 Patrick Eriksson * qpack-0-0-15 * The inclusion of polynomial fit finished. * It is now (more?) important to set f_sensor and za_sensor. These files will be used in some cases even if the corresponding sensor part is not included. If the backend or antenna not are included set F_SENSOR=F_MONO or ZA_SENSOR=ZA_PENCIL, respectively. * A bug in qpoem for non-linear inversion found. Not fixed!! 2001-08-31 Patrick Eriksson * qpack-0-0-14 * Started to include polynomial fit of baseline ripple. Not finished. * The unit used now for emission spectra is Rayleigh-Jeans brightness temperature. One reason to this is that the Sx matrix easily is singular when making baseline fits and using intensities. (I have written in AUG that brightness temperatures cannot be used for practical retrievals, but I think that that statement is wrong if the calibration is done correctly. More about this later. For simulations there is no problems.) 2001-08-24 Patrick Eriksson * qpack-0-0-13 * qpoem_inchar has now return variables. 2001-08-06 Carlos Jimenez * qpack-0-012 * /Main/qp_rnd changed so the spectra is saved without any sensor matrix applied, /Main/qp_rndxH added to do the multiplication. Why? Provides flexibility as it is possible to apply a previous reduction from a structure Qi to a new rnd set given by Q. See help. 2001-07-30 Carlos Jimenez * qpack-0-0-11 * Reduction based on weighting functions implemented, qp_Hd.m updated and new ami function/arts/ami/hmatrix/hRedKx.m added. New fields in Q structure KRED_ON, KRED_N, KRED_DEPTH. * Functions to generate random spectra /Main/qp_rnd and corresponding template /Templates/rnd.tmplt added, based on arts methods to generate random realizations, only species, temperature and pointing. They are PROVISIONAL, as a more detailed implementation not relying in arts methods is needed. 2001-06-13 Patrick Eriksson * qpack-0-0-10 * Smaller changes to cfile templates and qpoem. 2001-04-24 Patrick Eriksson * Qpack-0-0-9 * Put in temperature retrieval with HSE. Two new Q fields: PREF and ZREF. * Updated templates to changes in ARTS regarding HSE, the ground and refraction. * Fixed a bug in qpoem_invchar. 2001-04-18 Patrick Eriksson * Qpack-0-0-8 * More work on qpoem. Bugs fixed and some changes for input and output. Test retrievals have been performed for species, pointing off-set and temperature (yet only without hydrostatic eq.). However, the sample case is not suited for temperature retrievals but the iteration seems to work properly. * A maximum number of iterations introduced (OEM_MAX_ITER). * The positive constraint for non-linear species retrievals can now be toggled (SPECIES_POSITIVE_ON). No heavy tests for this option, but so far it looks good. 2001-04-17 Patrick Eriksson * Qpack-0-0-7 * Added functions etc. to easily simulate measurements corresponding to a Q structure. Noise is not yet included. The function doing the work is called qp_ycalc. A suitable Q for this function si found in Sample and it is called ycalc_q. * The Q-fields for the apriori data are renamed. See README. This to make it possible to select VMRs and PTZ from different directories. * Continua added. 2001-04-12 Patrick Eriksson * Qpack-0-0-6 * The OEM retrievals seem to work for species and pointing off-set. No bigger bug checks. 2001-04-11 Patrick Eriksson * Qpack-0-0-5 * Mainly a back-up commit. * I have started to work on the retrieval stuff (qpoem.m etc.) 2001-03-29 Patrick Eriksson * Qpack-0-0-4 * Included: oem_iter1.tmplt, qp_Se.m, qp_kinfo.m, qpi_Kx.m, qp_Hd.m, qpoem_invchar.m and qpoem_iter1.m * Modefied the sample files somewhat to better match Odin. * Changes to README and sample_q 2001-03-26 Patrick Eriksson * Qpack-0-0-3 * Made an organization into sub-folders. * The README file extended and a first version almost ready. * Created a sample case (found in Sample/). 2001-03-21 Patrick Eriksson * Qpack-0-0-2 * First, not finished, version of the README file. 2001-03-19 Carlos Jimenez * Qpack-0-0-1 * Initializing Qpack under cvs