Schema metadata for catalogdb

[albireox]

This is a first pass at generating complete schema metadata for catalogdb. Most tables and columns are now there, copied from minidb_docs but a number of them are still missing. These roughly fall in two categories:

• Tables/models that had not been released yet in DR19 and that don't have minidb information.
• Columns that are arrays in catalogdb but that were unpacked into multiple columns in minidb and the column names don't match. For these we do have descriptions in minidb but they need to be manually updated.

Another caveat is that the display_name is just the same as column_name. It would take a lot of effort to manually add a display name for all columns, so I think we should only do it for special cases.

Here's the list of columns/tables that still need fixing:

Warning: Model for table 'version' not found in docs. Adding stub.
Warning: Model for table 'catalog_ver25_to_ver31_full_unique' not found in docs. Adding stub.
Warning: Model for table 'catalog_ver25_to_ver31_full_all' not found in docs. Adding stub.
Warning: Model for table 'target_non_carton' not found in docs. Adding stub.
Warning: Model for table 'bailer_jones_edr3' not found in docs. Adding stub.
Warning: Model for table 'erosita_superset_v1_agn' not found in docs. Adding stub.
Warning: Model for table 'erosita_superset_v1_clusters' not found in docs. Adding stub.
Warning: Model for table 'erosita_superset_v1_stars' not found in docs. Adding stub.
Warning: Model for table 'erosita_superset_v1_compactobjects' not found in docs. Adding stub.
Warning: Model for table 'elbadry_rix' not found in docs. Adding stub.
Warning: Model for table 'twomass_xsc' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr2_source_g_lt_18' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_source' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_source' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_source_g_lt_16' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr2_neighbourhood' not found in docs. Adding stub.
Warning: Model for table 'gedr3spur_main' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_allwise_best_neighbour' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_allwise_neighbourhood' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_panstarrs1_best_neighbour' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_panstarrs1_neighbourhood' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_ravedr6_best_neighbour' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_ravedr6_neighbourhood' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_sdssdr13_best_neighbour' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_sdssdr13_neighbourhood' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_skymapperdr2_best_neighbour' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_skymapperdr2_neighbourhood' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_tmass_psc_xsc_best_neighbour' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_tmass_psc_xsc_best_neighbour2' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_tmass_psc_xsc_neighbourhood' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_tycho2tdsc_merge_best_neighbour' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_tycho2tdsc_merge_best_neighbour2' not found in docs. Adding stub.
Warning: Model for table 'gaia_edr3_tycho2tdsc_merge_neighbourhood' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr2_clean' not found in docs. Adding stub.
Warning: Model for table 'galex_gr7_gaia_dr3' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_astrophysical_parameters' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_xp_summary' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_xp_continuous_mean_spectrum' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_xp_sampled_mean_spectrum' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_qso_candidates' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_galaxy_candidates' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_synthetic_photometry_gspc' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_vari_agn' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_vari_rrlyrae' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_nss_two_body_orbit' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_nss_acceleration_astro' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr3_nss_non_linear_spectro' not found in docs. Adding stub.
Warning: Model for table 'galah_dr3' not found in docs. Adding stub.
Warning: Model for table 'visual_binary_gaia_dr3' not found in docs. Adding stub.
Warning: Model for table 'lamost_dr6' not found in docs. Adding stub.
Warning: Model for table 'wd_gaia_dr3' not found in docs. Adding stub.
Warning: Model for table 'kepler_input_10' not found in docs. Adding stub.
Warning: Model for table 'cantat_gaudin_table1' not found in docs. Adding stub.
Warning: Model for table 'cantat_gaudin_nodup' not found in docs. Adding stub.
Warning: Model for table 'sagitta_edr3' not found in docs. Adding stub.
Warning: Column 'guidenums1' not found in docs for 'sdssv_plateholes_meta'.
Warning: Column 'guidemag_minmax' not found in docs for 'sdssv_plateholes_meta'.
Warning: Column 'reddeningmed' not found in docs for 'sdssv_plateholes_meta'.
Warning: Column 'mfd_mag' not found in docs for 'sdssv_plateholes'.
Warning: Column 'usnob_mag' not found in docs for 'sdssv_plateholes'.
Warning: Column 'sp_params' not found in docs for 'sdssv_plateholes'.
Warning: Column 'sp_param_err' not found in docs for 'sdssv_plateholes'.
Warning: Column 'psfflux' not found in docs for 'sdssv_plateholes'.
Warning: Column 'psfflux_ivar' not found in docs for 'sdssv_plateholes'.
Warning: Column 'fiberflux' not found in docs for 'sdssv_plateholes'.
Warning: Column 'fiberflux_ivar' not found in docs for 'sdssv_plateholes'.
Warning: Column 'fiber2flux' not found in docs for 'sdssv_plateholes'.
Warning: Column 'fiber2flux_ivar' not found in docs for 'sdssv_plateholes'.
Warning: Column 'psfmag' not found in docs for 'sdssv_plateholes'.
Warning: Column 'fibermag' not found in docs for 'sdssv_plateholes'.
Warning: Column 'fiber2mag' not found in docs for 'sdssv_plateholes'.
Warning: Column 'mag' not found in docs for 'sdssv_plateholes'.
Warning: Column 'calibflux' not found in docs for 'sdssv_boss_spall'.
Warning: Column 'calibflux_ivar' not found in docs for 'sdssv_boss_spall'.
Warning: Column 'mag' not found in docs for 'sdssv_boss_spall'.
Warning: Column 'tcolumn' not found in docs for 'sdssv_boss_spall'.
Warning: Column 'theta' not found in docs for 'sdssv_boss_spall'.
Warning: Column 'sn_median' not found in docs for 'sdssv_boss_spall'.
Warning: Column 'fracnsigma' not found in docs for 'sdssv_boss_spall'.
Warning: Column 'fracnsighi' not found in docs for 'sdssv_boss_spall'.
Warning: Column 'fracnsiglo' not found in docs for 'sdssv_boss_spall'.
Warning: Column 'spectroflux' not found in docs for 'sdssv_boss_spall'.
Warning: Column 'spectroflux_ivar' not found in docs for 'sdssv_boss_spall'.
Warning: Column 'spectrosynflux' not found in docs for 'sdssv_boss_spall'.
Warning: Column 'spectrosynflux_ivar' not found in docs for 'sdssv_boss_spall'.
Warning: Column 'spectroskyflux' not found in docs for 'sdssv_boss_spall'.
Warning: Model for table 'sdss_dr13_photoobj' not found in docs. Adding stub.
Warning: Model for table 'sdss_dr16_apogeevisit' not found in docs. Adding stub.
Warning: Model for table 'sdss_dr16_apogeestar' not found in docs. Adding stub.
Warning: Model for table 'sdss_dr16_apogeestarvisit' not found in docs. Adding stub.
Warning: Model for table 'sdss_dr16_apogeestarallvisit' not found in docs. Adding stub.
Warning: Column 'nvisit_apstar' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'weights' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'location_id' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'commiss' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'param' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'param_cov' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'fparam' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'fparam_cov' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'param_symbol' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'x_h' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'x_h_err' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'felem' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'felem_err' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'elem_symbol' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'felemtoh' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'dist_srclist' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'jd' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'rv' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'rv_err' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'rv_src' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'snr' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'fiberid' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Column 'visit_pk' not found in docs for 'sdss_apogeeallstarmerge_r13'.
Warning: Model for table 'sdss_dr14_specobj' not found in docs. Adding stub.
Warning: Model for table 'sdss_dr14_qso' not found in docs. Adding stub.
Warning: Model for table 'sdss_dr17_apogee_allplates' not found in docs. Adding stub.
Warning: Model for table 'sdss_dr17_apogee_allstarmerge' not found in docs. Adding stub.
Warning: Model for table 'sdss_dr17_apogee_allvisits' not found in docs. Adding stub.
Warning: Model for table 'sdss_dr19p_speclite' not found in docs. Adding stub.
Warning: Column 'designation2' not found in docs for 'tycho2'.
Warning: Model for table 'mwm_validation_hot_catalog' not found in docs. Adding stub.
Warning: Model for table 'twoqz_sixqz' not found in docs. Adding stub.
Warning: Model for table 'zari18ums' not found in docs. Adding stub.
Warning: Model for table 'xpfeh_gaia_dr3' not found in docs. Adding stub.
Warning: Column 'dchisq' not found in docs for 'legacy_survey_dr8'.
Warning: Model for table 'legacy_survey_dr10a' not found in docs. Adding stub.
Warning: Model for table 'legacy_survey_dr10' not found in docs. Adding stub.
Warning: Column 'fibermag' not found in docs for 'ebosstarget_v5'.
Warning: Column 'fiber2mag' not found in docs for 'ebosstarget_v5'.
Warning: Column 'calib_status' not found in docs for 'ebosstarget_v5'.
Warning: Column 'psf_fwhm' not found in docs for 'ebosstarget_v5'.
Warning: Column 'psfflux' not found in docs for 'ebosstarget_v5'.
Warning: Column 'psfflux_ivar' not found in docs for 'ebosstarget_v5'.
Warning: Column 'extinction' not found in docs for 'ebosstarget_v5'.
Warning: Column 'fiberflux' not found in docs for 'ebosstarget_v5'.
Warning: Column 'fiberflux_ivar' not found in docs for 'ebosstarget_v5'.
Warning: Column 'fiber2flux' not found in docs for 'ebosstarget_v5'.
Warning: Column 'fiber2flux_ivar' not found in docs for 'ebosstarget_v5'.
Warning: Column 'modelflux' not found in docs for 'ebosstarget_v5'.
Warning: Column 'modelflux_ivar' not found in docs for 'ebosstarget_v5'.
Warning: Column 'modelmag' not found in docs for 'ebosstarget_v5'.
Warning: Column 'modelmag_ivar' not found in docs for 'ebosstarget_v5'.
Warning: Model for table 'bhm_spiders_generic_superset' not found in docs. Adding stub.
Warning: Model for table 'gaia_dr2_wd_sdss' not found in docs. Adding stub.
Warning: Model for table 'gaia_qso' not found in docs. Adding stub.
Warning: Model for table 'catwise' not found in docs. Adding stub.
Warning: Model for table 'catwise_reject' not found in docs. Adding stub.
Warning: Model for table 'watchdog' not found in docs. Adding stub.
Warning: Model for table 'blackcat' not found in docs. Adding stub.
Warning: Model for table 'xray_pulsars' not found in docs. Adding stub.
Warning: Model for table 'lmxb' not found in docs. Adding stub.
Warning: Model for table 'galactic_millisecond_pulsars' not found in docs. Adding stub.
Warning: Model for table 'transitional_msps' not found in docs. Adding stub.
Warning: Model for table 'atnf' not found in docs. Adding stub.
Warning: Model for table 'skymapper_dr1_1' not found in docs. Adding stub.
Warning: Model for table 'ps1_g18' not found in docs. Adding stub.
Warning: Model for table 'bhm_csc_v3' not found in docs. Adding stub.
Warning: Model for table 'glimpse360' not found in docs. Adding stub.
Warning: Column 'sn_median' not found in docs for 'bhm_efeds_veto'.
Warning: Column 'spectroflux' not found in docs for 'bhm_efeds_veto'.
Warning: Column 'spectroflux_ivar' not found in docs for 'bhm_efeds_veto'.
Warning: Model for table 'mipsgal_extra' not found in docs. Adding stub.
Warning: Column 'pk' not found in docs for 'tess_toi_v05'.
Warning: Model for table 'tess_toi_v1' not found in docs. Adding stub.
Warning: Model for table 'xmm_om_suss_5_0' not found in docs. Adding stub.
Warning: Model for table 'hecate_1_1' not found in docs. Adding stub.
Warning: Model for table 'milliquas_7_7' not found in docs. Adding stub.
Warning: Column 'psfmag_des' not found in docs for 'bhm_rm_v0'.
Warning: Column 'psfmagerr_des' not found in docs for 'bhm_rm_v0'.
Warning: Column 'mag_auto_des' not found in docs for 'bhm_rm_v0'.
Warning: Column 'magerr_auto_des' not found in docs for 'bhm_rm_v0'.
Warning: Column 'imaflags_iso' not found in docs for 'bhm_rm_v0'.
Warning: Column 'psfmag_ps1' not found in docs for 'bhm_rm_v0'.
Warning: Column 'psfmagerr_ps1' not found in docs for 'bhm_rm_v0'.
Warning: Column 'kronmag_ps1' not found in docs for 'bhm_rm_v0'.
Warning: Column 'kronmagerr_ps1' not found in docs for 'bhm_rm_v0'.
Warning: Column 'infoflag2' not found in docs for 'bhm_rm_v0'.
Warning: Column 'mag_nsc' not found in docs for 'bhm_rm_v0'.
Warning: Column 'magerr_nsc' not found in docs for 'bhm_rm_v0'.
Warning: Column 'psfmag_sdss' not found in docs for 'bhm_rm_v0'.
Warning: Column 'psfmagerr_sdss' not found in docs for 'bhm_rm_v0'.
Warning: Column 'modelmag_sdss' not found in docs for 'bhm_rm_v0'.
Warning: Column 'modelmagerr_sdss' not found in docs for 'bhm_rm_v0'.
Warning: Column 'mag_gaia' not found in docs for 'bhm_rm_v0'.
Warning: Column 'magerr_gaia' not found in docs for 'bhm_rm_v0'.
Warning: Column 'mag_unwise' not found in docs for 'bhm_rm_v0'.
Warning: Column 'magerr_unwise' not found in docs for 'bhm_rm_v0'.
Warning: Column 'flags_unwise' not found in docs for 'bhm_rm_v0'.
Warning: Column 'mag_ir' not found in docs for 'bhm_rm_v0'.
Warning: Column 'magerr_ir' not found in docs for 'bhm_rm_v0'.
Warning: Column 'des_var_nepoch' not found in docs for 'bhm_rm_v0'.
Warning: Column 'des_var_status' not found in docs for 'bhm_rm_v0'.
Warning: Column 'des_var_rms' not found in docs for 'bhm_rm_v0'.
Warning: Column 'des_var_sigrms' not found in docs for 'bhm_rm_v0'.
Warning: Column 'des_var_sn' not found in docs for 'bhm_rm_v0'.
Warning: Column 'ps1_var_nepoch' not found in docs for 'bhm_rm_v0'.
Warning: Column 'ps1_var_status' not found in docs for 'bhm_rm_v0'.
Warning: Column 'ps1_var_rms' not found in docs for 'bhm_rm_v0'.
Warning: Column 'ps1_var_sigrms' not found in docs for 'bhm_rm_v0'.
Warning: Column 'ps1_var_sn' not found in docs for 'bhm_rm_v0'.
Warning: Model for table 'bhm_rm_v1' not found in docs. Adding stub.
Warning: Column 'mag' not found in docs for 'bhm_rm_tweaks'.
Warning: Column 'ref_epoch' not found in docs for 'gaia_assas_sn_cepheids'.
Warning: Model for table 'rave_dr6_gauguin_madera' not found in docs. Adding stub.
Warning: Model for table 'rave_dr6_xgaiae3' not found in docs. Adding stub.
Warning: Column 'catalogid31' not found in docs for 'sdss_id_stacked'.
Warning: Model for table 'gaia_stellar_parameters' not found in docs. Adding stub.
Warning: Model for table 'marvels_dr11_velocitycurve_ccf' not found in docs. Adding stub.
Warning: Model for table 'marvels_dr11_velocitycurve_dfdi' not found in docs. Adding stub.
Warning: Column 'pk' not found in docs for 'marvels_dr12_star'.
Warning: Model for table 'marvels_dr12_velocitycurve_uf1d' not found in docs. Adding stub.
Warning: Model for table 'too_target' not found in docs. Adding stub.
Warning: Model for table 'too_metadata' not found in docs. Adding stub.
Warning: Model for table 'catalog_from_sdss_dr19p_speclite' not found in docs. Adding stub.
Warning: Column 'added_by_phase' not found in docs for 'catalog_to_allstar_dr17_synspec_rev1'.

Fixes #263

[albireox]

@havok2063 I think this is at the stage of what we can do without manually having to go over each column with missing descriptions. There are many v1 tables that don't have documentation but will after DocuCharm. We can merge now and update those later or wait until we have them.

Let me know if there are tables with missing columns that are important and I can add those now.

[havok2063]

This looks good to me. I think I mostly want the parent catalog tables so I can add descriptions in Zora to those columns in the Sources tab under "Parent Catalogs".

I'm ok merging now and doing another pass after DocuCharm.