EPN-TAP Services

Atmospheres

√ Check descriptions
√ Enlarge contents
√ Remove duplicates!
√ TAP parameters reviewed

Rewrite with mixin (required to fix coord UCDs)

Correct existing file names

√ Added new series of profiles from C. Mathé

Update of older files scheduled ~ mid 2020 - refined inversion method, either as replacement or addition, TBD

New data provided end 2019

Formerly called Titan 

Updated to v2 in 2016, to be tested again

Mixin version installed Jan 2020

Enlarged with new data, May 2021 (x2.5 content)

voparis-gitlab

— beware that older Titan service is also present there!

Access to spectral cubes. Venus-Express legacy

nb of granules : ~ 50,000 calibrated/geometry files
+ possibly derived products (maps, profiles, etc)

√ Complete data description with geometry, enlarge to the complete dataset. Intended as a demonstrator of both EPN-TAP access to the PSA, and data handling / distribution system in a PI team for an experiment in operation phase (would replace the Otarie/ION system in Meudon for data access).

In the mid-term, this could include derived products, which are not in the PSA.

? May start with Marcq et al paper 2023, need to recover the major results.

• v1 addressing part of nominal mission, limited nb of parameters
+ some inconsistencies

• First v2 version for nominal mission (2016), param from archive INDEX - still does not use the mixin.

• June 2020 version: uses the mixin and get data from the PI database. One part of geometry missing, still to be recovered entirely.

√ Also need to work on footprints — MOC added in 2022 (in coverage param)

Prospects:
• May include cruise phase, which is not in the PSA? That would require to make the files available somewhere (could be the PSA extra area?)

IAA-CSIC

Granada

First model in v2 from Toulouse 2016 VESPA workshop

Updated for DaCHS2 in 2021

Vertical profiles of Mars

May be coupled with ACRI-ST project in EPN2024, including a visu tool on a web page.

√ Number of issues identified afterwards, including extra table not integrated.

√ 2021 update to be reviewed

First simple / complete datalink example.

√ Provides links to MCD simulation + ascii version of the profile.

√ Convert to DaCHS2

v2 direct from Toulouse 2016 workshop.

Update from Prague workshop, 2018.

New update 2021, with direct links to simulation; v2 compliant.

First version on sampled data, access to vertical profiles only, reviewed.

Issues fixed later on

Add daily cycles and √ maps (in another service)?
√ Add more scenarios.
√ In a second step, direct access through workflow will be studied (OK via datalink)

√ Profiles contain all species/dust (to limit the # of granules)

√ Convert to DaCHS2

Issue with access time to be solved

v2 installed from Toulouse 2016 VESPA workshop

Update from Prague workshop, 2018.

New update in 2021; DaCHS v2 compliant, more scenarios + datalink

First version on sampled data, access to vertical profiles only, reviewed.

Issues fixed later on

√ Fix issue with Ls vs Martian sols in cubes

In 2021; DaCHSv2 compliant

First version on sampled data, access to vertical profiles only, reviewed.

DaCHS2 compliant

Profiles only

Less granules, no Ls sampling. Scenarios for UV flux and cloud albedo patterns

In 2021; DaCHSv2 compliant

Oct 2016: P. Rannou suggests to contact S. Lebonnois for his more modern 3D code.

Alt, 2020: the team is building a db of precomputed profiles - could be distributed as a data service

Only available as a code for the time being, no interface.

May be a candidate for integration on a code-on-line platform.

VIMS/Cassini calibrated cubes, satellites only
Catalogue of cubes with description, thumbnails, links to PDS raw and ISIS3 calibrated cubes + possibly geotiff format

Small bodies

PADC/LESIA

S. Erard with J. Crovisier

√ Restructure with mixin, clean up, check parameters and UCDs (not yet published)

√ Deep review in spring 2019: spectra, thumbnails, granule list (remove duplicates & identify upper limits when no detection)

√ Big update, 2021:
• All fits & thumbs rebuilt from txt files, in velocity 
• removed low level data
• Cleaned up upper limits
• added recent observations (15 yr of data)

• Still uses the initial parsing system of all files and tables, all further steps now integrated in a single IDL routine producing a csv file

• freq_min and max to be cleaned up — but two spectral ranges added, hence…

√ Pending review with science team, but should be OK

• Add ephemeris in table?

Updated to EPN-TAP v2

Needs update to DaCHS 2.5

√Check descriptions,
√update VOtable format / script,
√ add thumbnails

2019: 
Update with new content
Add import script on crontab
Other small things to fix, in particular VOtable conversion script

• March 2019: rebuilt with mixin + restored data loss.

• March 2019: frozen in July 2015 - the source database seems inactive in Aug. 2022. Additional spectra are now fed into spectro_asteroids

updated to v2.

√ Restructure, Check descriptions, Update server.

√ Added thumbnails and spectra when available.

√ Update presentation web page, the current one is missing!

• Data and thumbnails out of reach (July 2019)?

Must be reinstalled on OATS DaCHS server

Need to clean up registry: There are still 2 declarations of the same service in the registry!!!

+ Revive associated data (images & spectra)

√ Check descriptions,
√ add phase angle
√ Add thumbnails
√ To be rebuild with mixin & grammar

Add better thumbnails!

Descriptors updated April 2016, new web page Sept 2017.

Updated to mixin/grammar, Dec 2017, then small updates

First v2 test case (old way). 

√ Make it consistent with M4ast, MPCOrb and DynAstVO.

Check some parameters

Classes of small bodies still to be refined

√ Finalize, add data, declare.
√ Identify correct dataproduct_type, see if extra param are required for sub-observer point.
Handle 3D format?

√ Add computed orbits as spice files, open in Cosmographia or similar.
Enlarge to other objects (MBA)?

√ Register

√ Updated in Aug 2018 (missing param, updates, kernels)

Spice kernels are usable in Cosmographia (manually on user's end) and 3Dview (if they are installed on the server part)

Directly in v2 from computation results

√ Provide epn_core view on existing TAP service in Heidelberg
√ Check if monthly updates still active
• Check parameters + change encoding of names (with no number)
√ Fix date format

First experiment with EPN-TAP2 mixin

Still to be refined in 2022.

Catalogue of asteroids properties, from IR observations (H2020 programme)

Initially ~ 60,000 obs (several/target)
2019: 170,000 measurements and growing

√ To be reviewed and finalized

√ Restarted in 2019 from outputs of the native web interface

VESPA 2018 Prague workshop

Finalized Feb 2020 (in EPN2024)

Build the table

Get data files, adjust M4ast conversion routine

Should be very similar to M4ast

Amateur site (high level) with > 16000 images (+ some spectra included).

Includes db and submission system

Simply write an EPN-TAP view with daily updates from existing db?

Other similar db to be studied too.

Spitzer thermal-infrared fluxes of near-Earth asteroid from ExploreNEOs, NEOSurvey, and NEOLegacy (~2000 asteroids).
Seems to be this https://arxiv.org/pdf/1906.07284.pdf (TBC)

Images of Sun grazing comets from the SoHO spacecraft / LASCO instrument

The main idea is to test a service with fits images only, and handling in VO tools.

This one is a simple test case.

Relies on TAPlib - interface study by PLS in July 2017; then crashed due to local system and lack of resources.

√ Redesigned in Jan 2022 on DaCHS

Small Main-Belt Asteroid Spectroscopic Survey

Binzel et al VNIR spectra of asteroids

http://smass.mit.edu/smass.html

Based on M4ast, very similar data

Coupled with "MIT-UH-IRTF Joint Campaign for NEO Spectral Reconnaissance" on the same site.

Plots/thumbnails have to be regenerated individually in PNG.

Physical properties of (some) NEOs

http://earn.dlr.de/nea/table1_new.html

Closed: this page no longer exists, the db has been integrated into ESRIN NEO Space Situational Awareness service: http://neo.ssa.esa.int/neo-home (may be accessed through MP3C?)

2020: May be resurrected through NEOROCKS 

Includes a (spectral) taxonomy type. Some duplication of MPC parameters (can be filtered out?)

Regularly updated on-line.
Related somehow to the NEOshield-2 EU program

Table is easy to enter (note that Binary objects, noted B in 1rst column, have 2 entry lines; only the first one is relevant).

Each object has a detailed page with extensive biblio that cannot be included in the table - should be linked with external_link parameter)

Database from the FRIPON system.

May include detection images, trajectories, orbits, sample analyses, and possibly GRAVE radar periodograms (also used for atmosphere / aerosols studies)

Test case for fireball detection networks

Identified content:
- table of events/detection/objects
- will include detection from multi or single camera (those for cross-detection with other networks)
- include external_link to web site page with detailed info

Other data may include (short-term): 
- VOevent alarm system
- meteor showers on Earth: orbits, etc

Just provide images and plots of operations / acquisition? This would be a different demonstrator of EPN-TAP service in support to an experiment in operation:

• granules = MTPs or STPs. Link to ancillary images / plots (SE material) - wait for regeneration of overall geometry (in EPN2024)?
• granules = files. Link to synthetic surface-related images (BR material)

The file service can be adapted from VVEx service; wait for final dataset to be accommodated on the PSA?

An ST-MOC would be very helpful. Requires s_region first

Extension to individual spectra has a major added value, but same pb as VEx: huge number of records, ingestion via DaCHS is too slow.

To be installed in Brasil ?

Draft based on Xcel output on Brasilian site. To be improved for updates

From several VizieR catalogues, granules are individual spectra (not always/easily accessible from VizieR tables, and not searchable from there)

Routine to include ephemeris in table embedded in q.rd, implemented but not used yet.

Link to VizieR fits when available, basic VOtable version computed otherwise;  thumbnails computed. EPNCore parameters retrieved from papers when needed (available tables are often not the ones describing the observations)

• Nov 2022: Added the Mahlke et al 2022 paper, collecting most quality spectra available to date — timing is not available in published version, see with team if this completed at some point

Surfaces

√ Completed to entire dataset
√ finalize s_region for plots in Aladin
√ Check descriptions

√ Check s_region again (they have changed)

Reworked by Markus, 2020. Test service for MOC footprints

To be completed with revised version from GEOPS

Still needs adjustments for consistency with Mars_craters

Revised version of bd at GEOPS, paper submitted to Icarus (2019).
Untimely published, then removed until publication of paper. Restored 2021

√ Check data access
√ Check descriptions

Imaging spectroscopy of Mars, WMS access

(planetServer version)

√ Check data access
√ Check descriptions
√ Description agreed with PDS geosciences, 2019

Completed to entire dataset (again)
Remove wvl parameter ? Add a file via datalink

Model for GIS-VO bridge (WCS) and QGIS plugins (working in May 2017)

Changed name according to review board request, 2019 (formerly CRISM)

√ Provide coefficient for calibration in radiance and reflectance

√ Provide min/max viewing angles ?

M3 / CHANDRAYAAN-1 cubes

Imaging spectroscopy of the Moon, WMS access

(planetServer version)

Changed name according to review board request, 2019 (formerly M3)

Off-line after publication, TBC

Pangaea-X 2017 data

gernot.groemer@oewf.org
nina.sejkora@oewf.org

√ Review details

Optimize format

Review details

Identify ivoID of provider

From Öhman 2015?

In 2021; v2 compliant

Only 2 maps

https://planetarymapping.wordpress.com/

=> http://planetarymapping.elte.hu

http://www.europlanet-eu.org/european-planetary-mapping-a-worldwide-historical-view-of-our-solar-system/

From an Xcel file, parsing is difficult but feasible. Include extra images and photographs.

To be finalized

From Tanaka latest global map? https://pubs.usgs.gov/sim/3292/
See file SIM3292_Global_Geology.shp
- but we want it split in connected units (they are actually contacts, or overlayed surfaces)

Actual info is s_region contours + region properties.

Granules should be connected units to make it efficient

voparis-gitlab?

There is a placeholder called mars_geological_map under PADC/planeto

Solid spectroscopy

PDS spectral lib

√ Define (spectral) extension to describe minerals. Can be enlarged with other open mineral spectroscopy db - either in the same service or separately, this is mostly a political decision

• Big issue with grain size, source is hill-formed

√ To be studied with SSHADE & DLR emission database & external contributors.
Uses mixin/CSV grammar

Beware that the database is now deprecated on PDS side, replaced by the complete RELAB database

√ Finalize, review

Publish (policy issue at DLR)

Publish (policy issue at DLR)

Potantially the first Europanet TA database

Uses mixin/CSV grammar.

Uses DaCHS Docker version

Spectroscopy of ices and minerals. A set of ~ 20 evolving databases (including GhoSST).

Alternative access to SSHADE service from VESPA interface. Focus first on reflectance spectra?

√ Spectro / sample descriptors required. Need to check/request new UCDs.

First Europanet TA database published.

Regular update required - connection to primary db.

Make it usable in CASSIS and SPLAT-VO (OK for spectra)

Large spectral library (in XLS files)

Ed Cloutis, Winnipeg Univ.

Parse Xcel files: metadata, then spectra

To be finalized - try on 1 pyroxene file, this is inferno ;(

Contacted at EPSC2018.

Rome 2019 workshop

Magnetospheres / radio

√ check server
√ Check descriptions,
√ Check data type handling (returns results for spectrum, but only dynamic_spectrum included?)
√ Add param saying if data are in the magnetosphere, solar wind, or both

Updated to v2

Support for long time series (HAPI interface)

Redesigned Dec 2022

√ Check descriptions

? access_url should point to spectra, not to images of spectra (spectra are under native_access_url)

Reference for EPN-TAP extension to auroral data. Get data selection from Hisaki service, reformatted (Nov 2017)

New data from Cassini UVIS, oct 2019

updated to v2, then refreshed (no mixin)

NDA

Jupiter decametric radio observations from Nançay.
Part of JUNO-Ground-Radio Observation Support.

Solar data added in 2021

Daily updates.

(formerly JupiterDAM then NDA, then RoutineJupiter)

Extended to solar data, March 2021 ~ 2x content (but nb of granules reduced with datalink)

√ Updated to v2, to be tested

√ Something to fix about datalink

√ Dec 2022: Added NewRoutine and Mefisto data

Updated to v2

Will be replaced by several services from PDS/PPI

√ Add radius as parameter

Add new simulations?

Distribute data both in matlab and netCDF format

Work on tool connection for reading / visu

Part of MASER services

Name to be changed

Enlargement in AMDA studied during Graz meeting

 Retired in 2022 after server crash 

updated to v2

Will be replaced by Lathys service in LATMOS

LatHyS

• Content is entirely included in PSA, no additional info in this early draft

• Retired in 2022 after server crash — was duplicating the PSA anyway 

√ Fix issue with server & updates

Fix formatting issues

Data is updated every night, after daily observation

(formerly called Iitate)

Updated to v2, being tested

Finalize, add calibrated data
√ APIS extension compliance (May 2017)

√ Some non-compliances corrected (Dec 2017)

But some remain

Regularly synchronized with APIS (from Nov 2017)

Updated by periods; latest ones not accessible (proprietary)

Transplanet

√ To be populated? (last data are from 2015)

THMSM

Mex_Marsis_ne

MarsExpress / MARSIS

Measurements under 2 different polarization directions

• there is also a lofar_jupiter_raw.epn_core table on the server - what is this?

kharkiv

UTR-2-JUNO-ground
(to be enlarged to other instruments on site)

First model in v2 from Toulouse 2016 VESPA workshop.

Updated May 2017 with mixin/custom grammar

LMSU/SINP

Magnetosphere models of Mercury and Saturn, using IMPEx architecture

LMSU/SINP

Initial data services:
voyager_pra: restoration of Voyager Planetary Radio Astronomy data
ExPRES: simulations
Cassini-Jupiter: Cassini/RPWS data products  
Stereo_waves
Wind_waves
TfCat
RadioJove (above)

Exoplanets

√ EPN-TAP descriptors reviewed (April 2017)

√ Further improvement in July 2018, with links to detailed information on web site

Reference for EPN-TAP extension to exoplanets and celestial objects

Check with exoplanets DM to come.

Updated to v2, TAP output checked.

Need to rebuild with mixin and DaCHS2

Simulations of topography of Exoplanets (maps)

Solar physics

HFC1T3

HFC1AR

HFC1FIL

IPRT/AMATERAS
Iitate Planetary Radio Telescope Solar Data

Populate? (expected regular updates, TBC)
√ Fix issue with server

Upgrade required (July 2019)

Updated to DaCHS2, 2021

First draft in May 2017.

Published May 2018

Solar images from SDO
Fits images (compressed internally, won't load in SAOimage/ds9) - maps with a specific projection (HPC)

Started at VESPA 2018 Prague workshop, advanced draft in April 2019, updated and published 2021

Additional content  in 2022

Synoptic maps of the corona in the extreme-UV (EUV), built from series of SoHO/EIT observations

Draft for DaCHS v1

Issue with waveband vs messenger?

Radio Solar Database

=> nrh & orfess

Design VO interface. Make it consistent with other projects in the field

Existing draft for NRH and ORFEES, 2022

Currently on https://gitlab.obspm.fr/DB/vo-nrh

to be moved

Issue with support of some million rows from DaCHS through the portal - async access is recommended in this case - TBC

Issue with datalink under DaCHS2, TBC

Archive of solar data from THEMIS telescope in Canary Islands. Fits files available here:

http://voparis-srv-paris.obspm.fr/vo/themis/

Study extraction of metadata from headers, and format compliance.

Check if format is consistent along time. 

Check completeness of dataset

Generic / interdisciplinary

√ Rearrange data products (jpeg vs fits), add previews, + check descriptions (from local db)

Compute pointing (mostly phase) + Fix image orientation?

Enlarge contents (other existing digitized images)

Phase angle can be retrieved from Miriade, other parameters more difficult (time of day not always available)

Orientation is more difficult, should be reconstructed from images.

√ Declare properly in registry (issue with referenceURL field)

To be enlarged with satellites info (see below)?

(In Feb 2016) best model for UCDs / param (with IKS) & q.rd file.

Test service, updated to v2 in 2016.

Updated to mixin/grammar Dec 2017

Add datalink to Miriade? (OK in test, Jan 2018) - could be at the moment of query.

Satellites info available at IMCCE, to be added.
Extend to orbital parameters? - should be available in a db at IMCCE.

√ SQL trigger to handle new data coming in.
√ Finalize EPN-TAP access
√ Register

√ Identify sources; currently THN library + USGS + IRTF + JSNU + occasional LESIA data

√ Convert files to documented VOtable, not fits (for use in CASSIS) - this is tricky in some cases

√ Collect complete info from original papers

Add ephemeris from Miriade in the table (or datalink to Miriade)?

See interoperability with Planets service.

Spectral calibration unchanged, not homogeneous - but solar spectra provided also

2020: several alt versions including ephemeris data in table

Polarbase_planets

(name TBD)

Very similar to spectro_planet in scope

Proposed by Jean-Michel Glorian, Jan 2020. Started during VESPA 2020-21 on-line workshop

Up in Dec 2022

√ Get metadata from fits headers, call Miriade to compute ephemeris

Finalize?

VESPA 2018 Prague workshop

Complete archive published early 2018.
Currently distribute files & labels in a zip with dataset documentation.

Only ~ 6 Mfiles among 18 in 2018 (Rosetta RPC filtered out - this slowed down the first draft, and provided no usable information)

Difficult on ESA side to retrieve description parameters: PDS/EPN-TAP correspondance is very much dataset dependent.

Get parameters from files/datasets?

Identify a better way to access detached labels (datalink?).

√ Data selection is tricky…

√ Target name, instrument & detector name, obs type are controled and fixed

Data description still to be improved? (multiple targets, etc)

Includes ephemeris data via datalink

Daily updates.

Fom Victoria Interop meeeting, 2018

Redesigned 2021

Table linking Solar System-related catalogues in VizieR (query to a web service returning one or more VOtables).

1400+ tables identified from keywords, regularly growing

• Access tricky to handle in the portal: "B/planet", requires specific handling mode

• Check description & parameters, complete a minima for publication

√ Solved issue: Support for lower cases and hash-list in Vollt server.

√ Remaining issue with value list handling

Will only provide access to existing tables - but most of them when displayed on VizieR include links to additional data files (not always). So this service will be best accessed through the portal.

• Need to agree upon an update procedure (will require manual check of description)

First draft 2019. 
Extended description of catalogues started May 2021, completed Nov 2022

voparis-gitlab
(under Vollt, not DaCHS! + initial name = B/Planets_epn_core)

CSV only (no rd file)

Missing parameters in VOevent standard - needs to specify where the event orginates from

• Name to be changed

Missing parameters in VOevent standard - needs to specify where the event orginates from

• Name to be changed

√ Reviewed. Finalized during Rome 2019 workshop.

Check format of VOevents.

Extract from global archive? Only standard products, ie raw and pipeline (TBC)

Alternative is to connect the complete ESAsky catalogue - SSOs are identified from ephemeris search, not from catalogue entries

(To be done on their side)

Evaluation by Baptiste: easy to do but requires optimization of target identification + data files are not standard fits cubes - how should they be handled?

Would still be very nice!
First need to make fits headers uniform.
Distribute raw images and make it a collaborative service accepting submission of calibrated products?
May require to hire a post-doc to check & process everything

• But get data first of all!
• Other parameters probably required, e.g. camera orientation in focal plane

PDS GeoSciences Node has a dataset of 1999-2001 opposition images and cubes in fits + geometry & projected versions.
More elaborated version than the HST archive/HST_planets service, reformatted: projected and include i/e angles. Fits files, provided with PDS labels.

~ 500 images, each in cylindrical and orthographic projection + cubes grouping series of 12 related images for each projection & incidence/emission angles.

Demo for use of images + coordinates planes (include only cubes?)

Congruence with HST_planets

Should be included in HST_planets?

Pb: file extensions are not "fits", so they won't open automatically

Vis / NIR from IRTF

Vis from ESO

Potential issue with maintenance.

Would help wait for computing on demand system