SSDM datamodel upgrade
- internal meetings on the datamodel changes implied by the change of structure from single database (GhoSST) to SSHADE database infrastructure
- discussion on how to separate the common databases (common data: fundamental data + general data) and the lab databases (partner data)
- discussed: experimentalists, instruments, samples & matters
- addition of a 'database' table => Done with all necessary DOI keywords
- ...
SSHADE infrastructure implementation
Software structure
- The development of SSHADE software is based on:
- Python (https://www.python.org/)
- Pyramid framework (http://www.pylonsproject.org/)
- SQLAlchemy (http://www.sqlalchemy.org/)
- LXML (http://lxml.de/)
- Astropy (http://www.astropy.org/)
- ...
- The development of SSHADE database is based on:
- PostgreSQL (http://www.postgresql.org/)
Database structure
- Software implementation
- Use of PostgreSQL schemas (OK - completed)
- Datamodel definition with SQLAlchemy (OK - completed)
- Refactoring of database structure inherited fom GhoSST (OK - completed)
- Split into multiple schemas (OK - completed)
- one schema dedicated to all common data (fundamental species, ...)
- one schema per "database" for all "private" data (experiments, spectra, ...)
- Implementation of the datamodel upgrades
- Experimentalist (OK - completed)
- Instrument (OK - completed)
- Sample (OK - completed)
- Mineral species (OK - completed)
- Matter (OK - completed)
- Database (OK - completed)
- Split into multiple schemas (OK - completed)
Data ingestion software
- Import XML files
- Source
- Command line (OK - completed)
- Web interface (OK - completed)
- Data types
- Species (OK - completed)
- Natural objects (OK - completed)
- Laboratory (OK - completed)
- Experimentalist (OK - completed)
- Instrument (OK - completed)
- Database (OK - completed)
- Sample (OK - completed)
- Matter (OK - completed)
- Experiment & spectrum (OK - completed)
Publication (OK - completed)
- Bandlist/Bands/States (TODO)
- Features
- XML validation : OK
- Import mode: correction, use existing, ... (OK - completed)
- Optional mandatory (OK - completed)
- Unit conversion (OK - completed)
- Resource files : image, PDF,... (OK - completed)
- Conversion of binary file : Nicolet (OK)
- History (OK - completed)
- Source
SSHADE web interface (search / visualization / export)
- Google-like Search (OK - completed)
- Specialized spectrum filters search (OK - completed)
- Specialized publication filters search (OK - completed)
- Provider searchs (OK - completed)
- Spectrum dynamic visu (OK - completed)
- experiment details visu (OK - completed)
- spectrum details visu (OK - completed)
- sample details visu (OK - completed)
- species details visu (OK - completed)
- phase details (OK - completed)
- Publication details (OK - completed)
- export spectrum / experiment (OK - completed)
- user dashboard (OK - completed)
- profiles and settings (OK - completed)
SSHADE web interface (Providers & Managers data management)
- import (OK - completed)
- data validation + access (OK - completed)
- database management (OK - completed)
- users management (OK - completed)
- groups management (TODO)
- backup (OK - completed)
SSHADE wiki (Users and Providers)
- SSHADE documentation (OK - completed)
- user help (OK - completed)
- provider documentation (OK - completed)
Hardware / Software management
- "Hardware"
- Deployment of 2 virtual servers (development/production) within the OSUG datacenter infrastructure (OK - completed)
- Operating system : Debian GNU/Linux 8 (Jessie - Stable)
- Software
- Deployment of a forge software: Redmine+Git (OK) with plugins for agile project management (Kanban/SCRUM) and continuous integration (Jenkins)