Third Update of INDIGO-2
Last updated
Last updated
The Third Update of INDIGO-2 release contains:
Some of the features of the new release are:
management of following CI: providers, computing and storage services, images
support for public cloud providers
access control on relevant level
support of IAM authentication
support of hierarchical ownership in authorization schema (support of federated organizations)
possibility to extend CI schema
Depends on other components features:
IAM
Other componets dependent on new features:
SLAM
Monitoring
CloudInfoProvider
Feature hub between versions Kybernetes 1.2, 1.3, 1.5
repeatable Installation Guide (already uploaded in Git)
Some of the highlights of the new versions are:
Openstack and OCCI Probe contain the integration with IAM.
new IM probe
Zabbix-wrapper validates the hostgroups belonging to hosts
N/A
The only upgraded probe is the OCCI probe. To upgrade just install the new probe packages over the old ones. It should work in the same way however:
The IAM information is needed in the configuration file as explained in the Configuration section of the documentation.
The CMDB content should have the extra information needed by the new version of the probe or the probe should be set to standalone as explained in the Configuration section of the documentation.
CentOS7
Ubuntu16.04
Docker:
The new version of Onedata includes major performance upgrades, stability improvements and many highly demanded new features.
Enabled native GlusterFS support on OSX
Multiuser tests implemented
add additional logging to performance tests
Fix space support with missing storage ID
setup luma when adding storage
Increase default RAM quota of couchbase buckets
Improve dbsync changes filtering and queue size control
Remove file_location links.
Move periodic cleanup of permission cache to fslogic_worker, refactor file_meta.
Adjust changes stream test to delayed creation of file_location.
implementation of reverse_luma and luma_cache_behaviour, update of luma tests
Enabled native GlusterFS support on OSX
VFS-3458 Make sure user's connected accounts are popagated through subscriptions, - use md5 rather than base64 to encode user and group ids
User base64 url rather than base64 in user id encoding
Fix a bug in groups encoding from SAML assertions, do base64 of user ids from IdPs
Update esaml reference to point to repo in onedata's github
Add support for GlusterFS
Update couchbase version to 4.5.1
Improve dbsync changes aggregation
Make sure that new permissions can be safely added to the system without breaking - gui compliance
Remove deprecated privilege names
Fix dbsync recovery stream
Decode cacert from pem into der format, when opening websocket connection.
Make sure user aliases in subscriptions are precomputed every time a space name - changes, decrease changes intervals
Cluster_worker update (update node monitoring logging)
Showing hashes for conflicting space, group and provider names in Onezone
Truncating long provider names in sidebar
Loader indicator when creating space
New support space modal with support token, deploy provider command and expose - data command
Extend oneclient fsync with flushing events and fsyncing files on provider side.
Add flush of all event streams
Add support for sig v2 to AWS S3 helper
Moved extended attribute messages from provider to fuse namespace
Added extended attributes support
Add copy/remove tests.
Check if mtime and ctime are equal after rename (in previous implemetation of - rename they were greater).
Use only storage ID in space support request
Change provider deregistration behaviour
Update provider name after modify
Copy/remove files during move when non posix storage is used
Implement rename operation.
Rewrite current remove implementation and delete rename operation.
Rename auth_rhea module to auth_keycloak module
Add support for RHEA KeyCloak OpenID Connect
Disable storage helpers buffering
Integrate with new datastore
Integrate with refactored datastore
Handle chmod, truncate and updating timestamps in storage_sync
Refactor storage_import and space_sync_worker
Update datastore models to use new datastore API
Remove space-storage mapping on space support revoke
Enable release docker to log to stdout
Add libcouchbase package dependency
Create new test files while verifying storage availability
Display Provider software version
Displaying Zone name and version in Onezone and login view
Fix blocking message when at least one provider is offline
Added RHEA social icon
Clean installation:
Oneclient:
any platform that supports Docker Engine (>11.2)
# wget -q -O - http://onedata-dev-packages.cloud.plgrid.pl/onedata.gpg.key | sudo apt-key add -
Onezone and Oneprovider:
any platform that supports Docker Engine (>11.2)
Ubuntu 16.04
Docker Container (1.4.0-FINAL):
This Ophidia minor release fixes several bugs and provides the following new main features:
WPS-enabled oph_term;
support for OpenID authZ/authN;
support for FITS data format;
operator for file system browsing;
multi-user installation;
and monitoring of workflow status.
Bugs in some operators and primitives
Bug in strncpy calls in framework
Bugs in primitives core library
Packages:
Ubuntu 14.04
CentOS 7
Support for the deployment of hybrid clusters has been added; Users can also retrieve their own deployents through REST APIs
Improvements:
No special operations will be required for the upgrade. Thus, the upgrade operations are:
Stop the old container:</br>
sudo docker stop orchestrator</br>
Remove the old container:</br>
sudo docker rm orchestrator</br>
Pull the new image version:
sudo docker pull indigodatacloud/orchestrator:1.4.0-FINAL</br>
Start the new version:</br>
docker run ...*parameters*... indigodatacloud/orchestrator:1.4.0-FINAL</br>
Docker Container (1.4.0-FINAL):
Some of the highlights of this update are:
UX has been greatly improved
added possibility to specify preference of the user using drag-and-drop technique
the current version is compliant with CMDB v0.4
improvement in authorization on REST API
some minor fixes in business logic and QoS
N/A
It is enough to replace service docker, with databases from old version.
Docker Container
Information regarding deployment is avalable in the
Information regarding the migrating of data is available in the
Updated documentation on how to setup a Kubernetes Cluster together with a shell script and Ansible playbook for the installation, uploaded to the git:
The Monitoring - Zabbix probes documentation has been updated and is available at
New probe documentation is available at:
OCCI probe:
OpenStack probe:
IM probe:
Zabbix-wrapper:
Ubuntu 16.04 (also 14.04, 15.04 in )
remember to download also the and download the onedata-key:
CentOS 7 (remember to download the
Fedora 23 - in
Fedora 23 in
For more details please read the
In order to perform an update please carefully read the instructions available in the Ophidia Upgrade Guide]()
- Fix IM header generation for IAM federated OpenStacks
- Support for deployment of hybrid clusters
- [Docker] Validate DB connection before starting wildfly
- Add information of who created the deployments in REST response
- Allow filtering of deployment though param in REST APIs
More details are available in the Upgrade guide: