On this page
[v1.12.1] Release Notes Improved ISO handling in Repository Storage Pool Enhanced Snapshot and VM Management Improved Storage and High Availability (HA) functionalities Added Changed/Fixed If an ISO file in the Repository Storage Pool is in use by any VM, deletion is now properly blocked, and users receive an appropriate warning. When taking a snapshot, the 'Confirm' button is now correctly activated once the 'State' dropdown menu is selected. Resolved issues related to Local Datastore Capacity information and migration problems after upgrading from earlier Sybelle versions. Fixed the blue screen issue encountered when deleting snapshots taken from VMware-converted virtual machines. Resolved DSS Storage Pool errors occurring after upgrading Sybelle from earlier versions. Fixed UI inconsistency displaying Storage Pool Capacity extensions for incorrect pools. Corrected an issue where deleted Storage Pools from the DSS, UI remained mounted on the respective node, preventing re-creation with the same name. Addressed an issue with NetBackup integration, where edits made to Backup Profiles and deletion of VMs were not being recognized, causing VMs to continue backup operations incorrectly. Corrected status display errors for Block Devices created on DSS. Fixed operational inconsistencies in UI reflecting system-side Storage Pool creation and deletion actions. Resolved issues encountered during Snapshot reverts when moving VM storage between different storage units. Fixed errors preventing users from deleting uploaded files in non-Content Library Storage Pools accessed via the "Images" section. Added validations for Overlay Network creation, ensuring that 'First Usable VNI' and 'Last Usable VNI' fields are appropriately filled with valid numeric inputs. Improved handling of iSCSI session failure or timeout notifications and corrected inconsistencies in UI service listings. Resolved errors in Search and Filtering functionalities in the 'Status' and 'Device' columns under Node Monitoring. Fixed boot failures for VMs created using converted physical machine disks, emphasizing precautions regarding mount and shell interactions during disk operations. Corrected the deletion restrictions on iSCSI Target Objects when their status is marked as "Created" or "Failed." Improved handling of automatic connection behavior for iSCSI discoveries, addressing system performance impacts during updates or reboots. Fixed errors related to CPU and Memory Hot Add operations for running VMs. Resolved High Availability status inconsistencies post-node reboot, ensuring correct VM migration and domain definitions. Fixed "Missing Bearer String" authentication errors by correctly enforcing the presence of the Bearer keyword in request headers. Addressed VM bootloader update issues causing incompatibility or corruption, ensuring successful VM boot after reverting changes. Corrected status update behavior for bare-metal hosts recovering from a NotReady state. Improved disk partitioning during installation to utilize available disk space efficiently. Reduced excessive post-installation processing time caused by multipath disks and HBA presence. Removed/Deprecated Update Notes Updating to 1.12.0: !!! Disable HA on running cluster before you start updating !!! Download and extract artifact Run ./sybelle/UPDATE.sh
[v1.12.0] Release Notes New Platform coveredge added as Virtualization:SDS, Multi-Tenancy, Container features only available in ENTERPRISE-SDDC license type Blockdevice and multipath-device handling improved TPM support enabled for virtual machines Virtual Machine cloning improved Distributed Storage Pool improved Added TPM 2.0 Support Enablement Encrypt/Decrypt VMware credentials with User Token/Password Sybelle Diagnostic Data Collector bash-completion binary added to installation ISO New ExecStartPre Script for sybelle-frontend.service Changed/Fixed Bug on cloning a powered-on vm with existing offline snapshot with iso device NFS Export Validity Check for Veeam Backup integration Nvram file save and restore in uefi mode is missing on Netbackup integration Increase relative overhead in converting vmdk to qcow2 from 1.1 to 1.2 Add fsid field to nfs export command for Veeam backup integration Validate isParent, xfsType, DiskLabel for Block Devices that contains partitioning table Create HA Fault Tolerance is reached due to excessive resource usage event object Live migration with multiple snapshot creates an error Slave Device Query Endpoint Fix Sybellectl is not restarting frontend service after configure-node User Shouldn't be able to remove itself Revert crashes virtual machine storage pool size does not change after extension Unavailable LUNS still appear on disk list Hardcoded storage pool name during lvremove in recovery operation Additional Control for Removal of "hci" and "overlay" Function Tag Triggering multiple operations on same VM without 1st one completed creates error (Clone-Snapshot) VM Creation Shouldn't possible during Node is on Maintenance Removed/Deprecated Update Notes Updating to 1.12.0: !!! Disable HA on running cluster before you start updating !!! Download and extract artifact Run ./sybelle/UPDATE.sh
[v1.11.2] Release Notes Critical DLTV LiveMigration & HighAvailability bugs fixed Veeam Backup Engine integration completed Management interfaces can be used by virtual machines for computation network Virtual interface mac address are changeable Removed AWS-S3 support for VmStoragePools Added VM Network Interface Provisioning over Management Interface UpdateVm operation shall edit mac address of vmNetworkInterface object Install should be default option on Grub selection Add sybellectl update-frontend parameter rclone binary add to in rpm packages Changed/Fixed Virtual Disk (qCow2) file Corruption on dLTV Datastore During High I/O Remove InitiatorNodeSelection on cluster deploy endpoint Ha Recovery Failed After Reboot Check Backup Profile objects prior to VM Deletion operation & Update Related Backup Profile Objects Add HA active control on update script before start update operation & update script enhancements During external backup restore operation disk files should be renamed for newly created vms Stopping startup-storage service unmounts gluster volume pools Wrong password logs out user Installation Reviews for ISO and BUILD process DltvLiveMigration Optimisation Local datastore for single disk is not mounted after reboot Remove vim and dependencies & add vi support for sybellectl edit Seperation of Veeam and Netbackup Integrations Disks over FC-HBA/iSCSI are available for Installation Target selection Select veeam backup proxy vm from dropdown on credentials Vmware migration panic for failed host on vcenter cluster Libvirt Permission Issue during Live VM Migration Fix Node Memory Amount Conversion Mistakes sDLTV Multi Path Slave Device Control Logic Hotfix Netbackup Orphan Backup Images Delete error on datastore "Backup Instances" sDLTV migration fails on Vm's that reverted snapshots Netbackup revision & fixes Deleting sDLTV pool does not remove all child partitions Heartbeat and Status Fields are not updated on iSCSI Connectivity Failure Unable to Remove CDDVD file from running VM HotFix: for terabyte calculation on pool & online memory size HotFix: thinLv storage migration status watch Removed/Deprecated Remove AWS support and rpm build dependencies from iso and build process Update Notes Updating to 1.11.2: !!! Disable HA on running cluster before you start updating !!! Download and extract artifact Run ./sybelle/UPDATE.sh
[v1.11.0] Release Notes Netbackup sybelle integration implemented New Installation TUI for ISO Memory over-commit implemented Various bugfixes and enhancements Added [sybellectl] "health" command revision for Non-Cluster-Initiliazed Node Info on snackbar should contain name instead of uuid Use separate directory for shared disk Etcd Migration when master node unreachble [P1] veritas backup engine integration w/ sybelle cluster for backup sybellectl commands to backup dkvs meta-data on storage pool sybellectl commands to import licence info housekeeping for out-of-date operation housekeeping for LVM archive files housekeeping for expired auth tokens sybelle backup manual trigger endpoint timebomb for non-licenced clusters Enable sybelle backup on dss storages Change systemd service sequence for sybelle Vms that are not shutdown state cannot be deleted Moving dss on the shakir resource system sybellectl Bash Autocompletion Restart running containers on server start at scheduler Improve Cluster Health Endpoint [VM Management] Missing VM Name on Title of VNC Console Browser Tab machine.slice memory usage for max memory override (memory overcommit) HA Failover -> Memory & CPU Overcommitment Create vm from ova image via sybellectl (sybellectl import-ova) Add licensing option for community release (single-node) Add TLS hardening on rest-api sybellectl init cluster logging changed for meaningfully messages libsnl package added to installation package Add mac address column for network interfaces on iso installer Additional HA events for resource management backupProfileType field of vm struct should be added into etcd Changed/Fixed OpenNoVncService.go index out of range [Multipath] Remove "scsi:sas" Exception Node is not added to shakir cluster info Changing ha and metrics service logs to be more readable deleteVm with backupProfileId does not update backupProfile object Assigned Public IP is not deleted via Tenant Delete Cloned VM does not accessible on Tenant UI Nested executions ve tenantNetwork must be deleted when tenant destroyed Reverting snapshot not updating network profile/disk and vm information vmNetwork and vmNetworkProfiles cannot be deleted if there are any interfaces related to it bondInterface Refresh button Could not decode json error Dss pools must not have auto-start attribute(systemd hangs) Execute backup unmount error if host name contains "-" on shared pool Dss data store re-create error due to the xfs filesystem signature Fix ha for changing virtual disk and virtual interfaces indexes on vm Backup revert failure on hci storage pool Update control functions for dltv and hci Hotfix Log file names for WebSocket backend Fix vm console error after ha and restarFailoverVm operations triggered Fix vm conversion error from UEFI to BIOS Update sharedlv fallback functions Update sharedlv and hci fallback functions Netbackup api version should be selectable during creating credentials UUID must replace by object name on the FE snackbarda Hotfixes for shared disk Etcd migration when master node is unreachable Cluster health endpoint improvements Remove node from cluster with force (if node not reachable) Check Memory Over-Provision State of the Sybelle Node on VM Start Operation Memory/CPU over-provision settings with sybellectl Remote iso remove fix [VM Memory Stats] collecting stats via by libvirt "dommemstat $domain --period $time" Add regex control for vmStoragePool object Remove node operation forgets to delete poolUnit and storagePool(local) objects Housekeeping using wrong loging tag Change vnc port detection from grep to libvirt During installation all partitions connected to host is formated by gpt Lvm meta-data backup operation creates infinite snapshots on etcd nil pointer error during network scan /deploy/ endpoints return authentication error Over-commited memory calculation mistake Change naming convension for HCI to SDS (Software Defined Storage) Additional trailing slash fixes after gin-gonic change [ISO] Management Interface Bond Mode should defaults to "active-backup" [ISO] Disks over FC-HBA/iSCSI are available for Installation Target selection Removed/Deprecated Converting vm's bootloader from BIOS to UEFI is disabled if vm has IDE disk attached If vm have snapshot virtual disks cannot be extended Obsolote CLEAR_STORAGE_HEART_BEATS & DEFINE_RELEVANT_VMS operations after HA failover Remove /etc/fstab usage Remove trailing slash from restapi endpoints Update Notes Updating to 1.11.0: !!! Disable HA on running cluster before you start updating !!! Download and extract artifact Run ./sybelle/build/bin/sybellectl update info
to check current version Run ./sybelle/build/bin/sybellectl update 1.11.0
to resolve conflicts Run ./sybelle/UPDATE.sh
[v1.10.0] Release Notes Added Changed/Fixed SharedLv Fallback Operations Drastically improved system service start order Added sybellectl restart [name.service] or all
command Sybellectl and Shakirctl Bash Command Autocompletion Hotfix: etcd connection check for HA Hotfix: create local user error after cluster init Removed Update Notes Updating to 1.10.0: Download and extract artifact Run ./sybelle/build/bin/sybellectl update info
to check current version Run ./sybelle/build/bin/sybellectl update 1.10.0
to resolve conflicts Run ./sybelle/UPDATE.sh
[v1.9.24] Release Notes Shakir Enhancement Log Rotation Enhancement Rollback Enahncement for Failed Operations Added Enable Persistent Journald Logging and Rotation Enable Shared Virtual Disk for shared block device volumes vnc2websocket proxy ile apiden vm console verilmeli New Sybellectl update command Password Encryption And AuthToken CleanUp Resource System For Shakir Container Restart Policies and Autostart Safe migration option added for vms that more than 32G memory SharedLV ve Gluster Pool yaratma islemleri icin rollback mekanizmasi Changed/Fixed HotFix: sybelle-dkvs service keep restarting for multiple quorum nodes Hotfix: masking etcd service HotFix: no-vnc installation changed from tar to folder Hotfix: add more logging and control for deploy cluster endpoint Hotfix: cluster deploy endpoint for wrong request endpoint CNI HOTFIX Initiate cluster from single node to prevent cert errors Merge update with hashing Check for empty losetup JSON Create local admin user at init cluster & updater docs Removed Update Notes Updating to 1.9.24: Download and extract artifact Run ./sybelle/build/bin/sybellectl update info
to check current version Run ./sybelle/build/bin/sybellectl update 1.9.24
to resolve conflicts Run ./sybelle/UPDATE.sh
[v1.9.23] Release Notes Clustering engine has changed from pcs
to shakir
(our own implementation)!!! UPDATES to 1.9.23 requires additional steps check 'Update Notes'
For datacenter installation's tag(trunk) interfaces can now have dss repository over management interface Persistent storage enabled for containers on shared storage pool
Certain bugfix and enhancements Added Add NFS storage pool api endpoints Event Acknowledgment Endpoint Map Tenant IP to Puclic IP Address (DNAT and SNAT) Tenant kullanicinin olusturdugu VMler icin otomatik host secilmeli Vm Command Run Endpoint Sub-interfacelere function tag atama Etcd quorum & New Cluster Controller service HA servis bagimliliginin PCSden Shakir'e tasinmasi Container SharedLV persistent data [Phase-1] (SAN Volume for containers) Sybelle User Guide for multi-tenancy ORM Migration icin Validasyon araci Add Cluster License Info Changed/Fixed MGMT interface has empty tag Function tag kontrolleri Multiple snapshot migration problem Hang Migration Task Troubleshooting HotFix: gluster probe parsing error Listing ISO Page for Remove Node Local... Cluster join bug Ha-SP fail over fixes CreateVmFromBackupInstance -> Discards Cpu... HotFix: Nil Cpu value in template and cloning Logrotate frequency Snapshot revert edildiginde minCpu... Broken bridges after running a VM HotFix: fix missing newline chars in qemu hook logs Iscsi degisikligi sonrasi storage pool olustururken... create storage pool operasyonunda already defined... HotFix: remove restart wdmw option from installation HCI Storage Volume icin kullanilan diske erisim kesilirse sunucu reboot olamiyor Sanitize and hide VMware credentials RLB Auto Fixes Orm validation for v2 Etcd ORM obje kaydederken degisiklik kontrolu yapmali Template ile ayni isimde storage uzerinde sanal makine olusturulamiyor Duplicate Container Image Records on Using Local Datastore LvmLock sunucu restart edildikten sonra glocklvm ayarini yapmali MGMT Add interface link down, failover not kicking SharedLV pool silinirken vgremove timeout hatasi veriyor HotFix: Dns addresses of MGMT interface is not seen on resolv.conf HotFix: Fix iso file delete HotFix: Delete quota profile error HotFix: Add container baypass for container start hook script HotFix: extend authToken endpoint Removed pcs for cluster management Update Notes Updating to 1.9.23: Before running ./UPDATE.sh script:Remove lines for sybelle-ha
and sybelle-metrics
services in start.sh
script Upgrade system with ./UPDATE.sh Initiate shakir cluster via shakirctl init
Then start sybelle-ha
and sybelle-metics
services manually [v1.9.19] Added Added ip address binding for tenant virtual machine Various multi-tenancy validation fixes Sanlock and lvm bugfix Changed/Fixed Removed [v1.9.18] Added Multipath changesBlockDevices now identified by their mpath device path User documentations added w/ png screenshots Changed/Fixed Removed [v1.9.17] Added New endpoint for cluster updatesybelle-updated service files New Rest API auth method accessKey?= as url parameter for sybelle cluster token Rest API documentation with swaggerhttp://SERVER:8000/api/v1/swagger/index.html New lock mechanism with sanlock
and lvmlockd
script: disable_pcs_dss.sh -> remove pcs related dss configurations Changed/Fixed Volume group lock race-condition (SAN lock) Pcs related nfs configuration for dss PathWalk for remote repositories Race condition for backup operations Removed Remove old api related files Old dss configurations and service configurations [v1.9.16] Added DSS with ETCD (sybelle-dss service) Removed Pcs related nfs configuration for dss [v1.9.15] Added New Gingonic api with swagger documentation New integration tests & configurations for api Tenant network to public IP assignment requires access to address poolNew and EXISTING tenants need to be given access to address pools in create/edit tenant screens Revoking access to an address pool from a tenant will result in unassignment of related public IPs from its tenant networks Added Container Network Interface (CNI) as an alternative to port binding. CNI can be attached toNetwork and Profile (only Access VLAN allowed, no Trunk) as an Admin Tenant Network or Underlay as a Tenant CNI's network configuration can be manual or automatic via a DHCP client Changed Fixed quota profile create/edit screen returning a network and network profile selection with no name Removed http and cluster controller for gingonic api switch Old integration test files [v1.9.14] Release Notes: Some memory leak problems fixed Added New pipeline configuration Base development for ORM on etcd Changed Qemu cdrom disk unplugged error GlusterFS volume validation error on non-eligible disks Migration authentication key changedauthentication is managed by /root/.ssh/migration_rsa
and /root/.ssh/mirgration_rsa.pub
UPGRADE: keys in /root/.ssh/id_rsa
and /root/.ssh/id_rsa.pub
can be renamed to new mirgration_rsa.pub
and mirgration_rsa
Cluster init operation now can be triggered with RestAPI Add new integration test configurations for pipeline Removed