Integration of Alibaba Cloud as a Back End in SODA Foundation Multi-Cloud with CloudsBrain
2020-08-12 : BY CLICK2CLOUD-BLOG
Before the integration of the Alibaba Gelato project of OpenSDS does not support the object management on the OSS service of Alibaba.
This blog embellishes the integration and Click2Cloud contribution with Alibaba cloud as a back end in OpenSDS/ multi-cloud.
The Gelato project of the SODA Foundation supports object operation performance, lifecycle management, and object management for different cloud vendors like AWS, GCP, Azure, IBM, Huawei, YIG, and Ceph.
Alibaba cloud as a back end in OpenSDS multi-cloud project integration helps in object operation, lifecycle management. Users can perform in-cloud and cross-cloud migration for Alibaba cloud using the Gelato project for Alibaba OSS (object storage service) service.
OpenSDS is an open-source community working to address storage integration challenges, particularly in scale-out cloud-native environments with heterogeneous storage platforms.
Below mentioned is the architecture of the integration of Alibaba cloud in OpenSDS/ multi-cloud.
Fig: Architecture of Integration of Alibaba cloud in OpenSDS/ multi-cloud
Alibaba cloud object storage service (OSS) helps users to conduct operations related to bucket and object storage in simple ways. Alibaba OSS adapter helps the user with:
- Add Backend for Alibaba OSS
- Create OpenSDS Bucket on Alibaba OSS
- Delete Bucket from Alibaba OSS
- SSE supported
- Upload Object on Alibaba OSS (PUT Object)
- Download Object from Alibaba OSS (GET Object)
- Support for Multi-part Upload
- Delete Object from Alibaba OSS
- In-cloud lifecycle management on Alibaba OSS (Standard, IA, Archive)
- Cross-cloud lifecycle management with Gelato supported backends (i.e. AWS, Azure & Huawei)
For a multi-cloud data engine, the team sketched the architecture diagram that presents the ability to migrate data across multiple clouds. The multi-cloud architecture diagram defines the concept of multi-cloud in OpenSDS clearly. Also, the user will be able to migrate its bucket from any OpenSDS supported public cloud or local storage to Alibaba cloud.
Let us see some of the significance of architecture diagrams:
- API Gateway: At the topmost, an API Gateway is shown, which takes client request and provides a response with backend services collection.
- S3 Service: It contains the S3 controller which communicates with the database and object storage backends on-premise or in the cloud, handles S3 API requests, returns results to the caller. To convert the location of an object passed in from API into the actual location on the object storage S3 service uses Location Mapper.
- Backend Service: This service communicates with the backend on-premise or in the cloud to confirm the information about the bucket. Also, backend service manages object storage backends on-premise or in the cloud.
- Dataflow service: Dataflow service is used for data migration.
- Data Mover: This is using to move the data from one location to another location.
- Database: Database is used to save the information that is present on other resources of a multi-cloud data engine.
- Backend Adapter: To support and communicates with backend management like AWS, a Backend Adapter is used.
Features of Click2Cloud contribution with Alibaba cloud as a back end in OpenSDS/ multi-cloud.
- The integration of Alibaba cloud in OpenSDS/ multi-cloud architecture offers a number of reasons to deploy into it which often results in reducing reliance on a single vendor, increasing flexibility, cost-efficiency, adherence to local policies, and a lot more.
- Users use OpenSDS multi-cloud data engine to move data to a location near to where it is needed for convenience. Data can be moved to different locations depending on usage, age, access frequency.
- Alibaba integration with the OpenSDS data engine allows data to be available and accessible all the time. In the case where one cloud is down, the user can still have access to data in another cloud that is up and running.
- A multi-cloud data engine provides policy-based data mobility across public and private clouds. These public and private clouds can be used in the following cases:
- Users may want to upload some datasets to the public cloud for data analysis and delete the data after the work is complete.
- Users can leverage a multi-cloud data engine to move data to the public cloud for high CPU computing when that is required for a period.
- Frequently accessed data can be stored on-premise. Data not accessed for a long time can be stored in archival storage in public clouds.
Earlier, users were not able to perform object related operations for Alibaba Object Storage Service on Multi-Cloud Project of SODA (i.e. Gelato Project). Click2Cloud has committed to extend the OpenSDS capabilities for Data Storage and Migration for a multi-cloud design and multi-cloud providers. Contribution with Alibaba in integration as backend in OpenSDS leads to a solution to many cloud storage vendors to come up with object storage management issues.