Cloud Storage Connection Parameter Description

This article will describe the parameters of object storage service connection, FTP service connection and Connection Timeout, so as to correctly Input Parameter information and complete Cloud storage service connection.

Object Storage Service Connection

Huawei Cloud Object Storage Service OBS、Alibaba Cloud Object Storage Service OSS、SeaweedFS Object Storage Service、 MinIO Object Storage Service and object storage service compatible with AWS S3 protocol are all object storage services. To select these Server types, you need to set the following parameters:

Parameter Explain
Connection name The default is the Cloud Storage ", which identifies the Cloud storage service connection. The specified name cannot be the same as the name of an existing connection. The connection name supports Chinese, English, numbers, underscores, dashes, and @ characters, for example: image-cloudstorage @ _ name.
Server Type

Identifies the Cloud Storage provider.

Huawei Cloud Object Storage Service OBS、Alibaba Cloud Object Storage Service OSS、 SeaweedFS Object Storage Service and MinIO Object Storage Service are also compatible with AWS S3 protocol object storage services. After selecting an object storage service compatible with AWS S3 protocol, you can also connect to the above Server Types, except that there is no service provider ID in the Connection Info.

Service endpoint Endpoint is used to set the access address of Cloud Storage, which supports two address forms: domain name and IP + port. Parameter value input example:
  • Domain name: Alibaba Cloud Object Storage Service OSS and Huawei Cloud Object Storage Service OBS provide service endpoints in the form of domain names. The service endpoint is associated with the geographic attribute specified when the bucket was created. If the region attribute of the bucket in the Alibaba Cloud Object Storage Service OSS is "North China 2 (Beijing)", the value of the service endpoint is "oss-cn-Beijing. Aliyuncs. Com" ".
  • IP + port: SeaweedFS Object Storage Service and MinIO object storage services provide service endpoints in this way. If the MinIO Object Storage Service is that the open port of S3 API access object storage is 9110, and the IP of the object storage server is 1.1.1.0, then the service endpoint parameter value should be specified as 1.1.1.0: 9110
Caution:
The address form of the

service endpoint is related to the specific object storage service, and the service endpoint may also be an HTTP or HTTPS access protocol. In Connection Options, set the value of AWS _ HTTPS and specify the correct port number as appropriate.

Access key

Access key is the access credential for the object bucket, including access keyID and access key. Due to server configuration issues, for example, the MinIO object storage service may only need to provide a login account and password.

Bucket name Specifies the name of the bucket in the Object Storage Service. Requires access credentials for the object bucket. Different providers have different definitions. For example, it is called storage space in Alibaba Cloud and bucket in Huawei Cloud.
Folder

Folders can be set to connect to the specified folder under the object bucket. If not specified, it connects to the root of the object bucket.

The object storage service provides virtual folders, that is, the object bucket uses folder structure to manage files. Through this parameter, you can directly connect to the specified folder to facilitate file search after the connection is established.

For example, for the bucket "image" connected to the MinIO object storage service, the File Path of the image. TIF in the bucket is "/folder1/folder2/IMG/image. TIF", The connection name for the Add Cloud Storage Connection is Cloud Storage 1. Then set the folder here to "/folder1/folder2", and when using the image. TIF on the desktop side, the File Path can be simplified to "//Cloud Storage1/IMG/image. TIF". If this parameter is not set, when the image. TIF is used, the File Path is "//CloudStorage1/folder1/folder2/IMG/image. TIF" ".

Connection options A comparison table of the name (key) and the value (value) is provided in the connection option. Common option information is listed below.
  • AWS _ HTTPS = YES/NO: AWS _ HTTPS value is NO, resources in the S3 object store will be accessed using the HTTP protocol; AWS _ HTTPS value is YES, resources in the S3 object store will be accessed using the HTTPS protocol. If you do not add the AWS _ HTTPS option, the default is to use the HTTPS protocol to access resources in the S3 object store. How to set the AWS _ HTTPS value? You need to confirm the request protocol supported by the S3 object storage server.
  • AWS _ NO _ SIGN _ REQUEST = YES/NO: Object bucket authentication method (whether request signing is disabled) for buckets with public Access Permissions. If YES, connect anonymously to buckets that do not require authenticated Access Permissions. If authentication is required to access an object bucket, the AWS _ NO _ SIGN _ REQUEST variable value is set to NO.
  • AWS _ VIRTUAL _ HOSTING = TRUE/FALSE: The way to access the object bucket. S3 supports Virtual Hosted and Path Type (path) URLs to access the bucket. If the value is TRUE (the default value), it is the virtual hosting type, which refers to the access method of placing the bucket on the Host Header. The bucket is identified by the host name of the virtual bucket, for example: mybucket. CNAME. Domain. Com, that is, "bucket name + HostName". If the value is FALSE, Path Type identifies the bucket as the top-level directory in the URI, for example: CNAME. Domain. Com/mybucket.

Taking MinIO object storage as an example, the default support format is path request of http://example.com/bucket/object. If you configure MINIO _ DOMAIN (MINIO _ DOMAIN Environment Variable to enable virtual host-style requests), MinIO supports both path-style and virtual host-style requests from the client. Therefore, you need to add AWS _ VIRTUAL _ HOSTING options and specify the correct values based on how the object store configuration supports the request. By default, the MinIO object store uses path requests to access buckets, so you need to add the AWS _ VIRTUAL _ HOSTING = FALSE option.

FTP service connection

You can connect to the FTP service only based on the service endpoint, user name, and password. The Parameter Description is as follows:

Parameter Explain
Connection name The default is the Cloud Storage ", which identifies the Cloud storage service connection. The specified name cannot be the same as the name of an existing connection. The connection name supports Chinese, English, numbers, underscores, dashes, and @ characters, for example: image-cloudstorage @ _ name.
Service endpoint FTP Server Address, for example, 127.0.0.1.
User name/password Username and corresponding password to access the FTP service.
Path

Path can be set to connect to the specified directory in the FTP service. If not specified, it will connect to the root directory of the FTP server.

For example, Set Directory:/NFS/gisdata/IMG/will only establish a connection to this directory. After the connection is created, only the files and folder contents in this directory will be displayed under the connection node.

Connection TimeoutParameter Description

The parameters for Connection Timeout are organized in the Global environment item of the Cloud Storage dialog box. When no new Cloud storage service connection is added, the Connection Timeout parameter can also be modified through this Global environment item, and the modified content will be applied to all connections in real time. The description is as follows:

Parameter Explain
HTTP Create Connection Timeout Timeout for HTTP create connection when connecting to Cloud Storage.
Total timeout for a single HTTP request The total timeout time of a single HTTP request when connecting to Cloud Storage. The total timeout time of a single request refers to the total time from the start of the request to the end of the request, including DNS resolution, connection establishment, transmission, etc.
Retry interval for HTTP HTTP retry interval when connecting to Cloud Storage.
Maximum number of HTTP retries Maximum number of HTTP retries when connecting to Cloud Storage.

Related topics

Add Cloud Storage Connection Instance

Build Mosaic Dataset

Single-task cutting graph

Generate Map Tiles by Multiple Tasks