As the portal platform of cloud GIS, SuperMap iPortal supports integrating traditional data, such as SuperMap GIS data, common GIS data and Excel, CSV files with geospatial coordinates, and also supports accessing big data, such as HDFS and database data. Besides the GIS data, the non-GIS data (such as video, audio, image) can also be added to iPortal by using REST API. The data added to the portal can be used in built-in WebApps to use maps or various charts for visual expression and in-depth analysis. Note: If the administrator has enabled the Data Review function, the newly added data into the portal cannot be searched and used in the portal until the review is approved.
Upload data
To upload data in iPortal, the user must be the "CREATOR" type and has the role of uploading data and publishing service permissions, such as DATA_CENTER (the division of user type and permissions in iPortal, see: Role, User Type and Permissions). Also, the administrator needs to Specify hosting servers and Configure hosted data storage.
iPortal supports to configure binary and relational hosted data storage, and defaults to use binary storage. If both are configured, the system will give priority to relational storage and will also back up the uploaded data in binary storage. But there are still some data such as cached tiles only can be stored in the binary storage. Table 1 below shows the corresponding relationship of data type, data files, service type to publish and download format supported by the uploaded data.
Table 1: The corresponding relationship of data type, data files, service type to publish and download format supported by the uploaded data
Data Type | Data File | Supported Service Type to Publish | Supported Download Format |
SuperMap Workspace |
The zip package compressed with the workspace in the format of *.sxwu, *.smwu, *.sxw or *.smw and the related UDB datasources. |
REST map service REST data service REST 3D service REST spatial analysis service WMS 1.1.1 service WMS 1.3.0 service WMTS 1.0.0 service WMTS-China service |
WORKSPACE UDB¹ SHP¹ |
SuperMap UDB data |
The zip package compressed with *.udb and *.udd format files. |
REST map service¹ REST data service REST spatial analysis service¹ | UDB SHP¹ |
ShapeFile |
The zip package compressed with *.shp, *.dbf, *.shx, *.prj, etc., format files. |
REST map service REST data service REST spatial analysis service¹ WMS 1.1.1 service WMS 1.3.0 service WMTS 1.0.0 service WMTS-China service |
UDB¹ SHP |
FileGDB | The zip format files. | - | GDB |
SMTiles file |
The *.smtiles format file, or the zip package compressed with the *.smtiles format file. |
REST map service WMS 1.1.1 service WMS 1.3.0 service WMTS 1.0.0 service WMTS-China service | SMTILES |
SVTiles file |
The *.svtiles format file, or the zip package compressed with the *.svtiles format file. |
REST map service | SVTILES |
MBTiles file |
The *.mbtiles format data file, or the zip package compressed with the *.mbtiles format data file. |
REST map service WMS 1.1.1 service WMS 1.3.0 service WMTS 1.0.0 service WMTS-China service | MBTILES |
TPK file |
The *.tpk format data file, or the zip package compressed with the *.tpk format data file. |
REST map service WMS 1.1.1 service WMS 1.3.0 service WMTS 1.0.0 service WMTS-China service | TPK |
UGCV5 cache |
The zip package compressed with the UGCV5 cache files. |
REST map service WMS 1.1.1 service WMS 1.3.0 service WMTS 1.0.0 service WMTS-China service | UGCV5 |
UGCV5(MVT) cache |
The zip package compressed with the UGCV5 vector cache files. |
REST map service WMS 1.1.1 service WMS 1.3.0 service WMTS 1.0.0 service WMTS-China service | UGCV5_MVT |
JSON data |
The *.json format data file. |
- | JSON |
Excel data |
The *.xls, or *.xlsx format data file. |
REST map service¹ REST data service¹ REST spatial analysis service¹ | EXCEL UDB¹ SHP¹ |
CSV data |
The *.csv format data file. |
REST map service¹ REST data service¹ REST spatial analysis service¹ | CSV UDB¹ SHP¹ |
GeoJSON data |
The *.geojson format data file. |
REST map service¹ REST data service¹ REST spatial analysis service¹ | GEOJSON UDB¹ SHP¹ |
PDF data |
The *.pdf format data file. |
- | |
Other types |
The any format data file. |
- | Any format |
¹ Represents the service type, or the download format is only supported when configuring the relational storage.
If you need to manage non-GIS data such as audio and video resources, you can upload it by using REST API. For details, see: The POST request of myDatas resource.
Additionally, iPortal has a size limit on the data capacity uploaded to iPortal. By default, the maximum capacity you can upload is 2048MB. The administrator can modify this configuration. For details, see: The uploaded data capacity configuration.
Upload steps:
-
On iPortal home page, click Resource Center > Data to enter the data resource page, click "Upload data" (needs login) to enter the data uploading page;
-
Select "Data Type", specify the "Data File" to upload, set the "Name" and "Tags", then click "Next"; click "Upload and Publish" to upload and publish the data to the service. If you use the shared storage publishing service, please refer to: Use shared storage publishing services.
-
Select ‘Upload and Publish’ to enter the publish service page, tick the service type to be published, and click ‘Next’ to configure the service parameters;
-
When selecting to publish as Traffic Network Analysis Service, please refer to: Traffic Network Analysis Service Provider Configuration Parameters for parameter descriptions; when selecting to publish as 3D Network Analysis Service, please refer to: 3D Network Analysis Service Provider Configuration Parameters for parameter descriptions;
-
Wait until the data uploading and publishing are finished, then the process is completed. Or you can also uncheck and directly click "Upload" to upload the data. When the uploading is finished, you can also perform publishing operations on Resource Center > Data > My Data page.
Note: If uploading ShapeFile data, you also need to choose the file encoding format: UTF-8/GBK.
When uploading is finished, the system will automatically forward to the details page of the uploaded data item, you can view/edit related infos, download data, or switch to the "Sharing" tab to perform sharing operations. For details, see: Share data.
All of the uploaded data will be shown on the Resource Center > Data > My Data page. Besides the publish, edit, download, and share operations you can perform on the My Data page, the operations of update, delete, preview pdf data are also provided.
- If services have been published before the update operation, the services will be re-published when performing the update operation, while the service name will keep the same.
- If the data is deleted, the associated published service will also be deleted simultaneously. Note: If the data to be deleted has associated maps, insights, dashboards and other applications, the deletion operation will cause these associated resources to not be accessed normally. For more information about deletion, see: Delete resources.
Note:
1 If the iPortal administrator enables the Service review function (disabled by default), after the data is published as services, the hosted services that automatically registered into iPortal will be in "Pending Review" state. The registration will succeed only when the administrator approves the review. To set sharing settings for a service to be reviewed or an unapproved service will not take effect. Users can check whether a service is approved or not by viewing the identification on the service thumbnail on "My Service" page. "Pending administrator review" shows the service in a "pending" state, while "Review Rejected" shows the administrator has rejected the review.
2 The data from adding a file, the point, line, or region data from adding a markerlayer in DataViz WebApp, and the data added in DataInsights WebApp, all of them will be saved in "My Data".
3: If the number of services you can publish has reached the upper limit, please contact your administrator to update the quota for you.
Register data
Registering data in iPortal also requires the user to be of the "CREATOR" type and has the role of uploading data and publishing service permissions, such as DATA_CENTER (the division of user type and permissions in iPortal, see: Role, User Type and Permissions). Also, the administrator needs to specify hosting servers. iPortal supports to register the following format data:
- The CSV format data in Hadoop Distributed File System (HDFS)
Register HDFS data:
-
On iPortal home page, click Resource Center > Data to enter the data resource page, click "Register Data" (needs login) to enter the registration page, setting the following items:
- Type: the type of data to register. Here select HDFS.
- HDFS Data Path: fill in the HDFS path + CSV name, such as: hdfs://{ip}:9000/data/newyork_taxi_2013-01_14k.csv
- Name: fill in the custom data name
- Tags: fill in the custom tags for the data
-
Click "Register", the system will automatically parse and display the related configuration infos for the data, but you need to verify them manually:
- X Index: the column corresponding to the X coordinate in the data
- Y Index: the column corresponding to the Y coordinate in the data
- EpsgCode: the EPSG code corresponding to the projected coordinate system of the data
- Separator: the separator character in the CSV file
- Whether include header: check according to whether the registered CSV data includes the table header
-
Click the "Verify" button to confirm the data configuration infos. If you can't confirm now, you can click "Verify Later". Later, you can also verify by clicking the
button on the data item or on the details page.
Register database:
- Data in PostGIS database
- Data in PostgreSQL database
- Data in MySQL database
If you want to customize the encryption key for the database connection information, see: iPortal configuration file description.
Note: Databases support querying spatial data, need to meet MySQL 8.0 and above version, PostGIS need to be installed in PostgreSQL 9.6 and above version.
Register PostGIS database:
-
On iPortal home page, click Resource Center > Data to enter the data resource page, click "Register Data" (needs login) to enter the registration page, setting the following items:
- Type: select database storage
- Name:fill in the customized data name
- Database type:select POSTGIS
- Server address:Fill in the service address of the database in the format of 1. IP address, such as: 192.168.1.1, 2. host address, such as: supermap.com
- Port: Fill in the port of the database
- Database: fill in the name of the database to be used
- User name: the user name of the database owner
- Password: the password of the database owner
- Schema: default is public, need to be consistent with the schema name set by creating database
- Table name: register all the tables by default, you can specify one or more tables after checking the box
- Connection parameters: fill in the connection parameters, the format is option1=value1&option2=value2
- Tags: fill in the custom tags for the data
-
Click "Register" to complete the PostGIS data registration process.
Register PostgreSQL database:
-
On iPortal home page, click Resource Center > Data to enter the data resource page, click "Register Data" (needs login) to enter the registration page, setting the following items:
- Type: select database storage
- Name:fill in the customized data name
- Database type:select POSTGRESQL
- Server address:Fill in the service address of the database in the format of 1. IP address, such as: 192.168.1.1, 2. host address, such as: supermap.com
- Port: Fill in the port of the database
- Database: fill in the name of the database to be used
- User name: the user name of the database owner
- Password: the password of the database owner
- Schema: default is public, need to be consistent with the schema name set by creating database
- Table name: register all the tables by default, you can specify one or more tables after checking the box
- Connection parameters: fill in the connection parameters, the format is option1=value1&option2=value2
- Tags: fill in the custom tags for the data
-
Click "Register" to complete the PostgreSQL data registration process.
Register MySQL database:
-
On iPortal home page, click Resource Center > Data to enter the data resource page, click "Register Data" (needs login) to enter the registration page, setting the following items:
- Type: select database storage
- Name:fill in the customized data name
- Database type:select MYSQL
- Server address:Fill in the service address of the database in the format of 1. IP address, such as: 192.168.1.1, 2. host address, such as: supermap.com
- Port: Fill in the port of the database
- Database: fill in the name of the database to be used
- User name: the user name of the database owner
- Password: the password of the database owner
- Table name: register all the tables by default, you can specify one or more tables after checking the box
- Connection parameters: fill in the connection parameters, the format is option1=value1&option2=value2
- Tags: fill in the custom tags for the data
-
Click "Register" to complete the MySQL data registration process.
After registered successfully, the system will automatically forward to the details page of the data item, where you can view or edit related infos. To share the data, you can switch to the "Sharing" tab to perform. For details, see: Share data.
All of the registered data shows on the Resource Center > Data > My Data page. Note: The registered data doesn't occupy data storage capacity, and doesn't support publishing and downloading, only supports editing data details, sharing data, and deleting data operations.
Register database workspace
Register database workspace in iPortal also requires the user to be of the "CREATOR" type and has the role of uploading data and publishing service permissions, such as DATA_CENTER (the division of user type and permissions in iPortal, see: Role, User Type and Permissions). Also, the administrator needs to specify hosting servers. iPortal supports to register the following format database workspace:
- Oracle workspace
- SQL Server workspace
- PostgreSQL workspace
- DM workspace
- PostGIS workspace
In SuperMap iPortal, supports rapid publishing of database-type workspaces as GIS services.
Register Steps:
- On iPortal home page, click Resource Center > Data to enter the data resource page, click "Register Data" (needs login) to enter the registration page, setting the following items:
- Type: select database workspace
- Data name:fill in the customized data name
- Database Type: Select the data source as the corresponding database workspace, support Oracle, SQL Server, PostgreSQL, DM, PostGIS workspace
- Server address:Fill in the service address of the database in the format of IP address, such as: 192.168.1.1, 2
- Port: Fill in the port of the database
- Workspace name: fill in the workspace name
- Database: fill in the name of the database to be used
- User name: the user name of the database owner
- Password: the password of the database owner
- Driver: Name of the driver for ODBC connection. When only SQL Server database uses ODBC connection, the driver name can be SQL Server or SQL Native Client; when PostgreSQL is selected, the driver is pgSQL Server.
- Tags: fill in the custom tags for the data
- Click ‘Register’ to complete the registration of the database workspace. Click ‘Register and publish’ to register and publish the database workspace as a service;
- If select ‘Register and publish’, it will enter the publish service page, which will analyse and judge according to the selected workspace, and give options for the types of services that can be published. Tick the service type you want to publish and click Next to configure the service parameters;
- Database-based workspaces can support publishing as: REST-Map Service, REST-Data Service, REST-3D Service, REST-Spatial Analysis Service, REST-3D Network Analysis Service, REST-Traffic Network Analysis Service, REST-Vector Tile Service, WMS1.1.1 Service, WMS1.3.0 Service, WMTS1.0.0 Service, WMTS-CHINA Service, WFS1.0.0 Service, WFS2.0.0 Service
- Select or fill in the appropriate service configuration and click Publish to publish the service;
- When the selected service type is a map service type, e.g., REST-Map Service, WMS1.1.1 Service, WMS1.3.0 Service, WMTS1.0.0 Service, WMTS-CHINA Service, the service configuration item is:
- Whether editing is allowed. The default is not editable.
- DPI setting. The default value is 96 and the minimum DPI can be set to 60.
- When the selected service type is a data service type, e.g. REST-Data-Service, WFS1.0.0 Service, WFS2.0.0 Service, the service configuration item is:
- Whether editing is allowed. The default is not editable. When Allow Editing is selected, support is enabled for Delayed Commit. When you turn on delayed submit, the system will delay submitting the data editing operation according to the settings.
- Select the dataset to publish, not enabled by default. Publish all datasets when not enabled, and publish selected datasets when enabled. For a description of the parameters, please refer to: Local data service provider. The editable nature of the data service can be controlled through the configuration of the service component after publishing is complete.
- When the selected service type is REST-Traffic Network Analysis Service, REST-3D Network Analysis Service, it needs to be supplemented with relevant parameter configurations. For a description of the parameters, please refer to: Local transportation analysis service provider.
- When the selected service type is REST-3D Service, REST-Spatial Analysis Service, or REST-Vector Tile Service, no configuration is required, and you can simply ‘Publish’ it.
- Wait for the registration to complete and the service to be published successfully to complete the process. If you choose to ‘Register’ instead of ‘Register and Publish’ when registering a database workspace, you can wait for the registration to complete and then perform the publishing operation on the ‘Resource Centre’ > ‘Data’ > ‘My Data’ page. Centre > Data > My Data.
When registering is finished, the system will automatically forward to the details page of the uploaded data item, you can view/edit related infos, or switch to the "Sharing" tab to perform sharing operations. For details, see: Share data.
All of the register database workspace will be shown on the Resource Center > Data > My Data page. Besides the publish, edit, download, and share operations you can perform on the My Data page, the operations of update, delete are also provided.
- If services have been published before the update operation, the services will be re-published when performing the update operation, while the service name will keep the same.
- If the data is deleted, the associated published service will also be deleted simultaneously. Note: If the data to be deleted has associated maps, insights, dashboards and other applications, the deletion operation will cause these associated resources to not be accessed normally. For more information about deletion, see: Delete resources.
Note:
1 If the iPortal administrator enables the Service review function (disabled by default), after the database workspace is published as services, the hosted services that automatically registered into iPortal will be in "Pending Review" state. The registration will succeed only when the administrator approves the review. To set sharing settings for a service to be reviewed or an unapproved service will not take effect. Users can check whether a service is approved or not by viewing the identification on the service thumbnail on "My Service" page. "Pending administrator review" shows the service in a "pending" state, while "Review Rejected" shows the administrator has rejected the review.
2: If the number of services you can publish has reached the upper limit, please contact your administrator to update the quota for you.
Using the data added to iPortal
The GIS data added into the portal can be directly used in built-in WebApps to use maps or various charts for visual expression and in-depth analysis. Also, when the data is published as services, the services can be used in WebApps or called by other Web GIS applications. Specifically:
-
In the DataViz Web App :
-
- You can directly add Excel, CSV, GeoJSON or ShapeFile data by Adding from file as a FeaturesLayer to overlap on the BaseLayer;
- Or, after published the data as a service, you can add the REST map service or REST data service as a layer;
- Now, you can use the data to make various thematic maps according to your needs.
-
In the DataInsights Web App:
-
- You can add the Excel, CSV, GeoJSON, ShapeFile, or the registered HDFS data;
- Or, add the REST map service or REST data service by publishing the data;
- Now, you can use the added data or service to use maps or charts for visual expression; Furthermore, in the map view, you can use the provided analysis function to explore the law and value of the data.
Note: The added HDFS data only can be used for the distributed analysis function.
-
In the iEarth Web App: You can add the published REST 3D service into the scene as a layer. And in the scene, you can Add point, line, or region features, or use measure, query, or perform analysis functions.
-
In the MapDashboard Web App, the public data, my data, iServer REST service are supported as the datasource of the visual components. For details, see: Add visual components.
-
In your Web GIS system, to call the services in iPortal, see: Use iCient JavaScript to call the resources of iPortal.