diff --git a/docs/dws/umn/.placeholder b/docs/dws/umn/.placeholder deleted file mode 100644 index e69de29b..00000000 diff --git a/docs/dws/umn/ALL_META.TXT.json b/docs/dws/umn/ALL_META.TXT.json new file mode 100644 index 00000000..543bf81d --- /dev/null +++ b/docs/dws/umn/ALL_META.TXT.json @@ -0,0 +1,2072 @@ +[ + { + "uri":"dws_01_index.html", + "product_code":"dws", + "code":"1", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Service Overview", + "title":"Service Overview", + "githuburl":"" + }, + { + "uri":"dws_01_0002.html", + "product_code":"dws", + "code":"2", + "des":"GaussDB(DWS) is an online data processing database that runs on the cloud infrastructure to provide scalable, fully-managed, and out-of-the-box analytic database service,", + "doc_type":"usermanual", + "kw":"What Is GaussDB(DWS)?,Service Overview,User Guide", + "title":"What Is GaussDB(DWS)?", + "githuburl":"" + }, + { + "uri":"dws_01_0007.html", + "product_code":"dws", + "code":"3", + "des":"GaussDB(DWS) uses the GaussDB database kernel and is compatible with PostgreSQL 9.2.4. It transforms from a single OLTP database to an enterprise-level distributed OLAP d", + "doc_type":"usermanual", + "kw":"Advantages,Service Overview,User Guide", + "title":"Advantages", + "githuburl":"" + }, + { + "uri":"dws_01_00013.html", + "product_code":"dws", + "code":"4", + "des":"Enhanced ETL + Real-time BI analysisETL + BI analysisThe data warehouse is the pillar of the Business Intelligence (BI) system for collecting, storing, and analyzing mass", + "doc_type":"usermanual", + "kw":"Application Scenarios,Service Overview,User Guide", + "title":"Application Scenarios", + "githuburl":"" + }, + { + "uri":"dws_01_0091.html", + "product_code":"dws", + "code":"5", + "des":"GaussDB(DWS) enables you to use this service through various methods, such as the GaussDB(DWS) management console, GaussDB(DWS) client, and REST APIs. This section descri", + "doc_type":"usermanual", + "kw":"Functions,Service Overview,User Guide", + "title":"Functions", + "githuburl":"" + }, + { + "uri":"dws_01_0004.html", + "product_code":"dws", + "code":"6", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Concepts", + "title":"Concepts", + "githuburl":"" + }, + { + "uri":"dws_01_0005.html", + "product_code":"dws", + "code":"7", + "des":"A cluster is a server group that consists of multiple nodes. GaussDB(DWS) is organized using clusters. A data warehouse cluster contains nodes with the same flavor in the", + "doc_type":"usermanual", + "kw":"GaussDB(DWS) Management Concepts,Concepts,User Guide", + "title":"GaussDB(DWS) Management Concepts", + "githuburl":"" + }, + { + "uri":"dws_01_0006.html", + "product_code":"dws", + "code":"8", + "des":"A data warehouse cluster is an analysis-oriented relational database platform that supports online analysis.OLAP is a major function of data warehouse clusters. It suppor", + "doc_type":"usermanual", + "kw":"GaussDB(DWS) Database Concepts,Concepts,User Guide", + "title":"GaussDB(DWS) Database Concepts", + "githuburl":"" + }, + { + "uri":"dws_01_0003.html", + "product_code":"dws", + "code":"9", + "des":"GaussDB(DWS) uses Identity and Access Management (IAM) for authentication and authorization.Users who have the DWS Administrator permissions can fully utilize GaussDB(DWS", + "doc_type":"usermanual", + "kw":"Related Services,Service Overview,User Guide", + "title":"Related Services", + "githuburl":"" + }, + { + "uri":"dws_01_0144.html", + "product_code":"dws", + "code":"10", + "des":"If you need to assign different permissions to employees in your enterprise to access your cloud GaussDB(DWS) resources, IAM is a good choice for fine-grained permissions", + "doc_type":"usermanual", + "kw":"GaussDB(DWS) Permissions Management,Service Overview,User Guide", + "title":"GaussDB(DWS) Permissions Management", + "githuburl":"" + }, + { + "uri":"dws_01_0009.html", + "product_code":"dws", + "code":"11", + "des":"The following figure shows how to use GaussDB(DWS).GaussDB(DWS) provides a web-based management console and HTTPS-compliant APIs for you to manage data warehouse clusters", + "doc_type":"usermanual", + "kw":"GaussDB(DWS) Access,Service Overview,User Guide", + "title":"GaussDB(DWS) Access", + "githuburl":"" + }, + { + "uri":"dws_01_0010.html", + "product_code":"dws", + "code":"12", + "des":"You can manage clusters only and cannot directly access nodes in a cluster. You can use a cluster's IP address and port to access the database in the cluster.You cannot c", + "doc_type":"usermanual", + "kw":"Restrictions,Service Overview,User Guide", + "title":"Restrictions", + "githuburl":"" + }, + { + "uri":"dws_01_00113.html", + "product_code":"dws", + "code":"13", + "des":"This section describes the technical specifications of GaussDB(DWS) in different versions.", + "doc_type":"usermanual", + "kw":"Technical Specifications,Service Overview,User Guide", + "title":"Technical Specifications", + "githuburl":"" + }, + { + "uri":"dws_01_0078.html", + "product_code":"dws", + "code":"14", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Getting Started", + "title":"Getting Started", + "githuburl":"" + }, + { + "uri":"dws_01_0088.html", + "product_code":"dws", + "code":"15", + "des":"This guide is an introductory tutorial that demonstrates how to create a sample GaussDB(DWS) cluster, connect to the cluster database, import the sample data from OBS, an", + "doc_type":"usermanual", + "kw":"Step 1: Starting Preparations,Getting Started,User Guide", + "title":"Step 1: Starting Preparations", + "githuburl":"" + }, + { + "uri":"dws_01_0013.html", + "product_code":"dws", + "code":"16", + "des":"Before using GaussDB(DWS) to analyze data, create a cluster. A cluster consists of multiple nodes in the same subnet. These nodes together provide services. This section ", + "doc_type":"usermanual", + "kw":"Step 2: Creating a Cluster,Getting Started,User Guide", + "title":"Step 2: Creating a Cluster", + "githuburl":"" + }, + { + "uri":"dws_01_0107.html", + "product_code":"dws", + "code":"17", + "des":"This section describes how to use a database client to connect to the database in a GaussDB(DWS) cluster. In the following example, the Data Studio client tool is used fo", + "doc_type":"usermanual", + "kw":"Step 3: Connecting to a Cluster,Getting Started,User Guide", + "title":"Step 3: Connecting to a Cluster", + "githuburl":"" + }, + { + "uri":"dws_01_0079.html", + "product_code":"dws", + "code":"18", + "des":"After performing the steps in preceding sections, you can refer to the documentation listed as follows for more information about GaussDB(DWS):Data Warehouse Service (DWS", + "doc_type":"usermanual", + "kw":"Step 4: Viewing Other Documents and Clearing Resources,Getting Started,User Guide", + "title":"Step 4: Viewing Other Documents and Clearing Resources", + "githuburl":"" + }, + { + "uri":"dws_01_0018.html", + "product_code":"dws", + "code":"19", + "des":"GaussDB(DWS) is an online data processing database that uses the cloud infrastructure to provide scalable, fully-managed, and out-of-the-box analytic database service, fr", + "doc_type":"usermanual", + "kw":"Process for Using GaussDB(DWS),User Guide", + "title":"Process for Using GaussDB(DWS)", + "githuburl":"" + }, + { + "uri":"dws_01_0154.html", + "product_code":"dws", + "code":"20", + "des":"Before using GaussDB(DWS), make the following preparations:Registering a Public Cloud Account and Completing Real-Name AuthenticationDetermining the Cluster PortsIf you d", + "doc_type":"usermanual", + "kw":"Preparations,User Guide", + "title":"Preparations", + "githuburl":"" + }, + { + "uri":"dws_01_0160.html", + "product_code":"dws", + "code":"21", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Cluster Configuration", + "title":"Cluster Configuration", + "githuburl":"" + }, + { + "uri":"dws_01_0157.html", + "product_code":"dws", + "code":"22", + "des":"This section describes how to log in to the GaussDB(DWS) management console and use GaussDB(DWS).", + "doc_type":"usermanual", + "kw":"Accessing the GaussDB(DWS) Management Console,Cluster Configuration,User Guide", + "title":"Accessing the GaussDB(DWS) Management Console", + "githuburl":"" + }, + { + "uri":"dws_01_0019.html", + "product_code":"dws", + "code":"23", + "des":"To use cloud GaussDB(DWS), create a cluster first.This section describes how to create a data warehouse cluster on the GaussDB(DWS) management console.You have evaluated ", + "doc_type":"usermanual", + "kw":"Creating a Cluster,Cluster Configuration,User Guide", + "title":"Creating a Cluster", + "githuburl":"" + }, + { + "uri":"dws_01_0131.html", + "product_code":"dws", + "code":"24", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Cluster Connection", + "title":"Cluster Connection", + "githuburl":"" + }, + { + "uri":"dws_01_0137.html", + "product_code":"dws", + "code":"25", + "des":"If you have created a GaussDB(DWS) cluster, you can use the SQL client tool or a third-party driver such as JDBC or ODBC to connect to the cluster and access the database", + "doc_type":"usermanual", + "kw":"Methods of Connecting to a Cluster,Cluster Connection,User Guide", + "title":"Methods of Connecting to a Cluster", + "githuburl":"" + }, + { + "uri":"dws_01_0033.html", + "product_code":"dws", + "code":"26", + "des":"You can access GaussDB(DWS) clusters by different methods and the connection address of each connection method varies. This section describes how to view and obtain the p", + "doc_type":"usermanual", + "kw":"Obtaining the Cluster Connection Address,Cluster Connection,User Guide", + "title":"Obtaining the Cluster Connection Address", + "githuburl":"" + }, + { + "uri":"dws_01_0093.html", + "product_code":"dws", + "code":"27", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Using the gsql CLI Client to Connect to a Cluster", + "title":"Using the gsql CLI Client to Connect to a Cluster", + "githuburl":"" + }, + { + "uri":"dws_01_0031.html", + "product_code":"dws", + "code":"28", + "des":"GaussDB(DWS) provides client tool packages that match the cluster versions. You can download the desired client tool package on the GaussDB(DWS) management console.The cl", + "doc_type":"usermanual", + "kw":"Downloading the Client,Using the gsql CLI Client to Connect to a Cluster,User Guide", + "title":"Downloading the Client", + "githuburl":"" + }, + { + "uri":"dws_01_0128.html", + "product_code":"dws", + "code":"29", + "des":"The gsql command line client provided by GaussDB(DWS) runs on the Linux OS. Before using it to remotely connect to a GaussDB(DWS) cluster, you need to prepare a Linux hos", + "doc_type":"usermanual", + "kw":"Preparing an ECS as the gsql Client Host,Using the gsql CLI Client to Connect to a Cluster,User Guid", + "title":"Preparing an ECS as the gsql Client Host", + "githuburl":"" + }, + { + "uri":"dws_01_0037.html", + "product_code":"dws", + "code":"30", + "des":"This section describes how to connect to a database through an SQL client after you create a data warehouse cluster and before you use the cluster's database. GaussDB(DWS", + "doc_type":"usermanual", + "kw":"Using the gsql Client to Connect to a Cluster,Using the gsql CLI Client to Connect to a Cluster,User", + "title":"Using the gsql Client to Connect to a Cluster", + "githuburl":"" + }, + { + "uri":"dws_01_0038.html", + "product_code":"dws", + "code":"31", + "des":"If the client or JDBC/ODBC driver needs to use SSL connection, you must configure related SSL connection parameters in the client or application code. The GaussDB(DWS) ma", + "doc_type":"usermanual", + "kw":"Establishing Secure TCP/IP Connections in SSL Mode,Using the gsql CLI Client to Connect to a Cluster", + "title":"Establishing Secure TCP/IP Connections in SSL Mode", + "githuburl":"" + }, + { + "uri":"dws_01_0076.html", + "product_code":"dws", + "code":"32", + "des":"GaussDB(DWS) supports connections in SSL authentication mode so that data transmitted between the GaussDB(DWS) client and the database can be encrypted. The SSL mode deli", + "doc_type":"usermanual", + "kw":"(Optional) Configuring SSL Connection,Using the gsql CLI Client to Connect to a Cluster,User Guide", + "title":"(Optional) Configuring SSL Connection", + "githuburl":"" + }, + { + "uri":"dws_01_0083.html", + "product_code":"dws", + "code":"33", + "des":"GaussDB(DWS) supports the standard SSL (TLS 1.2). As a highly secure protocol, SSL authenticates bidirectional identification between the server and client using digital ", + "doc_type":"usermanual", + "kw":"(Optional) Downloading the SSL Certificate,Using the gsql CLI Client to Connect to a Cluster,User Gu", + "title":"(Optional) Downloading the SSL Certificate", + "githuburl":"" + }, + { + "uri":"dws_01_0094.html", + "product_code":"dws", + "code":"34", + "des":"Data Studio is a SQL client tool running on the Windows operating system. It provides various GUIs for you to manage databases and database objects, as well as edit, run,", + "doc_type":"usermanual", + "kw":"Using the Data Studio GUI Client to Connect to a Cluster,Cluster Connection,User Guide", + "title":"Using the Data Studio GUI Client to Connect to a Cluster", + "githuburl":"" + }, + { + "uri":"dws_01_0081.html", + "product_code":"dws", + "code":"35", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Using the JDBC and ODBC Drivers to Connect to a Cluster", + "title":"Using the JDBC and ODBC Drivers to Connect to a Cluster", + "githuburl":"" + }, + { + "uri":"dws_01_0106.html", + "product_code":"dws", + "code":"36", + "des":"If the connection pool mechanism is used during application development, the following specifications must be met. Otherwise, connections in the connection pool have stat", + "doc_type":"usermanual", + "kw":"Development Specifications,Using the JDBC and ODBC Drivers to Connect to a Cluster,User Guide", + "title":"Development Specifications", + "githuburl":"" + }, + { + "uri":"dws_01_0032.html", + "product_code":"dws", + "code":"37", + "des":"The JDBC or ODBC driver is used to connect to data warehouse clusters. You can download the JDBC or ODBC driver provided by GaussDB(DWS) from the management console or us", + "doc_type":"usermanual", + "kw":"Downloading the JDBC or ODBC Driver,Using the JDBC and ODBC Drivers to Connect to a Cluster,User Gui", + "title":"Downloading the JDBC or ODBC Driver", + "githuburl":"" + }, + { + "uri":"dws_01_0077.html", + "product_code":"dws", + "code":"38", + "des":"In GaussDB(DWS), you can use a JDBC driver to connect to a database on Linux or Windows. The driver can connect to the database through an ECS on the cloud platform or ov", + "doc_type":"usermanual", + "kw":"Using a JDBC Driver to Connect to a Database,Using the JDBC and ODBC Drivers to Connect to a Cluster", + "title":"Using a JDBC Driver to Connect to a Database", + "githuburl":"" + }, + { + "uri":"dws_01_0086.html", + "product_code":"dws", + "code":"39", + "des":"GaussDB(DWS) allows you to use an ODBC driver to connect to the database through an ECS on the cloud platform or over the Internet.For details about how to use the ODBC A", + "doc_type":"usermanual", + "kw":"Using an ODBC Driver to Connect to a Database,Using the JDBC and ODBC Drivers to Connect to a Cluste", + "title":"Using an ODBC Driver to Connect to a Database", + "githuburl":"" + }, + { + "uri":"dws_01_0133.html", + "product_code":"dws", + "code":"40", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Connecting to a Cluster Using IAM Authentication", + "title":"Connecting to a Cluster Using IAM Authentication", + "githuburl":"" + }, + { + "uri":"dws_01_0134.html", + "product_code":"dws", + "code":"41", + "des":"GaussDB(DWS) allows you to access databases using IAM authentication. When you use the JDBC application program to connect to a cluster, set the IAM username, credential,", + "doc_type":"usermanual", + "kw":"Overview,Connecting to a Cluster Using IAM Authentication,User Guide", + "title":"Overview", + "githuburl":"" + }, + { + "uri":"dws_01_0135.html", + "product_code":"dws", + "code":"42", + "des":"The IAM account you use to access a database must be granted with the DWS Database Access permission. Only users with both the DWS Administrator and DWS Database Access p", + "doc_type":"usermanual", + "kw":"Granting an IAM Account the DWS Database Access Permission,Connecting to a Cluster Using IAM Authent", + "title":"Granting an IAM Account the DWS Database Access Permission", + "githuburl":"" + }, + { + "uri":"dws_01_0136.html", + "product_code":"dws", + "code":"43", + "des":"You can log in to the management console to create an AK/SK pair or use an existing one.Log in to the management console, move your cursor over your account in the upper ", + "doc_type":"usermanual", + "kw":"Creating an IAM User Credential,Connecting to a Cluster Using IAM Authentication,User Guide", + "title":"Creating an IAM User Credential", + "githuburl":"" + }, + { + "uri":"dws_01_0132.html", + "product_code":"dws", + "code":"44", + "des":"When you use the JDBC application program to connect to a cluster, set the IAM username, credential, and other information as you configure the JDBC URL. After doing this", + "doc_type":"usermanual", + "kw":"Configuring the JDBC Connection to Connect to a Cluster Using IAM Authentication,Connecting to a Clu", + "title":"Configuring the JDBC Connection to Connect to a Cluster Using IAM Authentication", + "githuburl":"" + }, + { + "uri":"dws_01_0039.html", + "product_code":"dws", + "code":"45", + "des":"By default, a database supports a certain number of connections. Administrators can manage database connections to learn about the connection performance of the current d", + "doc_type":"usermanual", + "kw":"Managing Database Connections,Cluster Connection,User Guide", + "title":"Managing Database Connections", + "githuburl":"" + }, + { + "uri":"dws_01_0600.html", + "product_code":"dws", + "code":"46", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Clusters", + "title":"Clusters", + "githuburl":"" + }, + { + "uri":"dws_01_0020.html", + "product_code":"dws", + "code":"47", + "des":"On the Clusters page of the GaussDB(DWS) management console, you can view the general information about a cluster in the cluster list, such as the cluster status, task in", + "doc_type":"usermanual", + "kw":"Checking the Cluster Status,Clusters,User Guide", + "title":"Checking the Cluster Status", + "githuburl":"" + }, + { + "uri":"dws_01_0112.html", + "product_code":"dws", + "code":"48", + "des":"Log in to the GaussDB(DWS) management console. In the navigation tree on the left, choose Clusters. In the cluster list, locate the required cluster and click its name. T", + "doc_type":"usermanual", + "kw":"Viewing Basic Cluster Information,Clusters,User Guide", + "title":"Viewing Basic Cluster Information", + "githuburl":"" + }, + { + "uri":"dws_01_0140.html", + "product_code":"dws", + "code":"49", + "des":"A domain name is a string of characters separated by dots to identify the location of a computer or a computer group on the Internet, for example, www.example.com. You ca", + "doc_type":"usermanual", + "kw":"Managing Access Domain Names,Clusters,User Guide", + "title":"Managing Access Domain Names", + "githuburl":"" + }, + { + "uri":"dws_01_0818.html", + "product_code":"dws", + "code":"50", + "des":"On the Nodes tab page, you can view the node list of the current cluster, add new nodes to or remove nodes from it, and view the node usage, status, and flavors.This feat", + "doc_type":"usermanual", + "kw":"Nodes,Clusters,User Guide", + "title":"Nodes", + "githuburl":"" + }, + { + "uri":"dws_01_0023.html", + "product_code":"dws", + "code":"51", + "des":"As your data warehouse capacity and performance requirements change, you can adjust the sizes of existing clusters on the management console to utilize compute and storag", + "doc_type":"usermanual", + "kw":"Cluster Scale-out,Clusters,User Guide", + "title":"Cluster Scale-out", + "githuburl":"" + }, + { + "uri":"dws_01_0820.html", + "product_code":"dws", + "code":"52", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Cluster Redistribution", + "title":"Cluster Redistribution", + "githuburl":"" + }, + { + "uri":"dws_01_8201.html", + "product_code":"dws", + "code":"53", + "des":"Data redistribution, where data in existing nodes is evenly allocated to the new nodes after you scale out a cluster, is a time-consuming yet crucial task that accelerate", + "doc_type":"usermanual", + "kw":"Redistributing Data,Cluster Redistribution,User Guide", + "title":"Redistributing Data", + "githuburl":"" + }, + { + "uri":"dws_01_8202.html", + "product_code":"dws", + "code":"54", + "des":"On the View Redistribution Details page, you can view the redistribution mode and progress of the current cluster. In offline scheduling mode, you can pause, resume, and ", + "doc_type":"usermanual", + "kw":"Viewing Redistribution Details,Cluster Redistribution,User Guide", + "title":"Viewing Redistribution Details", + "githuburl":"" + }, + { + "uri":"dws_01_8115.html", + "product_code":"dws", + "code":"55", + "des":"In the Unbalanced state, the number of primary instances on some nodes increases. As a result, the load pressure is high. In this case, the cluster is normal, but the ove", + "doc_type":"usermanual", + "kw":"Performing a Primary/Standby Switchback,Clusters,User Guide", + "title":"Performing a Primary/Standby Switchback", + "githuburl":"" + }, + { + "uri":"dws_01_0008.html", + "product_code":"dws", + "code":"56", + "des":"After you create a data warehouse cluster, the system automatically configures a random maintenance window for the cluster. Alternatively, you can customize a maintenance", + "doc_type":"usermanual", + "kw":"Cluster Upgrade,Clusters,User Guide", + "title":"Cluster Upgrade", + "githuburl":"" + }, + { + "uri":"dws_01_0026.html", + "product_code":"dws", + "code":"57", + "des":"GaussDB(DWS) allows you to reset the password of the database administrator. If a database administrator forgets their password or the account is locked because the numbe", + "doc_type":"usermanual", + "kw":"Password Reset,Clusters,User Guide", + "title":"Password Reset", + "githuburl":"" + }, + { + "uri":"dws_01_0024.html", + "product_code":"dws", + "code":"58", + "des":"If a cluster is in the Unbalanced state or cannot work properly, you may need to restart it for restoration. After modifying a cluster's configurations, such as security ", + "doc_type":"usermanual", + "kw":"Cluster Restart,Clusters,User Guide", + "title":"Cluster Restart", + "githuburl":"" + }, + { + "uri":"dws_01_0152.html", + "product_code":"dws", + "code":"59", + "des":"After a cluster is created, you can modify the cluster's database parameters as required. On the GaussDB(DWS) management console, you can view or set common database para", + "doc_type":"usermanual", + "kw":"Modifying Database Parameters,Clusters,User Guide", + "title":"Modifying Database Parameters", + "githuburl":"" + }, + { + "uri":"dws_01_0057.html", + "product_code":"dws", + "code":"60", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"MRS Data Sources", + "title":"MRS Data Sources", + "githuburl":"" + }, + { + "uri":"dws_01_0055.html", + "product_code":"dws", + "code":"61", + "des":"MRS is a big data cluster running based on the open-source Hadoop ecosystem. It provides the industry's latest cutting-edge storage and analysis capabilities of massive v", + "doc_type":"usermanual", + "kw":"Importing Data from MRS to GaussDB(DWS),MRS Data Sources,User Guide", + "title":"Importing Data from MRS to GaussDB(DWS)", + "githuburl":"" + }, + { + "uri":"dws_01_0059.html", + "product_code":"dws", + "code":"62", + "des":"Before GaussDB(DWS) reads data from MRS HDFS, you need to create an MRS data source connection that functions as a channel of transporting data warehouse cluster data and", + "doc_type":"usermanual", + "kw":"Creating an MRS Data Source Connection,MRS Data Sources,User Guide", + "title":"Creating an MRS Data Source Connection", + "githuburl":"" + }, + { + "uri":"dws_01_0156.html", + "product_code":"dws", + "code":"63", + "des":"For MRS, if the following parameter configurations of the HDFS cluster change, data may fail to be imported to the data warehouse cluster from the HDFS cluster. Before im", + "doc_type":"usermanual", + "kw":"Updating the MRS Data Source Configuration,MRS Data Sources,User Guide", + "title":"Updating the MRS Data Source Configuration", + "githuburl":"" + }, + { + "uri":"dws_01_0723.html", + "product_code":"dws", + "code":"64", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Managing Cluster Workloads", + "title":"Managing Cluster Workloads", + "githuburl":"" + }, + { + "uri":"dws_01_07231.html", + "product_code":"dws", + "code":"65", + "des":"When multiple database users query jobs at the same time, some complex queries may occupy cluster resources for a long time, affecting the performance of other queries. F", + "doc_type":"usermanual", + "kw":"Workload Management Overview,Managing Cluster Workloads,User Guide", + "title":"Workload Management Overview", + "githuburl":"" + }, + { + "uri":"dws_01_07233.html", + "product_code":"dws", + "code":"66", + "des":"You can create a maximum of 63 workload queues.", + "doc_type":"usermanual", + "kw":"Adding Workload Queues,Managing Cluster Workloads,User Guide", + "title":"Adding Workload Queues", + "githuburl":"" + }, + { + "uri":"dws_01_07234.html", + "product_code":"dws", + "code":"67", + "des":"You can modify the parameters of a workload queue.Click Edit on the right and modify the parameters according to Table 1.Workload queue parametersParameterDescriptionValu", + "doc_type":"usermanual", + "kw":"Modifying Workload Queues,Managing Cluster Workloads,User Guide", + "title":"Modifying Workload Queues", + "githuburl":"" + }, + { + "uri":"dws_01_07238.html", + "product_code":"dws", + "code":"68", + "des":"In the Query Overview area, you can view the number of long and short queries that are running in the current queue at the current time. The chart information is refreshe", + "doc_type":"usermanual", + "kw":"Workload Queue Query,Managing Cluster Workloads,User Guide", + "title":"Workload Queue Query", + "githuburl":"" + }, + { + "uri":"dws_01_07239.html", + "product_code":"dws", + "code":"69", + "des":"If the queue to be deleted has associated database users, these users will be associated with the default queue after the queue is deleted.", + "doc_type":"usermanual", + "kw":"Deleting Workload Queues,Managing Cluster Workloads,User Guide", + "title":"Deleting Workload Queues", + "githuburl":"" + }, + { + "uri":"dws_01_72362.html", + "product_code":"dws", + "code":"70", + "des":"Workload plan is an advanced workload management feature provided by GaussDB(DWS). You can create a workload plan, add multiple stages to the plan, and configure differen", + "doc_type":"usermanual", + "kw":"Workload Plans,Managing Cluster Workloads,User Guide", + "title":"Workload Plans", + "githuburl":"" + }, + { + "uri":"dws_01_72363.html", + "product_code":"dws", + "code":"71", + "des":"You must stop the workload plan when adding a stage. Otherwise, the stage cannot be added.You can add a maximum of 48 stages for each plan.The switchover time of all phas", + "doc_type":"usermanual", + "kw":"Stages of Workload Plans,Managing Cluster Workloads,User Guide", + "title":"Stages of Workload Plans", + "githuburl":"" + }, + { + "uri":"dws_01_72365.html", + "product_code":"dws", + "code":"72", + "des":"You can commission a workload plan in the test environment and export the plan configurations to the production environment.An ongoing workload plan cannot be imported.Be", + "doc_type":"usermanual", + "kw":"Importing and Exporting Workload Plans,Managing Cluster Workloads,User Guide", + "title":"Importing and Exporting Workload Plans", + "githuburl":"" + }, + { + "uri":"dws_01_0724.html", + "product_code":"dws", + "code":"73", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Managing Logical Clusters", + "title":"Managing Logical Clusters", + "githuburl":"" + }, + { + "uri":"dws_01_7241.html", + "product_code":"dws", + "code":"74", + "des":"A physical cluster can be divided into logical clusters that use the node-group mechanism. Tables in a database can be allocated to different physical nodes by logical cl", + "doc_type":"usermanual", + "kw":"Overview,Managing Logical Clusters,User Guide", + "title":"Overview", + "githuburl":"" + }, + { + "uri":"dws_01_7242.html", + "product_code":"dws", + "code":"75", + "des":"If you access the Logical Clusters page for the first time, the metadata of the logical cluster created at the backend is synchronized to the frontend. After the synchron", + "doc_type":"usermanual", + "kw":"Adding Logical Clusters,Managing Logical Clusters,User Guide", + "title":"Adding Logical Clusters", + "githuburl":"" + }, + { + "uri":"dws_01_7243.html", + "product_code":"dws", + "code":"76", + "des":"Nodes are added to or removed from a logical cluster by ring.At least one ring must be reserved in a logical cluster.The ring removed from the logical cluster will be add", + "doc_type":"usermanual", + "kw":"Editing Logical Clusters,Managing Logical Clusters,User Guide", + "title":"Editing Logical Clusters", + "githuburl":"" + }, + { + "uri":"dws_01_7244.html", + "product_code":"dws", + "code":"77", + "des":"The first added logical cluster cannot be deleted.Nodes of the deleted logical cluster are added to the elastic cluster.", + "doc_type":"usermanual", + "kw":"Deleting Logical Clusters,Managing Logical Clusters,User Guide", + "title":"Deleting Logical Clusters", + "githuburl":"" + }, + { + "uri":"dws_01_7245.html", + "product_code":"dws", + "code":"78", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Restarting Logical Clusters,Managing Logical Clusters,User Guide", + "title":"Restarting Logical Clusters", + "githuburl":"" + }, + { + "uri":"dws_01_7246.html", + "product_code":"dws", + "code":"79", + "des":"Logical clusters and elastic clusters cannot be scaled out online.", + "doc_type":"usermanual", + "kw":"Scaling Out Logical Clusters,Managing Logical Clusters,User Guide", + "title":"Scaling Out Logical Clusters", + "githuburl":"" + }, + { + "uri":"dws_01_0103.html", + "product_code":"dws", + "code":"80", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Managing Tags", + "title":"Managing Tags", + "githuburl":"" + }, + { + "uri":"dws_01_0104.html", + "product_code":"dws", + "code":"81", + "des":"A tag is a key-value pair customized by users and used to identify cloud resources. It helps users to classify and search for cloud resources.Tags are composed of key-val", + "doc_type":"usermanual", + "kw":"Overview,Managing Tags,User Guide", + "title":"Overview", + "githuburl":"" + }, + { + "uri":"dws_01_0105.html", + "product_code":"dws", + "code":"82", + "des":"This section describes how to search for clusters based on tags and how to add, modify, and delete tags for clusters.You can quickly locate a tagged cluster using tags.Yo", + "doc_type":"usermanual", + "kw":"Tag Management,Managing Tags,User Guide", + "title":"Tag Management", + "githuburl":"" + }, + { + "uri":"dws_01_0113.html", + "product_code":"dws", + "code":"83", + "des":"An enterprise project is a cloud resource management mode. Enterprise Management provides users with comprehensive management in cloud-based resources, personnel, and per", + "doc_type":"usermanual", + "kw":"Managing Enterprise Projects,Clusters,User Guide", + "title":"Managing Enterprise Projects", + "githuburl":"" + }, + { + "uri":"dws_01_0025.html", + "product_code":"dws", + "code":"84", + "des":"If you do not need to use a cluster, perform the operations in this section to delete it.Deleted clusters cannot be recovered. Additionally, you cannot access user data a", + "doc_type":"usermanual", + "kw":"Deleting Clusters,Clusters,User Guide", + "title":"Deleting Clusters", + "githuburl":"" + }, + { + "uri":"dws_01_0126.html", + "product_code":"dws", + "code":"85", + "des":"To facilitate database parameter configuration, GaussDB(DWS) provides the parameter template function. A parameter template contains some common database parameters. You ", + "doc_type":"usermanual", + "kw":"Managing Parameter Templates,Clusters,User Guide", + "title":"Managing Parameter Templates", + "githuburl":"" + }, + { + "uri":"dws_01_0073.html", + "product_code":"dws", + "code":"86", + "des":"If a cluster fails to be created, you can go to the Clusters page of the GaussDB(DWS) management console to view the cluster status and the cause of failure.For details a", + "doc_type":"usermanual", + "kw":"Managing Clusters That Fail to Be Created,Clusters,User Guide", + "title":"Managing Clusters That Fail to Be Created", + "githuburl":"" + }, + { + "uri":"dws_01_0035.html", + "product_code":"dws", + "code":"87", + "des":"No database operation is allowed on a read-only cluster. Cancel the read-only status on the management console.You can cancel the read-only status only when a cluster is ", + "doc_type":"usermanual", + "kw":"Read-only Status,Clusters,User Guide", + "title":"Read-only Status", + "githuburl":"" + }, + { + "uri":"dws_01_0161.html", + "product_code":"dws", + "code":"88", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Cluster HA", + "title":"Cluster HA", + "githuburl":"" + }, + { + "uri":"dws_01_0800.html", + "product_code":"dws", + "code":"89", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Snapshots", + "title":"Snapshots", + "githuburl":"" + }, + { + "uri":"dws_01_0151.html", + "product_code":"dws", + "code":"90", + "des":"A snapshot is a full or incremental backup of a GaussDB(DWS) cluster at a specific point in time. It records the current database data and cluster information, including ", + "doc_type":"usermanual", + "kw":"Overview,Snapshots,User Guide", + "title":"Overview", + "githuburl":"" + }, + { + "uri":"dws_01_0092.html", + "product_code":"dws", + "code":"91", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Manual Snapshots", + "title":"Manual Snapshots", + "githuburl":"" + }, + { + "uri":"dws_01_0028.html", + "product_code":"dws", + "code":"92", + "des":"A snapshot is a complete backup that records point-in-time configuration data and service data of a GaussDB(DWS) cluster. This section describes how to create a snapshot ", + "doc_type":"usermanual", + "kw":"Manually Creating a Snapshot,Manual Snapshots,User Guide", + "title":"Manually Creating a Snapshot", + "githuburl":"" + }, + { + "uri":"dws_01_0030.html", + "product_code":"dws", + "code":"93", + "des":"On the Snapshots page, you can delete a snapshot in the Unavailable state or delete an available snapshot to release the storage space.Deleted snapshots cannot be restore", + "doc_type":"usermanual", + "kw":"Deleting Manual Snapshots,Manual Snapshots,User Guide", + "title":"Deleting Manual Snapshots", + "githuburl":"" + }, + { + "uri":"dws_01_1013.html", + "product_code":"dws", + "code":"94", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Automated Snapshots", + "title":"Automated Snapshots", + "githuburl":"" + }, + { + "uri":"dws_01_10131.html", + "product_code":"dws", + "code":"95", + "des":"Automated snapshots adopt differential incremental backups. The automated snapshot created for the first time is a full backup (base version), and then the system creates", + "doc_type":"usermanual", + "kw":"Automated Snapshot Overview,Automated Snapshots,User Guide", + "title":"Automated Snapshot Overview", + "githuburl":"" + }, + { + "uri":"dws_01_0089.html", + "product_code":"dws", + "code":"96", + "des":"You can select a snapshot type and set one or more automated snapshot policies for a cluster. After an automated snapshot policy is enabled, the system automatically crea", + "doc_type":"usermanual", + "kw":"Configuring an Automated Snapshot Policy,Automated Snapshots,User Guide", + "title":"Configuring an Automated Snapshot Policy", + "githuburl":"" + }, + { + "uri":"dws_01_0085.html", + "product_code":"dws", + "code":"97", + "des":"This section describes how to copy snapshots that are automatically created for long-term retention.All snapshots are displayed by default. You can copy the snapshots tha", + "doc_type":"usermanual", + "kw":"Copying Automated Snapshots,Automated Snapshots,User Guide", + "title":"Copying Automated Snapshots", + "githuburl":"" + }, + { + "uri":"dws_01_10134.html", + "product_code":"dws", + "code":"98", + "des":"Only GaussDB(DWS) can delete automated snapshots. You cannot delete them manually.GaussDB(DWS) deletes an automated snapshot if:The retention period of the snapshot ends.", + "doc_type":"usermanual", + "kw":"Deleting an Automated Snapshot,Automated Snapshots,User Guide", + "title":"Deleting an Automated Snapshot", + "githuburl":"" + }, + { + "uri":"dws_01_0021.html", + "product_code":"dws", + "code":"99", + "des":"This section describes how to view snapshot information on the Snapshots page.In the snapshot list, all snapshots are displayed by default. Click next to the snapshot na", + "doc_type":"usermanual", + "kw":"Viewing Snapshot Information,Snapshots,User Guide", + "title":"Viewing Snapshot Information", + "githuburl":"" + }, + { + "uri":"dws_01_1015.html", + "product_code":"dws", + "code":"100", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Restoration Using a Snapshot", + "title":"Restoration Using a Snapshot", + "githuburl":"" + }, + { + "uri":"dws_01_0029.html", + "product_code":"dws", + "code":"101", + "des":"This section describes how to restore a snapshot to a new cluster when you want to check point-in-time snapshot data of the cluster.When a snapshot is restored to a new c", + "doc_type":"usermanual", + "kw":"Restoring a Snapshot to a New Cluster,Restoration Using a Snapshot,User Guide", + "title":"Restoring a Snapshot to a New Cluster", + "githuburl":"" + }, + { + "uri":"dws_01_0080.html", + "product_code":"dws", + "code":"102", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Cluster DR", + "title":"Cluster DR", + "githuburl":"" + }, + { + "uri":"dws_01_00081.html", + "product_code":"dws", + "code":"103", + "des":"A homogeneous GaussDB(DWS) DR cluster is deployed in another AZ. If the production cluster fails to provide read and write services due to natural disasters in the specif", + "doc_type":"usermanual", + "kw":"DR Overview,Cluster DR,User Guide", + "title":"DR Overview", + "githuburl":"" + }, + { + "uri":"dws_01_00082.html", + "product_code":"dws", + "code":"104", + "des":"You can create a DR task only when the cluster is in the Available or Unbalanced state.Type: Cross-AZ DRName: Enter 4 to 64 case-insensitive characters, starting with a l", + "doc_type":"usermanual", + "kw":"Creating a DR Task,Cluster DR,User Guide", + "title":"Creating a DR Task", + "githuburl":"" + }, + { + "uri":"dws_01_00083.html", + "product_code":"dws", + "code":"105", + "des":"On the page that is displayed, view the following information:DR Information: You can view the DR ID, DR name, DR creation time, and DR status.Production Cluster Informat", + "doc_type":"usermanual", + "kw":"Viewing DR Information,Cluster DR,User Guide", + "title":"Viewing DR Information", + "githuburl":"" + }, + { + "uri":"dws_01_00084.html", + "product_code":"dws", + "code":"106", + "des":"The DR status will change to Starting. The process will take some time. After the task is started, the DR status will change to Running.You can start a DR task that is in", + "doc_type":"usermanual", + "kw":"DR Management,Cluster DR,User Guide", + "title":"DR Management", + "githuburl":"" + }, + { + "uri":"dws_01_00085.html", + "product_code":"dws", + "code":"107", + "des":"After scale-out, the number of DNs in the production cluster must be the same as that in the DR cluster.", + "doc_type":"usermanual", + "kw":"Mutually Exclusive DR Cases,Cluster DR,User Guide", + "title":"Mutually Exclusive DR Cases", + "githuburl":"" + }, + { + "uri":"dws_01_0822.html", + "product_code":"dws", + "code":"108", + "des":"If the internal IP address or EIP of a CN is used to connect to a cluster, the failure of this CN will lead to cluster connection failure. If a private domain name is use", + "doc_type":"usermanual", + "kw":"Associating and Disassociating ELB,Cluster HA,User Guide", + "title":"Associating and Disassociating ELB", + "githuburl":"" + }, + { + "uri":"dws_01_7115.html", + "product_code":"dws", + "code":"109", + "des":"After a cluster is created, the number of required CNs varies with service requirements. The CN management function enables you to adjust the number of CNs in the cluster", + "doc_type":"usermanual", + "kw":"CNs,Cluster HA,User Guide", + "title":"CNs", + "githuburl":"" + }, + { + "uri":"dws_01_0162.html", + "product_code":"dws", + "code":"110", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Monitoring and Alarms", + "title":"Monitoring and Alarms", + "githuburl":"" + }, + { + "uri":"dws_01_0022.html", + "product_code":"dws", + "code":"111", + "des":"This section describes how to check cluster metrics on Cloud Eye. By monitoring cluster running metrics, you can identify the time when the database cluster is abnormal a", + "doc_type":"usermanual", + "kw":"Monitoring Clusters Using Cloud Eye,Monitoring and Alarms,User Guide", + "title":"Monitoring Clusters Using Cloud Eye", + "githuburl":"" + }, + { + "uri":"dws_01_00014.html", + "product_code":"dws", + "code":"112", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Databases Monitoring", + "title":"Databases Monitoring", + "githuburl":"" + }, + { + "uri":"dws_01_00131.html", + "product_code":"dws", + "code":"113", + "des":"DMS is provided by GaussDB(DWS) to ensure the fast and stable running of databases. It collects, monitors, and analyzes the disk, network, and OS metric data used by the ", + "doc_type":"usermanual", + "kw":"Database Monitoring Overview,Databases Monitoring,User Guide", + "title":"Database Monitoring Overview", + "githuburl":"" + }, + { + "uri":"dws_01_00136.html", + "product_code":"dws", + "code":"114", + "des":"You can check the status and available resources of a cluster and learn about its real-time resource consumption through the GaussDB(DWS) monitoring items.Table 1 describ", + "doc_type":"usermanual", + "kw":"Monitoring Metrics,Databases Monitoring,User Guide", + "title":"Monitoring Metrics", + "githuburl":"" + }, + { + "uri":"dws_01_00132.html", + "product_code":"dws", + "code":"115", + "des":"On the page that is displayed, you can view the cluster status, real-time resource consumption, top SQL statements, cluster resource consumption, and key database metrics", + "doc_type":"usermanual", + "kw":"Cluster Overview,Databases Monitoring,User Guide", + "title":"Cluster Overview", + "githuburl":"" + }, + { + "uri":"dws_01_00133.html", + "product_code":"dws", + "code":"116", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Monitoring", + "title":"Monitoring", + "githuburl":"" + }, + { + "uri":"dws_01_1331.html", + "product_code":"dws", + "code":"117", + "des":"On the page that is displayed, view the real-time consumption of nodes, memory, disks, disk I/O, and network I/O.On the Overview tab page, you can view the key resources ", + "doc_type":"usermanual", + "kw":"Node Monitoring,Monitoring,User Guide", + "title":"Node Monitoring", + "githuburl":"" + }, + { + "uri":"dws_01_1337.html", + "product_code":"dws", + "code":"118", + "des":"The Performance Monitoring page displays the resource consumption trends of clusters and databases.You can configure monitoring views by customizing monitoring panels. Mo", + "doc_type":"usermanual", + "kw":"Performance Monitoring,Monitoring,User Guide", + "title":"Performance Monitoring", + "githuburl":"" + }, + { + "uri":"dws_01_1332.html", + "product_code":"dws", + "code":"119", + "des":"The Database Monitoring page displays the real-time and historical resource consumption a database.You can select a database and check its resource usage. For details, se", + "doc_type":"usermanual", + "kw":"Database Monitoring,Monitoring,User Guide", + "title":"Database Monitoring", + "githuburl":"" + }, + { + "uri":"dws_01_1333.html", + "product_code":"dws", + "code":"120", + "des":"The Session Monitoring page displays the session-level real-time database query statistics. You can also select and terminate a session.You can browse the query statistic", + "doc_type":"usermanual", + "kw":"Session Monitoring,Monitoring,User Guide", + "title":"Session Monitoring", + "githuburl":"" + }, + { + "uri":"dws_01_1334.html", + "product_code":"dws", + "code":"121", + "des":"The Query Monitoring page displays the real-time information about all queries that are running in a cluster and the historical information about the queries that have be", + "doc_type":"usermanual", + "kw":"Query Monitoring,Monitoring,User Guide", + "title":"Query Monitoring", + "githuburl":"" + }, + { + "uri":"dws_01_1338.html", + "product_code":"dws", + "code":"122", + "des":"On the Instance Monitoring page, you can view the real-time and historical information about detected slow instances.DMS can automatically configure and start the slow in", + "doc_type":"usermanual", + "kw":"Instance Monitoring,Monitoring,User Guide", + "title":"Instance Monitoring", + "githuburl":"" + }, + { + "uri":"dws_01_1339.html", + "product_code":"dws", + "code":"123", + "des":"On the Load Monitoring page, you can view the real-time and historical resource consumption of workload queues.The DMS displays the user-defined workload queue name, real", + "doc_type":"usermanual", + "kw":"Load Monitoring,Monitoring,User Guide", + "title":"Load Monitoring", + "githuburl":"" + }, + { + "uri":"dws_01_00175.html", + "product_code":"dws", + "code":"124", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Utilities", + "title":"Utilities", + "githuburl":"" + }, + { + "uri":"dws_01_00134.html", + "product_code":"dws", + "code":"125", + "des":"To enable SQL diagnosis, enable monitoring on real-time and historical queries on the Queries and History tabs, respectively. For details, see .Query IDDatabaseSchema Nam", + "doc_type":"usermanual", + "kw":"SQL Diagnosis,Utilities,User Guide", + "title":"SQL Diagnosis", + "githuburl":"" + }, + { + "uri":"dws_01_01752.html", + "product_code":"dws", + "code":"126", + "des":"You can audit DDL to check DDL metadata, identify inappropriate table definitions, and locate performance problems.This feature is supported only in cluster version 8.1.2", + "doc_type":"usermanual", + "kw":"DDL Audit,Utilities,User Guide", + "title":"DDL Audit", + "githuburl":"" + }, + { + "uri":"dws_01_00135.html", + "product_code":"dws", + "code":"127", + "des":"The Monitoring page displays the collection period and data aging period of monitoring metrics.The cluster monitoring function is enabled by default.Disable the function ", + "doc_type":"usermanual", + "kw":"Settings,Databases Monitoring,User Guide", + "title":"Settings", + "githuburl":"" + }, + { + "uri":"dws_01_00137.html", + "product_code":"dws", + "code":"128", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Typical Scenarios", + "title":"Typical Scenarios", + "githuburl":"" + }, + { + "uri":"dws_01_01372.html", + "product_code":"dws", + "code":"129", + "des":"The execution of SQL statements takes a long time, resulting in great resource consumption.If the execution efficiency of SQL statements is low, optimization suggestions ", + "doc_type":"usermanual", + "kw":"SQL Diagnosis,Typical Scenarios,User Guide", + "title":"SQL Diagnosis", + "githuburl":"" + }, + { + "uri":"dws_01_01373.html", + "product_code":"dws", + "code":"130", + "des":"Time-consuming SQL statements exist.On the Top 5 Time-Consuming Queries page directed from the Cluster Overview page, record the change of top 5 time-consuming queries.An", + "doc_type":"usermanual", + "kw":"Top Time-Consuming SQL Statements Viewing,Typical Scenarios,User Guide", + "title":"Top Time-Consuming SQL Statements Viewing", + "githuburl":"" + }, + { + "uri":"dws_01_1240.html", + "product_code":"dws", + "code":"131", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Alarms", + "title":"Alarms", + "githuburl":"" + }, + { + "uri":"dws_01_1241.html", + "product_code":"dws", + "code":"132", + "des":"Alarm management includes viewing and configuring alarm rules and subscribing to alarm information. Alarm rules display alarm statistics and details of the past week for ", + "doc_type":"usermanual", + "kw":"Alarm Management,Alarms,User Guide", + "title":"Alarm Management", + "githuburl":"" + }, + { + "uri":"dws_01_1242.html", + "product_code":"dws", + "code":"133", + "des":"Concepts related to threshold alarmsAlarm rule: consists of the alarm rule name, rule description, clusters associated with the rule, alarm policy triggering relationship", + "doc_type":"usermanual", + "kw":"Alarm Rules,Alarms,User Guide", + "title":"Alarm Rules", + "githuburl":"" + }, + { + "uri":"dws_01_1243.html", + "product_code":"dws", + "code":"134", + "des":"You can subscribe to GaussDB(DWS) alarm notifications to receive notifications by SMS message, email, or application when an alarm of a specified severity is generated.To", + "doc_type":"usermanual", + "kw":"Alarm Subscriptions,Alarms,User Guide", + "title":"Alarm Subscriptions", + "githuburl":"" + }, + { + "uri":"dws_01_0700.html", + "product_code":"dws", + "code":"135", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Cluster Security Management", + "title":"Cluster Security Management", + "githuburl":"" + }, + { + "uri":"dws_01_0074.html", + "product_code":"dws", + "code":"136", + "des":"By default, the administrator specified when you create a GaussDB(DWS) cluster is the database system administrator. The administrator can create other users and view the", + "doc_type":"usermanual", + "kw":"Configuring Separation of Permissions,Cluster Security Management,User Guide", + "title":"Configuring Separation of Permissions", + "githuburl":"" + }, + { + "uri":"dws_01_0145.html", + "product_code":"dws", + "code":"137", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Permissions", + "title":"Permissions", + "githuburl":"" + }, + { + "uri":"dws_01_0150.html", + "product_code":"dws", + "code":"138", + "des":"An RBAC policy consists of a Version, a Statement, and Depends.When selecting a policy for a user group, click below the policy to view the details of the policy. The DW", + "doc_type":"usermanual", + "kw":"RBAC Syntax of RBAC Policies,Permissions,User Guide", + "title":"RBAC Syntax of RBAC Policies", + "githuburl":"" + }, + { + "uri":"dws_01_0701.html", + "product_code":"dws", + "code":"139", + "des":"GaussDB(DWS) protects mission-critical operations. If you want to perform a mission-critical operation on the management console, you must enter a credential for identity", + "doc_type":"usermanual", + "kw":"Protection for Mission-Critical Operations,Cluster Security Management,User Guide", + "title":"Protection for Mission-Critical Operations", + "githuburl":"" + }, + { + "uri":"dws_01_0119.html", + "product_code":"dws", + "code":"140", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Audit Logs", + "title":"Audit Logs", + "githuburl":"" + }, + { + "uri":"dws_01_1911.html", + "product_code":"dws", + "code":"141", + "des":"Tenant database audit logs:GaussDB(DWS) allows you to record the audit logs of specific operations, involving audit log retention policies, unauthorized access, as well a", + "doc_type":"usermanual", + "kw":"Overview,Audit Logs,User Guide", + "title":"Overview", + "githuburl":"" + }, + { + "uri":"dws_01_0118.html", + "product_code":"dws", + "code":"142", + "des":"This section is organized as follows:Enabling CTSDisabling the Audit Log FunctionKey OperationsViewing TracesA tracker will be automatically created after CTS is enabled.", + "doc_type":"usermanual", + "kw":"Viewing Audit Logs of Key Operations on the Management Console,Audit Logs,User Guide", + "title":"Viewing Audit Logs of Key Operations on the Management Console", + "githuburl":"" + }, + { + "uri":"dws_01_0075.html", + "product_code":"dws", + "code":"143", + "des":"Database audit logs are configured on the Security Settings page. You can change security settings only when the cluster status is Available and Unbalanced, and Task Info", + "doc_type":"usermanual", + "kw":"Configuring the Database Audit Logs,Audit Logs,User Guide", + "title":"Configuring the Database Audit Logs", + "githuburl":"" + }, + { + "uri":"dws_01_0142.html", + "product_code":"dws", + "code":"144", + "des":"GaussDB(DWS) records information (audit logs) about connections and user activities in your database. With the information, you can monitor the database to ensure securit", + "doc_type":"usermanual", + "kw":"Dumping the Database Audit Logs,Audit Logs,User Guide", + "title":"Dumping the Database Audit Logs", + "githuburl":"" + }, + { + "uri":"dws_03_0061.html", + "product_code":"dws", + "code":"145", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"FAQs", + "title":"FAQs", + "githuburl":"" + }, + { + "uri":"dws_03_0001.html", + "product_code":"dws", + "code":"146", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"General Problems", + "title":"General Problems", + "githuburl":"" + }, + { + "uri":"dws_03_0003.html", + "product_code":"dws", + "code":"147", + "des":"Much data (orders, stocks, materials, and payments) is generated in the business operation systems and background (transactional) database of enterprises.Decision makers ", + "doc_type":"usermanual", + "kw":"Why Are Data Warehouses Necessary?,General Problems,User Guide", + "title":"Why Are Data Warehouses Necessary?", + "githuburl":"" + }, + { + "uri":"dws_03_0005.html", + "product_code":"dws", + "code":"148", + "des":"The Hadoop big data platform can be regarded as a next-generation data warehousing system. It has the characteristics of modern data warehouses and is widely used by ente", + "doc_type":"usermanual", + "kw":"What Are the Differences Between a Data Warehouse and the Hadoop Big Data Platform?,General Problems", + "title":"What Are the Differences Between a Data Warehouse and the Hadoop Big Data Platform?", + "githuburl":"" + }, + { + "uri":"dws_03_0006.html", + "product_code":"dws", + "code":"149", + "des":"Conventional data warehouses are not practical for smaller enterprises due to high cost, time-consuming device and system selection and procurement, and complex scale-out", + "doc_type":"usermanual", + "kw":"Why Should I Use Public Cloud GaussDB(DWS)?,General Problems,User Guide", + "title":"Why Should I Use Public Cloud GaussDB(DWS)?", + "githuburl":"" + }, + { + "uri":"dws_03_0009.html", + "product_code":"dws", + "code":"150", + "des":"Both allow you to run conventional relational databases on the cloud and transfer database management loads. RDS databases are useful for OLTP, reporting, and analysis, b", + "doc_type":"usermanual", + "kw":"Should I Choose Public Cloud GaussDB(DWS) or RDS?,General Problems,User Guide", + "title":"Should I Choose Public Cloud GaussDB(DWS) or RDS?", + "githuburl":"" + }, + { + "uri":"dws_03_0010.html", + "product_code":"dws", + "code":"151", + "des":"MRS works better with big data processing frameworks such as Apache Spark, Hadoop, and HBase, to process and analyze ultra-large data sets through custom code. It allows ", + "doc_type":"usermanual", + "kw":"When Should I Use GaussDB(DWS) and MRS?,General Problems,User Guide", + "title":"When Should I Use GaussDB(DWS) and MRS?", + "githuburl":"" + }, + { + "uri":"dws_03_0011.html", + "product_code":"dws", + "code":"152", + "des":"No. Although SQL on OBS of GaussDB(DWS) can be used for GaussDB(DWS) and OBS data query, it cannot replace the processing frameworks of MRS.Apart from SQL query, MRS also", + "doc_type":"usermanual", + "kw":"Can GaussDB(DWS) SQL on OBS Replace MRS?,General Problems,User Guide", + "title":"Can GaussDB(DWS) SQL on OBS Replace MRS?", + "githuburl":"" + }, + { + "uri":"dws_03_0037.html", + "product_code":"dws", + "code":"153", + "des":"GaussDB(DWS) and Hive have different functions in the following aspects:Hive is a data warehouse based on Hadoop MapReduce. GaussDB(DWS) is a data warehouse based on Post", + "doc_type":"usermanual", + "kw":"What Are the Differences Between GaussDB(DWS) and Hive in Functions?,General Problems,User Guide", + "title":"What Are the Differences Between GaussDB(DWS) and Hive in Functions?", + "githuburl":"" + }, + { + "uri":"dws_03_0034.html", + "product_code":"dws", + "code":"154", + "des":"For cloud services, quotas limit the number of resources available to users. If you need more, submit a service ticket to increase your quotas. Once approved, we will upd", + "doc_type":"usermanual", + "kw":"What Is the User Quota?,General Problems,User Guide", + "title":"What Is the User Quota?", + "githuburl":"" + }, + { + "uri":"dws_03_0067.html", + "product_code":"dws", + "code":"155", + "des":"Users and roles are shared within the entire cluster, but their data is not shared. That is, a user can connect to any database, but after the connection is successful, a", + "doc_type":"usermanual", + "kw":"What Are the Differences Between Users and Roles?,General Problems,User Guide", + "title":"What Are the Differences Between Users and Roles?", + "githuburl":"" + }, + { + "uri":"dws_03_0052.html", + "product_code":"dws", + "code":"156", + "des":"A region and availability zone (AZ) identify the location of a data center. You can create resources in regions and AZs.A region is a physical data center. Each region is", + "doc_type":"usermanual", + "kw":"Regions and AZs,General Problems,User Guide", + "title":"Regions and AZs", + "githuburl":"" + }, + { + "uri":"dws_03_0022.html", + "product_code":"dws", + "code":"157", + "des":"Yes. In the big data era, data has become a core asset. The public cloud will adhere to the commitment made over the years that we do not touch your applications or data,", + "doc_type":"usermanual", + "kw":"Is My Data Secure in GaussDB(DWS)?,General Problems,User Guide", + "title":"Is My Data Secure in GaussDB(DWS)?", + "githuburl":"" + }, + { + "uri":"dws_03_0023.html", + "product_code":"dws", + "code":"158", + "des":"GaussDB(DWS) uses IAM and VPC to control user access and isolate cluster network. Cluster access is over SSL and cipher suite. Additionally, GaussDB(DWS) supports two-way", + "doc_type":"usermanual", + "kw":"How Is GaussDB(DWS) Secured?,General Problems,User Guide", + "title":"How Is GaussDB(DWS) Secured?", + "githuburl":"" + }, + { + "uri":"dws_03_0053.html", + "product_code":"dws", + "code":"159", + "des":"Yes. When a data warehouse cluster is created, its security group cannot be changed. However, you can add, delete, or modify rules of the current security group.To edit t", + "doc_type":"usermanual", + "kw":"Can I Modify the Security Group of a GaussDB(DWS) Cluster?,General Problems,User Guide", + "title":"Can I Modify the Security Group of a GaussDB(DWS) Cluster?", + "githuburl":"" + }, + { + "uri":"dws_03_2121.html", + "product_code":"dws", + "code":"160", + "des":"The evolving Internet and IoT produce massive volumes of data. This data needs to be managed, using concepts like database, data warehouse, data lake, and lakehouse. Here", + "doc_type":"usermanual", + "kw":"What Is a Database/Data Warehouse/Data Lake/Lakehouse?,General Problems,User Guide", + "title":"What Is a Database/Data Warehouse/Data Lake/Lakehouse?", + "githuburl":"" + }, + { + "uri":"dws_03_0029.html", + "product_code":"dws", + "code":"161", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Cluster Management", + "title":"Cluster Management", + "githuburl":"" + }, + { + "uri":"dws_03_0016.html", + "product_code":"dws", + "code":"162", + "des":"Check that you have enough quota for creating the cluster.Call the Customer Hotline for support.Telephone:Germany: 0800 330 44 44International: +800 44556600", + "doc_type":"usermanual", + "kw":"What Do I Do If Creating a GaussDB(DWS) Cluster Failed?,Cluster Management,User Guide", + "title":"What Do I Do If Creating a GaussDB(DWS) Cluster Failed?", + "githuburl":"" + }, + { + "uri":"dws_03_0031.html", + "product_code":"dws", + "code":"163", + "des":"Cluster patching or upgrading is automatic because GaussDB(DWS) upgrades its own version.For service patch:Duration: less than 10 minutesImpact on services: 1 to 3 minute", + "doc_type":"usermanual", + "kw":"How Can I Upgrade or Downgrade GaussDB(DWS)?,Cluster Management,User Guide", + "title":"How Can I Upgrade or Downgrade GaussDB(DWS)?", + "githuburl":"" + }, + { + "uri":"dws_03_0033.html", + "product_code":"dws", + "code":"164", + "des":"After you delete data stored in GaussDB(DWS) data warehouses, dirty data may be generated from the unreleased disk space. This results in space waste and deteriorates sna", + "doc_type":"usermanual", + "kw":"How Can I Clear and Reclaim Storage?,Cluster Management,User Guide", + "title":"How Can I Clear and Reclaim Storage?", + "githuburl":"" + }, + { + "uri":"dws_03_0054.html", + "product_code":"dws", + "code":"165", + "des":"If you do not run VACUUM to clear and reclaim the storage space before the scale-out, the data deleted from GaussDB(DWS) may not free up the occupied disk space.During th", + "doc_type":"usermanual", + "kw":"Why Did the Used Storage Reduce After Scale-out?,Cluster Management,User Guide", + "title":"Why Did the Used Storage Reduce After Scale-out?", + "githuburl":"" + }, + { + "uri":"dws_03_0104.html", + "product_code":"dws", + "code":"166", + "des":"You can view the used capacity of a cluster CPU, memory, and disks on the Cloud Eye management console. Perform the following steps to view the information:", + "doc_type":"usermanual", + "kw":"How Do I View Node Metrics (CPU, Memory, and Disk Usage)?,Cluster Management,User Guide", + "title":"How Do I View Node Metrics (CPU, Memory, and Disk Usage)?", + "githuburl":"" + }, + { + "uri":"dws_03_0090.html", + "product_code":"dws", + "code":"167", + "des":"A cluster with three data nodes of 320 GB each has a total capacity of 960 GB. When 1 GB data is stored, GaussDB(DWS) stores 1 GB data on two nodes due to duplication, a ", + "doc_type":"usermanual", + "kw":"How Is the Disk Space or Capacity of GaussDB(DWS) Calculated?,Cluster Management,User Guide", + "title":"How Is the Disk Space or Capacity of GaussDB(DWS) Calculated?", + "githuburl":"" + }, + { + "uri":"dws_03_0024.html", + "product_code":"dws", + "code":"168", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Database Connections", + "title":"Database Connections", + "githuburl":"" + }, + { + "uri":"dws_03_0017.html", + "product_code":"dws", + "code":"169", + "des":"Yes, but GaussDB(DWS) clients and drivers are recommended. Unlike open-source PostgreSQL clients and drivers, GaussDB(DWS) clients and drivers have two key advantages:Sec", + "doc_type":"usermanual", + "kw":"Does GaussDB(DWS) Support Third-Party Clients and JDBC and ODBC Drivers?,Database Connections,User G", + "title":"Does GaussDB(DWS) Support Third-Party Clients and JDBC and ODBC Drivers?", + "githuburl":"" + }, + { + "uri":"dws_03_0040.html", + "product_code":"dws", + "code":"170", + "des":"No, direct access is not supported. VMs at the bottom layer of GaussDB(DWS) serve as the compute nodes for data analysis. Access cluster databases using the private or pu", + "doc_type":"usermanual", + "kw":"Can I Connect to GaussDB(DWS) Cluster Nodes Using SSH?,Database Connections,User Guide", + "title":"Can I Connect to GaussDB(DWS) Cluster Nodes Using SSH?", + "githuburl":"" + }, + { + "uri":"dws_03_0014.html", + "product_code":"dws", + "code":"171", + "des":"Check:Whether the cluster status is normal.Whether the connection command, username, password, IP address, and port are correct.Whether the operating system type and vers", + "doc_type":"usermanual", + "kw":"What Should I Do If I Cannot Connect to a Data Warehouse Cluster?,Database Connections,User Guide", + "title":"What Should I Do If I Cannot Connect to a Data Warehouse Cluster?", + "githuburl":"" + }, + { + "uri":"dws_03_0025.html", + "product_code":"dws", + "code":"172", + "des":"After the EIP is unbound, the network may be disconnected. However, the TCP layer does not detect a faulty physical connection in time due to keepalive settings. As a res", + "doc_type":"usermanual", + "kw":"Why Was I Not Notified of Failure Unbinding the EIP When GaussDB(DWS) Is Connected Over the Internet", + "title":"Why Was I Not Notified of Failure Unbinding the EIP When GaussDB(DWS) Is Connected Over the Internet?", + "githuburl":"" + }, + { + "uri":"dws_03_0169.html", + "product_code":"dws", + "code":"173", + "des":"Resources in different AZs of the same region can communicate with each other directly if they belong to the same VPC.For resources in different AZs of the same region bu", + "doc_type":"usermanual", + "kw":"How Can a Data Warehouse and a Database in Different AZs of the Same Region Communicate?,Database Co", + "title":"How Can a Data Warehouse and a Database in Different AZs of the Same Region Communicate?", + "githuburl":"" + }, + { + "uri":"dws_03_2125.html", + "product_code":"dws", + "code":"174", + "des":"If BI applications, client ECS, and DGC need to communicate with GaussDB(DWS), they must be in the same region and VPC as the GaussDB(DWS) cluster (different subnets are ", + "doc_type":"usermanual", + "kw":"Do I Need the Same VPC and Subnet to Connect to a GaussDB(DWS) Cluster?,Database Connections,User Gu", + "title":"Do I Need the Same VPC and Subnet to Connect to a GaussDB(DWS) Cluster?", + "githuburl":"" + }, + { + "uri":"dws_03_2130.html", + "product_code":"dws", + "code":"175", + "des":"You can also log in to the VPC management console to manually create a security group. Then, go back to the page for creating data warehouse clusters, click the button n", + "doc_type":"usermanual", + "kw":"How Do I Configure a Whitelist to Protect Clusters Available Through a Public IP Address?,Database C", + "title":"How Do I Configure a Whitelist to Protect Clusters Available Through a Public IP Address?", + "githuburl":"" + }, + { + "uri":"dws_03_0026.html", + "product_code":"dws", + "code":"176", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Data Import and Export", + "title":"Data Import and Export", + "githuburl":"" + }, + { + "uri":"dws_03_0018.html", + "product_code":"dws", + "code":"177", + "des":"The file formats supported by OBS and GDS foreign tables are as follows:OBS file formats: CSV, TEXT, ORC, and CARBONDATA. The default format is TEXT.GDS file formats: CSV", + "doc_type":"usermanual", + "kw":"What Are the Differences Between Data Formats Supported by OBS and GDS Foreign Tables?,Data Import a", + "title":"What Are the Differences Between Data Formats Supported by OBS and GDS Foreign Tables?", + "githuburl":"" + }, + { + "uri":"dws_03_0027.html", + "product_code":"dws", + "code":"178", + "des":"GaussDB(DWS) supports efficient data import from multiple data sources. The following lists typical data import modes. For details, see \"Import Modes\" in the Data Warehou", + "doc_type":"usermanual", + "kw":"How Can I Import Data to GaussDB(DWS)?,Data Import and Export,User Guide", + "title":"How Can I Import Data to GaussDB(DWS)?", + "githuburl":"" + }, + { + "uri":"dws_03_0028.html", + "product_code":"dws", + "code":"179", + "des":"Each node in a data warehouse cluster has a default storage capacity of 160 GB, 256 GB, 1.6 TB, 1.8 TB, or 13 TB. A cluster can house 3 to 32 nodes and the total storage ", + "doc_type":"usermanual", + "kw":"How Much Service Data Can a Data Warehouse Store?,Data Import and Export,User Guide", + "title":"How Much Service Data Can a Data Warehouse Store?", + "githuburl":"" + }, + { + "uri":"dws_03_0073.html", + "product_code":"dws", + "code":"180", + "des":"GaussDB(DWS) is a fully managed service on the cloud. Users cannot log in to the background to import or export data by using COPY, so the COPY syntax is disabled. You ar", + "doc_type":"usermanual", + "kw":"How Do I Use \\Copy to Import and Export Data?,Data Import and Export,User Guide", + "title":"How Do I Use \\Copy to Import and Export Data?", + "githuburl":"" + }, + { + "uri":"dws_03_0102.html", + "product_code":"dws", + "code":"181", + "des":"No, GaussDB(DWS) does not support OBS data import or export across regions. The GaussDB(DWS) cluster and OBS must be in the same region.", + "doc_type":"usermanual", + "kw":"Can I Export GaussDB(DWS) Data from/to OBS Across Regions?,Data Import and Export,User Guide", + "title":"Can I Export GaussDB(DWS) Data from/to OBS Across Regions?", + "githuburl":"" + }, + { + "uri":"dws_03_0074.html", + "product_code":"dws", + "code":"182", + "des":"To import heterogeneous data to GaussDB(DWS), use CDM to migrate the entire MySQL or SQL Server database. Or migrate the entire GaussDB(DWS) database to another GaussDB(D", + "doc_type":"usermanual", + "kw":"How Do I Import GaussDB(DWS)/Oracle/MySQL/SQL Server Data to GaussDB(DWS) (Whole Database Migration)", + "title":"How Do I Import GaussDB(DWS)/Oracle/MySQL/SQL Server Data to GaussDB(DWS) (Whole Database Migration)?", + "githuburl":"" + }, + { + "uri":"dws_03_0105.html", + "product_code":"dws", + "code":"183", + "des":"No. The GDS server and GaussDB(DWS) can only communicate with each other on the intranet. Each DN in the GaussDB(DWS) cluster is used to connect to the GDS server in para", + "doc_type":"usermanual", + "kw":"Can I Import Data over the Public/External Network Using GDS?,Data Import and Export,User Guide", + "title":"Can I Import Data over the Public/External Network Using GDS?", + "githuburl":"" + }, + { + "uri":"dws_03_0110.html", + "product_code":"dws", + "code":"184", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Account, Password, and Permissions", + "title":"Account, Password, and Permissions", + "githuburl":"" + }, + { + "uri":"dws_03_0092.html", + "product_code":"dws", + "code":"185", + "des":"To change the password of the database administrator dbadmin, log in to the console and choose More > Reset Password in cluster row.For security, the following two parame", + "doc_type":"usermanual", + "kw":"How Do I Change My Expired Database Password?,Account, Password, and Permissions,User Guide", + "title":"How Do I Change My Expired Database Password?", + "githuburl":"" + }, + { + "uri":"dws_03_0095.html", + "product_code":"dws", + "code":"186", + "des":"To view the user list, query the PG_USER view.SELECT * FROM pg_user;To view user attributes, query the PG_AUTHID system catalog.SELECT * FROM pg_authid;Query the permissi", + "doc_type":"usermanual", + "kw":"How Do I View All Database Users and Their Permissions?,Account, Password, and Permissions,User Guid", + "title":"How Do I View All Database Users and Their Permissions?", + "githuburl":"" + }, + { + "uri":"dws_03_0197.html", + "product_code":"dws", + "code":"187", + "des":"This section describes how to grant users the SELECT, INSERT, UPDATE, or full permissions for tables.Assume there are users u1, u2, u3, u4, and u5 and five schemas named ", + "doc_type":"usermanual", + "kw":"How Do I Grant Table Permissions to a User?,Account, Password, and Permissions,User Guide", + "title":"How Do I Grant Table Permissions to a User?", + "githuburl":"" + }, + { + "uri":"dws_03_0196.html", + "product_code":"dws", + "code":"188", + "des":"This section describes how to grant the query permission for a schema as an example. For more information, see \"How Do I Grant Table Permissions to a User?\" in FAQ. You ", + "doc_type":"usermanual", + "kw":"How Do I Grant Schema Permissions to a User?,Account, Password, and Permissions,User Guide", + "title":"How Do I Grant Schema Permissions to a User?", + "githuburl":"" + }, + { + "uri":"dws_03_0195.html", + "product_code":"dws", + "code":"189", + "des":"GaussDB(DWS) provides an implicitly defined group public that contains all roles. By default, all new users and roles have the permissions of public. To revoke permission", + "doc_type":"usermanual", + "kw":"How Do I Revoke the CONNECT ON DATABASE Permission from a User?,Account, Password, and Permissions,U", + "title":"How Do I Revoke the CONNECT ON DATABASE Permission from a User?", + "githuburl":"" + }, + { + "uri":"dws_03_0065.html", + "product_code":"dws", + "code":"190", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Database Usage", + "title":"Database Usage", + "githuburl":"" + }, + { + "uri":"dws_03_0075.html", + "product_code":"dws", + "code":"191", + "des":"No, you only need to set the primary key. By default, the first column of the primary key is selected as the distribution key. If both are set, the primary key must conta", + "doc_type":"usermanual", + "kw":"Do I Need to Set a Distribution Key After Setting a Primary Key?,Database Usage,User Guide", + "title":"Do I Need to Set a Distribution Key After Setting a Primary Key?", + "githuburl":"" + }, + { + "uri":"dws_03_0076.html", + "product_code":"dws", + "code":"192", + "des":"Yes.GaussDB(DWS) is compatible with PostgreSQL stored procedures. For details, see \"Stored Procedures\" in the Developer Guide.", + "doc_type":"usermanual", + "kw":"Is GaussDB(DWS) Compatible with PostgreSQL Stored Procedures?,Database Usage,User Guide", + "title":"Is GaussDB(DWS) Compatible with PostgreSQL Stored Procedures?", + "githuburl":"" + }, + { + "uri":"dws_03_0064.html", + "product_code":"dws", + "code":"193", + "des":"Partitioned table: Partitioning refers to splitting what is logically one large table into smaller physical pieces based on specific schemes. The table based on the logic", + "doc_type":"usermanual", + "kw":"What Are Partitioned Tables, Partitions, and Partition Keys?,Database Usage,User Guide", + "title":"What Are Partitioned Tables, Partitions, and Partition Keys?", + "githuburl":"" + }, + { + "uri":"dws_03_0078.html", + "product_code":"dws", + "code":"194", + "des":"You are advised to use the Data Studio graphical client to export table data. You can export data from:A specific tableAll tables in a schemaAll tables in a databaseFor d", + "doc_type":"usermanual", + "kw":"How Can I Export the Table Structure?,Database Usage,User Guide", + "title":"How Can I Export the Table Structure?", + "githuburl":"" + }, + { + "uri":"dws_03_0079.html", + "product_code":"dws", + "code":"195", + "des":"You can use pg_tables and pg_views to query all table information and views in a database. Example:For details about the returned columns, see \"PG_TABLES\" and \"PG_VIEWS\" ", + "doc_type":"usermanual", + "kw":"How Can I Export All Tables and Views from a Database?,Database Usage,User Guide", + "title":"How Can I Export All Tables and Views from a Database?", + "githuburl":"" + }, + { + "uri":"dws_03_0085.html", + "product_code":"dws", + "code":"196", + "des":"In GaussDB(DWS), the encoding format of a database cannot be changed. You need to create another database in the required format. For globalization purposes, set the enco", + "doc_type":"usermanual", + "kw":"How Can I Change the Character Encoding Format of a Database?,Database Usage,User Guide", + "title":"How Can I Change the Character Encoding Format of a Database?", + "githuburl":"" + }, + { + "uri":"dws_03_0088.html", + "product_code":"dws", + "code":"197", + "des":"Yes. TRUNCATE is more efficient than DELETE for deleting massive data.For details, see \"TRUNCATE\" in the Data Warehouse Service (DWS) Developer Guide.TRUNCATE quickly rem", + "doc_type":"usermanual", + "kw":"How Can I Delete Table Data Efficiently?,Database Usage,User Guide", + "title":"How Can I Delete Table Data Efficiently?", + "githuburl":"" + }, + { + "uri":"dws_03_0089.html", + "product_code":"dws", + "code":"198", + "des":"Yes. For tables that involve frequent add, delete, or modify operations, perform VACUUM FULL and ANALYZE to reclaim the disk space occupied by updated or deleted data, pr", + "doc_type":"usermanual", + "kw":"Do I Need to Run VACUUM FULL and ANALYZE on Common Tables Periodically?,Database Usage,User Guide", + "title":"Do I Need to Run VACUUM FULL and ANALYZE on Common Tables Periodically?", + "githuburl":"" + }, + { + "uri":"dws_03_2124.html", + "product_code":"dws", + "code":"199", + "des":"To query information about OBS/GDS foreign tables such as OBS paths, run the following statement:The following uses table traffic_data.GCJL_OBS as an example:", + "doc_type":"usermanual", + "kw":"How Do I View Foreign Table Information?,Database Usage,User Guide", + "title":"How Do I View Foreign Table Information?", + "githuburl":"" + }, + { + "uri":"dws_03_2126.html", + "product_code":"dws", + "code":"200", + "des":"In a data warehouse database, you need to carefully choose distribution columns for large tables, because they can affect your database and query performance. If an impro", + "doc_type":"usermanual", + "kw":"How Do I Change Distribution Columns?,Database Usage,User Guide", + "title":"How Do I Change Distribution Columns?", + "githuburl":"" + }, + { + "uri":"dws_03_0035.html", + "product_code":"dws", + "code":"201", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Database Performance", + "title":"Database Performance", + "githuburl":"" + }, + { + "uri":"dws_03_0071.html", + "product_code":"dws", + "code":"202", + "des":"When a database is used for a period of time, the table data increases as services grow, or the table data is frequently added, deleted, or modified. This results in bloa", + "doc_type":"usermanual", + "kw":"Why Is SQL Execution Slow After Long GaussDB(DWS) Usage?,Database Performance,User Guide", + "title":"Why Is SQL Execution Slow After Long GaussDB(DWS) Usage?", + "githuburl":"" + }, + { + "uri":"dws_03_0036.html", + "product_code":"dws", + "code":"203", + "des":"Due to the MPP architecture limitation of GaussDB(DWS), a few PostgreSQL methods and functions cannot be pushed to DNs for execution. As a result, performance bottlenecks", + "doc_type":"usermanual", + "kw":"Why Does GaussDB(DWS) Perform Worse Than a Single-Server Database in Extreme Scenarios?,Database Per", + "title":"Why Does GaussDB(DWS) Perform Worse Than a Single-Server Database in Extreme Scenarios?", + "githuburl":"" + }, + { + "uri":"dws_03_0100.html", + "product_code":"dws", + "code":"204", + "des":"The top SQL feature lets you view SQL statements executed in a specified period (in real time and historical). SQL statements of the current CN or all CNs are available f", + "doc_type":"usermanual", + "kw":"How Can I View SQL Execution Records of A Certain Period When Service Read and Write Are Blocked?,Da", + "title":"How Can I View SQL Execution Records of A Certain Period When Service Read and Write Are Blocked?", + "githuburl":"" + }, + { + "uri":"dws_03_0068.html", + "product_code":"dws", + "code":"205", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Logs", + "title":"Logs", + "githuburl":"" + }, + { + "uri":"dws_03_0082.html", + "product_code":"dws", + "code":"206", + "des":"GaussDB(DWS) allows you to record the audit logs of specific operations, involving audit log retention policies, unauthorized access, as well as DML, DDL, SELECT and COPY", + "doc_type":"usermanual", + "kw":"How Can I View Database Operation Logs?,Logs,User Guide", + "title":"How Can I View Database Operation Logs?", + "githuburl":"" + }, + { + "uri":"dws_01_0070.html", + "product_code":"dws", + "code":"207", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Change History,User Guide", + "title":"Change History", + "githuburl":"" + } +] \ No newline at end of file diff --git a/docs/dws/umn/CLASS.TXT.json b/docs/dws/umn/CLASS.TXT.json new file mode 100644 index 00000000..b099ceb6 --- /dev/null +++ b/docs/dws/umn/CLASS.TXT.json @@ -0,0 +1,1865 @@ +[ + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Service Overview", + "uri":"dws_01_index.html", + "doc_type":"usermanual", + "p_code":"", + "code":"1" + }, + { + "desc":"GaussDB(DWS) is an online data processing database that runs on the cloud infrastructure to provide scalable, fully-managed, and out-of-the-box analytic database service,", + "product_code":"dws", + "title":"What Is GaussDB(DWS)?", + "uri":"dws_01_0002.html", + "doc_type":"usermanual", + "p_code":"1", + "code":"2" + }, + { + "desc":"GaussDB(DWS) uses the GaussDB database kernel and is compatible with PostgreSQL 9.2.4. It transforms from a single OLTP database to an enterprise-level distributed OLAP d", + "product_code":"dws", + "title":"Advantages", + "uri":"dws_01_0007.html", + "doc_type":"usermanual", + "p_code":"1", + "code":"3" + }, + { + "desc":"Enhanced ETL + Real-time BI analysisETL + BI analysisThe data warehouse is the pillar of the Business Intelligence (BI) system for collecting, storing, and analyzing mass", + "product_code":"dws", + "title":"Application Scenarios", + "uri":"dws_01_00013.html", + "doc_type":"usermanual", + "p_code":"1", + "code":"4" + }, + { + "desc":"GaussDB(DWS) enables you to use this service through various methods, such as the GaussDB(DWS) management console, GaussDB(DWS) client, and REST APIs. This section descri", + "product_code":"dws", + "title":"Functions", + "uri":"dws_01_0091.html", + "doc_type":"usermanual", + "p_code":"1", + "code":"5" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Concepts", + "uri":"dws_01_0004.html", + "doc_type":"usermanual", + "p_code":"1", + "code":"6" + }, + { + "desc":"A cluster is a server group that consists of multiple nodes. GaussDB(DWS) is organized using clusters. A data warehouse cluster contains nodes with the same flavor in the", + "product_code":"dws", + "title":"GaussDB(DWS) Management Concepts", + "uri":"dws_01_0005.html", + "doc_type":"usermanual", + "p_code":"6", + "code":"7" + }, + { + "desc":"A data warehouse cluster is an analysis-oriented relational database platform that supports online analysis.OLAP is a major function of data warehouse clusters. It suppor", + "product_code":"dws", + "title":"GaussDB(DWS) Database Concepts", + "uri":"dws_01_0006.html", + "doc_type":"usermanual", + "p_code":"6", + "code":"8" + }, + { + "desc":"GaussDB(DWS) uses Identity and Access Management (IAM) for authentication and authorization.Users who have the DWS Administrator permissions can fully utilize GaussDB(DWS", + "product_code":"dws", + "title":"Related Services", + "uri":"dws_01_0003.html", + "doc_type":"usermanual", + "p_code":"1", + "code":"9" + }, + { + "desc":"If you need to assign different permissions to employees in your enterprise to access your cloud GaussDB(DWS) resources, IAM is a good choice for fine-grained permissions", + "product_code":"dws", + "title":"GaussDB(DWS) Permissions Management", + "uri":"dws_01_0144.html", + "doc_type":"usermanual", + "p_code":"1", + "code":"10" + }, + { + "desc":"The following figure shows how to use GaussDB(DWS).GaussDB(DWS) provides a web-based management console and HTTPS-compliant APIs for you to manage data warehouse clusters", + "product_code":"dws", + "title":"GaussDB(DWS) Access", + "uri":"dws_01_0009.html", + "doc_type":"usermanual", + "p_code":"1", + "code":"11" + }, + { + "desc":"You can manage clusters only and cannot directly access nodes in a cluster. You can use a cluster's IP address and port to access the database in the cluster.You cannot c", + "product_code":"dws", + "title":"Restrictions", + "uri":"dws_01_0010.html", + "doc_type":"usermanual", + "p_code":"1", + "code":"12" + }, + { + "desc":"This section describes the technical specifications of GaussDB(DWS) in different versions.", + "product_code":"dws", + "title":"Technical Specifications", + "uri":"dws_01_00113.html", + "doc_type":"usermanual", + "p_code":"1", + "code":"13" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Getting Started", + "uri":"dws_01_0078.html", + "doc_type":"usermanual", + "p_code":"", + "code":"14" + }, + { + "desc":"This guide is an introductory tutorial that demonstrates how to create a sample GaussDB(DWS) cluster, connect to the cluster database, import the sample data from OBS, an", + "product_code":"dws", + "title":"Step 1: Starting Preparations", + "uri":"dws_01_0088.html", + "doc_type":"usermanual", + "p_code":"14", + "code":"15" + }, + { + "desc":"Before using GaussDB(DWS) to analyze data, create a cluster. A cluster consists of multiple nodes in the same subnet. These nodes together provide services. This section ", + "product_code":"dws", + "title":"Step 2: Creating a Cluster", + "uri":"dws_01_0013.html", + "doc_type":"usermanual", + "p_code":"14", + "code":"16" + }, + { + "desc":"This section describes how to use a database client to connect to the database in a GaussDB(DWS) cluster. In the following example, the Data Studio client tool is used fo", + "product_code":"dws", + "title":"Step 3: Connecting to a Cluster", + "uri":"dws_01_0107.html", + "doc_type":"usermanual", + "p_code":"14", + "code":"17" + }, + { + "desc":"After performing the steps in preceding sections, you can refer to the documentation listed as follows for more information about GaussDB(DWS):Data Warehouse Service (DWS", + "product_code":"dws", + "title":"Step 4: Viewing Other Documents and Clearing Resources", + "uri":"dws_01_0079.html", + "doc_type":"usermanual", + "p_code":"14", + "code":"18" + }, + { + "desc":"GaussDB(DWS) is an online data processing database that uses the cloud infrastructure to provide scalable, fully-managed, and out-of-the-box analytic database service, fr", + "product_code":"dws", + "title":"Process for Using GaussDB(DWS)", + "uri":"dws_01_0018.html", + "doc_type":"usermanual", + "p_code":"", + "code":"19" + }, + { + "desc":"Before using GaussDB(DWS), make the following preparations:Registering a Public Cloud Account and Completing Real-Name AuthenticationDetermining the Cluster PortsIf you d", + "product_code":"dws", + "title":"Preparations", + "uri":"dws_01_0154.html", + "doc_type":"usermanual", + "p_code":"", + "code":"20" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Cluster Configuration", + "uri":"dws_01_0160.html", + "doc_type":"usermanual", + "p_code":"", + "code":"21" + }, + { + "desc":"This section describes how to log in to the GaussDB(DWS) management console and use GaussDB(DWS).", + "product_code":"dws", + "title":"Accessing the GaussDB(DWS) Management Console", + "uri":"dws_01_0157.html", + "doc_type":"usermanual", + "p_code":"21", + "code":"22" + }, + { + "desc":"To use cloud GaussDB(DWS), create a cluster first.This section describes how to create a data warehouse cluster on the GaussDB(DWS) management console.You have evaluated ", + "product_code":"dws", + "title":"Creating a Cluster", + "uri":"dws_01_0019.html", + "doc_type":"usermanual", + "p_code":"21", + "code":"23" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Cluster Connection", + "uri":"dws_01_0131.html", + "doc_type":"usermanual", + "p_code":"", + "code":"24" + }, + { + "desc":"If you have created a GaussDB(DWS) cluster, you can use the SQL client tool or a third-party driver such as JDBC or ODBC to connect to the cluster and access the database", + "product_code":"dws", + "title":"Methods of Connecting to a Cluster", + "uri":"dws_01_0137.html", + "doc_type":"usermanual", + "p_code":"24", + "code":"25" + }, + { + "desc":"You can access GaussDB(DWS) clusters by different methods and the connection address of each connection method varies. This section describes how to view and obtain the p", + "product_code":"dws", + "title":"Obtaining the Cluster Connection Address", + "uri":"dws_01_0033.html", + "doc_type":"usermanual", + "p_code":"24", + "code":"26" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Using the gsql CLI Client to Connect to a Cluster", + "uri":"dws_01_0093.html", + "doc_type":"usermanual", + "p_code":"24", + "code":"27" + }, + { + "desc":"GaussDB(DWS) provides client tool packages that match the cluster versions. You can download the desired client tool package on the GaussDB(DWS) management console.The cl", + "product_code":"dws", + "title":"Downloading the Client", + "uri":"dws_01_0031.html", + "doc_type":"usermanual", + "p_code":"27", + "code":"28" + }, + { + "desc":"The gsql command line client provided by GaussDB(DWS) runs on the Linux OS. Before using it to remotely connect to a GaussDB(DWS) cluster, you need to prepare a Linux hos", + "product_code":"dws", + "title":"Preparing an ECS as the gsql Client Host", + "uri":"dws_01_0128.html", + "doc_type":"usermanual", + "p_code":"27", + "code":"29" + }, + { + "desc":"This section describes how to connect to a database through an SQL client after you create a data warehouse cluster and before you use the cluster's database. GaussDB(DWS", + "product_code":"dws", + "title":"Using the gsql Client to Connect to a Cluster", + "uri":"dws_01_0037.html", + "doc_type":"usermanual", + "p_code":"27", + "code":"30" + }, + { + "desc":"If the client or JDBC/ODBC driver needs to use SSL connection, you must configure related SSL connection parameters in the client or application code. The GaussDB(DWS) ma", + "product_code":"dws", + "title":"Establishing Secure TCP/IP Connections in SSL Mode", + "uri":"dws_01_0038.html", + "doc_type":"usermanual", + "p_code":"27", + "code":"31" + }, + { + "desc":"GaussDB(DWS) supports connections in SSL authentication mode so that data transmitted between the GaussDB(DWS) client and the database can be encrypted. The SSL mode deli", + "product_code":"dws", + "title":"(Optional) Configuring SSL Connection", + "uri":"dws_01_0076.html", + "doc_type":"usermanual", + "p_code":"27", + "code":"32" + }, + { + "desc":"GaussDB(DWS) supports the standard SSL (TLS 1.2). As a highly secure protocol, SSL authenticates bidirectional identification between the server and client using digital ", + "product_code":"dws", + "title":"(Optional) Downloading the SSL Certificate", + "uri":"dws_01_0083.html", + "doc_type":"usermanual", + "p_code":"27", + "code":"33" + }, + { + "desc":"Data Studio is a SQL client tool running on the Windows operating system. It provides various GUIs for you to manage databases and database objects, as well as edit, run,", + "product_code":"dws", + "title":"Using the Data Studio GUI Client to Connect to a Cluster", + "uri":"dws_01_0094.html", + "doc_type":"usermanual", + "p_code":"24", + "code":"34" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Using the JDBC and ODBC Drivers to Connect to a Cluster", + "uri":"dws_01_0081.html", + "doc_type":"usermanual", + "p_code":"24", + "code":"35" + }, + { + "desc":"If the connection pool mechanism is used during application development, the following specifications must be met. Otherwise, connections in the connection pool have stat", + "product_code":"dws", + "title":"Development Specifications", + "uri":"dws_01_0106.html", + "doc_type":"usermanual", + "p_code":"35", + "code":"36" + }, + { + "desc":"The JDBC or ODBC driver is used to connect to data warehouse clusters. You can download the JDBC or ODBC driver provided by GaussDB(DWS) from the management console or us", + "product_code":"dws", + "title":"Downloading the JDBC or ODBC Driver", + "uri":"dws_01_0032.html", + "doc_type":"usermanual", + "p_code":"35", + "code":"37" + }, + { + "desc":"In GaussDB(DWS), you can use a JDBC driver to connect to a database on Linux or Windows. The driver can connect to the database through an ECS on the cloud platform or ov", + "product_code":"dws", + "title":"Using a JDBC Driver to Connect to a Database", + "uri":"dws_01_0077.html", + "doc_type":"usermanual", + "p_code":"35", + "code":"38" + }, + { + "desc":"GaussDB(DWS) allows you to use an ODBC driver to connect to the database through an ECS on the cloud platform or over the Internet.For details about how to use the ODBC A", + "product_code":"dws", + "title":"Using an ODBC Driver to Connect to a Database", + "uri":"dws_01_0086.html", + "doc_type":"usermanual", + "p_code":"35", + "code":"39" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Connecting to a Cluster Using IAM Authentication", + "uri":"dws_01_0133.html", + "doc_type":"usermanual", + "p_code":"35", + "code":"40" + }, + { + "desc":"GaussDB(DWS) allows you to access databases using IAM authentication. When you use the JDBC application program to connect to a cluster, set the IAM username, credential,", + "product_code":"dws", + "title":"Overview", + "uri":"dws_01_0134.html", + "doc_type":"usermanual", + "p_code":"40", + "code":"41" + }, + { + "desc":"The IAM account you use to access a database must be granted with the DWS Database Access permission. Only users with both the DWS Administrator and DWS Database Access p", + "product_code":"dws", + "title":"Granting an IAM Account the DWS Database Access Permission", + "uri":"dws_01_0135.html", + "doc_type":"usermanual", + "p_code":"40", + "code":"42" + }, + { + "desc":"You can log in to the management console to create an AK/SK pair or use an existing one.Log in to the management console, move your cursor over your account in the upper ", + "product_code":"dws", + "title":"Creating an IAM User Credential", + "uri":"dws_01_0136.html", + "doc_type":"usermanual", + "p_code":"40", + "code":"43" + }, + { + "desc":"When you use the JDBC application program to connect to a cluster, set the IAM username, credential, and other information as you configure the JDBC URL. After doing this", + "product_code":"dws", + "title":"Configuring the JDBC Connection to Connect to a Cluster Using IAM Authentication", + "uri":"dws_01_0132.html", + "doc_type":"usermanual", + "p_code":"40", + "code":"44" + }, + { + "desc":"By default, a database supports a certain number of connections. Administrators can manage database connections to learn about the connection performance of the current d", + "product_code":"dws", + "title":"Managing Database Connections", + "uri":"dws_01_0039.html", + "doc_type":"usermanual", + "p_code":"24", + "code":"45" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Clusters", + "uri":"dws_01_0600.html", + "doc_type":"usermanual", + "p_code":"", + "code":"46" + }, + { + "desc":"On the Clusters page of the GaussDB(DWS) management console, you can view the general information about a cluster in the cluster list, such as the cluster status, task in", + "product_code":"dws", + "title":"Checking the Cluster Status", + "uri":"dws_01_0020.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"47" + }, + { + "desc":"Log in to the GaussDB(DWS) management console. In the navigation tree on the left, choose Clusters. In the cluster list, locate the required cluster and click its name. T", + "product_code":"dws", + "title":"Viewing Basic Cluster Information", + "uri":"dws_01_0112.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"48" + }, + { + "desc":"A domain name is a string of characters separated by dots to identify the location of a computer or a computer group on the Internet, for example, www.example.com. You ca", + "product_code":"dws", + "title":"Managing Access Domain Names", + "uri":"dws_01_0140.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"49" + }, + { + "desc":"On the Nodes tab page, you can view the node list of the current cluster, add new nodes to or remove nodes from it, and view the node usage, status, and flavors.This feat", + "product_code":"dws", + "title":"Nodes", + "uri":"dws_01_0818.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"50" + }, + { + "desc":"As your data warehouse capacity and performance requirements change, you can adjust the sizes of existing clusters on the management console to utilize compute and storag", + "product_code":"dws", + "title":"Cluster Scale-out", + "uri":"dws_01_0023.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"51" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Cluster Redistribution", + "uri":"dws_01_0820.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"52" + }, + { + "desc":"Data redistribution, where data in existing nodes is evenly allocated to the new nodes after you scale out a cluster, is a time-consuming yet crucial task that accelerate", + "product_code":"dws", + "title":"Redistributing Data", + "uri":"dws_01_8201.html", + "doc_type":"usermanual", + "p_code":"52", + "code":"53" + }, + { + "desc":"On the View Redistribution Details page, you can view the redistribution mode and progress of the current cluster. In offline scheduling mode, you can pause, resume, and ", + "product_code":"dws", + "title":"Viewing Redistribution Details", + "uri":"dws_01_8202.html", + "doc_type":"usermanual", + "p_code":"52", + "code":"54" + }, + { + "desc":"In the Unbalanced state, the number of primary instances on some nodes increases. As a result, the load pressure is high. In this case, the cluster is normal, but the ove", + "product_code":"dws", + "title":"Performing a Primary/Standby Switchback", + "uri":"dws_01_8115.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"55" + }, + { + "desc":"After you create a data warehouse cluster, the system automatically configures a random maintenance window for the cluster. Alternatively, you can customize a maintenance", + "product_code":"dws", + "title":"Cluster Upgrade", + "uri":"dws_01_0008.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"56" + }, + { + "desc":"GaussDB(DWS) allows you to reset the password of the database administrator. If a database administrator forgets their password or the account is locked because the numbe", + "product_code":"dws", + "title":"Password Reset", + "uri":"dws_01_0026.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"57" + }, + { + "desc":"If a cluster is in the Unbalanced state or cannot work properly, you may need to restart it for restoration. After modifying a cluster's configurations, such as security ", + "product_code":"dws", + "title":"Cluster Restart", + "uri":"dws_01_0024.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"58" + }, + { + "desc":"After a cluster is created, you can modify the cluster's database parameters as required. On the GaussDB(DWS) management console, you can view or set common database para", + "product_code":"dws", + "title":"Modifying Database Parameters", + "uri":"dws_01_0152.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"59" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"MRS Data Sources", + "uri":"dws_01_0057.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"60" + }, + { + "desc":"MRS is a big data cluster running based on the open-source Hadoop ecosystem. It provides the industry's latest cutting-edge storage and analysis capabilities of massive v", + "product_code":"dws", + "title":"Importing Data from MRS to GaussDB(DWS)", + "uri":"dws_01_0055.html", + "doc_type":"usermanual", + "p_code":"60", + "code":"61" + }, + { + "desc":"Before GaussDB(DWS) reads data from MRS HDFS, you need to create an MRS data source connection that functions as a channel of transporting data warehouse cluster data and", + "product_code":"dws", + "title":"Creating an MRS Data Source Connection", + "uri":"dws_01_0059.html", + "doc_type":"usermanual", + "p_code":"60", + "code":"62" + }, + { + "desc":"For MRS, if the following parameter configurations of the HDFS cluster change, data may fail to be imported to the data warehouse cluster from the HDFS cluster. Before im", + "product_code":"dws", + "title":"Updating the MRS Data Source Configuration", + "uri":"dws_01_0156.html", + "doc_type":"usermanual", + "p_code":"60", + "code":"63" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Managing Cluster Workloads", + "uri":"dws_01_0723.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"64" + }, + { + "desc":"When multiple database users query jobs at the same time, some complex queries may occupy cluster resources for a long time, affecting the performance of other queries. F", + "product_code":"dws", + "title":"Workload Management Overview", + "uri":"dws_01_07231.html", + "doc_type":"usermanual", + "p_code":"64", + "code":"65" + }, + { + "desc":"You can create a maximum of 63 workload queues.", + "product_code":"dws", + "title":"Adding Workload Queues", + "uri":"dws_01_07233.html", + "doc_type":"usermanual", + "p_code":"64", + "code":"66" + }, + { + "desc":"You can modify the parameters of a workload queue.Click Edit on the right and modify the parameters according to Table 1.Workload queue parametersParameterDescriptionValu", + "product_code":"dws", + "title":"Modifying Workload Queues", + "uri":"dws_01_07234.html", + "doc_type":"usermanual", + "p_code":"64", + "code":"67" + }, + { + "desc":"In the Query Overview area, you can view the number of long and short queries that are running in the current queue at the current time. The chart information is refreshe", + "product_code":"dws", + "title":"Workload Queue Query", + "uri":"dws_01_07238.html", + "doc_type":"usermanual", + "p_code":"64", + "code":"68" + }, + { + "desc":"If the queue to be deleted has associated database users, these users will be associated with the default queue after the queue is deleted.", + "product_code":"dws", + "title":"Deleting Workload Queues", + "uri":"dws_01_07239.html", + "doc_type":"usermanual", + "p_code":"64", + "code":"69" + }, + { + "desc":"Workload plan is an advanced workload management feature provided by GaussDB(DWS). You can create a workload plan, add multiple stages to the plan, and configure differen", + "product_code":"dws", + "title":"Workload Plans", + "uri":"dws_01_72362.html", + "doc_type":"usermanual", + "p_code":"64", + "code":"70" + }, + { + "desc":"You must stop the workload plan when adding a stage. Otherwise, the stage cannot be added.You can add a maximum of 48 stages for each plan.The switchover time of all phas", + "product_code":"dws", + "title":"Stages of Workload Plans", + "uri":"dws_01_72363.html", + "doc_type":"usermanual", + "p_code":"64", + "code":"71" + }, + { + "desc":"You can commission a workload plan in the test environment and export the plan configurations to the production environment.An ongoing workload plan cannot be imported.Be", + "product_code":"dws", + "title":"Importing and Exporting Workload Plans", + "uri":"dws_01_72365.html", + "doc_type":"usermanual", + "p_code":"64", + "code":"72" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Managing Logical Clusters", + "uri":"dws_01_0724.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"73" + }, + { + "desc":"A physical cluster can be divided into logical clusters that use the node-group mechanism. Tables in a database can be allocated to different physical nodes by logical cl", + "product_code":"dws", + "title":"Overview", + "uri":"dws_01_7241.html", + "doc_type":"usermanual", + "p_code":"73", + "code":"74" + }, + { + "desc":"If you access the Logical Clusters page for the first time, the metadata of the logical cluster created at the backend is synchronized to the frontend. After the synchron", + "product_code":"dws", + "title":"Adding Logical Clusters", + "uri":"dws_01_7242.html", + "doc_type":"usermanual", + "p_code":"73", + "code":"75" + }, + { + "desc":"Nodes are added to or removed from a logical cluster by ring.At least one ring must be reserved in a logical cluster.The ring removed from the logical cluster will be add", + "product_code":"dws", + "title":"Editing Logical Clusters", + "uri":"dws_01_7243.html", + "doc_type":"usermanual", + "p_code":"73", + "code":"76" + }, + { + "desc":"The first added logical cluster cannot be deleted.Nodes of the deleted logical cluster are added to the elastic cluster.", + "product_code":"dws", + "title":"Deleting Logical Clusters", + "uri":"dws_01_7244.html", + "doc_type":"usermanual", + "p_code":"73", + "code":"77" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Restarting Logical Clusters", + "uri":"dws_01_7245.html", + "doc_type":"usermanual", + "p_code":"73", + "code":"78" + }, + { + "desc":"Logical clusters and elastic clusters cannot be scaled out online.", + "product_code":"dws", + "title":"Scaling Out Logical Clusters", + "uri":"dws_01_7246.html", + "doc_type":"usermanual", + "p_code":"73", + "code":"79" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Managing Tags", + "uri":"dws_01_0103.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"80" + }, + { + "desc":"A tag is a key-value pair customized by users and used to identify cloud resources. It helps users to classify and search for cloud resources.Tags are composed of key-val", + "product_code":"dws", + "title":"Overview", + "uri":"dws_01_0104.html", + "doc_type":"usermanual", + "p_code":"80", + "code":"81" + }, + { + "desc":"This section describes how to search for clusters based on tags and how to add, modify, and delete tags for clusters.You can quickly locate a tagged cluster using tags.Yo", + "product_code":"dws", + "title":"Tag Management", + "uri":"dws_01_0105.html", + "doc_type":"usermanual", + "p_code":"80", + "code":"82" + }, + { + "desc":"An enterprise project is a cloud resource management mode. Enterprise Management provides users with comprehensive management in cloud-based resources, personnel, and per", + "product_code":"dws", + "title":"Managing Enterprise Projects", + "uri":"dws_01_0113.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"83" + }, + { + "desc":"If you do not need to use a cluster, perform the operations in this section to delete it.Deleted clusters cannot be recovered. Additionally, you cannot access user data a", + "product_code":"dws", + "title":"Deleting Clusters", + "uri":"dws_01_0025.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"84" + }, + { + "desc":"To facilitate database parameter configuration, GaussDB(DWS) provides the parameter template function. A parameter template contains some common database parameters. You ", + "product_code":"dws", + "title":"Managing Parameter Templates", + "uri":"dws_01_0126.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"85" + }, + { + "desc":"If a cluster fails to be created, you can go to the Clusters page of the GaussDB(DWS) management console to view the cluster status and the cause of failure.For details a", + "product_code":"dws", + "title":"Managing Clusters That Fail to Be Created", + "uri":"dws_01_0073.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"86" + }, + { + "desc":"No database operation is allowed on a read-only cluster. Cancel the read-only status on the management console.You can cancel the read-only status only when a cluster is ", + "product_code":"dws", + "title":"Read-only Status", + "uri":"dws_01_0035.html", + "doc_type":"usermanual", + "p_code":"46", + "code":"87" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Cluster HA", + "uri":"dws_01_0161.html", + "doc_type":"usermanual", + "p_code":"", + "code":"88" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Snapshots", + "uri":"dws_01_0800.html", + "doc_type":"usermanual", + "p_code":"88", + "code":"89" + }, + { + "desc":"A snapshot is a full or incremental backup of a GaussDB(DWS) cluster at a specific point in time. It records the current database data and cluster information, including ", + "product_code":"dws", + "title":"Overview", + "uri":"dws_01_0151.html", + "doc_type":"usermanual", + "p_code":"89", + "code":"90" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Manual Snapshots", + "uri":"dws_01_0092.html", + "doc_type":"usermanual", + "p_code":"89", + "code":"91" + }, + { + "desc":"A snapshot is a complete backup that records point-in-time configuration data and service data of a GaussDB(DWS) cluster. This section describes how to create a snapshot ", + "product_code":"dws", + "title":"Manually Creating a Snapshot", + "uri":"dws_01_0028.html", + "doc_type":"usermanual", + "p_code":"91", + "code":"92" + }, + { + "desc":"On the Snapshots page, you can delete a snapshot in the Unavailable state or delete an available snapshot to release the storage space.Deleted snapshots cannot be restore", + "product_code":"dws", + "title":"Deleting Manual Snapshots", + "uri":"dws_01_0030.html", + "doc_type":"usermanual", + "p_code":"91", + "code":"93" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Automated Snapshots", + "uri":"dws_01_1013.html", + "doc_type":"usermanual", + "p_code":"89", + "code":"94" + }, + { + "desc":"Automated snapshots adopt differential incremental backups. The automated snapshot created for the first time is a full backup (base version), and then the system creates", + "product_code":"dws", + "title":"Automated Snapshot Overview", + "uri":"dws_01_10131.html", + "doc_type":"usermanual", + "p_code":"94", + "code":"95" + }, + { + "desc":"You can select a snapshot type and set one or more automated snapshot policies for a cluster. After an automated snapshot policy is enabled, the system automatically crea", + "product_code":"dws", + "title":"Configuring an Automated Snapshot Policy", + "uri":"dws_01_0089.html", + "doc_type":"usermanual", + "p_code":"94", + "code":"96" + }, + { + "desc":"This section describes how to copy snapshots that are automatically created for long-term retention.All snapshots are displayed by default. You can copy the snapshots tha", + "product_code":"dws", + "title":"Copying Automated Snapshots", + "uri":"dws_01_0085.html", + "doc_type":"usermanual", + "p_code":"94", + "code":"97" + }, + { + "desc":"Only GaussDB(DWS) can delete automated snapshots. You cannot delete them manually.GaussDB(DWS) deletes an automated snapshot if:The retention period of the snapshot ends.", + "product_code":"dws", + "title":"Deleting an Automated Snapshot", + "uri":"dws_01_10134.html", + "doc_type":"usermanual", + "p_code":"94", + "code":"98" + }, + { + "desc":"This section describes how to view snapshot information on the Snapshots page.In the snapshot list, all snapshots are displayed by default. Click next to the snapshot na", + "product_code":"dws", + "title":"Viewing Snapshot Information", + "uri":"dws_01_0021.html", + "doc_type":"usermanual", + "p_code":"89", + "code":"99" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Restoration Using a Snapshot", + "uri":"dws_01_1015.html", + "doc_type":"usermanual", + "p_code":"89", + "code":"100" + }, + { + "desc":"This section describes how to restore a snapshot to a new cluster when you want to check point-in-time snapshot data of the cluster.When a snapshot is restored to a new c", + "product_code":"dws", + "title":"Restoring a Snapshot to a New Cluster", + "uri":"dws_01_0029.html", + "doc_type":"usermanual", + "p_code":"100", + "code":"101" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Cluster DR", + "uri":"dws_01_0080.html", + "doc_type":"usermanual", + "p_code":"88", + "code":"102" + }, + { + "desc":"A homogeneous GaussDB(DWS) DR cluster is deployed in another AZ. If the production cluster fails to provide read and write services due to natural disasters in the specif", + "product_code":"dws", + "title":"DR Overview", + "uri":"dws_01_00081.html", + "doc_type":"usermanual", + "p_code":"102", + "code":"103" + }, + { + "desc":"You can create a DR task only when the cluster is in the Available or Unbalanced state.Type: Cross-AZ DRName: Enter 4 to 64 case-insensitive characters, starting with a l", + "product_code":"dws", + "title":"Creating a DR Task", + "uri":"dws_01_00082.html", + "doc_type":"usermanual", + "p_code":"102", + "code":"104" + }, + { + "desc":"On the page that is displayed, view the following information:DR Information: You can view the DR ID, DR name, DR creation time, and DR status.Production Cluster Informat", + "product_code":"dws", + "title":"Viewing DR Information", + "uri":"dws_01_00083.html", + "doc_type":"usermanual", + "p_code":"102", + "code":"105" + }, + { + "desc":"The DR status will change to Starting. The process will take some time. After the task is started, the DR status will change to Running.You can start a DR task that is in", + "product_code":"dws", + "title":"DR Management", + "uri":"dws_01_00084.html", + "doc_type":"usermanual", + "p_code":"102", + "code":"106" + }, + { + "desc":"After scale-out, the number of DNs in the production cluster must be the same as that in the DR cluster.", + "product_code":"dws", + "title":"Mutually Exclusive DR Cases", + "uri":"dws_01_00085.html", + "doc_type":"usermanual", + "p_code":"102", + "code":"107" + }, + { + "desc":"If the internal IP address or EIP of a CN is used to connect to a cluster, the failure of this CN will lead to cluster connection failure. If a private domain name is use", + "product_code":"dws", + "title":"Associating and Disassociating ELB", + "uri":"dws_01_0822.html", + "doc_type":"usermanual", + "p_code":"88", + "code":"108" + }, + { + "desc":"After a cluster is created, the number of required CNs varies with service requirements. The CN management function enables you to adjust the number of CNs in the cluster", + "product_code":"dws", + "title":"CNs", + "uri":"dws_01_7115.html", + "doc_type":"usermanual", + "p_code":"88", + "code":"109" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Monitoring and Alarms", + "uri":"dws_01_0162.html", + "doc_type":"usermanual", + "p_code":"", + "code":"110" + }, + { + "desc":"This section describes how to check cluster metrics on Cloud Eye. By monitoring cluster running metrics, you can identify the time when the database cluster is abnormal a", + "product_code":"dws", + "title":"Monitoring Clusters Using Cloud Eye", + "uri":"dws_01_0022.html", + "doc_type":"usermanual", + "p_code":"110", + "code":"111" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Databases Monitoring", + "uri":"dws_01_00014.html", + "doc_type":"usermanual", + "p_code":"110", + "code":"112" + }, + { + "desc":"DMS is provided by GaussDB(DWS) to ensure the fast and stable running of databases. It collects, monitors, and analyzes the disk, network, and OS metric data used by the ", + "product_code":"dws", + "title":"Database Monitoring Overview", + "uri":"dws_01_00131.html", + "doc_type":"usermanual", + "p_code":"112", + "code":"113" + }, + { + "desc":"You can check the status and available resources of a cluster and learn about its real-time resource consumption through the GaussDB(DWS) monitoring items.Table 1 describ", + "product_code":"dws", + "title":"Monitoring Metrics", + "uri":"dws_01_00136.html", + "doc_type":"usermanual", + "p_code":"112", + "code":"114" + }, + { + "desc":"On the page that is displayed, you can view the cluster status, real-time resource consumption, top SQL statements, cluster resource consumption, and key database metrics", + "product_code":"dws", + "title":"Cluster Overview", + "uri":"dws_01_00132.html", + "doc_type":"usermanual", + "p_code":"112", + "code":"115" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Monitoring", + "uri":"dws_01_00133.html", + "doc_type":"usermanual", + "p_code":"112", + "code":"116" + }, + { + "desc":"On the page that is displayed, view the real-time consumption of nodes, memory, disks, disk I/O, and network I/O.On the Overview tab page, you can view the key resources ", + "product_code":"dws", + "title":"Node Monitoring", + "uri":"dws_01_1331.html", + "doc_type":"usermanual", + "p_code":"116", + "code":"117" + }, + { + "desc":"The Performance Monitoring page displays the resource consumption trends of clusters and databases.You can configure monitoring views by customizing monitoring panels. Mo", + "product_code":"dws", + "title":"Performance Monitoring", + "uri":"dws_01_1337.html", + "doc_type":"usermanual", + "p_code":"116", + "code":"118" + }, + { + "desc":"The Database Monitoring page displays the real-time and historical resource consumption a database.You can select a database and check its resource usage. For details, se", + "product_code":"dws", + "title":"Database Monitoring", + "uri":"dws_01_1332.html", + "doc_type":"usermanual", + "p_code":"116", + "code":"119" + }, + { + "desc":"The Session Monitoring page displays the session-level real-time database query statistics. You can also select and terminate a session.You can browse the query statistic", + "product_code":"dws", + "title":"Session Monitoring", + "uri":"dws_01_1333.html", + "doc_type":"usermanual", + "p_code":"116", + "code":"120" + }, + { + "desc":"The Query Monitoring page displays the real-time information about all queries that are running in a cluster and the historical information about the queries that have be", + "product_code":"dws", + "title":"Query Monitoring", + "uri":"dws_01_1334.html", + "doc_type":"usermanual", + "p_code":"116", + "code":"121" + }, + { + "desc":"On the Instance Monitoring page, you can view the real-time and historical information about detected slow instances.DMS can automatically configure and start the slow in", + "product_code":"dws", + "title":"Instance Monitoring", + "uri":"dws_01_1338.html", + "doc_type":"usermanual", + "p_code":"116", + "code":"122" + }, + { + "desc":"On the Load Monitoring page, you can view the real-time and historical resource consumption of workload queues.The DMS displays the user-defined workload queue name, real", + "product_code":"dws", + "title":"Load Monitoring", + "uri":"dws_01_1339.html", + "doc_type":"usermanual", + "p_code":"116", + "code":"123" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Utilities", + "uri":"dws_01_00175.html", + "doc_type":"usermanual", + "p_code":"112", + "code":"124" + }, + { + "desc":"To enable SQL diagnosis, enable monitoring on real-time and historical queries on the Queries and History tabs, respectively. For details, see .Query IDDatabaseSchema Nam", + "product_code":"dws", + "title":"SQL Diagnosis", + "uri":"dws_01_00134.html", + "doc_type":"usermanual", + "p_code":"124", + "code":"125" + }, + { + "desc":"You can audit DDL to check DDL metadata, identify inappropriate table definitions, and locate performance problems.This feature is supported only in cluster version 8.1.2", + "product_code":"dws", + "title":"DDL Audit", + "uri":"dws_01_01752.html", + "doc_type":"usermanual", + "p_code":"124", + "code":"126" + }, + { + "desc":"The Monitoring page displays the collection period and data aging period of monitoring metrics.The cluster monitoring function is enabled by default.Disable the function ", + "product_code":"dws", + "title":"Settings", + "uri":"dws_01_00135.html", + "doc_type":"usermanual", + "p_code":"112", + "code":"127" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Typical Scenarios", + "uri":"dws_01_00137.html", + "doc_type":"usermanual", + "p_code":"112", + "code":"128" + }, + { + "desc":"The execution of SQL statements takes a long time, resulting in great resource consumption.If the execution efficiency of SQL statements is low, optimization suggestions ", + "product_code":"dws", + "title":"SQL Diagnosis", + "uri":"dws_01_01372.html", + "doc_type":"usermanual", + "p_code":"128", + "code":"129" + }, + { + "desc":"Time-consuming SQL statements exist.On the Top 5 Time-Consuming Queries page directed from the Cluster Overview page, record the change of top 5 time-consuming queries.An", + "product_code":"dws", + "title":"Top Time-Consuming SQL Statements Viewing", + "uri":"dws_01_01373.html", + "doc_type":"usermanual", + "p_code":"128", + "code":"130" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Alarms", + "uri":"dws_01_1240.html", + "doc_type":"usermanual", + "p_code":"110", + "code":"131" + }, + { + "desc":"Alarm management includes viewing and configuring alarm rules and subscribing to alarm information. Alarm rules display alarm statistics and details of the past week for ", + "product_code":"dws", + "title":"Alarm Management", + "uri":"dws_01_1241.html", + "doc_type":"usermanual", + "p_code":"131", + "code":"132" + }, + { + "desc":"Concepts related to threshold alarmsAlarm rule: consists of the alarm rule name, rule description, clusters associated with the rule, alarm policy triggering relationship", + "product_code":"dws", + "title":"Alarm Rules", + "uri":"dws_01_1242.html", + "doc_type":"usermanual", + "p_code":"131", + "code":"133" + }, + { + "desc":"You can subscribe to GaussDB(DWS) alarm notifications to receive notifications by SMS message, email, or application when an alarm of a specified severity is generated.To", + "product_code":"dws", + "title":"Alarm Subscriptions", + "uri":"dws_01_1243.html", + "doc_type":"usermanual", + "p_code":"131", + "code":"134" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Cluster Security Management", + "uri":"dws_01_0700.html", + "doc_type":"usermanual", + "p_code":"", + "code":"135" + }, + { + "desc":"By default, the administrator specified when you create a GaussDB(DWS) cluster is the database system administrator. The administrator can create other users and view the", + "product_code":"dws", + "title":"Configuring Separation of Permissions", + "uri":"dws_01_0074.html", + "doc_type":"usermanual", + "p_code":"135", + "code":"136" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Permissions", + "uri":"dws_01_0145.html", + "doc_type":"usermanual", + "p_code":"135", + "code":"137" + }, + { + "desc":"An RBAC policy consists of a Version, a Statement, and Depends.When selecting a policy for a user group, click below the policy to view the details of the policy. The DW", + "product_code":"dws", + "title":"RBAC Syntax of RBAC Policies", + "uri":"dws_01_0150.html", + "doc_type":"usermanual", + "p_code":"137", + "code":"138" + }, + { + "desc":"GaussDB(DWS) protects mission-critical operations. If you want to perform a mission-critical operation on the management console, you must enter a credential for identity", + "product_code":"dws", + "title":"Protection for Mission-Critical Operations", + "uri":"dws_01_0701.html", + "doc_type":"usermanual", + "p_code":"135", + "code":"139" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Audit Logs", + "uri":"dws_01_0119.html", + "doc_type":"usermanual", + "p_code":"", + "code":"140" + }, + { + "desc":"Tenant database audit logs:GaussDB(DWS) allows you to record the audit logs of specific operations, involving audit log retention policies, unauthorized access, as well a", + "product_code":"dws", + "title":"Overview", + "uri":"dws_01_1911.html", + "doc_type":"usermanual", + "p_code":"140", + "code":"141" + }, + { + "desc":"This section is organized as follows:Enabling CTSDisabling the Audit Log FunctionKey OperationsViewing TracesA tracker will be automatically created after CTS is enabled.", + "product_code":"dws", + "title":"Viewing Audit Logs of Key Operations on the Management Console", + "uri":"dws_01_0118.html", + "doc_type":"usermanual", + "p_code":"140", + "code":"142" + }, + { + "desc":"Database audit logs are configured on the Security Settings page. You can change security settings only when the cluster status is Available and Unbalanced, and Task Info", + "product_code":"dws", + "title":"Configuring the Database Audit Logs", + "uri":"dws_01_0075.html", + "doc_type":"usermanual", + "p_code":"140", + "code":"143" + }, + { + "desc":"GaussDB(DWS) records information (audit logs) about connections and user activities in your database. With the information, you can monitor the database to ensure securit", + "product_code":"dws", + "title":"Dumping the Database Audit Logs", + "uri":"dws_01_0142.html", + "doc_type":"usermanual", + "p_code":"140", + "code":"144" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"FAQs", + "uri":"dws_03_0061.html", + "doc_type":"usermanual", + "p_code":"", + "code":"145" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"General Problems", + "uri":"dws_03_0001.html", + "doc_type":"usermanual", + "p_code":"145", + "code":"146" + }, + { + "desc":"Much data (orders, stocks, materials, and payments) is generated in the business operation systems and background (transactional) database of enterprises.Decision makers ", + "product_code":"dws", + "title":"Why Are Data Warehouses Necessary?", + "uri":"dws_03_0003.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"147" + }, + { + "desc":"The Hadoop big data platform can be regarded as a next-generation data warehousing system. It has the characteristics of modern data warehouses and is widely used by ente", + "product_code":"dws", + "title":"What Are the Differences Between a Data Warehouse and the Hadoop Big Data Platform?", + "uri":"dws_03_0005.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"148" + }, + { + "desc":"Conventional data warehouses are not practical for smaller enterprises due to high cost, time-consuming device and system selection and procurement, and complex scale-out", + "product_code":"dws", + "title":"Why Should I Use Public Cloud GaussDB(DWS)?", + "uri":"dws_03_0006.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"149" + }, + { + "desc":"Both allow you to run conventional relational databases on the cloud and transfer database management loads. RDS databases are useful for OLTP, reporting, and analysis, b", + "product_code":"dws", + "title":"Should I Choose Public Cloud GaussDB(DWS) or RDS?", + "uri":"dws_03_0009.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"150" + }, + { + "desc":"MRS works better with big data processing frameworks such as Apache Spark, Hadoop, and HBase, to process and analyze ultra-large data sets through custom code. It allows ", + "product_code":"dws", + "title":"When Should I Use GaussDB(DWS) and MRS?", + "uri":"dws_03_0010.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"151" + }, + { + "desc":"No. Although SQL on OBS of GaussDB(DWS) can be used for GaussDB(DWS) and OBS data query, it cannot replace the processing frameworks of MRS.Apart from SQL query, MRS also", + "product_code":"dws", + "title":"Can GaussDB(DWS) SQL on OBS Replace MRS?", + "uri":"dws_03_0011.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"152" + }, + { + "desc":"GaussDB(DWS) and Hive have different functions in the following aspects:Hive is a data warehouse based on Hadoop MapReduce. GaussDB(DWS) is a data warehouse based on Post", + "product_code":"dws", + "title":"What Are the Differences Between GaussDB(DWS) and Hive in Functions?", + "uri":"dws_03_0037.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"153" + }, + { + "desc":"For cloud services, quotas limit the number of resources available to users. If you need more, submit a service ticket to increase your quotas. Once approved, we will upd", + "product_code":"dws", + "title":"What Is the User Quota?", + "uri":"dws_03_0034.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"154" + }, + { + "desc":"Users and roles are shared within the entire cluster, but their data is not shared. That is, a user can connect to any database, but after the connection is successful, a", + "product_code":"dws", + "title":"What Are the Differences Between Users and Roles?", + "uri":"dws_03_0067.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"155" + }, + { + "desc":"A region and availability zone (AZ) identify the location of a data center. You can create resources in regions and AZs.A region is a physical data center. Each region is", + "product_code":"dws", + "title":"Regions and AZs", + "uri":"dws_03_0052.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"156" + }, + { + "desc":"Yes. In the big data era, data has become a core asset. The public cloud will adhere to the commitment made over the years that we do not touch your applications or data,", + "product_code":"dws", + "title":"Is My Data Secure in GaussDB(DWS)?", + "uri":"dws_03_0022.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"157" + }, + { + "desc":"GaussDB(DWS) uses IAM and VPC to control user access and isolate cluster network. Cluster access is over SSL and cipher suite. Additionally, GaussDB(DWS) supports two-way", + "product_code":"dws", + "title":"How Is GaussDB(DWS) Secured?", + "uri":"dws_03_0023.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"158" + }, + { + "desc":"Yes. When a data warehouse cluster is created, its security group cannot be changed. However, you can add, delete, or modify rules of the current security group.To edit t", + "product_code":"dws", + "title":"Can I Modify the Security Group of a GaussDB(DWS) Cluster?", + "uri":"dws_03_0053.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"159" + }, + { + "desc":"The evolving Internet and IoT produce massive volumes of data. This data needs to be managed, using concepts like database, data warehouse, data lake, and lakehouse. Here", + "product_code":"dws", + "title":"What Is a Database/Data Warehouse/Data Lake/Lakehouse?", + "uri":"dws_03_2121.html", + "doc_type":"usermanual", + "p_code":"146", + "code":"160" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Cluster Management", + "uri":"dws_03_0029.html", + "doc_type":"usermanual", + "p_code":"145", + "code":"161" + }, + { + "desc":"Check that you have enough quota for creating the cluster.Call the Customer Hotline for support.Telephone:Germany: 0800 330 44 44International: +800 44556600", + "product_code":"dws", + "title":"What Do I Do If Creating a GaussDB(DWS) Cluster Failed?", + "uri":"dws_03_0016.html", + "doc_type":"usermanual", + "p_code":"161", + "code":"162" + }, + { + "desc":"Cluster patching or upgrading is automatic because GaussDB(DWS) upgrades its own version.For service patch:Duration: less than 10 minutesImpact on services: 1 to 3 minute", + "product_code":"dws", + "title":"How Can I Upgrade or Downgrade GaussDB(DWS)?", + "uri":"dws_03_0031.html", + "doc_type":"usermanual", + "p_code":"161", + "code":"163" + }, + { + "desc":"After you delete data stored in GaussDB(DWS) data warehouses, dirty data may be generated from the unreleased disk space. This results in space waste and deteriorates sna", + "product_code":"dws", + "title":"How Can I Clear and Reclaim Storage?", + "uri":"dws_03_0033.html", + "doc_type":"usermanual", + "p_code":"161", + "code":"164" + }, + { + "desc":"If you do not run VACUUM to clear and reclaim the storage space before the scale-out, the data deleted from GaussDB(DWS) may not free up the occupied disk space.During th", + "product_code":"dws", + "title":"Why Did the Used Storage Reduce After Scale-out?", + "uri":"dws_03_0054.html", + "doc_type":"usermanual", + "p_code":"161", + "code":"165" + }, + { + "desc":"You can view the used capacity of a cluster CPU, memory, and disks on the Cloud Eye management console. Perform the following steps to view the information:", + "product_code":"dws", + "title":"How Do I View Node Metrics (CPU, Memory, and Disk Usage)?", + "uri":"dws_03_0104.html", + "doc_type":"usermanual", + "p_code":"161", + "code":"166" + }, + { + "desc":"A cluster with three data nodes of 320 GB each has a total capacity of 960 GB. When 1 GB data is stored, GaussDB(DWS) stores 1 GB data on two nodes due to duplication, a ", + "product_code":"dws", + "title":"How Is the Disk Space or Capacity of GaussDB(DWS) Calculated?", + "uri":"dws_03_0090.html", + "doc_type":"usermanual", + "p_code":"161", + "code":"167" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Database Connections", + "uri":"dws_03_0024.html", + "doc_type":"usermanual", + "p_code":"145", + "code":"168" + }, + { + "desc":"Yes, but GaussDB(DWS) clients and drivers are recommended. Unlike open-source PostgreSQL clients and drivers, GaussDB(DWS) clients and drivers have two key advantages:Sec", + "product_code":"dws", + "title":"Does GaussDB(DWS) Support Third-Party Clients and JDBC and ODBC Drivers?", + "uri":"dws_03_0017.html", + "doc_type":"usermanual", + "p_code":"168", + "code":"169" + }, + { + "desc":"No, direct access is not supported. VMs at the bottom layer of GaussDB(DWS) serve as the compute nodes for data analysis. Access cluster databases using the private or pu", + "product_code":"dws", + "title":"Can I Connect to GaussDB(DWS) Cluster Nodes Using SSH?", + "uri":"dws_03_0040.html", + "doc_type":"usermanual", + "p_code":"168", + "code":"170" + }, + { + "desc":"Check:Whether the cluster status is normal.Whether the connection command, username, password, IP address, and port are correct.Whether the operating system type and vers", + "product_code":"dws", + "title":"What Should I Do If I Cannot Connect to a Data Warehouse Cluster?", + "uri":"dws_03_0014.html", + "doc_type":"usermanual", + "p_code":"168", + "code":"171" + }, + { + "desc":"After the EIP is unbound, the network may be disconnected. However, the TCP layer does not detect a faulty physical connection in time due to keepalive settings. As a res", + "product_code":"dws", + "title":"Why Was I Not Notified of Failure Unbinding the EIP When GaussDB(DWS) Is Connected Over the Internet?", + "uri":"dws_03_0025.html", + "doc_type":"usermanual", + "p_code":"168", + "code":"172" + }, + { + "desc":"Resources in different AZs of the same region can communicate with each other directly if they belong to the same VPC.For resources in different AZs of the same region bu", + "product_code":"dws", + "title":"How Can a Data Warehouse and a Database in Different AZs of the Same Region Communicate?", + "uri":"dws_03_0169.html", + "doc_type":"usermanual", + "p_code":"168", + "code":"173" + }, + { + "desc":"If BI applications, client ECS, and DGC need to communicate with GaussDB(DWS), they must be in the same region and VPC as the GaussDB(DWS) cluster (different subnets are ", + "product_code":"dws", + "title":"Do I Need the Same VPC and Subnet to Connect to a GaussDB(DWS) Cluster?", + "uri":"dws_03_2125.html", + "doc_type":"usermanual", + "p_code":"168", + "code":"174" + }, + { + "desc":"You can also log in to the VPC management console to manually create a security group. Then, go back to the page for creating data warehouse clusters, click the button n", + "product_code":"dws", + "title":"How Do I Configure a Whitelist to Protect Clusters Available Through a Public IP Address?", + "uri":"dws_03_2130.html", + "doc_type":"usermanual", + "p_code":"168", + "code":"175" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Data Import and Export", + "uri":"dws_03_0026.html", + "doc_type":"usermanual", + "p_code":"145", + "code":"176" + }, + { + "desc":"The file formats supported by OBS and GDS foreign tables are as follows:OBS file formats: CSV, TEXT, ORC, and CARBONDATA. The default format is TEXT.GDS file formats: CSV", + "product_code":"dws", + "title":"What Are the Differences Between Data Formats Supported by OBS and GDS Foreign Tables?", + "uri":"dws_03_0018.html", + "doc_type":"usermanual", + "p_code":"176", + "code":"177" + }, + { + "desc":"GaussDB(DWS) supports efficient data import from multiple data sources. The following lists typical data import modes. For details, see \"Import Modes\" in the Data Warehou", + "product_code":"dws", + "title":"How Can I Import Data to GaussDB(DWS)?", + "uri":"dws_03_0027.html", + "doc_type":"usermanual", + "p_code":"176", + "code":"178" + }, + { + "desc":"Each node in a data warehouse cluster has a default storage capacity of 160 GB, 256 GB, 1.6 TB, 1.8 TB, or 13 TB. A cluster can house 3 to 32 nodes and the total storage ", + "product_code":"dws", + "title":"How Much Service Data Can a Data Warehouse Store?", + "uri":"dws_03_0028.html", + "doc_type":"usermanual", + "p_code":"176", + "code":"179" + }, + { + "desc":"GaussDB(DWS) is a fully managed service on the cloud. Users cannot log in to the background to import or export data by using COPY, so the COPY syntax is disabled. You ar", + "product_code":"dws", + "title":"How Do I Use \\Copy to Import and Export Data?", + "uri":"dws_03_0073.html", + "doc_type":"usermanual", + "p_code":"176", + "code":"180" + }, + { + "desc":"No, GaussDB(DWS) does not support OBS data import or export across regions. The GaussDB(DWS) cluster and OBS must be in the same region.", + "product_code":"dws", + "title":"Can I Export GaussDB(DWS) Data from/to OBS Across Regions?", + "uri":"dws_03_0102.html", + "doc_type":"usermanual", + "p_code":"176", + "code":"181" + }, + { + "desc":"To import heterogeneous data to GaussDB(DWS), use CDM to migrate the entire MySQL or SQL Server database. Or migrate the entire GaussDB(DWS) database to another GaussDB(D", + "product_code":"dws", + "title":"How Do I Import GaussDB(DWS)/Oracle/MySQL/SQL Server Data to GaussDB(DWS) (Whole Database Migration)?", + "uri":"dws_03_0074.html", + "doc_type":"usermanual", + "p_code":"176", + "code":"182" + }, + { + "desc":"No. The GDS server and GaussDB(DWS) can only communicate with each other on the intranet. Each DN in the GaussDB(DWS) cluster is used to connect to the GDS server in para", + "product_code":"dws", + "title":"Can I Import Data over the Public/External Network Using GDS?", + "uri":"dws_03_0105.html", + "doc_type":"usermanual", + "p_code":"176", + "code":"183" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Account, Password, and Permissions", + "uri":"dws_03_0110.html", + "doc_type":"usermanual", + "p_code":"145", + "code":"184" + }, + { + "desc":"To change the password of the database administrator dbadmin, log in to the console and choose More > Reset Password in cluster row.For security, the following two parame", + "product_code":"dws", + "title":"How Do I Change My Expired Database Password?", + "uri":"dws_03_0092.html", + "doc_type":"usermanual", + "p_code":"184", + "code":"185" + }, + { + "desc":"To view the user list, query the PG_USER view.SELECT * FROM pg_user;To view user attributes, query the PG_AUTHID system catalog.SELECT * FROM pg_authid;Query the permissi", + "product_code":"dws", + "title":"How Do I View All Database Users and Their Permissions?", + "uri":"dws_03_0095.html", + "doc_type":"usermanual", + "p_code":"184", + "code":"186" + }, + { + "desc":"This section describes how to grant users the SELECT, INSERT, UPDATE, or full permissions for tables.Assume there are users u1, u2, u3, u4, and u5 and five schemas named ", + "product_code":"dws", + "title":"How Do I Grant Table Permissions to a User?", + "uri":"dws_03_0197.html", + "doc_type":"usermanual", + "p_code":"184", + "code":"187" + }, + { + "desc":"This section describes how to grant the query permission for a schema as an example. For more information, see \"How Do I Grant Table Permissions to a User?\" in FAQ. You ", + "product_code":"dws", + "title":"How Do I Grant Schema Permissions to a User?", + "uri":"dws_03_0196.html", + "doc_type":"usermanual", + "p_code":"184", + "code":"188" + }, + { + "desc":"GaussDB(DWS) provides an implicitly defined group public that contains all roles. By default, all new users and roles have the permissions of public. To revoke permission", + "product_code":"dws", + "title":"How Do I Revoke the CONNECT ON DATABASE Permission from a User?", + "uri":"dws_03_0195.html", + "doc_type":"usermanual", + "p_code":"184", + "code":"189" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Database Usage", + "uri":"dws_03_0065.html", + "doc_type":"usermanual", + "p_code":"145", + "code":"190" + }, + { + "desc":"No, you only need to set the primary key. By default, the first column of the primary key is selected as the distribution key. If both are set, the primary key must conta", + "product_code":"dws", + "title":"Do I Need to Set a Distribution Key After Setting a Primary Key?", + "uri":"dws_03_0075.html", + "doc_type":"usermanual", + "p_code":"190", + "code":"191" + }, + { + "desc":"Yes.GaussDB(DWS) is compatible with PostgreSQL stored procedures. For details, see \"Stored Procedures\" in the Developer Guide.", + "product_code":"dws", + "title":"Is GaussDB(DWS) Compatible with PostgreSQL Stored Procedures?", + "uri":"dws_03_0076.html", + "doc_type":"usermanual", + "p_code":"190", + "code":"192" + }, + { + "desc":"Partitioned table: Partitioning refers to splitting what is logically one large table into smaller physical pieces based on specific schemes. The table based on the logic", + "product_code":"dws", + "title":"What Are Partitioned Tables, Partitions, and Partition Keys?", + "uri":"dws_03_0064.html", + "doc_type":"usermanual", + "p_code":"190", + "code":"193" + }, + { + "desc":"You are advised to use the Data Studio graphical client to export table data. You can export data from:A specific tableAll tables in a schemaAll tables in a databaseFor d", + "product_code":"dws", + "title":"How Can I Export the Table Structure?", + "uri":"dws_03_0078.html", + "doc_type":"usermanual", + "p_code":"190", + "code":"194" + }, + { + "desc":"You can use pg_tables and pg_views to query all table information and views in a database. Example:For details about the returned columns, see \"PG_TABLES\" and \"PG_VIEWS\" ", + "product_code":"dws", + "title":"How Can I Export All Tables and Views from a Database?", + "uri":"dws_03_0079.html", + "doc_type":"usermanual", + "p_code":"190", + "code":"195" + }, + { + "desc":"In GaussDB(DWS), the encoding format of a database cannot be changed. You need to create another database in the required format. For globalization purposes, set the enco", + "product_code":"dws", + "title":"How Can I Change the Character Encoding Format of a Database?", + "uri":"dws_03_0085.html", + "doc_type":"usermanual", + "p_code":"190", + "code":"196" + }, + { + "desc":"Yes. TRUNCATE is more efficient than DELETE for deleting massive data.For details, see \"TRUNCATE\" in the Data Warehouse Service (DWS) Developer Guide.TRUNCATE quickly rem", + "product_code":"dws", + "title":"How Can I Delete Table Data Efficiently?", + "uri":"dws_03_0088.html", + "doc_type":"usermanual", + "p_code":"190", + "code":"197" + }, + { + "desc":"Yes. For tables that involve frequent add, delete, or modify operations, perform VACUUM FULL and ANALYZE to reclaim the disk space occupied by updated or deleted data, pr", + "product_code":"dws", + "title":"Do I Need to Run VACUUM FULL and ANALYZE on Common Tables Periodically?", + "uri":"dws_03_0089.html", + "doc_type":"usermanual", + "p_code":"190", + "code":"198" + }, + { + "desc":"To query information about OBS/GDS foreign tables such as OBS paths, run the following statement:The following uses table traffic_data.GCJL_OBS as an example:", + "product_code":"dws", + "title":"How Do I View Foreign Table Information?", + "uri":"dws_03_2124.html", + "doc_type":"usermanual", + "p_code":"190", + "code":"199" + }, + { + "desc":"In a data warehouse database, you need to carefully choose distribution columns for large tables, because they can affect your database and query performance. If an impro", + "product_code":"dws", + "title":"How Do I Change Distribution Columns?", + "uri":"dws_03_2126.html", + "doc_type":"usermanual", + "p_code":"190", + "code":"200" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Database Performance", + "uri":"dws_03_0035.html", + "doc_type":"usermanual", + "p_code":"145", + "code":"201" + }, + { + "desc":"When a database is used for a period of time, the table data increases as services grow, or the table data is frequently added, deleted, or modified. This results in bloa", + "product_code":"dws", + "title":"Why Is SQL Execution Slow After Long GaussDB(DWS) Usage?", + "uri":"dws_03_0071.html", + "doc_type":"usermanual", + "p_code":"201", + "code":"202" + }, + { + "desc":"Due to the MPP architecture limitation of GaussDB(DWS), a few PostgreSQL methods and functions cannot be pushed to DNs for execution. As a result, performance bottlenecks", + "product_code":"dws", + "title":"Why Does GaussDB(DWS) Perform Worse Than a Single-Server Database in Extreme Scenarios?", + "uri":"dws_03_0036.html", + "doc_type":"usermanual", + "p_code":"201", + "code":"203" + }, + { + "desc":"The top SQL feature lets you view SQL statements executed in a specified period (in real time and historical). SQL statements of the current CN or all CNs are available f", + "product_code":"dws", + "title":"How Can I View SQL Execution Records of A Certain Period When Service Read and Write Are Blocked?", + "uri":"dws_03_0100.html", + "doc_type":"usermanual", + "p_code":"201", + "code":"204" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Logs", + "uri":"dws_03_0068.html", + "doc_type":"usermanual", + "p_code":"145", + "code":"205" + }, + { + "desc":"GaussDB(DWS) allows you to record the audit logs of specific operations, involving audit log retention policies, unauthorized access, as well as DML, DDL, SELECT and COPY", + "product_code":"dws", + "title":"How Can I View Database Operation Logs?", + "uri":"dws_03_0082.html", + "doc_type":"usermanual", + "p_code":"205", + "code":"206" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dws", + "title":"Change History", + "uri":"dws_01_0070.html", + "doc_type":"usermanual", + "p_code":"", + "code":"207" + } +] \ No newline at end of file diff --git a/docs/dws/umn/PARAMETERS.txt b/docs/dws/umn/PARAMETERS.txt new file mode 100644 index 00000000..6da8d5f0 --- /dev/null +++ b/docs/dws/umn/PARAMETERS.txt @@ -0,0 +1,3 @@ +version="" +language="en-us" +type="" \ No newline at end of file diff --git a/docs/dws/umn/dws_01_00013.html b/docs/dws/umn/dws_01_00013.html new file mode 100644 index 00000000..340f000c --- /dev/null +++ b/docs/dws/umn/dws_01_00013.html @@ -0,0 +1,30 @@ + + +
The data warehouse is the pillar of the Business Intelligence (BI) system for collecting, storing, and analyzing massive amounts of data. It provides powerful business analysis support for IoT, mobile Internet, gaming, and Online to Offline (O2O) industries.
+Advantages of GaussDB(DWS) are as follows:
+Data of online retailers is mainly used for marketing recommendation, operating and customer analysis, and full text search.
+Advantages of GaussDB(DWS) are as follows:
+GaussDB(DWS) helps you analyze massive amounts of data from IoT in real time and perform optimization based on the results. It is widely used in industrial IoT, O2O service system, and IoV solutions.
+Advantages of GaussDB(DWS) are as follows:
+GaussDB(DWS) is an online data processing database that runs on the cloud infrastructure to provide scalable, fully-managed, and out-of-the-box analytic database service, freeing you from complex database management and monitoring. It is a native cloud service based on the converged data warehouse GaussDB, and is fully compatible with the standard ANSI SQL 99 and SQL 2003, as well as the PostgreSQL and Oracle ecosystems. GaussDB(DWS) provides competitive solutions for PB-level big data analysis in various industries.
+GaussDB(DWS) employs the shared-nothing architecture and the massively parallel processing (MPP) engine, and consists of numerous independent logical nodes that do not share the system resources such as CPUs, memory, and storage. In such a system architecture, service data is separately stored on numerous nodes. Data analysis tasks are executed in parallel on the nodes where data is stored. The massively parallel data processing significantly improves response speed.
+Data loading tools, extract, transform, and load (ETL) tools, business intelligence (BI) tools, as well as data mining and analysis tools, can be integrated with GaussDB(DWS) through standard APIs. GaussDB(DWS) is compatible with the PostgreSQL ecosystem, and the SQL syntax is compatible with Oracle and Teradata. Applications can be smoothly migrated to GaussDB(DWS) with few changes.
+Applications can connect to GaussDB(DWS) through the standard Java Database Connectivity (JDBC) 4.0 and Open Database Connectivity (ODBC) 3.5.
+A GaussDB(DWS) cluster contains nodes of the same flavor in the same subnet. These nodes jointly provide services. Datanodes (DNs) in a cluster store data on disks. Coordinators (CNs) receive access requests from applications and return the execution results to clients. In addition, a CN splits and distributes tasks to the DNs for parallel processing.
+Cluster snapshots can be automatically backed up to the EB-level Object Storage Service (OBS), which facilitates periodic backup of the cluster during off-peak hours, ensuring data recovery after a cluster exception occurs.
+A snapshot is a complete backup of GaussDB(DWS) at a specific time point, including the configuration data and service data of a cluster.
+The parallel data loading tool General Data Service (GDS), SQL syntax migration tool Database Schema Convertor (DSC), and SQL development tool Data Studio are provided. The cluster O&M can be monitored on a console.
+Figure 2 shows the logical architecture of a GaussDB(DWS) cluster. For details about instances, see Table 1.
+ + +Name + |
+Description + |
+Remarks + |
+
---|---|---|
Global Transaction Manager (GTM) + |
+Generates and maintains the globally unique information, such as the transaction ID, transaction snapshot, and timestamp. + |
+The cluster includes only one pair of GTMs: one primary GTM and one standby GTM. + |
+
Workload Manager (WLM) + |
+WLM controls allocation of system resources to prevent service congestion and system crash resulting from excessive workload. + |
+You do not need to specify names of hosts where WLMs are to be deployed, because the installation program automatically installs a WLM on each host. + |
+
Coordinator (CN) + |
+A CN receives access requests from applications, and returns execution results to the client; splits tasks and allocates task fragments to different DNs for parallel processing. + |
+CNs in a cluster have equivalent roles and return the same result for the same DML statement. Load balancers can be added between CNs and applications to ensure that CNs are transparent to applications. If a CN is faulty, the load balancer connects its applications to another CN. +CNs need to connect to each other in the distributed transaction architecture. To reduce heavy load caused by excessive threads on GTMs, no more than 10 CNs should be configured in a cluster. +GaussDB(DWS) handles the global resource load in a cluster using the Central Coordinator (CCN) for adaptive dynamic load management. When the cluster is started for the first time, the CM selects the CN with the smallest ID as the CCN. If the CCN is faulty, CM replaces it with a new one. + |
+
Datanode (DN) + |
+A DN stores service data by column or row or in the hybrid mode, executes data query tasks, and returns execution results to CNs. + |
+A cluster consists of multiple DNs and each DN stores part of data. If no HA solution is available for DNs, data cannot be accessed when a DN is faulty. + + |
+
Storage + |
+Functions as the server's local storage resources to store data permanently. + |
+- + |
+
DNs in a cluster store data on disks. Figure 3 describes the objects on each DN and the relationships among them logically.
+Data can be distributed in replication, round-robin, or hash mode. You can specify the distribution mode during table creation.
+ +GaussDB(DWS) uses Identity and Access Management (IAM) for authentication and authorization.
+Users who have the DWS Administrator permissions can fully utilize GaussDB(DWS). To obtain the permissions, contact a user with the Security Administrator permissions or directly create a user with the DWS Administrator permissions. Users granted the DWS Database Access permissions can generate temporary database user credentials based on IAM users to connect to databases in the data warehouse clusters.
+GaussDB(DWS) uses an ECS as a cluster node.
+GaussDB(DWS) uses the Virtual Private Cloud (VPC) service to provide a network topology for clusters to isolate clusters and control access.
+GaussDB(DWS) uses OBS to convert cluster data and external data, satisfying the requirements for secure, reliable, and cost-effective storage.
+Data can be migrated from MRS to GaussDB(DWS) clusters for analysis after the data is processed by Hadoop.
+GaussDB(DWS) uses Cloud Eye to monitor cluster performance metrics, delivering status information in a concise and efficient manner. Cloud Eye supports alarm customization so that you are notified of the exception instantly.
+GaussDB(DWS) uses Cloud Trace Service (CTS) to audit your non-query operations on the management console to ensure that no invalid or unauthorized operations are performed, enhancing service security management.
+With Tag Management Service (TMS), GaussDB(DWS) can provide centralized tag management and resource classification functions across regions and services. You can customize tags to classify and locate resources.
+GaussDB(DWS) uses Domain Name Service (DNS) to provide the cluster IP addresses mapped from domain names.
+A cluster is a server group that consists of multiple nodes. GaussDB(DWS) is organized using clusters. A data warehouse cluster contains nodes with the same flavor in the same subnet. These nodes work together to provide services.
+Each data warehouse cluster contains at least three nodes, all of which support data storage and analysis.
+You need to specify the node flavors when you create a data warehouse cluster. CPU, memory, and storage resources vary depending on node flavors.
+You can create snapshots to back up GaussDB(DWS) cluster data. A snapshot is retained until you delete it on the management console. Automated snapshots cannot be manually deleted. Snapshots will occupy your OBS quotas.
+Projects are used to group and isolate OpenStack resources (computing resources, storage resources, and network resources). A project can be a department or a project team. Multiple projects can be created for one account.
+A data warehouse cluster is an analysis-oriented relational database platform that supports online analysis.
+OLAP is a major function of data warehouse clusters. It supports complex analysis, provides decision-making support tailored to analysis results, and delivers intuitive query results.
+On each node in the data warehouse cluster, memory computing and disk storage systems are independent from each other. With MPP, GaussDB(DWS) distributes service data to different nodes based on the database model and application characteristics. Nodes are connected through the network and collaboratively process computing tasks as a cluster and provide database services that meet service needs.
+The shared-nothing architecture is a distributed computing architecture. Each node is independent so that nodes do not compete for resources, which improves work efficiency.
+Each data warehouse cluster has a specific database version. You can check the version when creating a data warehouse cluster.
+You can use a client to connect to a GaussDB(DWS) cluster in the cloud and over the Internet.
+You can add and control users who can access the database of a data warehouse cluster by assigning specific permissions to them. The database administrator generated when you create a cluster is the default database user.
+GaussDB(DWS) uses the GaussDB database kernel and is compatible with PostgreSQL 9.2.4. It transforms from a single OLTP database to an enterprise-level distributed OLAP database oriented to massive data analysis based on the massively parallel processing (MPP) architecture.
+Unlike conventional data warehouses, GaussDB(DWS) excels in massive data processing and general platform management with the following benefits:
+Ease of use
+GaussDB(DWS) allows you to easily complete the entire process from project concept to production deployment. With the GaussDB(DWS) management console, you can obtain a high-performance and highly available enterprise-level data warehouse cluster within several minutes. Data warehouse software or data warehouse servers are not required.
+With just a few clicks, you can easily connect applications to the data warehouse, back up data, restore data, and monitor data warehouse resources and performance.
+Without the need to migrate data, you can use standard SQL statements to directly query data on HDFS and OBS.
+GaussDB(DWS) provides various migration tools to migrate SQL scripts of Oracleand Teradata to GaussDB(DWS).
+High performance
+GaussDB(DWS) adopts the MPP-based database so that service data is separately stored on numerous nodes. Data analysis tasks are executed in parallel on the nodes where data is stored. The massively parallel data processing significantly improves response speed.
+GaussDB(DWS) improves data query performance by executing multi-thread operators in parallel, running commands in registers in parallel with the vectorized computing engine, and reducing redundant judgment conditions using LLVM.
+GaussDB(DWS) provides you with a better data compression ratio (column-store), better indexing (column-store), and higher point update and query (row-store) performance.
+GDS is a tool that helps you with high-speed massively parallel data loading.
+High scalability
+Robust reliability
+Support for the atomicity, consistency, isolation, and durability (ACID) feature, which ensures strong data consistency for distributed transactions.
+All software processes of GaussDB(DWS) are in active/standby mode. Logical components such as the CNs and DNs of each cluster also work in active/standby mode. This ensures data reliability and consistency when any single point of failure (SPOF) occurs.
+GaussDB(DWS) supports transparent data encryption and can interconnect with the Database Security Service (DBSS) to better protect user privacy and data security with network isolation and security group rule setting options. In addition, GaussDB(DWS) supports automatic full and incremental backup of data, improving data reliability.
+After you create a data warehouse cluster, the system automatically configures a random maintenance window for the cluster. Alternatively, you can customize a maintenance window as required. For details about how to view and configure the maintenance window, see Configuring the Maintenance Window.
+The validity period of the maintenance window (maximum maintenance duration) is 4 hours. During this period, you can upgrade the cluster, install operating system patches, and harden the system. If no maintenance tasks are performed within the planned maintenance window, the cluster continues to run properly until the next maintenance window. GaussDB(DWS) will notify you of any cluster O&M operation by sending SMS messages. Exercise caution when performing operations on the cluster during the O&M period.
+If the upgrade affects the current query requests or service running, contact technical support for emergency handling.
+A cluster is charged by hour as long as it is in the Available state. Since the cluster is charged by hour, you will not see any difference in the bills if a faulty node or system upgrade causes a short interruption, for example, 15 minutes. If such events cause major system interruption, which is a very rare case, you will not be charged for those downtime hours.
+You do not need to care about GaussDB(DWS) cluster patching or upgrading because GaussDB(DWS) will handle version upgrade automatically. After GaussDB(DWS) is upgraded, the service automatically upgrades the clusters to the latest version within the maintenance window. During the upgrade, the cluster is automatically restarted and cannot provide services for a short period of time. Therefore, you are advised to set a suitable time range when the number of connected users and the number of active tasks are small.
+After the cluster is upgraded, it cannot be rolled back.
+The following figure shows the cluster version.
+In the Cluster Information area, you can view the maintenance window.
+A homogeneous GaussDB(DWS) DR cluster is deployed in another AZ. If the production cluster fails to provide read and write services due to natural disasters in the specified region or cluster internal faults, the DR cluster becomes the production cluster to ensure service continuity. The following figure shows the architecture.
+You can create a DR task only when the cluster is in the Available or Unbalanced state.
+The production cluster AZ will be filtered out from the available DR cluster AZs.
+The DR status will then change to Creating. Wait until the creation is complete, and the DR status will change to Not Started.
+On the page that is displayed, view the following information:
+The DR status will change to Starting. The process will take some time. After the task is started, the DR status will change to Running.
+The DR status will change to Stopping. The process will take some time. After the DR task is stopped, the status will change to Stopped.
+The DR status will change to DR switching.
+After the switchover is successful, the DR status will change to the original status.
+After scale-out, the number of DNs in the production cluster must be the same as that in the DR cluster.
+The following figure shows how to use GaussDB(DWS).
+GaussDB(DWS) provides a web-based management console and HTTPS-compliant APIs for you to manage data warehouse clusters.
+Access the cluster database using GaussDB(DWS) clients. For details, see Connecting to Clusters" in the Data Warehouse Service (DWS) User Guide.
+For more information, see https://www.postgresql.org/.
+For more information, see https://www.pgadmin.org/.
+For more information, see https://dbeaver.jkiss.org/download/.
+You can call standard APIs, such as JDBC and ODBC, to access databases in clusters.
+For details, see "Using the JDBC and ODBC Drivers to Connect to a Cluster" in the Data Warehouse Service (DWS) User Guide.
+GaussDB(DWS) has been seamlessly integrated with other services on the cloud, helping you rapidly deploy end-to-end data analysis solutions.
+The following figure shows the end-to-end data analysis process. Services in use during each process are also displayed.
+This section describes the technical specifications of GaussDB(DWS) in different versions.
+ +Technical Specifications + |
+Maximum Value of 8.0.x + |
+Maximum Value of 8.1.0 + |
+Maximum Value of 8.1.1 + |
+
---|---|---|---|
Data capacity + |
+10 PB + |
+10 PB + |
+20 PB + |
+
Number of cluster nodes + |
+256 + |
+256 + |
+2048 + |
+
Size of a single table + |
+1 PB + |
+1 PB + |
+1 PB + |
+
Size of data in each row + |
+1 GB + |
+1 GB + |
+1 GB + |
+
Size of a single column in each record + |
+1 GB + |
+1 GB + |
+1 GB + |
+
Number of records in each table + |
+255 + |
+255 + |
+255 + |
+
Number of columns in each table + |
+1600 + |
+1600 + |
+1600 + |
+
Number of indexes in each table + |
+Unlimited + |
+Unlimited + |
+Unlimited + |
+
Number of columns in the index of each table + |
+32 + |
+32 + |
+32 + |
+
Number of constraints in each table + |
+Unlimited + |
+Unlimited + |
+Unlimited + |
+
Number of concurrent connections + |
+60 for analytical long transactions; 5,000 for short transactions + |
+60 for analytical long transactions; 5,000 for short transactions + |
+80 for analytical long transactions; 5,000 for short transactions + |
+
Number of partitions in a partitioned table + |
+32,768 + |
+32768 + |
+32768 + |
+
Size of each partition in a partitioned table + |
+1 PB + |
+1 PB + |
+1 PB + |
+
Number of records in each partition in a partitioned table + |
+255 + |
+255 + |
+255 + |
+
Before using GaussDB(DWS) to analyze data, create a cluster. A cluster consists of multiple nodes in the same subnet. These nodes together provide services. This section describes how to create a GaussDB(DWS) cluster.
+The automatically created security group is named GaussDB(DWS)-<Cluster name>-<GaussDB(DWS) cluster database port>. The outbound allows all access requests, while the inbound enables only Database Port for access requests from clients or applications.
+If you select a custom security group, add an inbound rule to it to enable Database Port for client hosts to access GaussDB(DWS). Table 1 shows an example. For details about how to add an inbound rule, see "Security > Security Group > Adding a Security Group Rule" in the Virtual Private Cloud User Guide.
+ +Parameter + |
+Example Value + |
+
---|---|
Protocol/Application + |
+TCP + |
+
Port + |
+8000 + NOTE:
+Enter the value of Database Port set when creating the GaussDB(DWS) cluster. This port is used for receiving client connections to GaussDB(DWS). The default port number is 8000. + |
+
Source + |
+Select IP address, and enter the IP address and subnet mask of the client host that accesses GaussDB(DWS), for example, 192.168.0.10/16. + |
+
An enterprise project facilitates project-level management and grouping of cloud resources and users.
+You can select the default enterprise project (default) or other existing enterprise projects. To create an enterprise project, log in to the Enterprise Management console. For details, see the Enterprise Management User Guide.
+After the submission is successful, the creation starts. Click Back to Cluster List. The Clusters page is displayed. The initial status of the cluster is Creating. Cluster creation takes some time. Wait for a while. Clusters in the Available state are ready for use.
+DMS is provided by GaussDB(DWS) to ensure the fast and stable running of databases. It collects, monitors, and analyzes the disk, network, and OS metric data used by the service database, as well as key performance metric data of cluster running. It also diagnoses database hosts, instances, and service SQL statements based on the collected metrics to expose key faults and performance problems in a database in a timely manner, and guides customers to optimize and resolve the problems.
+The database monitoring function is supported by 8.1.1.200 and later versions.
+On the page that is displayed, you can view the cluster status, real-time resource consumption, top SQL statements, cluster resource consumption, and key database metrics.
+In the Cluster Status area, you can view the status of the current cluster and the number of available resources, including the numbers of nodes, CNs, and databases.
+In Resource Consumption, you can view the real-time resource consumption of the current cluster, including Memory Usage, Disk Usage, CPU Usage, Disk I/O (KB/s), and Network I/O (KB/s).
+In the TOP SQL area, you can query the SQL statements that take the longest time and have the largest amount of data flushed to disks in the current cluster.
+ +Top 5 SQL statement query is implemented by max_ctime, which displays the query duration and the amount of data written to disks in the current collection period. If no query is executed during off-peak hours, the top 5 time-consuming query page will not be refreshed.
+On the Cluster Overview page, you can also view the database metrics of the current cluster, including Sessions and Queries.
+To enable SQL diagnosis, enable monitoring on real-time and historical queries on the Queries and History tabs, respectively. For details, see .
+GUC parameters related to SQL diagnosis are as follows. For details, see "GUC Parameters" in the Data Warehouse Service (DWS) Developer Guide.
+If this parameter is enabled without other GUC-related parameters correctly configured, real-time resource consumption cannot be recorded.
+If this parameter is set to a small value, more statements will be recorded, causing record expansion and affecting cluster performance.
+If the resource monitoring is set to operator-level, performance will be greatly affected.
+If this parameter is set to a small value, the batch processing mechanism for dumping kernel statements becomes invalid, affecting the kernel performance.
+If this parameter is set to 0, data will not be aged, which will cause storage expansion.
+When this parameter is enabled, you are advised to set topsql_retention_time properly to configure the aging time. Otherwise, data in the GS_WLM_SESSION_INFO or GS_WLM_OPERATOR_INFO table will expand.
+The Monitoring page displays the collection period and data aging period of monitoring metrics.
+Click Update of DDL Audit to reset the automatic audit frequency or audit items.
+You can check the status and available resources of a cluster and learn about its real-time resource consumption through the GaussDB(DWS) monitoring items.
+Table 1 describes GaussDB(DWS) monitoring metrics.
+ +Monitored Object + |
+Metric + |
+Description + |
+Value Range + |
+Monitoring Period (Raw Data) + |
+
---|---|---|---|---|
Cluster Overview + + + + |
+Cluster Status + |
+Status of a cluster. + |
+Normal/Abnormal/Degraded + |
+30s + |
+
Nodes + |
+Number of available nodes and total number of nodes (Available/Total) in a cluster. + |
+≥ 0 + |
+60s + |
+|
CNs + |
+Number of CNs in a cluster. + |
+≥ 0 + |
+60s + |
+|
Databases + |
+Number of created databases in a cluster. + |
+≥ 0 + |
+90s + |
+|
Resource Consumption + + + + + |
+CPU Usage + |
+Average real-time CPU usage of all nodes in a cluster. + |
+0% to 100% + |
+30s + |
+
Memory Usage + |
+Average real-time memory usage of all nodes in a cluster. + |
+0% to 100% + |
+30s + |
+|
Disk Usage + |
+Average real-time disk usage of all nodes in a cluster. + |
+0% to 100% + |
+30s + |
+|
Disk I/O + |
+Average real-time disk I/O of all nodes in a cluster. + |
+≥ 0 KB/s + |
+30s + |
+|
Network I/O + |
+Average real-time network I/O of all NICs in a cluster. + |
+≥ 0 KB/s + |
+30s + |
+|
Top 5 Time-Consuming Queries + + + |
+Query ID + |
+ID of a query, which is automatically generated by the database. + |
+≥ 0 + |
+180s + |
+
SQL Statement + |
+Query statement executed by a user. + |
+Character string + |
+180s + |
+|
Execution Time + |
+Execution time of a query statement (unit: ms). + |
+≥ 0 ms + |
+180s + |
+|
Top 5 Queries with Most Data Written to Disk + + + |
+Query ID + |
+ID of a query, which is automatically generated by the database. + |
+≥ 0 + |
+180s + |
+
SQL Statement + |
+Query statement executed by a user. + |
+Character string + |
+180s + |
+|
Data Written to Disk + |
+Data to be written to disks after a user runs a statement (unit: MB). + |
+≥ 0 MB + |
+180s + |
+|
Cluster Resource Metrics + + + + + + + + + + + |
+CPU Usage + |
+Average CPU usage and skew ratio of all nodes in the cluster. The formula for calculating the skew is (max-avg)/max. + |
+0% to 100% + |
+30s + |
+
Memory Usage + |
+Average memory usage and skew ratio of all nodes in the cluster. The formula for calculating the skew is (max-avg)/max. + |
+0% to 100% + |
+30s + |
+|
Disk Usage + |
+Average usage and skew ratio of all disks in the cluster. The formula for calculating the skew is (max-avg)/max. + |
+0% to 100% + |
+30s + |
+|
Disk I/O Usage + |
+Average I/O usage and skew rate of all disks in the cluster. The formula for calculating the skew is (max-avg)/max. + |
+0% to 100% + |
+30s + |
+|
Network I/O Usage + |
+Average I/O usage and skew rate of all NICs in the cluster. The formula for calculating the skew is (max-avg)/max. + |
+0% to 100% + |
+30s + |
+|
Key Database Metrics + |
+Cluster Status + |
+Cluster running status. + |
+Normal/Degraded/Abnormal + |
+30s + |
+
Cluster Abnormal CNs + |
+Number of abnormal CNs in the cluster + |
+≥ 0 + |
+60s + |
+|
Cluster Read-only + |
+Whether the cluster is in the read-only state + |
+Yes/No + |
+30s + |
+|
Concurrent Sessions + |
+Number of concurrent sessions in a cluster within a specified period. + |
+≥ 0 + |
+30s + |
+|
Concurrent Queries + |
+Number of concurrent queries in a cluster within a specified period. + |
+≥ 0 + |
+30s + |
+|
Node Monitoring-Overview + + + + + + + |
+Node Name + |
+Name of a node in a cluster. + |
+Character string + |
+30s + |
+
CPU Usage + |
+CPU usage of a host. + |
+0% to 100% + |
+30s + |
+|
Memory Usage + |
+Memory usage of a host. + |
+0% to 100% + |
+30s + |
+|
Average Disk Usage (%) + |
+Disk usage of a host. + |
+0% to 100% + |
+30s + |
+|
IP Address + |
+Service IP address of a host. + |
+Character string + |
+30s + |
+|
Disk I/O + |
+Disk I/O of a host (unit: KB/s) + |
+≥ 0 KB/s + |
+30s + |
+|
TCP Protocol Stack Retransmission Rate + |
+Retransmission rate of TCP packets per unit time. + |
+0% to 100% + |
+30s + |
+|
Status + |
+Running status of a host + |
+Online/Offline + |
+30s + |
+|
Node Monitoring-Disks + + + + + + + + + |
+Node Name + |
+Name of a node in a cluster. + |
+Character string + |
+30s + |
+
Disk Name + |
+Name of a disk on a host. + |
+Character string + |
+30s + |
+|
Disk Capacity + |
+Disk capacity of the host (unit: GB) + |
+≥ 0 GB + |
+30s + |
+|
Disk Usage + |
+Disk usage of a host. + |
+0% to 100% + |
+30s + |
+|
Disk Read Rate + |
+Disk read rate of the host (unit: KB/s) + |
+≥ 0 KB/s + |
+30s + |
+|
Disk Write Rate + |
+Disk write rate of the host (unit: KB/s) + |
+≥ 0 KB/s + |
+30s + |
+|
I/O Wait Time (await, ms) + |
+Average waiting time for each I/O request (unit: ms) + |
+≥ 0 ms + |
+30s + |
+|
I/O Service Time (svctm, ms) + |
+Average processing time for each I/O request (unit: ms) + |
+≥ 0 ms + |
+30s + |
+|
I/O Utility (util, %) + |
+Disk I/O usage of a host. + |
+0% to 100% + |
+30s + |
+|
Node Monitoring-Network + + + + + + + + + |
+Node Name + |
+Name of a node in a cluster. + |
+Character string + |
+30s + |
+
NIC Name + |
+Name of the NIC on a host. + |
+Character string + |
+30s + |
+|
NIC Status + |
+NIC status. + |
+up/down + |
+30s + |
+|
NIC Speed + |
+Working rate of a NIC, in Mbit/s. + |
+≥ 0 + |
+30s + |
+|
Received Packets + |
+Number of received packets of a NIC. + |
+≥ 0 + |
+30s + |
+|
Sent Packets + |
+Number of sent packets of a NIC. + |
+≥ 0 + |
+30s + |
+|
Lost Packets Received + |
+Number of received lost packets of a NIC. + |
+≥ 0 + |
+30s + |
+|
Receive Rate + |
+Number of bytes received by a NIC per unit of time (KB/s). + |
+≥ 0 KB/s + |
+30s + |
+|
Transmit Rate + |
+Number of bytes sent by a NIC per unit of time (unit: KB/s) + |
+≥ 0 KB/s + |
+30s + |
+|
Database Monitoring + + + + + + + + + + + + + + + + + + |
+Database Name + |
+Name of the database created by a user in a cluster. + |
+Character string + |
+60s + |
+
Usage + |
+Used capacity of the current database (unit: GB). + |
+≥ 0 GB + |
+86400s + |
+|
Users + |
+Number of users in the current database. + |
+≥ 0 + |
+30s + |
+|
Sessions + |
+Number of sessions in the current database. + |
+≥ 0 + |
+30s + |
+|
Applications + |
+Number of applications in the current database. + |
+≥ 0 + |
+30s + |
+|
Queries + |
+Number of active queries in the current database. + |
+≥ 0 + |
+30s + |
+|
Scanning Rows + |
+Number of rows returned by the full table scan query in the current database. + |
+≥ 0 + |
+60s + |
+|
Index Query Rows + |
+Number of rows returned by the index query in the current database. + |
+≥ 0 + |
+60s + |
+|
Inserted Rows + |
+Number of rows inserted in the current database. + |
+≥ 0 + |
+60s + |
+|
Updated Rows + |
+Number of rows updated in the current database. + |
+≥ 0 + |
+60s + |
+|
Deleted Rows + |
+Number of rows deleted from the current database. + |
+≥ 0 + |
+60s + |
+|
Executed Transactions + |
+Number of transaction executions on the current database. + |
+≥ 0 + |
+60s + |
+|
Transaction Rollbacks + |
+Number of transactions in the current database that have been rolled back. + |
+≥ 0 + |
+60s + |
+|
Deadlocks + |
+Number of deadlocks detected in the current database. + |
+≥ 0 + |
+60s + |
+|
Physical Read Times + |
+Number of disk blocks read in the current database. + |
+≥ 0 + |
+60s + |
+|
Logical Read Times + |
+Number of times that disk blocks are found in the cache. + |
+≥ 0 + |
+60s + |
+|
Temporary Files + |
+Number of temporary files created in the current database. + |
+≥ 0 + |
+60s + |
+|
Temporary File Capacity + |
+Size of temporary files written by the current database, in GB. + |
+≥ 0 + |
+60s + |
+|
Performance Monitoring + + + + + + + + + + + + + + + + + + + + + + + + + |
+Cluster CPU Usage + |
+Historical trend of the average CPU usage and skew of all nodes in the cluster. The formula for calculating the skew is (max-avg)/max. + |
+0% to 100% + |
+30s + |
+
Cluster Memory Usage + |
+Historical trend of the average memory usage and skew of all nodes in the cluster. The formula for calculating the skew is (max-avg)/max. + |
+0% to 100% + |
+30s + |
+|
Cluster Disk Usage + |
+Historical trend of the average disk usage and skew of all nodes in the cluster. The formula for calculating the skew is (max-avg)/max. + |
+0% to 100% + |
+30s + |
+|
Cluster Disk I/O + |
+Historical trend of the average disk I/O and skew of all disks in the cluster. The formula for calculating the skew is (max-avg)/max. + |
+0% to 100% + |
+30s + |
+|
Cluster Network I/O + |
+Historical trend of the average network I/O value and skew of all NICs in the cluster. The formula for calculating the skew is (max-avg)/max. + |
+0% to 100% + |
+30s + |
+|
Cluster Status + |
+Historical trend of the cluster status. + |
+Normal/Abnormal/Degraded + |
+30s + |
+|
Cluster Read-only + |
+Historical trend of the cluster read-only status change trend. + |
+Yes/No + |
+30s + |
+|
Cluster Abnormal CNs + |
+Historical trend of the number of abnormal CNs in the cluster. + |
+≥ 0 + |
+60s + |
+|
Cluster Abnormal DNs + |
+Historical trend of the number of abnormal DNs in the cluster. + |
+≥ 0 + |
+60s + |
+|
Cluster CPU Usage of DNs + |
+Historical trends of the average CPU usage and skew ratio changes of all DNs in the cluster. The formula for calculating the skew ratio is (max – avg)/max. + |
+0% to 100% + |
+60s + |
+|
Cluster Sessions + |
+Historical trend of the number of sessions in a cluster. + |
+≥ 0 + |
+30s + |
+|
Cluster Queries + |
+Historical change trend of the number of queries in the cluster. + |
+≥ 0 + |
+30s + |
+|
Cluster Deadlocks + |
+Historical trend of the number of deadlocks in a cluster. + |
+≥ 0 + |
+60s + |
+|
Cluster TPS + |
+Average number of transactions per second of all databases in a cluster. Formula: (delta_xact_commit + delta_xact_rollback)/current_collect_rate + |
+≥0 + |
+60s + |
+|
Cluster QPS + |
+Average number of concurrent requests per second of all databases in a cluster. Formula: delta_query_count/current_collect_rate + |
+≥ 0 + |
+60s + |
+|
Database Sessions + |
+Historical trend of the number of sessions on a single database in a cluster. + |
+≥ 0 + |
+30s + |
+|
Database Queries + |
+Historical trend of the number of queries on a single database in a cluster. + |
+≥ 0 + |
+30s + |
+|
Database Submitted Transactions + |
+Historical trend of the number of transactions submitted on a single database in a cluster. + |
+≥ 0 + |
+60s + |
+|
Database Rollback Transactions + |
+Historical trend of the number of rollback transactions on a single database in a cluster. + |
+≥ 0 + |
+60s + |
+|
Cluster Scanning Rows + |
+Historical trend of the number of rows returned by a full table scan on a single database in a cluster. + |
+≥ 0 + |
+60s + |
+|
Database Index Query Rows + |
+Historical trend of the number of rows returned by an index query in a single database of a cluster. + |
+≥ 0 + |
+60s + |
+|
Database Inserted Rows + |
+Historical trend of the number of rows inserted into a single database in a cluster. + |
+≥ 0 + |
+60s + |
+|
Database Updated Rows + |
+Historical trend of the number of updated rows in a single database in a cluster. + |
+≥ 0 + |
+60s + |
+|
Database Deleted Rows + |
+Historical trend of the number of deleted rows in a single database in a cluster. + |
+≥ 0 + |
+60s + |
+|
Database Capacity + |
+Historical trend of the capacity in a single database in a cluster. + |
+≥ 0 + |
+86400s + |
+|
Database Length of the Request Waiting Queue + |
+Historical trend of the waiting queue length on a single database in a cluster. + |
+≥ 0 + |
+30s + |
+|
Database TPS + |
+Number of transactions per second of each database in a cluster. Formula: (delta_xact_commit + delta_xact_rollback)/current_collect_rate. + |
+≥0 + |
+60s + |
+|
Session Monitoring + + + + + + + + + |
+Session ID + |
+ID of the current session (query thread ID). + |
+Character string + |
+30s + |
+
User Name + |
+Name of the user who executes the current session. + |
+Character string + |
+30s + |
+|
Database Name + |
+Name of the database connected to the current session. + |
+Character string + |
+30s + |
+|
Session Duration + |
+Duration of the current session (unit: ms). + |
+≥ 0 ms + |
+30s + |
+|
Application Name + |
+Name of the application that creates the current session. + |
+Character string + |
+30s + |
+|
Queries + |
+Number of SQL statements executed in the current session. + |
+≥ 0 + |
+30s + |
+|
Latest Query Duration + |
+Duration for executing the previous SQL statement in the current session. + |
+≥ 0 ms + |
+30s + |
+|
Client IP Address + |
+IP address of the client that initiates the current session. + |
+Character string + |
+30s + |
+|
Connected CN + |
+Connected CN of the current session. + |
+Character string + |
+30s + |
+|
Session Status + |
+Execution status of the current session. + |
+Running/Idle/Retry + |
+30s + |
+|
Query Monitoring-Real-Time + + + + + + + + + + + + + + + + + + |
+Query ID + |
+Query ID of a current query statement, which is a unique identifier allocated by the kernel to each query statement. + |
+Character string + |
+30s + |
+
User Name + |
+Name of the user who submits the current query statement. + |
+Character string + |
+30s + |
+|
Database Name + |
+Name of the database corresponding to the current query statement. + |
+Character string + |
+30s + |
+|
Application Name + |
+Name of the application corresponding to the current query statement. + |
+Character string + |
+30s + |
+|
Workload Queue + |
+Name of the workload queue that carries the current query statement. + |
+Character string + |
+30s + |
+|
Submitted + |
+Timestamp when the current query statement is submitted. + |
+Character string + |
+30s + |
+|
Blocking Time + |
+Waiting time before the current query statement is executed, in ms. + |
+≥ 0 + |
+30s + |
+|
Execution Time + |
+Execution time of the current query statement, in ms. + |
+≥ 0 + |
+30s + |
+|
CPU Time + |
+Total CPU time spent by the current query statement on all DNs, in ms. + |
+≥ 0 + |
+30s + |
+|
CPU Time Skew + |
+CPU time skew of the current query statement among all DNs. + |
+0% to 100% + |
+30s + |
+|
Average Written Data + |
+Average data size of the current query statement flushed to disks on all DNs, in MB. + |
+≥ 0 + |
+30s + |
+|
Statement + |
+Query statement that is being executed. + |
+Character string + |
+30s + |
+|
Connected CN + |
+Name of the CN that submits the current query statement. + |
+Character string + |
+30s + |
+|
Client IP Address + |
+IP address of the client that submits the current query statement. + |
+Character string + |
+30s + |
+|
Lane + |
+Lane where the current query statement is located. + |
+Fast Lane/Slow Lane + |
+30s + |
+|
Query Status + |
+Query status of the statement that is being executed. + |
+Character string + |
+30s + |
+|
Session ID + |
+Session ID of the current query statement, which is a unique identifier allocated by the kernel to each client connection. + |
+Character string + |
+30s + |
+|
Queuing Status + |
+Status of the current query execution in the database, indicating whether the query is queued in the workload queue. + |
+Yes/No + |
+30s + |
+|
Query Monitoring-History + + + + + + + + + + + + |
+Query ID + |
+Query ID of a query statement, which is a unique identifier allocated by the kernel to each query statement. + |
+Character string + |
+180s + |
+
User Name + |
+Name of the user who submits a query statement. + |
+Character string + |
+180s + |
+|
Application Name + |
+Application name corresponding to a query statement. + |
+Character string + |
+180s + |
+|
Database Name + |
+Name of the database corresponding to a query statement. + |
+Character string + |
+180s + |
+|
Workload Queue + |
+Name of the workload queue that carries the current query statement. + |
+Character string + |
+180s + |
+|
Submitted + |
+Timestamp when a query statement is submitted. + |
+Character string + |
+180s + |
+|
Blocking Time + |
+Waiting time before the query statement is executed, in ms. + |
+≥ 0 + |
+180s + |
+|
Execution Time + |
+Execution time of the query statement, in ms. + |
+≥ 0 + |
+180s + |
+|
CPU Time + |
+Total CPU time spent by the query statement on all DNs, in ms. + |
+≥ 0 + |
+180s + |
+|
CPU Time Skew + |
+CPU time skew of a query statement executed on all DNs. + |
+0% to 100% + |
+180s + |
+|
Average Written Data + |
+Average data size of the query statement flushed to disks on all DNs, in MB. + |
+≥ 0 + |
+180s + |
+|
Statement + |
+Query statements to be parsed + |
+Character string + |
+180s + |
+|
Slow Instance Monitoring + + + + + |
+Slow Instance + |
+Number of slow instances detected at the current time point. + |
+≥ 0 + |
+240s + |
+
Detected + |
+Time when a slow instance is detected for the first time. + |
+Character string + |
+240s + |
+|
Node Name + |
+Name of the node where the slow instance is deployed. + |
+Character string + |
+240s + |
+|
Instance + |
+Name of an instance. + |
+Character string + |
+240s + |
+|
Slow Node Detections (within 24 hours) + |
+Number of times that a slow instance is detected within 24 hours. + |
+≥ 0 + |
+240s + |
+|
Workload Queue Monitoring + + + + + + + + + + + + + |
+Workload Queue + |
+Name of the workload queue in the cluster. + |
+Character string + |
+120s + |
+
CPU Usage + |
+Real-time CPU usage of the workload queue. + |
+0% to 100% + |
+120s + |
+|
CPU Resource + |
+CPU usage quotas of the workload queue. + |
+0% to 100% + |
+120s + |
+|
Real-Time Concurrent Short Queries + |
+Number of real-time concurrent simple queries in a workload queue. + |
+≥ 0 + |
+120s + |
+|
Concurrent Short Queries + |
+Concurrent simple query quotas of a workload queue. + |
+≥ 0 + |
+120s + |
+|
Real-Time Concurrent Queries + |
+Number of real-time concurrent complex queries in a workload queue. + |
+≥ 0 + |
+120s + |
+|
Query Concurrency + |
+Concurrent complex query quotas of a workload queue. + |
+≥ 0 + |
+120s + |
+|
Waiting Queries + + + + + + + |
+User + |
+Name of the user of waiting queries + |
+Character string + |
+120s + |
+
Application + |
+Name of the application to be queried. + |
+Character string + |
+120s + |
+|
Database + |
+Name of the database to be queried. + |
+Character string + |
+120s + |
+|
Queuing Status + |
+Execution status of a query in the database (CCN/CN/DN). + |
+Character string + |
+120s + |
+|
Wait Time + |
+Waiting time for a waiting query (unit: ms). + |
+≥ 0 ms + |
+120s + |
+|
Workload Queue + |
+Workload queue to which the waiting query belongs. + |
+Character string + |
+120s + |
+|
Statement + |
+Query statement for the waiting status. + |
+Character string + |
+120s + |
+|
Circuit Breaking Queries + + + + + + + + |
+Query ID + |
+Query ID of the circuit breaking query statement. + |
+Character string + |
+120s + |
+
Query Statement + |
+Query statement for the circuit breaking status. + |
+Character string + |
+120s + |
+|
Blocking Time + |
+Blocking time before the query statement triggers circuit breaking, in ms. + |
+≥ 0 + |
+120s + |
+|
Execution Time + |
+Execution time before the query statement triggers circuit breaking, in ms. + |
+≥ 0 + |
+120s + |
+|
CPU Time + |
+Average CPU time consumed by each DN before the query statement triggers circuit breaking, in ms. + |
+≥ 0 + |
+120s + |
+|
CPU Skew + |
+Skew rate of CPU time consumed by each DN before the query statement triggers circuit breaking. + |
+0% to 100% + |
+120s + |
+|
Exception Handling + |
+Handling method after the query statement triggers circuit breaking. + |
+Abort/Degrade + |
+120s + |
+|
Status + |
+Circuit breaking handling status of a query statement. + |
+Executing/Completed + |
+120s + |
+|
SQL Tuning + + + + + + + + + + + + |
+Query ID + |
+IP address of the current query (query logic ID). + |
+Character string + |
+180s + |
+
Database + |
+Name of the database where the current query is executed. + |
+Character string + |
+180s + |
+|
Schema Name + |
+Name of the current query schema. + |
+Character string + |
+180s + |
+|
User Name + |
+Name of the user who performs the query. + |
+Character string + |
+180s + |
+|
Client + |
+Name of the client that initiates the current query. + |
+Character string + |
+180s + |
+|
Client IP Address + |
+IP address of the client that initiates the current query. + |
+Character string + |
+180s + |
+|
Running Time + |
+Execution time of the current query, in ms. + |
+≥ 0 + |
+180s + |
+|
CPU Time + |
+CPU time of the current query, in ms. + |
+≥ 0 + |
+180s + |
+|
Scale-Out Started + |
+Start time of the current query. + |
+Timestamp + |
+180s + |
+|
Completed + |
+End time of the current query. + |
+Timestamp + |
+180s + |
+|
Details + |
+Details about the current query. + |
+Character string + |
+180s + |
+|
INODE + |
+Inode Usage + |
+Disk inode usage. + |
+0% to 100% + |
+30s + |
+
SCHEMA + |
+Schema Usage + |
+Database schema usage. + |
+0% to 100% + |
+3600s + |
+
Type + |
+Metric + |
+ECS Cluster + |
+BMS Cluster + |
+
---|---|---|---|
Network + + |
+NIC nominal speed + |
+None + |
+100/1000/10000/50000M + |
+
NIC working mode (duplex) + |
+None + |
+full/half + |
+
GaussDB(DWS) is an online data processing database that uses the cloud infrastructure to provide scalable, fully-managed, and out-of-the-box analytic database service, freeing you from complex database management and monitoring. It is a native cloud service based on the converged data warehouse GaussDB, and is fully compatible with the standard ANSI SQL 99 and SQL 2003, as well as the PostgreSQL and Oracle ecosystems. GaussDB(DWS) provides competitive solutions for PB-level big data analysis in various industries.
+GaussDB(DWS) provides an easy-to-use management console, allowing you to quickly create clusters and easily manage data warehouses.
+Process + |
+Task + |
+Description + |
+Operation Instruction + |
+
---|---|---|---|
Make preparations. + |
+- + |
+Before using GaussDB(DWS), select an open port on your firewall as the database port of your data warehouse cluster. + |
++ | +
Create a cluster. + |
+- + |
+Create a cluster before using GaussDB(DWS) to execute data analysis tasks. A GaussDB(DWS) cluster contains nodes in the same subnet. These nodes jointly provide services. During cluster creation, the system creates a default database. + |
++ | +
Connect to the cluster. + |
+- + |
+After the data warehouse cluster is successfully created, use the SQL client tool or a third-party driver such as JDBC or ODBC to connect to the database in the cluster. You can download the SQL client tool and JDBC/ODBC driver on the Connection Management page of the GaussDB(DWS) management console. + |
++ | +
Access the database. + |
+- + |
+After connecting to the cluster, you can create and manage databases, manage users and permissions, import and export data, and query and analyze data. + |
+Data Warehouse Service (DWS) Developer Guide + |
+
Manage and monitor the cluster. + + + |
+Manage the cluster. + |
+View the cluster status, modify cluster configurations, add cluster tags, and scale out, restart, and delete the cluster. + |
++ | +
Manage the snapshot. + |
+Create snapshots to back up and restore the cluster. + |
++ | +|
Perform O&M and monitoring. + |
+View the running status and performance of the cluster through monitoring, log auditing, event notification, and resource load management. + |
+
|
+
To use cloud GaussDB(DWS), create a cluster first.
+This section describes how to create a data warehouse cluster on the GaussDB(DWS) management console.
+You can select the number of nodes by data volume, service load, and performance. More nodes bring you stronger storage and compute capabilities. In a GaussDB(DWS) cluster, the number of DNs on each node varies depending on the cluster flavor. Generally, the number ranges from 1 to 4. A DN stores service data by column or row or in hybrid mode, executes data query tasks, and returns execution results.
+When first using GaussDB(DWS), you can create a cluster with a smaller flavor. Then, you can adjust the cluster scale and node flavor based on the data volume and service load changes without interrupting services. For details, see Cluster Scale-out.
+Plan an appropriate AZ and configure the network to isolate the GaussDB(DWS) cluster from other cloud services.
++
Parameter + |
+Description + |
+Example Value + |
+
---|---|---|
Region + |
+Select the actual region where the cluster nodes run. + |
+eu-de + |
+
AZ + |
+Select an AZ associated with the cluster region. + |
+- + |
+
The number of nodes in a new cluster cannot exceed the quota that can be used by a user or 32. If the node quota is insufficient, click Increase quota to submit a service ticket and apply for higher node quota.
+Parameter + |
+Description + |
+Example Value + |
+
---|---|---|
Cluster Type + |
+GaussDB(DWS) cluster types include: +
|
+Standard + |
+
CPU Architecture + |
+The CPU architecture includes: +
NOTE:
+The only difference between the x86 and Kunpeng architectures lies in the underlying architecture, of which the application layer is unaware. The same SQL syntax is used. If x86 servers are sold out when you create a cluster, select the Kunpeng architecture. + |
+x86 + |
+
Node Flavor + |
+Select the desired node flavor based on service requirements. Each node flavor displays the vCPU, memory, and recommended application scenario. + +Table 3 describes the node flavors supported by GaussDB(DWS). + |
+dws.m3.xlarge + |
+
Nodes + |
+Specify the number of nodes in the cluster. +The number of nodes ranges from 3 to 256. + |
+3 + |
+
Total Capacity (GB) + |
+Displays the total capacity of a cluster. +The storage capacity of each flavor is the actual database space used for storing data. The displayed storage capacity has deducted the disk space consumed by backups and RAIDs. + |
+- + |
+
Type + |
+vCPU Cores + |
+Memory + |
+Disk Size + |
+Disk Type + |
+
---|---|---|---|---|
dws.m1.xlarge.ultrahigh + |
+4 + |
+32 GB + |
+256 GB + |
+General-purpose generation I, SSD + |
+
dws.d1.xlarge + |
+4 + |
+32 GB + |
+1.68 TB + |
+Local disk (HDD) + |
+
dws.d2.15xlarge + |
+60 + |
+540 GB + |
+13.41 TB + |
+Disk-intensive generation II (KVM), local disk (HDD) + |
+
dws.d2.xlarge + |
+4 + |
+32 GB + |
+1.68 TB + |
+Disk-intensive generation II (KVM), local disk (HDD) + |
+
dws.m3.xlarge + |
+4 + |
+32 GB + |
+160 GB + |
+General-purpose generation III (KVM), SSD + |
+
Parameter + |
+Description + |
+Example Value + |
+
---|---|---|
Cluster Name + |
+Set the name of the data warehouse cluster. +Enter 4 to 64 characters. Only case-insensitive letters, digits, hyphens (-), and underscores (_) are allowed. The value must start with a letter. + NOTE:
+After a cluster is created, its name cannot be changed. + |
+dws-demo + |
+
Cluster Version + |
+Displays the version of the database instance installed in the cluster. The figure is for reference only. + |
+- + |
+
Default Database + |
+The default database name of the cluster is gaussdb. + NOTE:
+This name cannot be changed. + |
+gaussdb + |
+
Administrator Account + |
+Set the database administrator name. +The administrator username must: +
|
+dbadmin + |
+
Administrator Password + |
+Set the password of the database administrator account. +The password complexity requirements are as follows:
+
NOTE:
+Change the password regularly and keep it secure. + |
+- + |
+
Confirm Password + |
+Enter the database administrator password again. + |
+- + |
+
Database Port + |
+Specify the port used when the client or application connects to the database in the cluster. +The port number ranges from 8000 to 30000. + |
+8000 + |
+
Parameter + |
+Description + |
+Example Value + |
+
---|---|---|
VPC + |
+Specify a virtual private network for nodes in a cluster to isolate networks of different services. +If you create a data warehouse cluster for the first time and have not configured the VPC, click View VPC. On the VPC management console that is displayed, create a VPC that satisfies your needs. +For details about how to create a VPC, see "VPC and Subnet > Creating a VPC" in the Virtual Private Cloud User Guide. +After selecting a VPC from the drop-down list, click View VPC to enter the VPC management console and view the detailed information about the VPC. +You can click |
+vpc-dws + |
+
Subnet + |
+Specify a VPC subnet. +A subnet provides dedicated network resources that are isolated from other networks, improving network security. + |
+subnet-dws + |
+
Security Group + |
+Specify a VPC security group. +A security group restricts access rules to enhance security when GaussDB(DWS) and other services access each other. +
|
+Automatic creation + |
+
Public Network Access + |
+Specify whether users can use a client to connect to a cluster's database over the Internet. The following methods are supported: +
NOTE:
+
|
+Automatically assign + |
+
Bandwidth + |
+When EIP is set to Automatically assign, you need to specify the bandwidth of the EIP, which ranges from 1 Mbit/s to 100 Mbit/s. + |
+50 Mbit/s + |
+
An enterprise project facilitates project-level management and grouping of cloud resources and users.
+You can select the default enterprise project (default) or other existing enterprise projects. To create an enterprise project, log in to the Enterprise Management console. For details, see the Enterprise Management User Guide.
+The enterprise project of the discount package must be the same as that of the cluster. All projects applies to any cluster.
+CNs receive access requests from the clients and return the execution results. In addition, a CN splits and distributes tasks to the DNs for parallel execution.
+The value ranges from 2 to the number of cluster nodes minus 1. The maximum value is 5 and the default value is 2. In a large-scale cluster, you are advised to deploy multiple CNs.
+A parameter template is a set of parameters for data warehouses. You need to select a parameter template from the drop-down list of Parameter Template and associate it with the cluster during cluster creation. You can select the default parameter template or a customized parameter template. By default, the cluster is associated with the default database parameter template.
+For details about parameter templates, see Managing Parameter Templates.
+A tag is a key-value pair used to identify a cluster. For details about the keys and values, see Table 6. By default, no tag is added to the cluster.
+For more information about tags, see Overview.
+ +Parameter + |
+Description + |
+Example Value + |
+
---|---|---|
Tag key + |
+You can perform the following operations: +
|
+key01 + |
+
Tag value + |
+You can perform the following operations: + + |
+value01 + |
+
If the number of requested nodes, vCPU (cores), or memory (GB) exceeds the user's remaining quota, a warning dialog box is displayed, indicating that the quota is insufficient and displaying the details of the remaining quota and the current quota application. You can click Increase quota in the warning dialog box to submit a service ticket and apply for higher node quota.
+For details about quotas, see What Is the User Quota?.
+After the submission is successful, the creation starts. Click Back to Cluster List to go back to the Clusters page. The initial status of the cluster is Creating. Cluster creation takes some time. Clusters in the Available state are ready for use.
+On the Clusters page of the GaussDB(DWS) management console, you can view the general information about a cluster in the cluster list, such as the cluster status, task information, and node flavor.
+Log in to the GaussDB(DWS) management console. In the navigation pane, choose Clusters. The cluster list displays all clusters. If there are a large number of clusters, you can turn pages to view the clusters in any status.
+Enter the cluster name in the search box, and click to search for a cluster. Alternatively, in the All projects drop-down list above the cluster list, select the target project. Click
to refresh the cluster list. You can also click Search by Tag to search for clusters based on the criteria. For details, see Searching for Clusters Based on Tags.
Clusters are listed in chronological order by default, with the most recent clusters displayed at the top. Table 1 lists the cluster list parameters.
+Parameter + |
+Description + |
+
---|---|
Cluster Name + |
+Cluster name specified when a cluster is created. + |
+
Cluster Status + |
+Cluster running status. For details, see Cluster Status. + |
+
Task Information + |
+Cluster task status. For details, see Cluster Task Information. + |
+
Node Flavor + |
+Node flavors of clusters. For details about the node flavors, see Table 3. + |
+
Enterprise Project + |
+Enterprise project to which a cluster belongs. + |
+
Operation + |
+
|
+
Status + |
+Description + |
+
---|---|
Available + |
+Indicates that the cluster runs properly. + |
+
Read-only + |
+A cluster goes into this state when the disk usage of the cluster or a single node in the cluster is greater than 90%. The cluster can still work in this state but supports only query operations. Write operations are not supported. When the cluster status becomes read-only, contact technical support engineers. +After the read-only status is canceled for the cluster, you are advised to perform the following operations: +
|
+
Unbalanced + |
+If the role of a GTM or DN in the cluster is different from the initial role, the cluster is in the Unbalanced state. In the Unbalanced state, the number of primary instances on some nodes increases. As a result, the load pressure is high. In this case, the cluster is normal, but the overall performance is not as good as that in a balanced state. You are advised to switch a cluster to the Available state during off-peak hours. + |
+
Redistributing + |
+A cluster goes into this state when it detects that the service data on the original nodes is significantly larger than that on the new node after a new node is added to the cluster. In this case, the system automatically redistributes data on all nodes. The cluster can still work in this state. + |
+
Redistribution failed + |
+A cluster goes into this state when data redistribution fails, but no data loss occurs. The cluster can still work in this state. You are advised to contact technical support. + |
+
Degraded + |
+A cluster goes into this state when some nodes in the cluster are faulty, but the whole cluster runs properly. You are advised to contact technical support. + |
+
Unavailable + |
+A cluster goes into this state when it cannot provide database services. You are advised to contact technical support. + |
+
Creating + |
+A cluster goes into this state when it is being created. + |
+
Creation failed + |
+A cluster goes into this state when it fails to be created. + |
+
Creating, restoring + |
+A cluster goes into this state when it is being restored from a snapshot. + |
+
Status + |
+Description + |
+
---|---|
Creating snapshot + |
+Indicates that a snapshot is being created in the cluster. + |
+
Snapshot creation failed + |
+Indicates that a snapshot fails to be created. + |
+
Configuring + |
+Indicates that the system is storing modifications of cluster parameters. + |
+
Restarting + |
+Indicates that a cluster is being restarted. + |
+
Restart failed + |
+Indicates that a cluster fails to be restarted. + |
+
Resizing + |
+Indicates that a cluster is being resized. + |
+
Resize failed + |
+Indicates that a cluster fails to be resized. + |
+
This section describes how to view snapshot information on the Snapshots page.
+In the snapshot list, all snapshots are displayed by default. Click next to the snapshot name to display the snapshot details.
You can also enter a snapshot name or cluster name in the upper right corner of the snapshot list and click to search for the specified snapshot. GaussDB(DWS) supports fuzzy search.
Table 1 describes snapshot status.
+ +Status + |
+Description + |
+
---|---|
Available + |
+Indicates that the existing snapshot works properly. + |
+
Creating + |
+Indicates that a snapshot is being created. + |
+
Unavailable + |
+Indicates that the existing snapshot cannot provide services. + |
+
Table 2 describes the snapshot types.
+ +Type + |
+Description + |
+
---|---|
Manual + |
+Indicates the snapshot that you manually create through the GaussDB(DWS) management console or using APIs. You can delete the snapshots that are manually created. + |
+
Automated + |
+Indicates the snapshot that is automatically created after the automated snapshot backup policy is enabled. You cannot delete the snapshots that are automatically created. The system automatically deletes the snapshots whose retention duration expires. + |
+
This section describes how to check cluster metrics on Cloud Eye. By monitoring cluster running metrics, you can identify the time when the database cluster is abnormal and analyze potential activity problems based on the database logs, improving database performance. This section describes the metrics that can be monitored by Cloud Eye as well as their namespaces and dimensions. You can use the management console or APIs provided by Cloud Eye to query the monitoring metrics and alarms generated by GaussDB(DWS). For details, see the User Guide and API Reference of Cloud Eye.
+This section is organized as follows:
+ +With the GaussDB(DWS) monitoring metrics provided by Cloud Eye, you can obtain information about the cluster running status and performance. This information will provide a better understanding of the node-level information.
+Table 1 describes GaussDB(DWS) monitoring metrics.
+ +Metric ID + |
+Name + |
+Description + |
+Value Range + |
+Monitored Object + |
+Monitoring Period (Raw Data) + |
+
---|---|---|---|---|---|
dws001_shared_buffer_hit_ratio + |
+Cache Hit Ratio + |
+Percentage of data volume obtained from memory, expressed in percentage + |
+0% to 100% + |
+Data warehouse cluster + |
+4 minutes + |
+
dws002_in_memory_sort_ratio + |
+In-memory Sort Ratio + |
+Percentage of data volume that is sorted in memory, expressed in percentage + |
+0% to 100% + |
+Data warehouse cluster + |
+4 minutes + |
+
dws003_physical_reads + |
+File Reads + |
+Total number of database file reads + |
+> 0 + |
+Data warehouse cluster + |
+4 minutes + |
+
dws004_physical_writes + |
+File Writes + |
+Total number of database file writes + |
+> 0 + |
+Data warehouse cluster + |
+4 minutes + |
+
dws005_physical_reads_per_second + |
+File Reads per Second + |
+Number of database file reads per second + |
+≥ 0 + |
+Data warehouse cluster + |
+4 minutes + |
+
dws006_physical_writes_per_second + |
+File Writes per Second + |
+Number of database file writes per second + |
+≥ 0 + |
+Data warehouse cluster + |
+4 minutes + |
+
dws007_db_size + |
+Data Volume + |
+Total size of data in the database, in MB + |
+≥ 0 MB + |
+Data warehouse cluster + |
+4 minutes + |
+
dws008_active_sql_count + |
+Active SQL Count + |
+Number of active SQLs in the database + |
+≥ 0 + |
+Data warehouse cluster + |
+4 minutes + |
+
dws009_session_count + |
+Session Count + |
+Number of sessions that access the database + |
+≥ 0 + |
+Data warehouse cluster + |
+4 minutes + |
+
dws010_cpu_usage + |
+CPU Usage + |
+CPU usage of each node in a cluster, in percentage + |
+0% to 100% + |
+Data warehouse node + |
+1 minute + |
+
dws011_mem_usage + |
+Memory Usage + |
+Memory usage of each node in a cluster, in percentage + |
+0% to 100% + |
+Data warehouse node + |
+1 minute + |
+
dws012_iops + |
+IOPS + |
+Number of I/O requests processed by each node in the cluster per second + |
+≥ 0 + |
+Data warehouse node + |
+1 minute + |
+
dws013_bytes_in + |
+Network Input Throughput + |
+Data input to each node in the cluster per second over the network +Unit: byte/s + |
+≥ 0 bytes/s + |
+Data warehouse node + |
+1 minute + |
+
dws014_bytes_out + |
+Network Output Throughput + |
+Data sent to the network per second from each node in the cluster +Unit: byte/s + |
+≥ 0 bytes/s + |
+Data warehouse node + + |
+1 minute + |
+
dws015_disk_usage + |
+Disk Usage + |
+Disk usage of each node in a cluster, in percentage + |
+0% to 100% + |
+Data warehouse node + |
+1 minute + |
+
dws016_disk_total_size + |
+Total Disk Size + |
+Total disk space of each node in the cluster +Unit: GB + |
+100 to 2000 GB + |
+Data warehouse node + |
+1 minute + |
+
dws017_disk_used_size + |
+Used Disk Space + |
+Used disk space of each node in the cluster +Unit: GB + |
+0 to 3600 GB + |
+Data warehouse node + |
+1 minute + |
+
dws018_disk_read_throughput + |
+Disk Read Throughput + |
+Data volume read from each disk in the cluster per second +Unit: byte/s + |
+≥ 0 bytes/s + |
+Data warehouse node + |
+1 minute + |
+
dws019_disk_write_throughput + |
+Disk Write Throughput + |
+Data volume written to each disk in the cluster per second +Unit: byte/s + |
+≥ 0 bytes/s + |
+Data warehouse node + |
+1 minute + |
+
dws020_avg_disk_sec_per_read + |
+Average Time per Disk Read + |
+Average time used each time when a disk reads data +Unit: second + |
+> 0s + |
+Data warehouse node + |
+1 minute + |
+
dws021_avg_disk_sec_per_write + |
+Average Time per Disk Write + |
+Average time used each time when data is written to a disk +Unit: second + |
+> 0s + |
+Data warehouse node + |
+1 minute + |
+
dws022_avg_disk_queue_length + |
+Average Disk Queue Length + |
+Average I/O queue length of a disk + |
+≥ 0 + |
+Data warehouse node + |
+1 minute + |
+
Key + |
+Value + |
+
---|---|
datastore_id + |
+Data warehouse cluster ID + |
+
dws_instance_id + |
+Data warehouse node ID + |
+
Additionally, you can specify a specific monitoring metric and the time range to view the performance curve.
+Additionally, you can specify a specific monitoring metric and the time range to view the performance curve.
+Cloud Eye also supports the ability to compare the monitoring metrics of multiple nodes. For details, see Comparing the Monitoring Metrics of Multiple Nodes.
+You can add multiple monitoring metrics by clicking Add Metric.
+The following describes how to set parameters if you want to compare CPU usage of two nodes.
+ +Parameter + |
+Example Value + |
+
---|---|
Resource Type + |
+DWS + |
+
Dimension + |
+Data Warehouse Node + |
+
Monitored Object + |
+dws-demo-dws-cn-cn-2-1 +dws-demo-dws-cn-cn-1-1 +dws-demo-dws-dn-1-1 + |
+
Metric + |
+CPU Usage + |
+
Then you can view the corresponding monitoring graph on the Panels page. Move the cursor to the graph and click in the upper right corner to zoom in the graph and view detailed metric comparison data.
Setting GaussDB(DWS) alarm rules allows you to customize the monitored objects and notification policies and determine the running status of your GaussDB(DWS) at any time.
+A GaussDB(DWS) alarm rule includes the alarm rule name, monitored object, metric, threshold, monitoring interval, and whether to send a notification. This section describes how to set GaussDB(DWS) alarm rules.
+The status of the target cluster must be Available. Otherwise, you cannot create alarm rules.
+Parameter + |
+Description + |
+Example Value + |
+
---|---|---|
Resource Type + |
+Name of the cloud service resource for which the alarm rule is configured. + |
+Data Warehouse Service + |
+
Dimension + |
+Metric dimension of the alarm rule. You can select Data Warehouse Nodes or Data Warehouses. + |
+Data Warehouse Node + |
+
Monitoring Scope + |
+Resource scope to which an alarm rule applies. Select Specific resources and select one or more monitoring objects. Select the ID of the cluster instance or node you have created. Click |
+Specific resources + |
+
Method + |
+Select Use template or Create manually as required. +
|
+Create manually + |
+
Template + |
+This parameter is valid only when Use template is selected. +Select the template to be imported. If no alarm template is available, click Create Custom Template to create one that meets your requirements. + |
+- + |
+
Alarm Policy + |
+This parameter is valid only when Create manually is selected. +Set the policy that triggers an alarm. For example, trigger an alarm if the CPU usage equals to or is greater than 80% for 3 consecutive periods. +Table 1 describes the GaussDB(DWS) monitoring metrics. + |
+- + |
+
Alarm Severity + |
+Severity of an alarm. Valid values are Critical, Major, Minor, and Informational. + |
+Major + |
+
Parameter + |
+Description + |
+Example Value + |
+
---|---|---|
Alarm Notification + |
+Whether to notify users when alarms are triggered. Notifications can be sent as emails or text messages, or HTTP/HTTPS requests sent to the servers. +You can enable (recommended) or disable Alarm Notification. + |
+Enable + |
+
Notification Object + |
+Name of the topic to which the alarm notification is sent. +If you enable Alarm Notification, you need to select a topic. If no desired topics are available, create one first, whereupon the SMN service is invoked. For details about how to create a topic, see the Simple Message Notification User Guide. + |
+- + |
+
Trigger Condition + |
+Condition for triggering the alarm. You can select Generated alarm, Cleared alarm, or both. + |
+- + |
+
After the alarm rule is created, if the metric data reaches the specified threshold, Cloud Eye will immediately inform you that an exception has occurred.
+As your data warehouse capacity and performance requirements change, you can adjust the sizes of existing clusters on the management console to utilize compute and storage resources provided by GaussDB(DWS).
+After the data in a data warehouse is deleted, the occupied disk space may not be released, resulting in dirty data and disk waste. Therefore, if you need to scale out your cluster due to insufficient storage capacity, run the VACUUM command to reclaim the storage space first. If the used storage capacity is still high after you run the VACUUM command, you can scale out your cluster. For details about VACUUM, see "SQL Reference > SQL Syntax > VACUUM" in the Data Warehouse Service (DWS) Developer Guide.
+All clusters are displayed by default.
+On the page that is displayed, the Automated Backup button is enabled by default.
+ +If the node quota is insufficient, click Increase quota to submit a service ticket and apply for higher node quota.
+If you choose Default, Online Scale-out will be disabled, Auto Redistribution will be enabled, and Redistribution Mode will be Offline by default.
+If the number of requested nodes, vCPU (cores), or memory (GB) exceed the user's remaining quota, a warning dialog box is displayed, indicating that the quota is insufficient and displaying the detailed remaining quota and the current quota application. You can click Increase quota in the warning dialog box to submit a service ticket and apply for higher node quota.
+For details about quotas, see What Is the User Quota?.
+If a cluster is in the Unbalanced state or cannot work properly, you may need to restart it for restoration. After modifying a cluster's configurations, such as security settings and parameters in the parameter template, manually restart the cluster to make the configurations take effect.
+If the cluster is processing service data, such as importing data, querying data, creating snapshots, or restoring snapshots, cluster restarting will cause file damage or restart failure. You are advised to stop all cluster tasks before restarting the cluster.
+View the Session Count and Active SQL Count metrics to check whether the cluster has active events. For details, see Monitoring Clusters Using Cloud Eye.
+Task Information changes to Restarting. When Cluster Status changes to Available again, the cluster is successfully restarted.
+If you do not need to use a cluster, perform the operations in this section to delete it.
+Deleted clusters cannot be recovered. Additionally, you cannot access user data and automated snapshots in a deleted cluster because the data and snapshots are automatically deleted. If you delete a cluster, its manual snapshots will not be deleted.
+If the cluster status is normal, you can click Create Snapshot. In the dialog box that is displayed, enter the snapshot name and click OK to create a snapshot for the cluster to be deleted. After the snapshot is created, go back to the Clusters page and delete the cluster.
+If the cluster is bound with an EIP, you can click Release the EIP bound to the cluster to release the EIP of the cluster to be deleted.
+If the cluster to be deleted uses an automatically created security group that is not used by other clusters, the security group is automatically deleted after the cluster is deleted.
+GaussDB(DWS) allows you to reset the password of the database administrator. If a database administrator forgets their password or the account is locked because the number of consecutive incorrect password attempts reaches the upper limit, the database administrator can reset the password on the Clusters page. After the password is reset, the account can be automatically unlocked. You can set the maximum number of incorrect password attempts (10 by default) by configuring the failed_login_attempts parameter on the Parameter Modifications tab of the cluster. For details, see Modifying Database Parameters.
+If the default cluster administrator account is deleted or renamed, password resetting fails.
+A snapshot is a complete backup that records point-in-time configuration data and service data of a GaussDB(DWS) cluster. This section describes how to create a snapshot on the Snapshots page to back up cluster data.
+A manual snapshot can be created at any time. It will be retained until it is deleted from the GaussDB (DWS) console. Manual snapshots are full backups, which takes a long time to create.
+If a snapshot is being created for a cluster, the cluster cannot be restarted, scaled, its password cannot be reset, and its configurations cannot be modified.
+To ensure the integrity of snapshot data, do not write data during snapshot creation.
+The task status of the cluster for which you are creating a snapshot is Creating snapshot. The status of the snapshot that is being created is Creating. After the snapshot is created, its status becomes Available.
+If the snapshot size is much greater than that of the data stored in the cluster, the data is possibly labeled with a deletion tag, but is not cleared and reclaimed. Clear the data and recreate a snapshot. For details, see How Can I Clear and Reclaim Storage?
+This section describes how to restore a snapshot to a new cluster when you want to check point-in-time snapshot data of the cluster.
+When a snapshot is restored to a new cluster, the restoration time is determined by the amount of data backed up by the snapshot. If a snapshot contains a large amount of data, the restoration will be slow. A small snapshot can be quickly restored.
+Automatic snapshots are incremental backups. When restoring a snapshot to a new cluster, GaussDB(DWS) uses all snapshots between the latest full backup and the current snapshot. You can configure the backup frequency. If snapshots are backed up only once a week, the backup will be slow if the incremental data volume is large. You are advised to increase the backup frequency.
+You can modify cluster parameters. For details, see Table 1. By default, other parameters are the same as those in the snapshot. For details, see Table 2.
+ +Category + |
+Operation + |
+
---|---|
Basic + |
+Configure the region, AZ, node flavor, cluster name, database port, VPC, subnet, security group, public access, and enterprise project. + |
+
Advanced settings + |
+If Custom is selected, configure the following parameters:
+
|
+
When the status of the new cluster changes to Available, the snapshot is restored.
+After the snapshot is restored, the private network address and EIP (if EIP is set to Automatically assign) are automatically assigned.
+If the number of requested nodes, vCPU (cores), or memory (GB) exceed the user's remaining quota, a warning dialog box is displayed, indicating that the quota is insufficient and displaying the detailed remaining quota and the current quota application. You can click Increase quota in the warning dialog box to submit a service ticket and apply for higher node quota.
+For details about quotas, see What Is the User Quota?.
+On the Snapshots page, you can delete a snapshot in the Unavailable state or delete an available snapshot to release the storage space.
+Deleted snapshots cannot be restored. Exercise caution when performing this operation.
+You can delete snapshots that are manually created only.
+GaussDB(DWS) provides client tool packages that match the cluster versions. You can download the desired client tool package on the GaussDB(DWS) management console.
+The client tool package contains the following:
+gsql is a command line client running on the Linux operating system. It is used to connect to the database in a data warehouse cluster.
+The script for testing sample data is used when you start an example.
+Gauss Data Service (GDS) is a data service tool. You can use the GDS tool to import a data file in a common file system to the GaussDB(DWS) database. The GDS tool package must be installed on the server where the data source file is located. The server where the data source file is located is called a data server or GDS server.
+Choose a corresponding client version according to the cluster version and operating system to which the client is to be installed.
+If clusters of different versions are available, you will download the gsql tool matching the earliest cluster version after clicking Download. If there is no cluster, you will download the gsql tool of the earliest version after clicking Download. GaussDB(DWS) clusters are compatible with earlier versions of gsql tools.
+Table 1 lists the files and folders in the downloaded tool package.
+ +File or Folder + |
+Description + |
+
---|---|
bin + |
+This folder contains the executable files of gsql on Linux, including the tools gsql, GDS, gs_dump, gs_dumpall, and gs_restore. For details, see "Server Tool". + |
+
gds + |
+This folder contains the files of the GDS data service tool. The GDS tool is used for parallel data loading and can import the data files stored in a common file system to a GaussDB(DWS) database. + |
+
lib + |
+This folder contains the lib library required for executing the gsql client. + |
+
sample + |
+This folder contains the following directories and files: +
|
+
gsql_env.sh + |
+Script file for configuring environment variables before running the gsql client. + |
+
The JDBC or ODBC driver is used to connect to data warehouse clusters. You can download the JDBC or ODBC driver provided by GaussDB(DWS) from the management console or use the open-source JDBC or ODBC driver.
+GaussDB(DWS) also supports open-source JDBC and ODBC drivers: PostgreSQL JDBC 9.3-1103 or later; PostgreSQL ODBC 09.01.0200 or later
+Select DWS JDBC Driver and click Download to download the JDBC driver matching the current cluster version. If clusters of different versions are available, you will download the JDBC driver matching the earliest cluster version after clicking Download. If there is no cluster, you will download the JDBC driver of the earliest version after clicking Download. GaussDB(DWS) clusters are compatible with earlier versions of JDBC drivers.
+Click Historical Version to download the corresponding JDBC driver version. You are advised to download the JDBC driver based on the cluster version.
+The JDBC driver can be used on all platforms and depends on JDK 1.6 or later.
+Select a corresponding version and click Download to download the ODBC driver matching the current cluster version. If clusters of different versions are available, you will download the ODBC driver matching the earliest cluster version after clicking Download. If there is no cluster, you will download the ODBC driver of the earliest version after clicking Download. GaussDB(DWS) clusters are compatible with earlier versions of ODBC drivers.
+Click Historical Version to download the corresponding ODBC driver version. You are advised to download the ODBC driver based on the cluster version.
+The ODBC driver is applicable to the following operating systems only:
+Windows drivers can only be 32-bit and can be used in 32-bit or 64-bit operating systems. However, the applications must be 32-bit.
+You can access GaussDB(DWS) clusters by different methods and the connection address of each connection method varies. This section describes how to view and obtain the private network address on the cloud platform, public network address on the Internet, and JDBC connection strings.
+To obtain the cluster connection address, use either of the following methods:
+ +You can only select clusters in the Available state.
+ +Parameter + |
+Description + |
+
---|---|
Default Database + |
+Database name specified when the cluster is created. When you connect to the cluster for the first time, connect to the default database. + |
+
Initial Administrator + |
+Database administrator specified during cluster creation. When you connect to the cluster for the first time, you need to use the initial database administrator and password to connect to the default database. + |
+
Port + |
+Port for accessing the cluster database over the public network or private network. The host port is specified when a cluster is created and used to listen to client connections. + |
+
Connection String + |
+Connection string. You can click View Details to check the data warehouse connection information. Its value can be: +
|
+
ELB Address + |
+To achieve high availability and avoid single-CN failures, a new cluster needs to be bound to ELB. You are advised to use the ELB address to connect to the cluster. + |
+
Private Network Domain Name + |
+Name of the domain for accessing the database in the cluster over the private network. The private network domain address is automatically generated when a cluster is created. The default name format is ClusterName.dws.otc-tsi.de. When you access a data warehouse cluster using a domain name, the domain name resolver provides the load balancing function. + NOTE:
+If the cluster name does not comply with the domain name standards, the prefix of the default access domain name will be adjusted accordingly. +You can click Modify to change the private network domain name. The access domain name contains 4 to 63 characters, which consists of letters, digits, and hyphens (-), and must start with a letter. +For details, see Managing Access Domain Names. + |
+
Private Network IP Address + |
+IP address for accessing the database in the cluster over the private network. + NOTE:
+
|
+
Public Network Domain Name + |
+Name of the domain for accessing the database in the cluster over the public network. +For details, see Managing Access Domain Names. + |
+
Public Network IP Address + |
+IP address for accessing the database in the cluster over the public network. + NOTE:
+
|
+
No database operation is allowed on a read-only cluster. Cancel the read-only status on the management console.
+All clusters are displayed by default.
+This section describes how to connect to a database through an SQL client after you create a data warehouse cluster and before you use the cluster's database. GaussDB(DWS) provides the gsql client that matches the cluster version for you to access the cluster using the cluster's public or private network address.
+For details, see Preparing an ECS as the gsql Client Host.
+The user who uploads the client must have the full control permission on the target directory on the host to which the client is uploaded.
+Alternatively, you can remotely log in to the Linux host where the gsql is to be installed in SSH mode and run the following command in the Linux command window to download the gsql client:
+wget https://obs.otc.t-systems.com/dws/download/dws_client_redhat_x64.zip --no-check-certificate+
For details about how to log in to an ECS, see "ECSs> Logging In to a Linux ECS > Login Using an SSH Password" in the Elastic Cloud Server User Guide.
+The SSL connection mode is more secure than the non-SSL mode. You are advised to connect the client to the cluster in SSL mode.
+cd <Path for saving the client> +unzip dws_client_8.1.x_redhat_x64.zip+
In the preceding commands:
+source gsql_env.sh+
If the following information is displayed, the GaussDB(DWS) client is successfully configured:
+All things done.+
gsql -d <Database_name> -h <Cluster_address> -U <Database_user> -p <Database_port> -r+
The parameters are described as follows:
+For example, run the following command to connect to the default database gaussdb in the GaussDB(DWS) cluster:
+gsql -d gaussdb -h 10.168.0.74 -U dbadmin -p 8000 -W password -r
+If the following information is displayed, the connection succeeded:
+1 | gaussdb=> + |
For more information about the gsql commands, see the Data Warehouse Service (DWS) Tool Guide.
+GaussDB(DWS) users can import data from external sources to data warehouse clusters. This section describes how to import sample data from OBS to a data warehouse cluster and perform querying and analysis operations on the sample data. The sample data is generated based on the standard TPC-DS benchmark test.
+TPC-DS is the benchmark for testing the performance of decision support. With TPC-DS test data and cases, you can simulate complex scenarios, such as big data set statistics, report generation, online query, and data mining, to better understand functions and performance of database applications.
+cd /opt+
cd sample +/bin/bash setup.sh -ak <Access_Key_Id> -sk <Secret_Access_Key> -obs_location obs.otc.t-systems.com+
If the following information is displayed, the settings are successful:
+setup successfully!+
<Access_Key_Id> and <Secret_Access_Key>: indicate the AK and SK, respectively. For details about how to obtain the AK and SK, see "Data Import > Concurrently Importing Data from OBS > Creating Access Keys (AK and SK)" in the Data Warehouse Service (DWS) Developer Guide. Then, replace the parameters in the statements with the obtained values.
+cd .. +source gsql_env.sh +cd bin+
Command format:
+gsql -d <Database name> -h <Public network address of the cluster> -U <Administrator> -p <Data warehouse port number> -f <Path for storing the sample data script> -r+
Sample command:
+gsql -d gaussdb -h 10.168.0.74 -U dbadmin -p 8000 -f /opt/sample/tpcds_load_data_from_obs.sql -r
+In the preceding command, sample data script tpcds_load_data_from_obs.sql is stored in the sample directory (for example, /opt/sample/) of the GaussDB(DWS) client.
+After you enter the database administrator password and successfully connect to the database in the cluster, the system will automatically create a foreign table to associate the sample data outside the cluster. Then, the system creates a target table for saving the sample data and imports the data to the target table using the foreign table.
+The time required for importing a large dataset depends on the current GaussDB(DWS) cluster specifications. Generally, the import takes about 10 to 20 minutes. If information similar to the following is displayed, the import is successful.
+Time:1845600.524 ms+
cd /opt/sample/query_sql/ +/bin/bash tpcds100x.sh+
After the query is complete, a directory for storing the query result, such as query_output_20170914_072341, will be generated in the current query directory, for example, sample/query_sql/.
+Using the default certificate may pose security risks. To improve system security, you are advised to periodically change the certificate to prevent password cracking. If you need to replace the certificate, contact the database customer service.
+For more information about SSL certificates, see (Optional) Downloading the SSL Certificate. The following parts are included in this section:
+After a data warehouse cluster is deployed, the SSL authentication mode is enabled by default. The server certificate, private key, and root certificate have been configured by default. You need to configure the client parameters.
+For more information about SSL certificates, see (Optional) Downloading the SSL Certificate.
+For example, save the downloaded certificate dws_ssl_cert.zip to the /home/dbadmin/dws_ssl/ directory.
+cd /home/dbadmin/dws_ssl/ +unzip dws_ssl_cert.zip+
There are two SSL authentication modes: bidirectional authentication and unidirectional authentication. Different authentication modes require different client environment variables. For details, see SSL Authentication Modes and Client Parameters.
+The following parameters must be configured for bidirectional authentication:
+export PGSSLCERT="/home/dbadmin/dws_ssl/sslcert/client.crt" +export PGSSLKEY="/home/dbadmin/dws_ssl/sslcert/client.key" +export PGSSLMODE="verify-ca" +export PGSSLROOTCERT="/home/dbadmin/dws_ssl/sslcert/cacert.pem"+
The following parameters must be configured for unidirectional authentication:
+export PGSSLMODE="verify-ca" +export PGSSLROOTCERT="/home/dbadmin/dws_ssl/sslcert/cacert.pem"+
The permissions on the client's root certificate, private key, certificate, and encrypted private key file must be 600. If the permissions do not meet the requirement, the client cannot connect to the cluster in SSL mode.
+chmod 600 client.key +chmod 600 client.crt +chmod 600 client.key.cipher +chmod 600 client.key.rand +chmod 600 cacert.pem+
There are two SSL authentication modes: bidirectional authentication and unidirectional authentication. Table Table 1 shows the differences between these two modes. You are advised to use bidirectional authentication for security purposes.
+ +Authentication Mode + |
+Description + |
+Environment Variables Configured on a Client + |
+Maintenance + |
+
---|---|---|---|
Bidirectional authentication (recommended) + |
+The client verifies the server's certificate and the server verifies the client's certificate. The connection can be set up only after the verifications are successful. + |
+Set the following environment variables: +
|
+This authentication mode is applicable to scenarios that require high data security. When using this mode, you are advised to set the PGSSLMODE client variable to verify-ca for network data security purposes. + |
+
Unidirectional authentication + |
+The client verifies the server's certificate, whereas the server does not verify the client's certificate. The server loads the certificate information and sends it to the client. The client verifies the server's certificate according to the root certificate. + |
+Set the following environment variables: +
|
+To prevent TCP-based link spoofing, you are advised to use the SSL certificate authentication. In addition to configuring the client root certificate, you are advised to set the PGSSLMODE variable to verify-ca on the client. + |
+
Configure environment variables related to SSL authentication on the client. For details, see Table 2.
+The path of environment variables is set to /home/dbadmin/dws_ssl/ as an example. Replace it with the actual path.
+Environment Variable + |
+Description + |
+Value Range + |
+
---|---|---|
PGSSLCERT + |
+Specifies the certificate files for a client, including the public key. Certificates prove the legal identity of the client and the public key is sent to the remote end for data encryption. + |
+The absolute path of the files must be specified, for example:
+export PGSSLCERT='/home/dbadmin/dws_ssl/sslcert/client.crt'+ (No default value) + |
+
PGSSLKEY + |
+Specifies the client private key file used to decrypt the digital signatures and the data encrypted using the public key. + |
+The absolute path of the files must be specified, for example:
+export PGSSLKEY='/home/dbadmin/dws_ssl/sslcert/client.key'+ (No default value) + |
+
PGSSLMODE + |
+Specifies whether to negotiate with the server about SSL connection and specifies the priority of the SSL connection. + |
+Values and meanings: +
Default value: prefer + |
+
PGSSLROOTCERT + |
+Specifies the root certificate file for issuing client certificates. The root certificate is used to verify the server certificate. + |
+The absolute path of the files must be specified, for example:
+export PGSSLROOTCERT='/home/dbadmin/dws_ssl/sslcert/certca.pem'+ Default value: null + |
+
PGSSLCRL + |
+Specifies the certificate revocation list file, which is used to check whether a server certificate is in the list. If the certificate is in the list, it is invalid. + |
+The absolute path of the files must be specified, for example:
+export PGSSLCRL='/home/dbadmin/dws_ssl/sslcert/sslcrl-file.crl'+ Default value: null + |
+
By default, a database supports a certain number of connections. Administrators can manage database connections to learn about the connection performance of the current database or increase the connection limit so that more users or applications can connect to the database at the same time.
+The number of connections supported by a cluster depends on its node flavor.
+ +Parameter + |
+Node Flavor + |
+Number of CN Connections + |
+Number of DN Connections + |
+
---|---|---|---|
max_connections + + + |
+vCPUs < 16 + |
+512 + |
+Number of CN connections x 2 + |
+
vCPUs > 16 && <= 32 + |
+1024 + |
+Number of CN connections x 2 + |
+|
other + |
+2048 + |
+Number of CN connections x 2 + |
+
The policies of comm_max_stream, poolsize, and max_prepared_transactions are the same as those of max_connections.
+1 | SHOW max_connections; + |
Information similar to the following is displayed, showing that the maximum number of database connections is 200 by default.
+max_connections +----------------- +200 +(1 row)+
+
Description + |
+Command + |
+||
---|---|---|---|
View the maximum number of sessions connected to a specific user. + |
+Run the following command to view the maximum number of sessions connected to user dbadmin. +
Information similar to the following is displayed. -1 indicates that the number of sessions connected to user dbadmin is not limited. +rolname | rolconnlimit +----------+-------------- + dwsadmin | -1 +(1 row)+ |
+||
View the number of session connections that have been used by a user. + |
+Run the following command to view the number of session connections that have been used by dbadmin. +
Information similar to the following is displayed. 1 indicates the number of session connections used by user dbadmin. +count +------- + 1 +(1 row)+ |
+||
View the maximum number of sessions connected to a specific database. + |
+Run the following command to view the upper limit of connections used by gaussdb. +
Information similar to the following is displayed. -1 indicates that the number of sessions connected to database gaussdb is not limited. + datname | datconnlimit
+----------+--------------
+ gaussdb | -1
+(1 row)
+ |
+||
View the number of session connections that have been used by a database. + |
+Run the following command to view the number of session connections that have been used by gaussdb. +
Information similar to the following is displayed. 1 indicates the number of session connections used by database gaussdb. +count +------- + 1 +(1 row)+ |
+||
View the number of session connections that have been used by all users. + |
+Run the following command to view the number of session connections that have been used by all users: +
Information similar to the following is displayed. +count +------- + 10 +(1 row)+ |
+
MRS is a big data cluster running based on the open-source Hadoop ecosystem. It provides the industry's latest cutting-edge storage and analysis capabilities of massive volumes of data, satisfying your data storage and processing requirements. For details about MRS services, see the MapReduce Service User Guide.
+You can use Hive/Spark (analysis cluster of MRS) to store massive volumes of service data. Hive/Spark data files are stored in HDFS. On GaussDB(DWS), you can connect a data warehouse cluster to MRS clusters, read data from HDFS files, and write the data to GaussDB(DWS) when the clusters are on the same network.
+Perform the following operations to import data from MRS to a data warehouse cluster:
+For details, see "Data Import > Importing Data from MRS to a Cluster" in the Data Warehouse Service (DWS) Developer Guide.
+Before GaussDB(DWS) reads data from MRS HDFS, you need to create an MRS data source connection that functions as a channel of transporting data warehouse cluster data and MRS cluster data.
+Configure parameters as required. For details, see "Cluster Operation Guide > Custom Creation of a Cluster" in the MapReduce Service User Guide.
+Cluster Version can also be set to 1.6.x, 1.7.x, 1.8.x, or 2.0.x.
+If you enable Kerberos authentication for an MRS cluster, use MRS Manager to create a user for interconnecting GaussDB(DWS) with the system after the MRS cluster is created. The user type must be Human-Machine and the user, user group hadoop, and role Manager_administrator must be bound together. The user password must be changed on the MRS Manager page after the user is created.
+If you already have a qualified MRS cluster, skip this step.
+Parameter + |
+Description + |
+
---|---|
MRS Data Source + |
+Specifies the MRS cluster to which GaussDB(DWS) can connect. By default, all available analytic MRS clusters that are in the same VPC and subnet as the current data warehouse cluster and in the Available state are displayed. +After you select an MRS cluster, the system automatically displays whether Kerberos authentication is enabled for the selected cluster. Click View MRS Cluster to view its detailed information. +If the MRS Data Source drop-down list is empty, click Create MRS Cluster to create an MRS cluster. + |
+
MRS Account + |
+Specifies the account used when a data warehouse cluster connects to an MRS cluster. This parameter is available only when Kerberos authentication is selected for the MRS cluster. + |
+
Password + |
+Specifies the password of the connection user. If you change the password, you need to create a connection again. This parameter is valid only for clusters with MRS Kerberos authentication enabled. + |
+
Description + |
+Describes the connection. + |
+
Configuration Status turns to Creating. You can view the connection that is successfully created in the MRS data source list and the connection status is Available.
+Release Date + |
+Description + |
+
---|---|
2022-11-17 + |
+This issue is the twenty-sixth official release. +Added the following sections: +Performing a Primary/Standby Switchback + + + + + |
+
2021-12-30 + |
+This issue is the twenty-fifth official release. +Added the following sections: + + + |
+
2021-07-30 + |
+This issue is the twenty-fourth official release. +Added the following sections: + + |
+
2020-11-03 + |
+This issue is the twenty-third official release. +Modified the following sections: + + |
+
2019-09-30 + |
+This issue is the twenty-second official release. +Added the following sections: + +Modified the following sections: + + |
+
2019-03-30 + |
+This is the twenty-first official release. +Modified the following sections: + + |
+
2019-03-29 + |
+This issue is the twentieth official release. + |
+
2019-03-11 + |
+This issue is the nineteenth official release. +Added the following section: + + |
+
2019-01-29 + |
+This issue is the eighteenth official release. +Modified the following sections: + +Deleted the following section. For related information, see "Data Import" in the Data Warehouse Service (DWS) Developer Guide. +
|
+
2018-12-24 + |
+This issue is the seventeenth official release. +Added the following sections: +
Modified the following sections: +
|
+
2018-11-12 + |
+This issue is the sixteenth official release. +Modified the following section: +
|
+
2018-09-26 + |
+This issue is the fifteenth official release. + |
+
2018-09-15 + |
+This issue is the fourteenth official release. +Modified the following sections: +
|
+
2018-09-05 + |
+This issue is the thirteenth official release. +Modified the following sections: +
|
+
2018-08-29 + |
+This issue is the twelfth official release. +Modified the following sections: +
Deleted the following section: +
|
+
2018-08-22 + |
+This issue is the eleventh official release. +Modified the following sections: +
|
+
2018-08-07 + |
+This issue is the tenth official release. +Modified the following sections: +
Added the following sections: + + |
+
2018-06-21 + |
+This issue is the ninth official release. + |
+
2018-06-13 + |
+This is the eighth official release. +Modified the following sections: +
Added the following sections: +
|
+
2018-02-12 + |
+This issue is the seventh official release. +Modified the following sections: +
Deleted the following content from this document. If you want to know more about the following content, see the Data Warehouse Service Database Developer Guide. +
|
+
2017-12-29 + |
+This is the sixth official release. +The following topics are added: + +Modified the following sections: +
|
+
2017-11-01 + |
+This issue is the fifth official release. +
|
+
2017-10-16 + |
+This issue is the fourth official release. +
|
+
2017-09-30 + |
+This issue is the third official release. +
|
+
2017-08-30 + |
+This issue is the second official release. +
|
+
2017-08-07 + |
+This issue is the first official release. + |
+
If a cluster fails to be created, you can go to the Clusters page of the GaussDB(DWS) management console to view the cluster status and the cause of failure.
+For details about the error codes, see "Error Code Reference". If the fault persists, contact technical support.
+You can delete a cluster that fails to be created if you do not need it. Before deletion, check the cause of creation failure.
+If the cluster to be deleted uses an automatically created security group that is not used by other clusters, the security group is automatically deleted when the cluster is deleted.
+By default, the administrator specified when you create a GaussDB(DWS) cluster is the database system administrator. The administrator can create other users and view the audit logs of the database. That is, separation of permissions is disabled.
+GaussDB(DWS) supports role-based separation of permissions. In this way, different roles have different permissions and cluster data can be better protected.
+For details about the default permissions mode and the separation of permissions mode, see "Database Security Management > Managing Users and Their Permissions > Separation of Permissions" in the Data Warehouse Service (DWS) Developer Guide.
+After you have modified the security parameters and the modifications take effect, the cluster may be restarted, which makes the cluster unavailable temporarily.
+To modify the cluster's security configuration, ensure that the following conditions are met:
+By default, Configuration Status is Synchronized, which indicates that the latest database result is displayed.
+ indicates that the function is enabled. When separation of permissions is enabled, configure the username and password for Security Administrator and Audit Administrator. Then the system automatically creates these two users. You can use these two users to connect to the database and perform database-related operations.
indicates that Rights Separation is disabled. Rights Separation is disabled by default.
Parameter + |
+Description + |
+Example Value + |
+
---|---|---|
Security Administrator + |
+The username must meet the following requirements: +
|
+security_admin + |
+
Password + |
+The password complexity requirements are as follows:
+
|
+- + |
+
Confirm Password + |
+Enter the password of the security administrator again. + |
+- + |
+
Audit Administrator + |
+The username must meet the following requirements: +
|
+audit_admin + |
+
Password + |
+The password complexity requirements are as follows:
+
|
+- + |
+
Confirm Password + |
+Enter the password of the audit administrator again. + |
+- + |
+
After the security settings are complete, Configuration Status can be one of the following on the Security Settings page:
+Database audit logs are configured on the Security Settings page. You can change security settings only when the cluster status is Available and Unbalanced, and Task Information cannot be Creating snapshot, Resizing, Configuring, or Restarting.
+By default, Configuration Status is Synchronized, which indicates that the latest database results are displayed.
+Table 1 describes the detailed information.
+ +Parameter + |
+Description + |
+
---|---|
Audit Log Retention Policy + |
+Specifies the audit log retention policy. Possible values are: +
Space priority is preferred. + CAUTION:
+
|
+
Minimum Retention Period (day) + |
+This parameter is valid when Audit Log Retention Policy is set to Time priority. +The value ranges from 0 to 730 days. The default value is 90 days. + |
+
Table 2 describes the detailed information about the audit items.
+ +Parameter + |
+Description + |
+
---|---|
Audit Unauthorized Access + |
+Specifies whether to record unauthorized operations. This parameter is disabled by default. + |
+
Audit DML Execution + |
+Specifies whether to record INSERT, UPDATE, and DELETE operations on tables. This parameter is disabled by default. + |
+
Audit SELECT Execution + |
+Specifies whether to record the SELECT operation. This parameter is disabled by default. + |
+
Audit Stored Procedure Execution + |
+Specifies whether to record operations when executing the stored procedure or user-defined functions. This parameter is disabled by default. + |
+
Audit COPY Execution + |
+Specifies whether to record the COPY operation. This parameter is disabled by default. + |
+
Audit DDL Execution + |
+Specifies whether to record the CREATE, DROP, and ALTER operations of specified database objects. DATABASE, SCHEMA, and USER are selected by default. + + |
+
Except the audit items listed in Table 2, key audit items in Table 3 are enabled by default on GaussDB(DWS).
+ +Parameter + |
+Description + |
+
---|---|
Key audit items + |
+Records successful and failed logins and logout. + |
+
Records database startup, stop, recovery, and switchover. + |
+|
Records user locking and unlocking. + |
+|
Records the grants and reclaims of user permissions. + |
+|
Records the audit function of the SET operation. + |
+
For more information, see Enabling Audit Log Dumps.
+Click . The configuration status Applying indicates that the configurations are being saved.
When the status changes to Synchronized, the configurations are saved and take effect.
+GaussDB(DWS) supports connections in SSL authentication mode so that data transmitted between the GaussDB(DWS) client and the database can be encrypted. The SSL mode delivers higher security than the common mode. By default, the SSL function is enabled in a cluster to allow SSL or non-SSL connections from the client. For security purposes, you are advised to enable SSL connection. If you want to use SSL connection, enable Require SSL Connection for the cluster.
+On the Security Settings page of the cluster, you can enable or disable Require SSL Connection.
+The following parts are included in this section:
+ +By default, Configuration Status is set to Synchronized, which indicates that the latest database result is displayed.
+ indicates that the server requires SSL connection.
indicates that no SSL connection is required (default).
The system automatically saves the SSL connection settings. On the Security Settings page, Configuration Status is Applying. After Configuration Status changes to Synchronized, the settings have been saved and taken effect.
+Whether the client uses the SSL encryption connection mode and whether to verify the server certificate depend on client parameter sslmode and server (cluster) parameters ssl and require_ssl. The parameters are described as follows:
+The combinations of client parameter sslmode and server parameters ssl and require_ssl are as follows.
+ +ssl (Server) + |
+sslmode (Client) + |
+require_ssl (Server) + |
+Result + |
+
---|---|---|---|
on + |
+disable + |
+on + |
+The server requires SSL, but the client disables SSL for the connection. As a result, the connection cannot be set up. + |
+
disable + |
+off + |
+The connection is not encrypted. + |
+|
allow + |
+on + |
+The connection is encrypted. + |
+|
allow + |
+off + |
+The connection is not encrypted. + |
+|
prefer + |
+on + |
+The connection is encrypted. + |
+|
prefer + |
+off + |
+The connection is encrypted. + |
+|
require + |
+on + |
+The connection is encrypted. + |
+|
require + |
+off + |
+The connection is encrypted. + |
+|
verify-ca + |
+on + |
+The connection is encrypted and the server certificate is verified. + |
+|
verify-ca + |
+off + |
+The connection is encrypted and the server certificate is verified. + |
+|
off + |
+disable + |
+on + |
+The connection is not encrypted. + |
+
disable + |
+off + |
+The connection is not encrypted. + |
+|
allow + |
+on + |
+The connection is not encrypted. + |
+|
allow + |
+off + |
+The connection is not encrypted. + |
+|
prefer + |
+on + |
+The connection is not encrypted. + |
+|
prefer + |
+off + |
+The connection is not encrypted. + |
+|
require + |
+on + |
+The client requires SSL, but SSL is disabled on the server. Therefore, the connection cannot be set up. + |
+|
require + |
+off + |
+The client requires SSL, but SSL is disabled on the server. Therefore, the connection cannot be set up. + |
+|
verify-ca + |
+on + |
+The client requires SSL, but SSL is disabled on the server. Therefore, the connection cannot be set up. + |
+|
verify-ca + |
+off + |
+The client requires SSL, but SSL is disabled on the server. Therefore, the connection cannot be set up. + |
+
In GaussDB(DWS), you can use a JDBC driver to connect to a database on Linux or Windows. The driver can connect to the database through an ECS on the cloud platform or over the Internet.
+When using the JDBC driver to connect to the data warehouse cluster, determine whether to enable SSL authentication. SSL authentication is used to encrypt communication data between the client and the server. It safeguards sensitive data transmitted over the Internet. You can download a self-signed certificate file on the GaussDB(DWS) management console. To make the certificate take effect, you must configure the client program using the OpenSSL tool and the Java keytool.
+The SSL mode delivers higher security than the common mode. You are advised to enable SSL connection when using JDBC to connect to a GaussDB(DWS) cluster.
+For details about how to use the JDBC API, see the official documentation.
+GaussDB(DWS) also supports open-source JDBC driver: PostgreSQL JDBC 9.3-1103 or later.
+The procedure for connecting to the database using a JDBC driver in a Linux environment is similar to that in a Windows environment. The following describes the connection procedure in a Windows environment.
+You are advised to store the certificate file in a path of the English version and can specify the actual path when configuring the certificate. If the path is incorrect, a message stating that the file does not exist will be prompted.
+openssl x509 -in cacert.pem -out cacert.crt.der -outform der +keytool -keystore mytruststore -alias cacert -import -file cacert.crt.der+
Enter the truststore password as prompted and answer y.
+ +openssl pkcs12 -export -out client.pkcs12 -in client.crt -inkey client.key+
Enter the client private key password Gauss@MppDB. Then enter and confirm the self-defined private key password.
+keytool -importkeystore -deststorepass Gauss@MppDB -destkeystore client.jks -srckeystore client.pkcs12 -srcstorepass Password -srcstoretype PKCS12 -alias 1+
Take the Eclipse project as an example. Store the JAR file to the project directory, for example, the lib directory in the project directory. In the Eclipse project, right-click the JAR file in the lib directory and choose Build Path to reference the JAR file.
+The following methods are available:
+The JDBC driver package downloaded on GaussDB(DWS)contains gsjdbc.jar.
+The JDBC API does not provide the connection retry capability. You need to implement the retry processing in the service code.
+DriverManager.getConnection() methods:
+Parameter + |
+Description + |
+
---|---|
url + |
+Specifies the database connection descriptor, which can be viewed on the management console. For details, see Obtaining the Cluster Connection Address. +The URL format is as follows: +
NOTE:
+
|
+
info + |
+Specifies database connection properties. Common properties include the following: +
|
+
user + |
+Specifies the database user. + |
+
password + |
+Specifies the password of the database user. + |
+
The following describes the sample code used to encrypt the connection using the SSL certificate:
+1 + 2 + 3 + 4 + 5 + 6 + 7 + 8 + 9 +10 +11 +12 +13 +14 +15 +16 +17 +18 +19 +20 +21 +22 +23 +24 +25 +26 +27 +28 +29 +30 +31 +32 +33 +34 +35 +36 +37 +38 +39 +40 +41 +42 +43 +44 +45 +46 | // The following code obtains the database SSL connection operation and encapsulates the operation as an API. +public static Connection GetConnection(String username, String passwd) + { + //Define the driver class. + String driver = "org.postgresql.Driver"; + //Set keyStore. + System.setProperty("javax.net.ssl.trustStore", "mytruststore"); + System.setProperty("javax.net.ssl.keyStore", "client.jks"); + System.setProperty("javax.net.ssl.trustStorePassword", "password"); + System.setProperty("javax.net.ssl.keyStorePassword", "password"); + + Properties props = new Properties(); + props.setProperty("user", username); + props.setProperty("password", passwd); + props.setProperty("ssl", "true"); + + String url = "jdbc:postgresql://" + "10.10.0.13" + ':' + + "8000" + '/' + + "gaussdb"; + Connection conn = null; + + try + { + //Load the driver. + Class.forName(driver); + } + catch( Exception e ) + { + e.printStackTrace(); + return null; + } + + try + { + //Create a connection. + conn = DriverManager.getConnection(url, props ); + System.out.println("Connection succeed!"); + } + catch(Exception e) + { + e.printStackTrace(); + return null; + } + + return conn; + } + |
1 | Statement stmt = con.createStatement(); + |
1 | int rc = stmt.executeUpdate("CREATE TABLE tab1(id INTEGER, name VARCHAR(32));"); + |
1 | stmt.close(); + |
This code sample illustrates how to develop applications based on the JDBC API provided by GaussDB(DWS).
+Before completing the following example, you need to create a stored procedure. For details, see "Tutorial: Development Using JDBC or ODBC" in the Data Warehouse Service (DWS) Developer Guide.
+1 + 2 + 3 + 4 + 5 + 6 + 7 + 8 + 9 +10 +11 | create or replace procedure testproc +( + psv_in1 in integer, + psv_in2 in integer, + psv_inout in out integer +) +as +begin + psv_inout := psv_in1 + psv_in2 + psv_inout; +end; +/ + |
1 + 2 + 3 + 4 + 5 + 6 + 7 + 8 + 9 + 10 + 11 + 12 + 13 + 14 + 15 + 16 + 17 + 18 + 19 + 20 + 21 + 22 + 23 + 24 + 25 + 26 + 27 + 28 + 29 + 30 + 31 + 32 + 33 + 34 + 35 + 36 + 37 + 38 + 39 + 40 + 41 + 42 + 43 + 44 + 45 + 46 + 47 + 48 + 49 + 50 + 51 + 52 + 53 + 54 + 55 + 56 + 57 + 58 + 59 + 60 + 61 + 62 + 63 + 64 + 65 + 66 + 67 + 68 + 69 + 70 + 71 + 72 + 73 + 74 + 75 + 76 + 77 + 78 + 79 + 80 + 81 + 82 + 83 + 84 + 85 + 86 + 87 + 88 + 89 + 90 + 91 + 92 + 93 + 94 + 95 + 96 + 97 + 98 + 99 +100 +101 +102 +103 +104 +105 +106 +107 +108 +109 +110 +111 +112 +113 +114 +115 +116 +117 +118 +119 +120 +121 +122 +123 +124 +125 +126 +127 +128 +129 +130 +131 +132 +133 +134 +135 +136 +137 +138 +139 +140 +141 +142 +143 +144 +145 +146 +147 +148 +149 +150 +151 +152 +153 +154 +155 +156 +157 +158 +159 +160 +161 +162 +163 +164 +165 +166 +167 +168 | //DBtest.java +//gsjdbc4.jar is used as an example. +//Demonstrate the main steps for JDBC development, including creating databases, creating tables, and inserting data. + +import java.sql.Connection; +import java.sql.DriverManager; +import java.sql.PreparedStatement; +import java.sql.SQLException; +import java.sql.Statement; +import java.sql.CallableStatement; +import java.sql.Types; + +public class DBTest { +//Create a database connection. Replace the following IP address and database with the actual database connection address and database name. + public static Connection GetConnection(String username, String passwd) { + String driver = "org.postgresql.Driver"; + String sourceURL = "jdbc:postgresql://10.10.0.13:8000/database"; + Connection conn = null; + try { + // Load the database driver. + Class.forName(driver).newInstance(); + } catch (Exception e) { + e.printStackTrace(); + return null; + } + + try { + //Create a database connection. + conn = DriverManager.getConnection(sourceURL, username, passwd); + System.out.println("Connection succeed!"); + } catch (Exception e) { + e.printStackTrace(); + return null; + } + + return conn; + }; + + //Run the common SQL statements to create table customer_t1. + public static void CreateTable(Connection conn) { + Statement stmt = null; + try { + stmt = conn.createStatement(); + + //Run the common SQL statements. + int rc = stmt + .executeUpdate("CREATE TABLE customer_t1(c_customer_sk INTEGER, c_customer_name VARCHAR(32));"); + + stmt.close(); + } catch (SQLException e) { + if (stmt != null) { + try { + stmt.close(); + } catch (SQLException e1) { + e1.printStackTrace(); + } + } + e.printStackTrace(); + } + } + + //Run the prepared statements and insert data in batches. + public static void BatchInsertData(Connection conn) { + PreparedStatement pst = null; + + try { + //Generate the prepared statements. + pst = conn.prepareStatement("INSERT INTO customer_t1 VALUES (?,?)"); + for (int i = 0; i < 3; i++) { + //Add parameters. + pst.setInt(1, i); + pst.setString(2, "data " + i); + pst.addBatch(); + } + //Execute batch processing. + pst.executeBatch(); + pst.close(); + } catch (SQLException e) { + if (pst != null) { + try { + pst.close(); + } catch (SQLException e1) { + e1.printStackTrace(); + } + } + e.printStackTrace(); + } + } + + //Run the precompiled statement to update the data. + public static void ExecPreparedSQL(Connection conn) { + PreparedStatement pstmt = null; + try { + pstmt = conn + .prepareStatement("UPDATE customer_t1 SET c_customer_name = ? WHERE c_customer_sk = 1"); + pstmt.setString(1, "new Data"); + int rowcount = pstmt.executeUpdate(); + pstmt.close(); + } catch (SQLException e) { + if (pstmt != null) { + try { + pstmt.close(); + } catch (SQLException e1) { + e1.printStackTrace(); + } + } + e.printStackTrace(); + } + } + + +//Execute the storage procedure. + public static void ExecCallableSQL(Connection conn) { + CallableStatement cstmt = null; + try { + + cstmt=conn.prepareCall("{? = CALL TESTPROC(?,?,?)}"); + cstmt.setInt(2, 50); + cstmt.setInt(1, 20); + cstmt.setInt(3, 90); + cstmt.registerOutParameter(4, Types.INTEGER); //Register a parameter of the out type. Its value is an integer. + cstmt.execute(); + int out = cstmt.getInt(4); //Obtain the out parameter. + System.out.println("The CallableStatment TESTPROC returns:"+out); + cstmt.close(); + } catch (SQLException e) { + if (cstmt != null) { + try { + cstmt.close(); + } catch (SQLException e1) { + e1.printStackTrace(); + } + } + e.printStackTrace(); + } + } + + + /** + * Main program, which gradually invokes each static method. + * @param args + */ + public static void main(String[] args) { + //Create a database connection. Replace User and Password with the actual database user name and password. + Connection conn = GetConnection("User", "Password"); + + //Create a table. + CreateTable(conn); + + //Insert data in batches. + BatchInsertData(conn); + + //Run the precompiled statement to update the data. + ExecPreparedSQL(conn); + + //Execute the storage procedure. + ExecCallableSQL(conn); + + //Close the database connection. + try { + conn.close(); + } catch (SQLException e) { + e.printStackTrace(); + } + + } + +} + |
After performing the steps in preceding sections, you can refer to the documentation listed as follows for more information about GaussDB(DWS):
+After performing the steps in "Getting Started," if you do not need to use the sample data, clusters, ECSs, or VPCs, delete the resources so that your service quotas will not be wasted or occupied.
+On the GaussDB(DWS) management console, click Clusters, locate the row that contains dws-demo in the cluster list, and choose More > Delete. In the dialog box that is displayed, select Release the EIP bound with the cluster and click OK.
+If the cluster to be deleted uses an automatically created security group that is not used by other clusters, the security group is automatically deleted when the cluster is deleted.
+Log in to the VPC management console. In the navigation tree on the left, click Virtual Private Cloud. In the VPC list, click vpc-dws. In the subnet list, locate the row that contains subnet-dws and click Delete.
+Log in to the VPC management console, locate the row that contains vpc-dws in the VPC list, and click Delete.
+For details, see "VPC and Subnet > Deleting a VPC" in the Virtual Private Cloud User Guide.
+GaussDB(DWS) supports the standard SSL (TLS 1.2). As a highly secure protocol, SSL authenticates bidirectional identification between the server and client using digital signatures and digital certificates to ensure secure data transmission. To support SSL connection, GaussDB(DWS) has obtained the formal certificates and keys for the server and client from the CA certification center. It is assumed that the key and certificate for the server are server.key and server.crt respectively; the key and certificate for the client are client.key and client.crt respectively, and the name of the CA root certificate is cacert.pem.
+By default, the SSL function is enabled for a data warehouse cluster (the server) to allow SSL and non-SSL connections from the client. In addition, the certificate, private key, and root certificate of the server have been configured by default.
+Using the default certificate may pose security risks. To improve system security, you are advised to periodically change the certificate to prevent password cracking. If you need to replace the certificate, contact the database customer service.
+This section describes how to download an SSL certificate.
+This section describes how to copy snapshots that are automatically created for long-term retention.
+All snapshots are displayed by default. You can copy the snapshots that are automatically created.
+The snapshot name must be 4 to 64 characters in length and start with a letter. It is case-insensitive and contains only letters, digits, hyphens (-), and underscores (_).
+This parameter is optional. Snapshot information contains 0 to 256 characters and does not support the following special characters: !<>'=&"
+The system displays a message indicating that the snapshot is successfully copied and delivered. After the snapshot is copied, the status of the copied snapshot is Available.
+If the snapshot size is much greater than that of the data stored in the cluster, the data is possibly labeled with a deletion tag, but is not cleared and reclaimed. Clear the data and recreate a snapshot. For details, see How Can I Clear and Reclaim Storage?
+GaussDB(DWS) allows you to use an ODBC driver to connect to the database through an ECS on the cloud platform or over the Internet.
+For details about how to use the ODBC API, see the official document.
+GaussDB(DWS) also supports open-source ODBC driver: PostgreSQL ODBC 09.01.0200 or later.
+tar -xvf unixODBC-2.3.0.tar.gz+
cd unixODBC-2.3.0 +vi configure+
Change the value of LIB_VERSION to the following. Save the change and exit.
+LIB_VERSION="1:0:0"+
./configure --enable-gui=no +make +make install+
unzip dws_odbc_driver_for_linux.zip+
vi /usr/local/etc/odbcinst.ini+
Copy the following content to the file:
+[DWS] +Driver64=/usr/local/lib/psqlodbcw.so+
The parameters are as follows:
+vi /usr/local/etc/odbc.ini+
Copy the following content to the configuration file, save the modification, and exit.
+[DWSODBC]
+Driver=DWS
+Servername=10.10.0.13
+Database=gaussdb
+Username=dbadmin
+Password=password
+Port=8000
+Sslmode=allow
+
+Parameter + |
+Description + |
+Example Value + |
+
---|---|---|
[DSN] + |
+Data source name. + |
+[DWSODBC] + |
+
Driver + |
+Driver name, corresponding to DriverName in odbcinst.ini. + |
+Driver=DWS + |
+
Servername + |
+Server IP address. + |
+Servername=10.10.0.13 + |
+
Database + |
+Name of the database to be connected to. + |
+Database=gaussdb + |
+
Username + |
+Database username. + |
+Username=dbadmin + |
+
Password + |
+Database user password. + |
+Password=password + |
+
Port + |
+Port number of the server. + |
+Port=8000 + |
+
Sslmode + |
+SSL certification mode. This parameter is enabled for the cluster by default. +Values and meanings: +
NOTE:
+The SSL mode delivers higher security than the common mode. By default, the SSL function is enabled in a cluster to allow SSL or non-SSL connections from the client. You are advised to use the SSL mode when using ODBC to connect to a GaussDB (DWS) cluster. + |
+Sslmode=allow + |
+
You can view the values of Servername and Port on the GaussDB(DWS) management console. Log in to the GaussDB(DWS) management console and click Connection Management. In the Data Warehouse Connection String area, select the target cluster and obtain Private Network Address or Public Network Address. For details, see Obtaining the Cluster Connection Address.
+vi ~/.bashrc+
Add the following information to the configuration file:
+export LD_LIBRARY_PATH=/usr/local/lib/:$LD_LIBRARY_PATH +export ODBCSYSINI=/usr/local/etc +export ODBCINI=/usr/local/etc/odbc.ini+
source ~/.bashrc+
/usr/local/bin/isql -v DWSODBC+
If the following information is displayed, the connection is successful:
+1 +2 +3 +4 +5 +6 +7 +8 +9 | +---------------------------------------+ +| Connected! | +| | +| sql-statement | +| help [tablename] | +| quit | +| | ++---------------------------------------+ +SQL> + |
You can choose to automatically or manually deploy the certificate based on your needs.
+Automatic deployment:
+Double-click the sslcert_env.bat file. The certificate is automatically deployed to a default location.
+The sslcert_env.bat file ensures the purity of the certificate environment. When the %APPDATA%\postgresql directory exists, a message will be prompted asking you whether you want to remove related directories. If you want to remove related directories, back up files in the directory.
+Currently, because GaussDB(DWS) only provides a 32-bit ODBC driver, it only supports 32-bit application development. Use the 32-bit Driver Manager when you configure the data source. (Assume the Windows system drive is drive C. If another disk drive is used, modify the path accordingly.)
+Do not choose Control Panel > System and Security > Administrative Tools > Data Sources (ODBC) directly.
+WOW64 is the acronym for Windows 32-bit on Windows 64-bit. C:\Windows\SysWOW64\ stores the 32-bit environment on a 64-bit system. C:\Windows\System32\ stores the environment consistent with the current operating system. For technical details, see the Windows technical documents.
+You can also open Driver Manager by choosing Control Panel > System and Security > Administrative Tools > Data Sources (ODBC).
+You can view the values of Server and Port on the GaussDB(DWS) management console. Log in to the GaussDB(DWS) management console and click Connections. In the Data Warehouse Connection String area, select the target cluster and obtain Private Network Address or Public Network Address. For details, see Obtaining the Cluster Connection Address.
+The ODBC API does not provide the database connection retry capability. You need to implement the connection retry processing in the service code.
+The sample code is as follows:
+1 + 2 + 3 + 4 + 5 + 6 + 7 + 8 + 9 +10 +11 +12 +13 +14 +15 +16 +17 +18 +19 +20 +21 +22 +23 +24 +25 +26 +27 +28 +29 +30 +31 +32 +33 +34 +35 +36 +37 +38 +39 +40 +41 +42 +43 +44 +45 +46 +47 +48 +49 +50 +51 +52 +53 +54 +55 +56 +57 +58 +59 +60 +61 +62 +63 +64 +65 +66 +67 +68 +69 +70 +71 +72 +73 +74 +75 +76 +77 +78 +79 +80 +81 +82 +83 | // This example shows how to obtain GaussDB(DWS) data through the ODBC driver. +// DBtest.c (compile with: libodbc.so) +#include <stdlib.h> +#include <stdio.h> +#include <sqlext.h> +#ifdef WIN32 +#include <windows.h> +#endif +SQLHENV V_OD_Env; // Handle ODBC environment +SQLHSTMT V_OD_hstmt; // Handle statement +SQLHDBC V_OD_hdbc; // Handle connection +char typename[100]; +SQLINTEGER value = 100; +SQLINTEGER V_OD_erg,V_OD_buffer,V_OD_err,V_OD_id; +int main(int argc,char *argv[]) +{ + // 1. Apply for an environment handle. + V_OD_erg = SQLAllocHandle(SQL_HANDLE_ENV,SQL_NULL_HANDLE,&V_OD_Env); + if ((V_OD_erg != SQL_SUCCESS) && (V_OD_erg != SQL_SUCCESS_WITH_INFO)) + { + printf("Error AllocHandle\n"); + exit(0); + } + // 2. Set environment attributes (version information). + SQLSetEnvAttr(V_OD_Env, SQL_ATTR_ODBC_VERSION, (void*)SQL_OV_ODBC3, 0); + // 3. Apply for a connection handle. + V_OD_erg = SQLAllocHandle(SQL_HANDLE_DBC, V_OD_Env, &V_OD_hdbc); + if ((V_OD_erg != SQL_SUCCESS) && (V_OD_erg != SQL_SUCCESS_WITH_INFO)) + { + SQLFreeHandle(SQL_HANDLE_ENV, V_OD_Env); + exit(0); + } + // 4. Set connection attributes. + SQLSetConnectAttr(V_OD_hdbc, SQL_ATTR_AUTOCOMMIT, SQL_AUTOCOMMIT_ON, 0); + // 5. Connect to a data source. You do not need to enter the username and password if you have configured them in the odbc.ini file. If you have not configured them, specify the name and password of the user who wants to connect to the database in the SQLConnect function. + V_OD_erg = SQLConnect(V_OD_hdbc, (SQLCHAR*) "gaussdb", SQL_NTS, + (SQLCHAR*) "", SQL_NTS, (SQLCHAR*) "", SQL_NTS); + if ((V_OD_erg != SQL_SUCCESS) && (V_OD_erg != SQL_SUCCESS_WITH_INFO)) + { + printf("Error SQLConnect %d\n",V_OD_erg); + SQLFreeHandle(SQL_HANDLE_ENV, V_OD_Env); + exit(0); + } + printf("Connected !\n"); + // 6. Set statement attributes. + SQLSetStmtAttr(V_OD_hstmt,SQL_ATTR_QUERY_TIMEOUT,(SQLPOINTER *)3,0); + // 7. Apply for a statement handle. + SQLAllocHandle(SQL_HANDLE_STMT, V_OD_hdbc, &V_OD_hstmt); + // 8. Executes an SQL statement directly. + SQLExecDirect(V_OD_hstmt,"drop table IF EXISTS testtable",SQL_NTS); + SQLExecDirect(V_OD_hstmt,"create table testtable(id int)",SQL_NTS); + SQLExecDirect(V_OD_hstmt,"insert into testtable values(25)",SQL_NTS); + // 9. Prepare for execution. + SQLPrepare(V_OD_hstmt,"insert into testtable values(?)",SQL_NTS); + // 10. Bind parameters. + SQLBindParameter(V_OD_hstmt,1,SQL_PARAM_INPUT,SQL_C_SLONG,SQL_INTEGER,0,0, + &value,0,NULL); + // 11. Execute the ready statement. + SQLExecute(V_OD_hstmt); + SQLExecDirect(V_OD_hstmt,"select id from testtable",SQL_NTS); + // 12. Obtain the attributes of a certain column in the result set. + SQLColAttribute(V_OD_hstmt,1,SQL_DESC_TYPE,typename,100,NULL,NULL); + printf("SQLColAtrribute %s\n",typename); + // 13. Bind the result set. + SQLBindCol(V_OD_hstmt,1,SQL_C_SLONG, (SQLPOINTER)&V_OD_buffer,150, + (SQLLEN *)&V_OD_err); + // 14. Collect data using SQLFetch. + V_OD_erg=SQLFetch(V_OD_hstmt); + // 15. Obtain and return data using SQLGetData. + while(V_OD_erg != SQL_NO_DATA) + { + SQLGetData(V_OD_hstmt,1,SQL_C_SLONG,(SQLPOINTER)&V_OD_id,0,NULL); + printf("SQLGetData ----ID = %d\n",V_OD_id); + V_OD_erg=SQLFetch(V_OD_hstmt); + }; + printf("Done !\n");pgadmin + // 16. Disconnect from the data source and release handles. + SQLFreeHandle(SQL_HANDLE_STMT,V_OD_hstmt); + SQLDisconnect(V_OD_hdbc); + SQLFreeHandle(SQL_HANDLE_DBC,V_OD_hdbc); + SQLFreeHandle(SQL_HANDLE_ENV, V_OD_Env); + return(0); + } + |
This guide is an introductory tutorial that demonstrates how to create a sample GaussDB(DWS) cluster, connect to the cluster database, import the sample data from OBS, and analyze the sample data. You can use this tutorial to evaluate GaussDB(DWS).
+Before creating a GaussDB(DWS) cluster, ensure that the following prerequisites are met:
+If you do not have a public cloud account, register one. If you already have an account with real-name authentication, skip this step and use the account.
+You must perform real-name authentication before enabling cloud services.
+You can select a snapshot type and set one or more automated snapshot policies for a cluster. After an automated snapshot policy is enabled, the system automatically creates snapshots based on the preset time, period, and snapshot type according to the policy.
+Perform the following steps to configure an automated snapshot policy.
+Parameter + |
+Description + |
+
---|---|
Retention Days + |
+Retention days of the snapshots that are automatically created. The value ranges from 1 to 31 days. + NOTE:
+Snapshots that are automatically created cannot be deleted manually. The system automatically deletes these snapshots when their retention duration exceeds the threshold. + |
+
The snapshot creation time is UTC, which may be different from your local time.
+Choosing the days in red (29/30/31) may skip some monthly backups.
+Parameter + |
+Description + |
+
---|---|
Name + |
+The policy name must be unique, consist of 4 to 92 characters, and start with a letter. It is case-insensitive and can contain only letters, digits, hyphens (-), and underscores (_). + |
+
Type + |
+You can choose either full or incremental snapshots. + |
+
Policy + |
+You can choose either periodic or one-time snapshots. + NOTE:
+You can select One-off Snapshot only when Snapshot Type is set to Full. + |
+
One-time + |
+You can create a full snapshot at a specified time in the future. The UTC time is used. + |
+
Periodic Policy Configurations + |
+You can create automated snapshots on a daily, weekly, or monthly basis: +
NOTICE:
+If the incremental data is large and the execution period is long, the backup will be slow. In this case, increase the backup frequency. + |
+
A maximum of three snapshot policies can be set for a cluster.
+Implementation of the same policy varies according to operations in the cluster. For example:
+GaussDB(DWS) enables you to use this service through various methods, such as the GaussDB(DWS) management console, GaussDB(DWS) client, and REST APIs. This section describes the main functions of GaussDB(DWS).
+A data warehouse cluster contains nodes with the same flavor in the same subnet. These nodes jointly provide services. GaussDB(DWS) provides a professional, efficient, and centralized management console, allowing you to quickly apply for clusters, easily manage data warehouses, and focus on data and services.
+Main functions of cluster management are described as follows:
+To use data warehouse services on the cloud, create a GaussDB(DWS) cluster first. You can select product and node specifications to quickly create a cluster.
+A snapshot is a complete backup that records point-in-time configuration data and service data of a GaussDB(DWS) cluster. A snapshot can be used to restore a cluster at a certain time. You can manually create snapshots for a cluster or enable automated snapshot creation (periodic). Automated snapshots have a limited retention period. You can copy automatic snapshots for long-term retention.
+When you restore a cluster from a snapshot, the system creates a new cluster with the same flavor and node quantity as the original one, and imports the snapshot data.
+You can delete snapshots that are no longer needed to release the storage space.
+You can check the nodes in a cluster, including the status, specifications, and usage of each node. To prepare for a large scale-out, you can add nodes in batches. For example, if 180 more BMS nodes are needed for a scale-out, add them in three batches (60 in each batch). If some nodes fail to be added, add them again. After all the 180 nodes are successfully added, use the nodes for cluster scale-out. Adding nodes does not affect cluster services.
+As the service volume increases, the current scale of a cluster may not meet service requirements. In this case, you can scale out the cluster by adding compute nodes to it. Services are not interrupted during the scale-out. You can enable online scale-out and automatic redistribution if necessary.
+By default, redistribution is automatically started after cluster scale-out. For enhanced reliability, disable the automatic redistribution function and manually start a redistribution task after the scale-out is successful. Data redistribution can accelerate service response. Currently, offline redistribution, online redistribution, and offline scheduling are supported. The default mode is offline redistribution.
+When multiple database users query jobs at the same time, some complex queries may occupy cluster resources for a long time, affecting the performance of other queries. For example, a group of database users continuously submit complex and time-consuming queries, while another group of users frequently submit short queries. In this case, short queries may have to wait in the queue for the time-consuming queries to complete. To improve efficiency, you can use the GaussDB(DWS) workload management function to handle such problems. GaussDB(DWS) workload management uses workload queues as resource bearers. You can create different workload queues for different service types and configure different resource ratios for these queues. Then, add database users to the corresponding queues to restrict their resource usages.
+A physical cluster can be divided into logical clusters that use the node-group mechanism. Tables in a database can be allocated to different physical nodes by logical cluster. A logical cluster can contain tables from multiple databases.
+Restarting a cluster may cause data loss in running services. If you have to restart a cluster, ensure that there is no running service and all data has been saved.
+You can delete a cluster when you do not need it. Deleting a cluster is risky and may cause data loss. Therefore, exercise caution when performing this operation.
+GaussDB(DWS) allows you to manage clusters and snapshots in either of the following ways:
+Use the management console to access GaussDB(DWS) clusters. When you have registered an account, log in to the management console and choose Data Warehouse Service.
+For more information about cluster management, see "Cluster Management".
+Use REST APIs provided by GaussDB(DWS) to manage clusters. In addition, if you need to integrate GaussDB(DWS) into a third-party system for secondary development, use APIs to access the service.
+For details, see the Data Warehouse Service API Reference.
+ +After a data warehouse cluster is created, you can use the SQL client to connect to the cluster and perform operations such as creating a database, managing the database, importing and exporting data, and querying data.
+GaussDB(DWS) provides petabyte-level (PB-level) high-performance databases with the following features:
+GaussDB(DWS) has comprehensive SQL capabilities:
+For details about the SQL syntax and database operation guidance, see the Data Warehouse Service Database Development Guide.
+GaussDB(DWS) supports efficient data import from multiple data sources. The following lists typical data import modes. For details, see "Data Import" in the Data Warehouse Service (DWS) Developer Guide.
+In addition, GaussDB(DWS)supports data import using mainstream third-party ETL tools.
+You can call standard APIs, such as JDBC and ODBC, to access databases in GaussDB(DWS) clusters.
+For details, see "Using the JDBC and ODBC Drivers to Connect to a Cluster" in the Data Warehouse Service (DWS) User Guide.
+GaussDB(DWS) integrates with Cloud Eye, allowing you to monitor compute nodes and databases in the cluster in real time. For details, see "Cluster Monitoring" in the Data Warehouse Service (DWS) User Guide.
+DMS is provided by GaussDB(DWS) to ensure the fast and stable running of databases. It collects, monitors, and analyzes the disk, network, and OS metric data used by the service database, as well as key performance metric data of cluster running. It also diagnoses database hosts, instances, and service SQL statements based on the collected metrics to expose key faults and performance problems in a database in a timely manner, and guides customers to optimize and resolve the problems. For details, see "Database Monitoring" in Data Warehouse Service User Guide.
+Alarm management includes viewing and configuring alarm rules and subscribing to alarm information. Alarm rules display alarm statistics and details of the past week for users to view tenant alarms. In addition to providing a set of default GaussDB(DWS) alarm rules, this feature allows you to modify alarm thresholds based on your own services. For details, see "Alarms" in Data Warehouse Service User Guide.
+GaussDB(DWS) provides the following self-developed tools. You can download the tool packages on the GaussDB(DWS) management console. For details about the tools, see the Data Warehouse Service (DWS) Tool Guide.
+gsql is a command line SQL client tool running on the Linux operating system. It helps connect to, operate, and maintain the database in a data warehouse cluster.
+Data Studio is a Graphical User Interface (GUI) SQL client tool running on the Windows operating system. It is used to connect to the database in a data warehouse cluster, manage the database and database objects, edit, run, and debug SQL scripts, and view the execution plans.
+GDS is a data service tool provided by GaussDB(DWS). It works with the foreign table mechanism to implement high-speed data import and export.
+The GDS tool package needs to be installed on the server where the data source file is located. This server is called the data server or the GDS server.
+The DSC is a command-line tool running on the Linux or Windows OS. It is dedicated to providing customers with simple, fast, reliable application SQL script migration services. It parses SQL scripts of source database applications by using the built-in syntax migration logic, and migrates them to be applicable to GaussDB(DWS) databases.
+The DSC can migrate SQL scripts of Teradata, Oracle, Netezza, MySQL, and DB2 databases.
+Data Studio is a SQL client tool running on the Windows operating system. It provides various GUIs for you to manage databases and database objects, as well as edit, run, and debug SQL scripts, and view execution plans. Download the Data Studio software package from the GaussDB(DWS) management console. The package can be used without installation after being decompressed.
+Data Studio versions include Windows x86 (32-bit Windows system) and Windows x64 (64-bit Windows system).
+For details, see "Security > Security Group > Adding a Security Group Rule" in the Virtual Private Cloud User Guide.
+Only JDK 1.8 is supported.
+In the Windows operating system, you can download the required JDK version from the official website of SDK, and install it by following the installation guidance.
+If clusters of different versions are available, you will download the Data Studio matching the earliest cluster version after clicking Download. If there is no cluster, you will download the Data Studio tool of the earliest version after clicking Download. GaussDB(DWS) clusters are compatible with earlier versions of Data Studio.
+If your computer blocks the running of the application, you can unlock the Data Studio.exe file to start the application.
++
Field + |
+Description + |
+Example Value + |
+
---|---|---|
Database Type + |
+Select GaussDB A + |
+GaussDB A + |
+
Connection Name + |
+Name of the connection + |
+dws-demo + |
+
Host + |
+IP address (IPv4) or domain name of the cluster to be connected + |
+- + |
+
Port Number + |
+Database port + |
+8000 + |
+
Database Name + |
+Database name + |
+gaussdb + |
+
Username + |
+Username for connecting to the database + |
+- + |
+
Password + |
+Password for logging in to the database to be connected + |
+- + |
+
Save Password + |
+Select an option from the drop-down list: +
|
+- + |
+
Enable SSL + |
+If Enable SSL is selected, the client can use SSL to encrypt connections. The SSL connection mode is more secure than common modes, so you are advised to enable SSL connection. + |
+- + |
+
When Enable SSL is selected, download the SSL certificate and decompress it by referring to (Optional) Downloading the SSL Certificate. Click the SSL tab and configure the following parameters:
+ +Field + |
+Description + |
+
---|---|
Client SSL Certificate + |
+Select the sslcert\client.crt file in the decompressed SSL certificate directory. + |
+
Client SSL Key + |
+Only the PK8 format is supported. Select the sslcert\client.key.pk8 file in the directory where the SSL certificate is decompressed. + |
+
Root Certificate + |
+When SSL Mode is set to verify-ca, the root certificate must be configured. Select the sslcert\cacert.pem file in the decompressed SSL certificate directory. + |
+
SSL Cipher + |
+Set the password for the client SSL key in PK8 format. + |
+
SSL Mode + |
+GaussDB(DWS) supports the following SSL modes: +
GaussDB(DWS) does not support the verify-full mode. + |
+
If SSL is enabled, click Continue in the displayed Connection Security Alert dialog box.
+After the login is successful, the RECENT LOGIN ACTIVITY dialog box is displayed, indicating that Data Studio is connected to the database. You can run the SQL statement in the window on the Data Studio page.
+For details about how to use other functions of Data Studio, press F1 to view the Data Studio user manual.
+A tag is a key-value pair customized by users and used to identify cloud resources. It helps users to classify and search for cloud resources.
+Tags are composed of key-value pairs.
+On GaussDB(DWS), after creating a cluster, you can add identifiers to items such as the project name, service type, and background information using tags. If you use tags in other cloud services, you are advised to create the same tag key-value pairs for cloud resources used by the same business to keep consistency.
+GaussDB(DWS) supports the following two types of tags:
+ +Predefined tags created on Tag Management Service (TMS). Predefined tags are global tags.
+For details about predefined tags, see the Tag Management Service User Guide.
+On GaussDB(DWS), tags can be added to the following resources:
+Tags can be added to a cluster when the cluster is being created or after it is successfully created. You can search for the cluster in the cluster list using tags.
+Each cluster can have a maximum of 10 tags added to it.
+After you add tags to a cluster and then create a snapshot for the cluster, the tags cannot be restored if you use the snapshot to restore the cluster. Instead, you need to add tags again.
+When a cluster is deleted, non-predefined tags associated with the cluster are also deleted. Predefined tags need to be deleted on TMS.
+This section describes how to search for clusters based on tags and how to add, modify, and delete tags for clusters.
+Parameter + |
+Description + |
+Example Value + |
+
---|---|---|
Tag key + |
+You can: +
|
+key01 + |
+
Tag value + |
+You can: + + |
+value01 + |
+
You can quickly locate a tagged cluster using tags.
+You can only enter a tag key or value that exists in the drop-down list. If no tag key or value is available, create a tag for the cluster. For details, see Adding a Tag to a Cluster.
+If the connection pool mechanism is used during application development, the following specifications must be met. Otherwise, connections in the connection pool have statuses, which will affect the correctness of subsequent operations on the connection pool.
+This section describes how to use a database client to connect to the database in a GaussDB(DWS) cluster. In the following example, the Data Studio client tool is used for connection through the public network address. You can also use other SQL clients to connect to the cluster. For more connection methods, see Methods of Connecting to a Cluster.
+If you use the client to connect to the cluster for the first time, use the database administrator username and password set in Step 2: Creating a Cluster to connect to the default database gaussdb.
+The public network address will be used in Connecting to the Cluster Database Using Data Studio.
+In the Windows operating system, you can download the required JDK version from the official website of JDK, and install it by following the installation guide.
+If clusters of different versions are available, you will download the Data Studio tool matching the earliest cluster version after clicking Download. If there is no cluster, you will download the Data Studio tool of the earliest version after clicking Download. GaussDB(DWS) clusters are compatible with earlier versions of Data Studio tools.
++
Parameter + |
+Description + |
+Example + |
+
---|---|---|
Database Type + |
+Select GaussDB A. + |
+GaussDB A + |
+
Connection Name + |
+Name of a connection + |
+dws-demo + |
+
Host + |
+IP address (IPv4) or domain name of the cluster to be connected + |
+- + |
+
Host Port + |
+Database port + |
+8000 + |
+
Database Name + |
+Database name + |
+gaussdb + |
+
User Name + |
+Username for connecting to the database + |
+- + |
+
Password + |
+Password for logging in to the database to be connected + |
+- + |
+
Save Password + |
+Select an option from the drop-down list: +
|
+- + |
+
Enable SSL + |
+If Enable SSL is selected, the client can use SSL to encrypt connections. The SSL mode is more secure than common modes, so you are advised to enable SSL connection. + |
+- + |
+
When Enable SSL is selected, download and decompress the SSL certificate. For details, see (Optional) Downloading the SSL Certificate. Click the SSL tab and configure the following parameters:
+ +Parameter + |
+Description + |
+
---|---|
Client SSL Certificate + |
+Select the sslcert\client.crt file in the decompressed SSL certificate directory. + |
+
Client SSL Key + |
+Only the PK8 format is supported. Select the sslcert\client.key.pk8 file in the directory where the SSL certificate is decompressed. + + |
+
Root Certificate + |
+When SSL Mode is set to verify-ca, the root certificate must be configured. Select the sslcert\cacert.pem file in the decompressed SSL certificate directory. + |
+
SSL Password + |
+Set the password for the client SSL key in PK8 format. + |
+
SSL Mode + |
+Supported SSL modes include: +
GaussDB(DWS) does not support the verify-full mode. + |
+
If SSL is enabled, click Continue in the displayed Connection Security Alert dialog box.
+After the login is successful, the RECENT LOGIN ACTIVITY dialog box is displayed, indicating that Data Studio is connected to the database. You can run the SQL statement in the window on the Data Studio page.
+For details about how to use other functions of Data Studio, press F1 to view the Data Studio user manual.
+Log in to the GaussDB(DWS) management console. In the navigation tree on the left, choose Clusters. In the cluster list, locate the required cluster and click its name. The Basic Information page is displayed.
+ +On a cluster's Basic Information page, you can view the following information:
+Parameter + |
+Description + |
+
---|---|
Cluster Name + |
+Cluster name specified when a cluster is created. + |
+
Cluster Status + |
+Cluster running status. For details, see Cluster Status. + |
+
Parameter Configuration Status + |
+Parameter configuration status of a cluster. + |
+
Task Information + |
+Cluster task status. For details, see Cluster Task Information. + |
+
Cluster ID + |
+ID of the cluster. + |
+
Nodes + |
+Number of nodes in the cluster. + |
+
Cluster Version + |
+Cluster version information. + |
+
Used Storage Capacity + |
+Used storage capacity of the cluster. + |
+
Created + |
+Time when the cluster was created. + |
+
Last Snapshot Created + |
+Time when the last snapshot was created. + |
+
Maintenance Window + |
+Maintenance window of the cluster. +You can click Configure on the right of Maintenance Window to configure the maintenance window. For more information, see Configuring the Maintenance Window. + |
+
Enterprise Project + |
+Enterprise project to which a cluster belongs. You can click the enterprise project name to view and edit it on the console of the Enterprise Project service. + |
+
Parameter + |
+Description + |
+
---|---|
Default Database + |
+Database name specified when the cluster is created. When you connect to the cluster for the first time, connect to the default database. + |
+
Initial Administrator + |
+Database administrator specified during cluster creation. When you connect to the cluster for the first time, you need to use the initial database administrator and password to connect to the default database. + |
+
Port + |
+Port for accessing the cluster database over the public network or private network. The host port is specified when a cluster is created and used to listen to client connections. + |
+
Connection String + |
+Connection string. You can click View Details to check the data warehouse connection information. Its value can be: +
|
+
ELB Address + |
+To achieve high availability and avoid single-CN failures, a new cluster needs to be bound to ELB. You are advised to use the ELB address to connect to the cluster. + |
+
Private Network Domain Name + |
+Name of the domain for accessing the database in the cluster over the private network. The private network domain address is automatically generated when a cluster is created. The default name format is ClusterName.dws.otc-tsi.de. When you access a data warehouse cluster using a domain name, the domain name resolver provides the load balancing function. + NOTE:
+If the cluster name does not comply with the domain name standards, the prefix of the default access domain name will be adjusted accordingly. +You can click Modify to change the private network domain name. The access domain name contains 4 to 63 characters, which consists of letters, digits, and hyphens (-), and must start with a letter. +For details, see Managing Access Domain Names. + |
+
Private Network IP Address + |
+IP address for accessing the database in the cluster over the private network. + NOTE:
+
|
+
Public Network Domain Name + |
+Name of the domain for accessing the database in the cluster over the public network. +For details, see Managing Access Domain Names. + |
+
Public Network IP Address + |
+IP address for accessing the database in the cluster over the public network. + NOTE:
+
|
+
Parameter + |
+Description + |
+
---|---|
Node Flavor + |
+Node flavor of the cluster. + |
+
Node Specifications + |
+Specifications of the node flavor. + |
+
Parameter + |
+Description + |
+
---|---|
Region + |
+Current working zone of the cluster. + |
+
AZ + |
+AZ selected during cluster creation. + |
+
VPC + |
+VPC selected during cluster creation. +A VPC is a secure, isolated, and logical network environment. +After a data warehouse cluster is created, its VPC cannot be changed. However, you can edit and modify the current VPC. You can click the VPC name to go to the VPC details page to configure it. For details about VPC operations, see VPC and Subnet in the Virtual Private Cloud User Guide. + |
+
Subnet + |
+Subnet selected during cluster creation. +A subnet provides dedicated network resources that are isolated from other networks, improving network security. +After a data warehouse cluster is created, its subnet cannot be changed. However, you can edit and modify the current subnet. You can click the subnet name to go to the subnet details page to configure it. For details about subnet operations, see VPC and Subnet > Modifying a Subnet in the Virtual Private Cloud User Guide. + |
+
Security Group + |
+Security group selected during cluster creation. +After a data warehouse cluster is created, its security group cannot be changed. However, you can edit and modify the current security group, and add, delete, or modify rules in it. +You can click the security group name to go to the security group details page to configure it. For details about security group operations, see Security > Security Group in the Virtual Private Cloud User Guide. + |
+
Parameter + |
+Description + |
+
---|---|
Key Name + |
+Indicates the database encryption key of the cluster when Encrypt DataStore is enabled. + |
+
Last Key Rotation Time + |
+Indicates the time when the last encryption key is rotated when Encrypt DataStore is enabled. + |
+
An enterprise project is a cloud resource management mode. Enterprise Management provides users with comprehensive management in cloud-based resources, personnel, and permissions. Unlike common management consoles that feature independent control and configuration of cloud products, the Enterprise Management console is oriented to resource management. It helps enterprises with cloud-based management in resources, personnel, and permissions in the hierarchy of companies, departments, and projects.
+You can select an enterprise project during cluster creation to associate it with the cluster. For details, see Creating a Cluster. The Enterprise Project drop-down list displays the projects you created. In addition, the system has a built-in enterprise project (default). If you do not select an enterprise project for the cluster, the default project is used.
+During cluster creation, if the cluster is successfully bound to an enterprise project, the cluster will be successfully created. If the binding fails, the system sends an alarm and the cluster fails to be created.
+Snapshots of a cluster retain the association between the cluster and its enterprise project. When the cluster is restored, the association is also restored.
+When you delete a cluster, the association between the cluster and its enterprise project is automatically deleted.
+After a cluster is created, you can view the associated enterprise project in the cluster list and Basic Information page. You can query only the cluster resources of the project on which you have the access permission.
+In the cluster list on the Clusters page, view the enterprise project to which the cluster belongs.
+In the cluster list, find the target cluster and click the cluster name. The Basic Information page is displayed, on which you can view the enterprise project associated with the cluster. Click the enterprise project name to view and edit it on the Enterprise Management console.
+When querying the resource list of a specified project on the Enterprise Management console, you can also query the GaussDB(DWS) resources.
+Log in to the GaussDB(DWS) management console, choose Clusters, click All projects above the cluster list, and select the required project name from the drop-down list to view all clusters associated with the project.
+A GaussDB(DWS) cluster can be associated with only one enterprise project. After a cluster is created, you can migrate it from its current enterprise project to another one on the Enterprise Management console, or migrate the cluster from another enterprise project to a specified enterprise project. After the migration, the cluster is associated with the new enterprise project. The association between the cluster and the original enterprise project is automatically released. For details, see "Resource Management > Managing Enterprise Project Resources" in the Enterprise Management User Guide.
+This section is organized as follows:
+ +A tracker will be automatically created after CTS is enabled. All traces recorded by CTS are associated with a tracker. Currently, only one tracker can be created for each account.
+If you are a first-time CTS user and do not have any trackers in the tracker list, enable CTS first. For details, see "Getting Started > Enabling CTS" in the Cloud Trace Service User Guide.
+If you have enabled CTS, the system has automatically created a management tracker. Only one management tracker can be created and it cannot be deleted. You can also manually create a data tracker. For details, see "Tracker Management > Creating a Tracker" in the Cloud Trace Service User Guide.
+If you want to disable the audit log function, disable the tracker in CTS.
+For details about how to enable or disable a tracker, see "Tracker Management > Disabling or Enabling a Tracker" in the Cloud Trace Service User Guide.
+With CTS, you can record operations associated with GaussDB(DWS) for later query, audit, and backtrack operations.
+ +Operation + |
+Resource + |
+Event Name + |
+
---|---|---|
Creating/Restoring a cluster + |
+cluster + |
+createCluster + |
+
Deleting a cluster + |
+cluster + |
+deleteCluster + |
+
Scaling out a cluster + |
+cluster + |
+growCluster + |
+
Restarting a cluster + |
+cluster + |
+rebootCluster + |
+
Creating a snapshot + |
+backup + |
+createBackup + |
+
Deleting a snapshot + |
+backup + |
+deleteBackup + |
+
Setting security parameters + |
+configurations + |
+updateConfigurations + |
+
Creating an MRS data source + |
+dataSource + |
+createExtDataSource + |
+
Deleting an MRS data source + |
+dataSource + |
+deleteExtDataSource + |
+
Updating an MRS data source + |
+dataSource + |
+updateExtDataSource + |
+
The following filters are available:
+For details about the key fields in the CTS trace structure, see "Trace References > Trace Structure" and "Trace References > Example Traces" in the Cloud Trace Service User Guide.
+To facilitate database parameter configuration, GaussDB(DWS) provides the parameter template function. A parameter template contains some common database parameters. You can manage parameter templates on the GaussDB(DWS) management console. After applying a parameter template to a cluster, you can modify parameters on the parameter modification page of the cluster.
+The following parts are included in this section:
+A parameter template is a set of parameters applicable to data warehouses. All parameters in the template have default values. The parameters include the session timeout interval, date, and time format. For details, see Parameters. You can adjust parameter values to better adapt the database to actual services. When creating a cluster, you can specify a parameter template for it. Parameters in the template will be applied to all databases in the cluster. If you do not specify a parameter template, the system applies the default parameter template to the cluster. After a cluster is created, you can modify the parameters on the Parameter Modifications page. Alternatively, select an existing parameter template or create a parameter template on the Parameter Template Management page and apply it to the cluster.
+GaussDB(DWS) presets a default parameter template to data warehouses of each version. The default parameter template cannot be deleted and modified. If you want to modify parameter values in the template, create a customized parameter template. The parameters in the customized template can be modified. After a customized parameter template is applied to a cluster, it is not associated with the cluster. If you modify the parameter values in the template, the modifications will not be synchronized to the cluster. You need to apply the template to the cluster again, and then the modified parameter values can be applied to the cluster. Similarly, if you modify parameters on the cluster details page, the modifications will not be synchronized to the parameter template.
+The default values of the following parameters are for reference only. For more information, see "Setting GUC Parameters".
+The parameter template only contains three parameters. These parameters will take effect on a cluster during cluster installation. You can check more parameters on the cluster parameter modification page of the console. For details, see Modifying Database Parameters.
+ +Parameter + |
+Description + |
+Default Value + |
+
---|---|---|
timezone + |
+Sets the time zone displayed in the time stamps. + |
+UTC + |
+
log_timezone + |
+Sets the time zone for timestamps in the server log. + |
+UTC + |
+
password_encryption_type + |
+Specifies the encryption type of user passwords. +
|
+1 + |
+
If parameters in the default parameter template cannot meet service requirements, you can customize a parameter template and change the parameter values to better adapt to services.
+To create a parameter template, perform the following steps:
+Enter 4 to 64 characters. Only letters, digits, hyphens (-), underscores (_), and periods (.) are allowed. The value must start with a letter. Letters are case-insensitive.
+The parameter template description contains 0 to 256 characters and does not support special characters !<>'=&".
+The Database Engine and Database Version selected during parameter template creation must be the same as the cluster type and version of the parameter template to be applied.
+You can modify the parameter values in a customized parameter template but cannot modify the parameter values in the default parameter template.
+After a cluster is created, you can apply a new parameter template to the cluster so that the values of all parameters in the parameter template can take effect in the cluster.
+To apply a parameter template, perform the following steps:
+You can apply the selected parameter template to the cluster corresponding to the parameter template version.
+If some parameter values in the new parameter template are different from the original parameter values in the cluster, a window comparing the differences will be displayed.
+You can delete an unnecessary parameter template or a parameter template that is no longer used. The default parameter template cannot be deleted. Deleted parameter templates cannot be restored. Exercise caution when performing this operation.
+The gsql command line client provided by GaussDB(DWS) runs on the Linux OS. Before using it to remotely connect to a GaussDB(DWS) cluster, you need to prepare a Linux host for installing and running the gsql client. If you use a public network address to access the cluster, you can install the gsql client on your own Linux host. Ensure that the Linux host has a public network address. For your convenience, you are advised to create a Linux ECS. This section describes how to prepare an ECS. If you already have a qualified ECS, skip this section.
+For details about how to create an ECS, see "Getting Started > Creating an ECS" in the Elastic Cloud Server User Guide.
+The created ECS must meet the following requirements:
+There is no special requirement for the image's specifications. The image's OS must be one of the following Linux OSs supported by the gsql client:
+For details about VPC operations, see "VPC and Subnet" in the Virtual Private Cloud User Guide.
+When creating an ECS, set EIP to Automatically assign or Specify.
+For details about security group operations, see "Security Group" in the Virtual Private Cloud User Guide.
+Ensure that the security group of the ECS contains rules meeting the following requirements. If the rules do not exist, add them to the security group:
+When you use the JDBC application program to connect to a cluster, set the IAM username, credential, and other information as you configure the JDBC URL. After doing this, when you try to access a database, the system will automatically generate a temporary credential and a connection will be set up.
+Currently, only clusters whose version is 1.3.1 or later and their corresponding JDBC driver provided by GaussDB(DWS) can access the databases in IAM authentication mode. Download the JDBC driver. For details, see Downloading the JDBC or ODBC Driver.
+Parameter + |
+Description + |
+
---|---|
url + |
+gsjdbc4.jar/gsjdbc200.jar database connection descriptor. The JDBC API does not provide the connection retry capability. You need to implement the retry processing in the service code. The URL example is as follows: +jdbc:dws:iam://dws-IAM-demo:eu-de/gaussdb?AccessKeyID=XXXXXXXXXXXXXXXXXXXX&SecretAccessKey=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX&DbUser=user_test&AutoCreate=true
+JDBC URL parameters: +
|
+
info + |
+Database connection properties. Common properties include the following: +
|
+
1 + 2 + 3 + 4 + 5 + 6 + 7 + 8 + 9 +10 +11 +12 +13 +14 +15 +16 +17 +18 +19 +20 +21 +22 +23 +24 +25 +26 +27 +28 +29 +30 +31 +32 +33 +34 | //The following uses gsjdbc4.jar as an example. +//The following encapsulates the database connection obtaining operations into an API. You can connect to the database by specifying the region where the cluster is located, cluster name, access key ID, secret access key, and the corresponding IAM username. +public static Connection GetConnection(String clustername, String regionname, String AK, String SK, String username) + { + //Driver class + String driver = "org.postgresql.Driver"; + // Database connection descriptor. + String sourceURL = "jdbc:dws:iam://" + clustername + ":" + regionname + "/gaussdb?" + "AccessKeyID=" + AK + "&SecretAccessKey=" + SK + "&DbUser=" + username + "&autoCreate=true"; + + Connection conn = null; + + try + { + //Load the driver. + Class.forName(driver); + } + catch( Exception e ) + { + return null; + } + + try + { + //Create a connection. + conn = DriverManager.getConnection(sourceURL); + System.out.println("Connection succeed!"); + } + catch(Exception e) + { + return null; + } + + return conn; + }; + |
GaussDB(DWS) allows you to access databases using IAM authentication. When you use the JDBC application program to connect to a cluster, set the IAM username, credential, and other information as you configure the JDBC URL. After doing this, when you try to access a database, the system will automatically generate a temporary credential and a connection will be set up.
+IAM supports two types of user credential: password and Access Key ID/Secret Access Key (AK/SK). JDBC connection requires the latter.
+The IAM account you use to access a database must be granted with the DWS Database Access permission. Only users with both the DWS Administrator and DWS Database Access permissions can connect to GaussDB(DWS) databases using the temporary database user credentials generated based on IAM users.
+The process of accessing a database is as follows:
+ +The IAM account you use to access a database must be granted with the DWS Database Access permission. Only users with both the DWS Administrator and DWS Database Access permissions can connect to GaussDB(DWS) databases using the temporary database user credentials generated based on IAM users. Using the DWS Database Access permission helps to control access to databases.
+The DWS Database Access permission can only be granted to user groups. Ensure that your IAM account is in a user group with this permission.
+On IAM, only users in the admin group have the permissions to manage users. This requires that your IAM account be in the admin user group. Otherwise, contact the IAM account administrator to grant your IAM account this permission.
+Only users in the admin user group of IAM can perform this step. In IAM, only users in the admin user group can manage users, including creating user groups and users and setting user group rights.
+For details, see "User and User Group Management > Viewing or Modifying User Group Information" in the Identity and Access Management User Guide.
+You can also create an IAM user group, and set a policy for, grant the DWS Administrator and DWS Database Access permissions to, and add your IAM user to it. For details, see "User and User Group Management > Creating a User Group" in the Identity and Access Management User Guide.
+You can log in to the management console to create an AK/SK pair or use an existing one.
+Log in to the management console, move your cursor over your account in the upper right corner, and choose My Credential. Click the Access Keys tab. On the Access Keys tab page, you can view the existing AKs or click Add Access Key to create an AK/SK pair.
+The AK/SK pair is so important that you can download the private key file containing the AK/SK information only when you create the pair. On the management console, you can only view the AKs. If you have not downloaded the file, create an AK/SK pair again.
+Each user can create a maximum of two AK/SK pairs, which are valid permanently. To ensure account security, change your AK/SK pairs periodically and keep them safe.
+If you have created a GaussDB(DWS) cluster, you can use the SQL client tool or a third-party driver such as JDBC or ODBC to connect to the cluster and access the database in the cluster.
+The procedure for connecting to a cluster is as follows:
+The execution of SQL statements takes a long time, resulting in great resource consumption.
+If the execution efficiency of SQL statements is low, optimization suggestions are provided after the kernel executes the SQL statements. You can query the execution history to retrieve optimization suggestions and further optimize SQL statements to improve query efficiency.
+Time-consuming SQL statements exist.
+On the Top 5 Time-Consuming Queries page directed from the Cluster Overview page, record the change of top 5 time-consuming queries.
+Analyze the frequency of top 5 queries to locate slow queries.
+A domain name is a string of characters separated by dots to identify the location of a computer or a computer group on the Internet, for example, www.example.com. You can enter a domain name in the address box of the web browser to access a website or web application.
+On GaussDB(DWS), you can access clusters using the private network domain name or the public network domain name.
+Private network domain name: Name of the domain for accessing the database in the cluster through the private network. The private network domain name is automatically generated when you create a cluster. The default naming rule is cluster name.dws.otc-tsi.de. If the cluster name does not comply with the domain name standards, the prefix of the default access domain name will be adjusted accordingly.
+Public network domain name: Name of the domain for accessing the database in the cluster through the public network. If a cluster is not bound to an EIP, it cannot be accessed using the public network domain name. If you bind an EIP during cluster creation, the public network domain name is automatically generated. The default naming rule is cluster name.dws.t-systems.com.
+After a cluster is created, you can set private and public domain names for accessing the cluster as required. The operations are as follows:
+The private network domain name is automatically generated during cluster creation. After the cluster is created, you can modify the default domain name based on site requirements.
+To modify the private network domain name, perform the following steps:
+The private network domain name contains 4 to 63 characters, which consists of letters, digits, and hyphens (-) and must start with a letter.
+After the domain name is modified, click copy button next to the private network domain name to copy it.
A cluster is not bound to an EIP by default during cluster creation. That is, cluster access using the public network is disabled. After a cluster is created, if you want to access it over the public network, bind an EIP to the cluster and create a public network domain name.
+To create a public network domain name, perform the following steps:
+If no available EIPs are displayed, click View EIP to go to the Elastic IP page and create an EIP that satisfies your needs. After the new EIP is created, click the refresh icon next to the drop-down list. The newly created EIP will be displayed in the EIP drop-down list.
+After the EIP is bound successfully, the specific public network IP address is displayed in the Database Attribute area.
+The public network domain name contains 4 to 63 characters, which consists of letters, digits, and hyphens (-) and must start with a letter.
+The specific public network domain name is displayed in the Database Attribute area after being created. Click copy button to copy the public network domain name.
If you bind an EIP during cluster creation, the public network domain name is automatically generated. After a cluster is created, you can modify the public network domain name as required.
+To modify the public network domain name, perform the following steps:
+After a cluster is created, you can release unnecessary public network domain names.
+To do so, perform the following steps:
+GaussDB(DWS) records information (audit logs) about connections and user activities in your database. With the information, you can monitor the database to ensure security and facilitate fault troubleshooting and historical operation record locating. These audit logs are stored in the database by default. You can also dump them to OBS so that users who are responsible for monitoring the database can view the logs more conveniently.
+You can perform the following operations on the GaussDB(DWS) console:
+After a data warehouse cluster is created, you can enable audit log dump for it to dump audit logs to OBS.
+Before enabling audit log dump, ensure that the following conditions are met:
+The procedure is as follows:
+ indicates that the function is enabled.
indicates that the function is disabled.
When you enable audit log dump for a project in a region for the first time, the system prompts you to create an agency named DWSAccessOBS. After the agency is created, GaussDB(DWS) can dump audit logs to OBS. By default, only cloud accounts or users with Security Administrator permissions can create agencies. IAM users under an account do not have the permission for creating agencies by default. Contact a user with the permission and complete the authorization on the current page.
+If Configuration Status is Applying, the system is saving the settings.
+Wait for a moment and then refresh Configuration Status. When Configuration Status is Synchronized, the configuration is saved and takes effect.
+After audit log dump is enabled, you can modify the dump configurations, for example, modifying the OBS bucket, path, and dump interval.
+The procedure is as follows:
+If Configuration Status is Applying, the system is saving the settings.
+Wait for a moment and then refresh Configuration Status. When Configuration Status is Synchronized, the configuration is saved and takes effect.
+After audit log dump is enabled, you can view the dumped audit logs on OBS.
+The procedure is as follows:
+You can download and decompress the files to view. The fields of audit log files are described as follows:
+ +Name + |
+Description + |
+
---|---|
time + |
+Indicates the operation time. + |
+
type + |
+Indicates the operation type. + |
+
result + |
+Indicates the operation result. + |
+
username + |
+Indicates the name of the user who initiates the operation. + |
+
database + |
+Indicates the database name. + |
+
client_conninfo + |
+Indicates the client connection information. + |
+
object_name + |
+Indicates the operation object name. + |
+
detail_info + |
+Indicates the detailed information about the operation. + |
+
node_name + |
+Indicates the node name. + |
+
thread_id + |
+Indicates the thread ID. + |
+
local_port + |
+Indicates the local port. + |
+
remote_port + |
+Indicates the remote port. + |
+
You can disable audit log dumps if you do not want to dump audit logs to OBS.
+The procedure is as follows:
+ indicates that the function is disabled.
If Configuration Status is Applying, the system is saving the settings.
+Wait for a moment and then refresh Configuration Status. When Configuration Status is Synchronized, the configuration is saved and takes effect.
+If you need to assign different permissions to employees in your enterprise to access your cloud GaussDB(DWS) resources, IAM is a good choice for fine-grained permissions management. IAM provides identity authentication, permissions management, and access control, helping you secure access to your cloud resources.
+With IAM, you can use your cloud account to create IAM users for your employees, and assign permissions to the users to control their access to specific resource types. For example, some software developers in your enterprise need to use GaussDB(DWS) resources but must not delete them or perform any high-risk operations. To this end, you can create IAM users for the software developers and grant them only the permissions required for using GaussDB(DWS) resources.
+If your cloud account does not need individual IAM users for permissions management, you may skip this section.
+IAM can be used free of charge. You pay only for the resources in your account. For more information about IAM, see "Service Overview" in the Identity and Access Management User Guide.
+By default, new IAM users do not have permissions assigned. You need to add a user to one or more groups, and attach permissions policies or roles to these groups. Users inherit permissions from the groups to which they are added and can perform specified operations on cloud services.
+GaussDB(DWS) is a project-level service deployed and accessed in specific physical regions. To assign GaussDB(DWS) permissions to a user group, specify the scope as region-specific projects and select projects for the permissions to take effect. If All projects is selected, the permissions will take effect for the user group in all region-specific projects. When accessing GaussDB(DWS), the users need to switch to a region where they have been authorized to use GaussDB(DWS).
+Role/Policy Name + |
+Description + |
+Category + |
+Dependencies + |
+
---|---|---|---|
DWS ReadOnlyAccess + |
+Read-only permissions for GaussDB(DWS). Users granted these permissions can only view GaussDB(DWS) data. + |
+System-defined policy + |
+N/A + |
+
DWS FullAccess + |
+Administrator permissions for GaussDB(DWS). Users granted these permissions can perform all operations on GaussDB(DWS). + |
+System-defined policy + |
+N/A + |
+
DWS Administrator + |
+Administrator permissions for GaussDB(DWS). Users granted these permissions can perform operations on all GaussDB(DWS) resources. +
|
+System-defined role + |
+Dependent on the Tenant Guest and Server Administrator policies, which must be assigned in the same project as the DWS Administrator policy. + |
+
DWS Database Access + |
+GaussDB(DWS) database access permission. Users with this permission can generate the temporary database user credentials based on IAM users to connect to the database in the data warehouse cluster. + |
+System-defined role + |
+Dependent on the DWS Administrator policy, which must be assigned in the same project as the DWS Database Access policy. + |
+
Table 2 lists the common operations supported by each system-defined policy or role of GaussDB(DWS). Choose appropriate policies or roles as required.
+Operation + |
+DWS FullAccess + |
+DWS ReadOnlyAccess + |
+DWS Administrator + |
+DWS Database Access + |
+
---|---|---|---|---|
Creating/Restoring clusters + |
+√ + |
+x + |
+√ + |
+x + |
+
Obtaining the cluster list + |
+√ + |
+√ + |
+√ + |
+√ + |
+
Obtaining the details of a cluster + |
+√ + |
+√ + |
+√ + |
+√ + |
+
Setting automated snapshot policy + |
+√ + |
+x + |
+√ + |
+x + |
+
Setting security parameters/parameter groups + |
+√ + |
+x + |
+√ + |
+x + |
+
Restarting clusters + |
+√ + |
+x + |
+√ + |
+x + |
+
Scaling out clusters + |
+√ + |
+x + |
+√ + |
+x + |
+
Resetting passwords + |
+√ + |
+x + |
+√ + |
+x + |
+
Applying parameter templates to clusters + |
+√ + |
+x + |
+√ + |
+x + |
+
Deleting clusters + |
+√ + |
+x + |
+√ + |
+x + |
+
Configuring maintenance windows + |
+√ + |
+x + |
+√ + |
+x + |
+
Binding EIPs + |
+√ + |
+x + |
+√ + |
+x + |
+
Unbinding EIPs + |
+√ + |
+x + |
+√ + |
+x + |
+
Creating DNS domain names + |
+√ + |
+x + |
+√ + |
+x + |
+
Releasing DNS domain names + |
+√ + |
+x + |
+√ + |
+x + |
+
Modifying DNS domain names + |
+√ + |
+x + |
+√ + |
+x + |
+
Creating MRS connections + |
+√ + |
+x + |
+√ + |
+x + |
+
Updating MRS connections + |
+√ + |
+x + |
+√ + |
+x + |
+
Deleting MRS connections + |
+√ + |
+x + |
+√ + |
+x + |
+
Adding/Deleting tags + |
+√ + |
+x + |
+√ + |
+x + |
+
Editing tags + |
+√ + |
+x + |
+√ + |
+x + |
+
Creating snapshots + |
+√ + |
+x + |
+√ + |
+x + |
+
Obtaining the snapshot list + |
+√ + |
+√ + |
+√ + |
+√ + |
+
Deleting snapshots + |
+√ + |
+x + |
+√ + |
+x + |
+
Copying snapshots + |
+√ + |
+x + |
+√ + |
+x + |
+
Creating parameter templates + |
+√ + |
+x + |
+√ + |
+x + |
+
Deleting parameter templates + |
+√ + |
+x + |
+√ + |
+x + |
+
Modifying parameter templates + |
+√ + |
+x + |
+√ + |
+x + |
+
An RBAC policy consists of a Version, a Statement, and Depends.
+When selecting a policy for a user group, click below the policy to view the details of the policy. The DWS Administrator policy is used as an example to describe the syntax of RBAC policies.
{ + "Version": "1.0", + "Statement": [ + { + "Effect": "Allow", + "Action": [ + "dws:dws:*" + ] + } + ], + "Depends": [ + { + "catalog": "BASE", + "display_name": "Server Administrator" + }, + { + "catalog": "BASE", + "display_name": "Tenant Guest" + } + ] +}+ +
Parameter + |
+Meaning + |
+Value + |
+|
---|---|---|---|
Version + |
+Policy version + |
+The value is fixed to 1.0. + |
+|
Statement + |
+Action + |
+Operations to be performed on GaussDB(DWS) + |
+Format: Service name:Resource type:Operation. +dws:dws:*: Permissions for performing all operations on all resource types in GaussDB(DWS). + |
+
Effect + |
+Whether the operation defined in an action is allowed + |
+
|
+|
Depends + |
+catalog + |
+Name of the service to which dependencies of a policy belong + |
+Service name +Example: BASE + |
+
display_name + |
+Name of a dependent policy + |
+Policy name +Example: Server Administrator + |
+
When using RBAC for authentication, pay attention to the Depends parameter and grant other dependent permissions at the same time.
+For example, the DWS Administrator permission depends on the Server Administrator and Tenant Guest permissions. When granting the DWS Administrator permission to users, you also need to grant the two dependent permissions to the users.
+A snapshot is a full or incremental backup of a GaussDB(DWS) cluster at a specific point in time. It records the current database data and cluster information, including the number of nodes, node specifications, and database administrator name. Snapshots can be created manually or automatically. For details, see Manual Snapshots and Automated Snapshots.
+When a snapshot is used for restoration, GaussDB(DWS) creates a new cluster based on the cluster information recorded in the snapshot and restores data from the snapshot. For details about how to restore a cluster from a snapshot, see Restoring a Snapshot to a New Cluster.
+After a cluster is created, you can modify the cluster's database parameters as required. On the GaussDB(DWS) management console, you can view or set common database parameters. For details, see Managing Parameter Templates. You can run SQL commands to view or set other database parameters. For details, see in the Data Warehouse Service Database Development Guide.
+You can modify parameters only when no task is running in the cluster.
+The following table describes part of the database parameters. You can search for and check more parameters by following the instructions in Procedure.
+Parameter + |
+Description + |
+Default Value + |
+
---|---|---|
session_timeout + |
+Specifies the timeout interval of an idle session, in seconds. The value 0 indicates that the timeout limit is disabled. The value ranges from 0 to 86400. + |
+600 + |
+
datestyle + |
+Sets the display format for date and time. + |
+ISO,MDY + |
+
failed_login_attempts + |
+Sets the number of consecutive incorrect password attempts after which the account is locked. The value 0 indicates that the number of incorrect password attempts is not limited. The value ranges from 0 to 1000. + |
+10 + |
+
timezone + |
+Sets the time zone displayed in the time stamps. + |
+UTC + |
+
log_timezone + |
+Sets the time zone for timestamps in the server log. + |
+UTC + |
+
enable_resource_record + |
+Specifies whether to enable resource recording. +If the actual execution time of an SQL statement is greater than the value of resource_track_duration (the default value is 60s; customizable), the monitoring information will be archived. +This function will cause storage space expansion and slightly affect system performance. Disable it when it is not required. + NOTE:
+
|
+off + |
+
query_dop + |
+Sets the Symmetric Multi-Processing (SMP) degree. +
|
+0 + |
+
resource_track_cost + |
+Sets the minimum execution cost for resource monitoring on statements. The value -1 indicates that resource monitoring is disabled (execution cost less than 10). If the value is greater than or equal to 0, and the cost of executing statements exceeds the value and is greater than or equal to 10, resource monitoring is performed. +You can run the SQL command Explain to query the estimated execution cost of an SQL statement. + |
+100000 + |
+
resource_track_duration + |
+Sets the minimum time for archiving executed statements recorded during real-time monitoring, in seconds. +
|
+60 + |
+
password_effect_time + |
+Sets the validity period of the account password. When the password is about to expire or has expired, the system prompts the user to change the password. +The value ranges from 0 to 999, in days. If this parameter is set to 0, the function is disabled. + |
+90 + |
+
update_lockwait_timeout + |
+Sets the maximum duration that a lock waits for concurrent updates on a row to complete. If the lock wait time exceeds the value, the system will report an error. If this parameter is set to 0, an error is reported immediately when a lock appears. The unit is milliseconds. + |
+120000 + |
+
enable_resource_track + |
+Specifies whether to enable resource monitoring. After you enable this function, SQL statements can be monitored. + |
+on + |
+
password_policy + |
+Specifies whether to check the password complexity when you create a GaussDB(DWS) account using CREATE ROLE/CREATE USER, or modify the account using ALTER ROLE/ALTER USER. +
|
+1 + |
+
password_reuse_time + |
+Specifies whether to check the password reuse interval when you modify the account password using ALTER USER/ALTER ROLE. The value ranges from 0 to 3650, in days. +
NOTE:
+The password_reuse_time and password_reuse_max parameters are checked during password change. +
|
+60 + |
+
password_reuse_max + |
+Specifies whether to check the number of password changes when you modify the account password using ALTER USER/ALTER ROLE. +
NOTE:
+The password_reuse_time and password_reuse_max parameters are checked during password change. +
|
+0 + |
+
password_lock_time + |
+Specifies the duration before a locked account is automatically unlocked. +
|
+1 + |
+
password_encryption_type + |
+Specifies the encryption type of user passwords. +
|
+2 + |
+
password_notify_time + |
+Specifies how many days in advance a user is notified before a password expires. +
|
+7 + |
+
enable_stateless_pooler_reuse + |
+Specifies whether to enable the pooler reuse mode. The setting takes effect after the cluster is restarted. +
NOTE:
+Set this parameter to the same value for CNs and DNs. If this parameter is set to off for CNs and on for DNs, the cluster communication fails. Restart the cluster for the setting to take effect. + |
+off + |
+
work_mem + |
+Specifies the amount of memory to be used by internal sort operations and hash tables before they write data into temporary disk files, in KB. +Sort operations are required for ORDER BY, DISTINCT, and merge joins. +Hash tables are used in hash joins, hash-based aggregation, and hash-based processing of IN subqueries. +In a complex query, several sort or hash operations may run in parallel; each operation will be allowed to use as much memory as this parameter specifies. If the memory is insufficient, data will be written into temporary files. In addition, several running sessions could be performing such operations concurrently. Therefore, the total memory used may be many times the value of work_mem. + |
+64MB + |
+
maintenance_work_mem + |
+Specifies the maximum amount of memory to be used by maintenance operations, such as VACUUM, CREATE INDEX, and ALTER TABLE ADD FOREIGN KEY, in KB. + NOTE:
+This parameter may affect the execution efficiency of VACUUM, VACUUM FULL, CLUSTER, and CREATE INDEX. + |
+128MB + |
+
enable_orc_cache + |
+Specifies whether to reserve 1/4 of cstore_buffers for storing ORC metadata when cstore_buffers is initialized. +
|
+on + |
+
sql_use_spacelimit + |
+Specifies the space size for files to be flushed to disks when a single SQL statement is executed on a single DN, in KB. The managed space includes the space occupied by ordinary tables, temporary tables, and intermediate result sets to be flushed to disks. -1 indicates no limit. + |
+-1 + |
+
enable_bitmapscan + |
+Specifies whether to enable the optimizer's use of bitmap-scan plan types. +
|
+on + |
+
enable_hashagg + |
+Specifies whether to enable the optimizer's use of hash aggregation plan types. +
|
+on + |
+
enable_hashjoin + |
+Specifies whether enable the optimizer's use of hash join plan types. +
|
+on + |
+
enable_indexscan + |
+Specifies whether to enable the optimizer's use of index-scan plan types. +
|
+on + |
+
enable_indexonlyscan + |
+Specifies whether to enable the optimizer's use of index-only-scan plan types. +
|
+on + |
+
enable_mergejoin + |
+Specifies whether the optimizer's use of merge-join plan types. +
|
+off + |
+
enable_nestloop + |
+Specifies whether the optimizer's use of nested-loop-join plan types. It is impossible to suppress nested-loop joins entirely, but disabling this parameter encourages the optimizer to choose other methods if available. +
|
+off + |
+
enable_seqscan + |
+Specifies whether enable the optimizer's use of sequential-scan plan types. It is impossible to suppress sequential scans entirely, but disabling this parameter encourages the optimizer to choose other methods if available. +
|
+on + |
+
enable_tidscan + |
+Specifies whether enable the optimizer's use of TID scan plan types. +
|
+on + |
+
enable_kill_query + |
+In CASCADE mode, when a user is deleted, all the objects belonging to the user are deleted. This parameter specifies whether the queries of the objects belonging to the user can be unlocked when the user is deleted. +
|
+off + |
+
enable_vector_engine + |
+Specifies whether to enable the optimizer's use of vectorized execution engines. +
|
+on + |
+
enable_broadcast + |
+Specifies whether to enable the optimizer's use of broadcast distribution when it evaluates the cost of stream. +
|
+on + |
+
skew_option + |
+Specifies whether to enable an optimization policy. +
|
+normal + |
+
default_statistics_target + |
+Specifies the default statistics target for table columns without a column-specific target set via ALTER TABLE SET STATISTICS. If this parameter is set to a positive number, it indicates the number of samples of statistics information. If this parameter is set to a negative number, percentage is used to set the statistic target. The negative number converts to its corresponding percentage, for example, -5 means 5%. + |
+100 + |
+
enable_codegen + |
+Specifies whether to enable code optimization. Currently, LLVM optimization is used. +
|
+on + |
+
autoanalyze + |
+Specifies whether to automatically collect statistics on tables that have no statistics when a plan is generated. +
NOTE:
+
|
+off + |
+
enable_sonic_hashagg + |
+Specifies whether to enable the hash aggregation operator designed for column-oriented hash tables when certain constraints are met. +
|
+on + |
+
log_hostname + |
+By default, connection log messages only show the IP address of the connecting host. The host name can be recorded when this parameter is set to on. It may take some time to parse the host name. Therefore, the database performance may be affected. +
|
+off + |
+
max_active_statements + |
+Specifies the maximum number of concurrent jobs. This parameter applies to all the jobs on one CN. The values -1 and 0 indicate that the number of concurrent jobs is not limited. + |
+60 + |
+
enable_resource_track + |
+Specifies whether to enable resource monitoring. + |
+on + |
+
resource_track_level + |
+Sets the resource monitoring level of the current session. This parameter is valid only when enable_resource_track is set to on. +
|
+query + |
+
enable_dynamic_workload + |
+Specifies whether to enable dynamic load management. +
|
+on + |
+
topsql_retention_time + |
+Specifies the data storage retention period of the gs_wlm_session_info and gs_wlm_operator_info catalogs in historical top SQL statements. The unit is day. +
|
+0 + |
+
track_counts + |
+Specifies whether to enable collection of statistics on database activities. +
|
+off + |
+
autovacuum + |
+Specifies whether to enable the autovacuum process. track_counts must be set to on for autovacuum to work. +
|
+off + |
+
autovacuum_mode + |
+Specifies the autovacuum mode. autovacuum must be set to on. +
|
+mix + |
+
autoanalyze_timeout + |
+Specifies the autoanalyze timeout period, in seconds. If the duration of autoanalyze on a table exceeds the value of autoanalyze_timeout, the autoanalyze operation is automatically canceled. + |
+5min + |
+
autovacuum_io_limits + |
+Specifies the maximum number of I/Os triggered by the autovacuum process per second. –1 indicates that the default cgroup is used. + |
+-1 + |
+
autovacuum_max_workers + |
+Specifies the maximum number of concurrent autovacuum threads. 0 indicates that autovacuum is disabled. + |
+3 + |
+
autovacuum_naptime + |
+Specifies the interval between two autovacuum operations, in seconds. + |
+10min + |
+
autovacuum_vacuum_threshold + |
+Specifies the threshold for triggering VACUUM. When the number of deleted or updated records in a table exceeds the specified threshold, the VACUUM operation is executed on this table. + |
+50 + |
+
autovacuum_analyze_threshold + |
+Specifies the threshold for triggering ANALYZE. When the number of deleted, inserted, or updated records in a table exceeds the specified threshold, the ANALYZE operation is executed on this table. + |
+50 + |
+
autovacuum_analyze_scale_factor + |
+Specifies a fraction of the table size added to the autovacuum_analyze_threshold parameter when deciding whether to analyze a table. + |
+0.1 + |
+
statement_timeout + |
+Specifies the statement timeout interval, in milliseconds. When the execution time of a statement exceeds the value (starting from the time when the server receives the command), the statement reports an error and exits. + |
+0 + |
+
deadlock_timeout + |
+Specifies the deadlock timeout interval, in milliseconds. When the applied lock exceeds the value, the system will check whether a deadlock occurs. + |
+1s + |
+
lockwait_timeout + |
+Specifies the maximum wait time for a single lock, in milliseconds. If the lock wait time exceeds the value, the system will report an error. + |
+20min + |
+
max_query_retry_times + |
+Specifies the maximum number of automatic retry times when an SQL statement error occurs. Currently, a statement can start retrying if the following errors occur: Connection reset by peer, Lock wait timeout, and Connection timed out. If this parameter is set to 0, the retry function is disabled. + |
+6 + |
+
max_pool_size + |
+Specifies the maximum number of connections between the connection pool of a CN and another CN or DN. + |
+800 + |
+
enable_gtm_free + |
+Specifies whether the GTM-FREE mode is enabled. In large concurrency scenarios, the snapshots delivered by the GTM increase in number and size. The network between the GTM and the CN becomes the performance bottleneck. The GTM-FREE mode is used to eliminate the bottleneck. In this mode, the CN communicates with DNs instead of the GTM. The CN sends queries to each DN, which locally generates snapshots and XIDs, ensuring external write consistency but not external read consistency. + |
+off + |
+
enable_fast_query_shipping + |
+Specifies whether to enable the optimizer's use of a distributed framework. + |
+on + |
+
enable_crc_check + |
+Specifies whether to enable data checks. Check information is generated when table data is written and is checked when the data is read. You are not advised to modify the settings. + |
+on + |
+
explain_perf_mode + |
+Specifies the display format of explain. +
|
+pretty + |
+
udf_memory_limit + |
+Specifies the maximum physical memory that can be used when UDFs are executed on each CN and DN, in KB. + |
+200MB + |
+
default_transaction_read_only + |
+Specifies whether each newly created transaction is read only. +
|
+off + |
+
Before using GaussDB(DWS), make the following preparations:
+If you do not have a public cloud account, register one. If you already have an account with real-name authentication, skip this step and use the account.
+You must perform real-name authentication before enabling cloud services.
+For MRS, if the following parameter configurations of the HDFS cluster change, data may fail to be imported to the data warehouse cluster from the HDFS cluster. Before importing data using the HDFS cluster, you must update the MRS data source configuration.
+ +Parameter + |
+Description + |
+
---|---|
dfs.client.read.shortcircuit + |
+Specifies whether to enable the local read function. + |
+
dfs.client.read.shortcircuit.skip.checksum + |
+Specifies whether to skip data verification during the local read. + |
+
dfs.client.block.write.replace-datanode-on-failure.enable + |
+Specifies whether to replace the location storing copies with the new node when data blocks fail to be written to HDFS. + |
+
dfs.encrypt.data.transfer + |
+Specifies whether to enable data encryption. + NOTE:
+This parameter is available only for clusters with Kerberos authentication enabled. + |
+
dfs.encrypt.data.transfer.algorithm + |
+Specifies the encryption and decryption algorithm for key transmission. + |
+
dfs.encrypt.data.transfer.cipher.suites + |
+Specifies the encryption and decryption algorithm for the transmission of actually stored data. + |
+
dfs.replication + |
+Specifies the default number of data copies. + |
+
dfs.blocksiz + |
+Specifies the default size of a data block. + |
+
hadoop.security.authentication + |
+Specifies the security authentication mode. + |
+
hadoop.rpc.protection + |
+Specifies the RPC communication protection mode. + |
+
dfs.domain.socket.path + |
+Specifies the locally used Domain socket path. + |
+
You have created an MRS data source connection for the data warehouse cluster.
+When you are updating an MRS data source connection, the data warehouse cluster will automatically restart and cannot provide services.
+MRS Cluster Status and Configuration Status of the current connection will be updated. During configuration update, you cannot create a connection. The system checks whether the security group rule is correct. If the rule is incorrect, the system rectifies the fault.
+This section describes how to log in to the GaussDB(DWS) management console and use GaussDB(DWS).
+You can audit DDL to check DDL metadata, identify inappropriate table definitions, and locate performance problems.
+GaussDB(DWS) protects mission-critical operations. If you want to perform a mission-critical operation on the management console, you must enter a credential for identity verification. You can perform the operation only after your identity is verified. For account security, you are advised to enable operation protection. The setting will take effect for both the account and its users.
+Currently, the following operations are supported: scaling out a cluster, deleting a cluster, restarting a cluster, adding a CN, and deleting a CN.
+Operation protection is disabled by default. To enable it, perform the following steps:
+To disable operation protection, perform the following steps:
+When multiple database users query jobs at the same time, some complex queries may occupy cluster resources for a long time, affecting the performance of other queries. For example, a group of database users continuously submit complex and time-consuming queries, while another group of users frequently submit short queries. In this case, short queries may have to wait in the queue for the time-consuming queries to complete.
+To improve efficiency, you can use the GaussDB(DWS) workload management function to handle such problems. GaussDB(DWS) workload management uses workload queues as resource bearers. You can create different workload queues for different service types and configure different resource ratios for these queues. Then, add database users to the corresponding queues to restrict their resource usages. For example, classify database users who frequently submit complex query jobs into one type, create a workload queue for these users, allocate more resources to the queue, and then add these users to the queue. In this case, the complex jobs submitted by these users can use only the resources of the created queue. Also, create a queue that occupies fewer resources and allocate it to users who submit short queries. In this way, the two types of jobs can be executed at the same time without affecting each other.
+On the Workload Management page, you can modify the global configurations of workload management, add, create, and modify workload queues, add database users to queues, and remove database users from queues.
+ + +In the Short Query Configuration area, you can enable or disable the short query acceleration function. To change the number of concurrent short queries (-1 by default. 0 or -1 indicates that the concurrent short queries are not controlled), you can enable short query acceleration.
+In the Resource Configuration area, you can view the resource configuration of the current workload queue, including the CPU resource (%), memory resource (%), storage resource (MB), and query concurrency.
+In the Exception Rule area, you can view the exception rule settings of the current workload queue. Exception rules allow you to control exceptions of jobs executed by associated users in the queue.
+In the Associated User list, you can view the associated users of the current workload queue, and the memory and disk usage of each user at the current time, as shown in the following figure.
+The Workload Management Configuration area includes the Workload Switch and Maximum Concurrency parameters. Maximum Concurrency refers to the maximum concurrent queries on a single CN. If you disable Workload Switch, all workload management functions will be unavailable.
+You can create a maximum of 63 workload queues.
++
Parameter + |
+Description + |
+Value + |
+
---|---|---|
Name + |
+Name of a workload queue. + |
+queue_test + |
+
CPU Usage (%) + |
+Percentage of the CPU time slice that can be used by database users in a queue for job execution. + |
+20 + |
+
Memory Resource (%) + |
+Percentage of the memory usage by a queue. + CAUTION:
+You can manage memory and query concurrency separately or jointly. Under joint management, jobs can be delivered only when both the memory and concurrency conditions are met. + |
+20 + |
+
Storage Resource (MB) + |
+Size of the available space for permanent tables. + CAUTION:
+This parameter indicates the total tablespace of all DNs in a queue. Available space of a single DN = Configured value/Number of DNs. + |
+1024 + |
+
Query Concurrency + |
+Maximum number of concurrent queries in a queue. + CAUTION:
+You can manage memory and query concurrency separately or jointly. Under joint management, jobs can be delivered only when both the memory and concurrency conditions are met. + |
+10 + |
+
You can modify the parameters of a workload queue.
++
Parameter + |
+Description + |
+Value + |
+
---|---|---|
Short Query Acceleration + |
+Whether to enable short query acceleration. This function is enabled by default. + |
+Enable + |
+
Concurrent Short Queries + |
+A short query is a job whose estimated memory used for execution is less than 32 MB. The default value -1 indicates that the job is not controlled. + |
+10 + |
+
Parameter + |
+Description + |
+Value + |
+
---|---|---|
Name + |
+Name of a workload queue. + |
+queue_test + |
+
CPU Resource (%) + |
+Percentage of the CPU time slice that can be used by database users in a queue for job execution. + |
+20 + |
+
Memory Resource (%) + |
+Percentage of the memory usage by a queue. + CAUTION:
+You can manage memory and query concurrency separately or jointly. Under joint management, jobs can be delivered only when both the memory and concurrency conditions are met. + |
+20 + |
+
Storage Resource (MB) + |
+Size of the available space for permanent tables. + CAUTION:
+This parameter indicates the total tablespace of all DNs in a queue. Available space of a single DN = Configured value/Number of DNs. + |
+1024 + |
+
Query Concurrency + |
+Maximum number of concurrent queries in a queue. + CAUTION:
+You can manage memory and query concurrency separately or jointly. Under joint management, jobs can be delivered only when both the memory and concurrency conditions are met. + |
+10 + |
+
Exception rules allow you to control exceptions of jobs executed by users in a queue. Currently, you can configure the parameters listed in Table 2.
+Parameter + |
+Description + |
+Value + |
+
---|---|---|
Blocking Time + |
+Job blocking duration, in seconds. The duration includes the total time spent in global and local concurrent queuing. +For example, if the blocking time is set to 300s, a job executed by a user in the queue will be terminated after being blocked for 300 seconds. + |
+1200 + |
+
Execution Time + |
+Execution duration of a job, in seconds. The time indicates the duration from the start point of execution to the current time point. +For example, if Time required for execution is set to 100s, a job executed by a user in the queue will be terminated after being executed for more than 100 seconds. + |
+2400 + |
+
Total CPU time on all DNs + |
+Total CPU time spent in executing a job on all DNs, in seconds. + |
+100 + |
+
Interval for Checking CPU Skew Rate + |
+Interval for checking the CPU skew, in seconds. This parameter must be set together with Total CPU Time on All DNs. + |
+2400 + |
+
Total CPU Time Skew Rate on All DNs + |
+CPU time skew rate of a job executed on DNs. The value depends on the setting of Interval for Checking CPU Skew Rate. + |
+90 + |
+
In the Query Overview area, you can view the number of long and short queries that are running in the current queue at the current time. The chart information is refreshed every 15 seconds.
+If the queue to be deleted has associated database users, these users will be associated with the default queue after the queue is deleted.
+On the Nodes tab page, you can view the node list of the current cluster, add new nodes to or remove nodes from it, and view the node usage, status, and flavors.
+This function is more suited for large-scale scale-out. Nodes can be added in batches in advance. For example, if 180 more BMS nodes are needed, add them in three batches (60 for each batch). If some nodes fail to be added, add them again. After all the 180 nodes are successfully added, use the nodes for cluster scale-out. Adding nodes does not affect cluster services.
+Precautions
+Procedure
+The nodes that fail to be added will be automatically rolled back and recorded in the displayed list, as shown in the following figure.
+Precautions
+Procedure
+If the internal IP address or EIP of a CN is used to connect to a cluster, the failure of this CN will lead to cluster connection failure. If a private domain name is used for connection, connection failures can be avoided by polling. However, private domain names cannot be used for public network access, and requests cannot be forwarded in the case of a CN failure. Therefore, ELB is used to avoid single CN failures.
+An ELB distributes access traffic to multiple ECSs for traffic control based on forwarding policies. It improves the fault tolerance capability of application programs. For details, see Elastic Load Balance User Guide.
+With ELB health checks, CN requests of a cluster can be quickly forwarded to normal CNs. If a CN is faulty, the workload can be immediately shifted to a healthy node, minimizing cluster access faults.
+The following ELB operations are supported:
+ +Automated snapshots adopt differential incremental backups. The automated snapshot created for the first time is a full backup (base version), and then the system creates full backups at a specified interval. Incremental backups are generated between two full backups. The incremental backup records change based on the previous backup.
+During snapshot restoration, GaussDB(DWS) uses all backups between the latest full backup and the current incremental backup to restore the cluster. This can prevent data loss.
+If the retention period of an incremental snapshot exceeds the maximum retention period, GaussDB(DWS) does not delete the snapshot immediately. Instead, GaussDB(DWS) retains it until the next full backup, when the deletion of the snapshot will not hinder incremental data backup and restoration.
+Automated snapshots are enabled by default when you create a cluster. If automated snapshots are enabled for a cluster, GaussDB(DWS) periodically takes snapshots of that cluster based on the time and interval you set, usually every eight hours. You can configure one or more automated snapshot policies for the cluster as required. For details, see Configuring an Automated Snapshot Policy.
+The retention period of an automated snapshot can be set to 1 to 31 days. The default retention period is 3 days. The system deletes the snapshot at the end of the retention period. If you want to keep an automated snapshot for a longer period, you can create a copy of it as a manual snapshot. The automated snapshot is retained until the end of the retention period, whrereas the corresponding manual snapshot is retained until you manually delete it. For details about how to replicate an automated snapshot, see Copying Automated Snapshots.
+If you disable the automated snapshot function for an existing cluster, all its automated snapshots will be deleted. However, manual snapshots will not be deleted.
+Only GaussDB(DWS) can delete automated snapshots. You cannot delete them manually.
+GaussDB(DWS) deletes an automated snapshot if:
+If you disable automated snapshot, GaussDB(DWS) will stop taking snapshots and delete the existing automated snapshots of the corresponding cluster. Exercise caution when performing this operation.
+Alarm management includes viewing and configuring alarm rules and subscribing to alarm information. Alarm rules display alarm statistics and details of the past week for users to view tenant alarms. In addition to providing a set of default GaussDB(DWS) alarm rules, this feature allows you to modify alarm thresholds based on your own services. GaussDB(DWS) alarm notifications are sent using the SMN service.
+This feature supports only the database kernel of 8.1.1.200 and later.
+Statistics of the existing alarms in the past seven days are displayed by alarm severity in a bar chart. In this way, you can see clearly the number and category of the alarms generated in the past week.
+Statistics of the existing alarms on the current day are displayed by alarm severity in a list. In this way, you can see clearly the number and category of the unhandled alarms generated on the day.
+Details about all alarms, handled and unhandled, in the past seven days are displayed in a table for you to quickly locate faults, including the alarm name, alarm severity, cluster name, location, description, generation date, and status.
+The alarm data displayed (a maximum of 30 days) is supported by the Event Service microservice.
+Type + |
+Name + |
+Severity + |
+Description + |
+
---|---|---|---|
Default + |
+Node CPU Usage Exceeds the Threshold + |
+Urgent + |
+This alarm is generated if the threshold of CPU usage (system + user) of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the CPU usage (system + user) is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node System CPU Usage Exceeds the Threshold + |
+Urgent + |
+This alarm is generated if the threshold of system CPU usage of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the system CPU usage is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node Swap Usage Exceeds the Threshold + |
+Urgent + |
+This alarm is generated if the threshold of swap usage of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the swap usage is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node System Disk Usage Exceeds the Threshold + |
+Urgent: > 85%; Important: >75% + |
+This alarm is generated if the threshold of system disk (/) usage of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the system disk (/) usage is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node Log Disk Usage Exceeds the Threshold + |
+Urgent: > 85%; Important: >75% + |
+This alarm is generated if the threshold of log disk (/var/chroot/DWS/manager) usage of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the log disk (/var/chroot/DWS/manager) usage is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node Data Disk Usage Exceeds the Threshold + |
+Urgent: > 85%; Important: >75% + |
+This alarm is generated if the threshold of data disk (/var/chroot/DWS/data[n]) usage of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the data disk (/var/chroot/DWS/data[n]) usage is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node System Disk I/O Usage Exceeds the Threshold + |
+Urgent + |
+This alarm is generated if the threshold of system disk (/) I/O usage (util) of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the system disk (/) I/O usage (util) is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node Log Disk I/O Usage Exceeds the Threshold + |
+Urgent + |
+This alarm is generated if the threshold of log disk (/var/chroot/DWS/manager) I/O usage (util) of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the log disk (/var/chroot/DWS/manager) I/O usage (util) is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node Data Disk I/O Usage Exceeds the Threshold + |
+Urgent + |
+This alarm is generated if the threshold of data disk (/var/chroot/DWS/data[n]) I/O usage (util) of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the data disk (/var/chroot/DWS/data[n]) I/O usage (util) is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node System Disk Latency Exceeds the Threshold + |
+Important + |
+This alarm is generated if the threshold of system disk (/) I/O latency (await) of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the system disk (/) I/O latency (await) is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node Log Disk Latency Exceeds the Threshold + |
+Important + |
+This alarm is generated if the threshold of log disk (/var/chroot/DWS/manager) I/O latency (await) of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the log disk (/var/chroot/DWS/manager) I/O latency (await) is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node Data Disk Latency Exceeds the Threshold + |
+Important + |
+This alarm is generated if the threshold of data disk (/var/chroot/DWS/data[n]) I/O latency (await) of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the data disk (/var/chroot/DWS/data[n]) I/O latency (await) is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node System Disk Inode Usage Exceeds the Threshold + |
+Urgent: > 85%; Important: >75% + |
+This alarm is generated if the threshold of system disk (/) inode usage of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the system disk (/) inode usage is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node Log Disk Inode Usage Exceeds the Threshold + |
+Urgent: > 85%; Important: >75% + |
+This alarm is generated if the threshold of log disk (/var/chroot/DWS/manager) inode usage of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the log disk (/var/chroot/DWS/manager) inode usage is lower than the threshold and the constraint is not met. + |
+
Default + |
+Node Data Disk Inode Usage Exceeds the Threshold + |
+Urgent: > 85%; Important: >75% + |
+This alarm is generated if the threshold of data disk (/var/chroot/DWS/data[n]) inode usage of any node in the cluster is exceeded within the specified period and the constraint is not met. The alarm will be cleared when the data disk (/var/chroot/DWS/data[n]) inode usage is lower than the threshold and the constraint is not met. + |
+
Default + |
+Data Flushed to Disks of the Query Statement Exceeds the Threshold + |
+Urgent + |
+This alarm is generated if the threshold of data flushed to disks of the SQL statement in the cluster is exceeded within the specified period and the constraint is not met. The alarm can be cleared only after you handle the SQL statement. + |
+
Default + |
+Number of Queuing Query Statements Exceeds the Threshold + |
+Urgent + |
+This alarm is generated if the threshold of the number of queuing SQL statements is exceeded within the specified period. The alarm will be cleared when the number of queuing SQL statements is less than the threshold. + |
+
Custom + |
+Name of the user-defined threshold alarm + |
+User-defined alarm severity + |
+Alarm description + |
+
You can modify only some items of the default rules (associated cluster, alarm policy threshold, time period, and alarm constraint). User-defined rules support modification of all items.
+Currently, only alarm rules of schema usage metrics can be created on GaussDB(DWS).
+You can subscribe to GaussDB(DWS) alarm notifications to receive notifications by SMS message, email, or application when an alarm of a specified severity is generated.
+Parameter + |
+Description + |
+
---|---|
Status + |
+Whether to enable the alarm subscription. +
|
+
Subscription Name + |
+Name of the alarm subscription: +
|
+
Alarm Severity + |
+Severity of the alarm you want to subscribe to: Urgent, Important, Minor, or Prompt + |
+
To create a topic, click Create Topic to switch to the SMN console page. For details, .
+The selected topic must have granted GaussDB(DWS) the permission for publishing messages to the topic. To grant permissions, configure topic policies on the SMN management console. When configuring the topic policy, select DWS as the service that can publish messages to this topic.
+On the page that is displayed, view the real-time consumption of nodes, memory, disks, disk I/O, and network I/O.
+On the Overview tab page, you can view the key resources of a specified node based on the node name, including:
+On the Disks tab page, view the real-time disk resource consumption of a node by node name and disk name, including:
+The sum of the used disk space and available disk space is not equal to the total disk space. This is because a small amount of space is reserved in each default partition for system administrators to use. Even if common users have run out of space, system administrators can log in to the system and use their space required for solving problems.
+Run the Linux df command to collect the disk capacity information, as shown in the following figure.
+/dev/sda4: Used(5757444) + Available(540228616) != Total(569616888)
+On the Network tab page, view the real-time network resource consumption of a node by node name and NIC name, including:
+The Database Monitoring page displays the real-time and historical resource consumption a database.
+You can select a database and check its resource usage. For details, see Monitoring Metrics. including:
+In the Monitoring column of a database, click to view the performance indicators of the database, including:
The Session Monitoring page displays the session-level real-time database query statistics. You can also select and terminate a session.
+You can browse the query statistics of a specified session based on the session ID, including:
+Select a session to be terminated, click Terminate a Session, and confirm your operation.
+The fine-grained permission control function is added. Only users with the operate permission are able to terminate sessions. For users with the read-only permission, the Terminate a Session button is grayed out.
+The Query Monitoring page displays the real-time information about all queries that are running in a cluster and the historical information about the queries that have been run.
+You need to set GUC parameters before viewing data on the monitoring page. If GUC parameters are not set, real-time or historical query may be unavailable. However, if this parameter is set, the cluster performance may deteriorate. Therefore, you need to balance the settings of related parameters. The following table describes recommended settings. For details about how to modify parameters, see "Modifying Database Parameters". Setting GUC Parameters provides parameter details.
+ +GUC Parameter + |
+CN Configuration + |
+DN Configuration + |
+
---|---|---|
max_active_statements + |
+10 + |
+10 + |
+
enable_resource_track + |
+on + |
+on + |
+
resource_track_level + |
+query + |
+query + |
+
resource_track_cost + |
+0 + |
+0 + |
+
resource_track_duration + |
+0 + |
+0 + |
+
enable_resource_record + |
+on + |
+on + |
+
session_statistics_memory + |
+1000MB + |
+1000MB + |
+
In this area, you can browse the number of queries in different status, including Running, Blocked, Delayed, Canceled, Fast Lane, and Slow Lane.
+In the Real-Time Query area, you can browse the real-time information about all running queries, including:
+Select a query to be terminated, click Terminate Query, and confirm your operation.
+The fine-grained permission control function is added. Only users with the operate permission are able to terminate queries. For users with the read-only permission, the Terminate Query button is grayed out.
+In the History area, you can browse all historical query information based on the specified time period, including:
+ +You can click a query ID to view the query details, including the basic information of query statements, real-time and historical resource consumption, SQL description, and query plan.
+The Performance Monitoring page displays the resource consumption trends of clusters and databases.
+You can configure monitoring views by customizing monitoring panels. Monitoring views are bound to users. After logging in to the system, you can view the user-defined monitoring panels.
+Currently, DMS provides two types of monitoring views: cluster and database. You can click Add View to add a monitoring view as required The monitoring indicators are as follows:
+Performance Monitoring supports data export. You can click Export Data to further process data. By default, data in all monitoring views on the current page is exported. The export time range is subject to the selected time range.
+Performance Monitoring allows data aggregation of different periods. You can aggregate raw data based on the corresponding sampling period to display indicator trends of a longer period.
+On the Instance Monitoring page, you can view the real-time and historical information about detected slow instances.
+DMS can automatically configure and start the slow instance detection script on cluster CNs, periodically collect the cache table of the script, and report the detected slow instance data. You can view the number of slow instances detected within 24 hours and the distribution status in the time dimension on the GUI to quickly locate the slow nodes in the cluster and analyze the root causes.
+The Instance Monitoring page consists of two parts. The upper part displays the time distribution chart of detected slow instances, that is, the number of slow instances detected in different detection periods. The lower part displays slow instance details. When you select any bar in the time distribution chart, details about the detection time, node name, instance name, and number of detections (within 24 hours) of slow instances are displayed.
+On the Load Monitoring page, you can view the real-time and historical resource consumption of workload queues.
+The DMS displays the user-defined workload queue name, real-time and historical resource consumption, and workload queue resource quotas.
+You can click the drop-down list of any workload queue to view the exception handling rule configured for the workload queue.
+You can view the waiting queries in a workload queue in real time to identify the service pressure.
+You can view the status of a triggered circuit breaking query in a workload queue.
+GaussDB(DWS) allows you to record the audit logs of specific operations, involving audit log retention policies, unauthorized access, as well as DML, DDL, SELECT and COPY operations performed on the stored procedures and database objects.
+After configuring audit logs, you can query audit information to troubleshoot, or historical operation records for a malfunctioning GaussDB(DWS) cluster.
+For details about how to view the database audit logs, see "Database Security Management > Querying Audit Results" in the Data Warehouse Service (DWS) Developer Guide.
+GaussDB(DWS) allows you to record key operation events of the management console, such as creating a cluster, creating a snapshot, and restarting a cluster. The logs can be used in common application scenarios such as security analysis, compliance audit, resource tracing, and fault locating.
+For details about how to view the audit information on the management console, see Viewing Audit Logs of Key Operations on the Management Console.
+After a cluster is created, the number of required CNs varies with service requirements. The CN management function enables you to adjust the number of CNs in the cluster. The operations are as follows:
+This feature is supported only in cluster version 8.1.1 or later.
+Workload plan is an advanced workload management feature provided by GaussDB(DWS). You can create a workload plan, add multiple stages to the plan, and configure different queue resource ratios for the stages. When a plan is started, it automatically switches the queue resource configurations in different stages. If a customer runs different services in different stages and these services occupy different proportions of resources, the workload plan function can help the customer implement automatic switchover of queue resource configurations in different stages.
+ +1. Before creating a workload plan, you must plan and create workload queues. For details, see Adding Workload Queues.
+2. You can create a maximum of 10 workload plans.
+You cannot delete a running workload plan.
+If a running plan needs to be switched to a stage in advance, you can manually do it.
+You must stop the workload plan when deleting a stage. Otherwise, the stage cannot be deleted.
+You can commission a workload plan in the test environment and export the plan configurations to the production environment.
+A physical cluster can be divided into logical clusters that use the node-group mechanism. Tables in a database can be allocated to different physical nodes by logical cluster. A logical cluster can contain tables from multiple databases. Figure 1 shows the relationships between logical clusters, databases, and tables.
+ +An elastic cluster consists of non-logical cluster nodes in a physical cluster in logical cluster mode. The elastic cluster is named elastic_group, which is a special node group that can contain multiple or no DNs.
+An elastic cluster cannot be manually created. When the first logical cluster is created in a physical cluster, an elastic cluster is also automatically created and all physical nodes not belonging to the logical cluster are automatically added to the elastic cluster. DNs in the elastic cluster will be used for logical clusters created later. To create a logical cluster, ensure that your logical cluster has DNs. (DNs are not required only when you create the first logical cluster in physical cluster mode.) You can add new physical nodes to the elastic cluster through scale-out.
+A replication table node group is a special node group in logical cluster mode. It can contain one or more logical clusters, but can only create replication tables. One typical scenario is to create public dimension tables. If multiple logical clusters require some common dimension tables, create a replication table node group and add the common dimension tables to it. The logical clusters contained in the replication table node group can access these dimension tables on the local DNs, with no need to access the tables on other DNs. If a logical cluster is scaled in, the replication table node group will be scaled accordingly. If the logical cluster is deleted, the replication table node group will be scaled in. However, if the replication table node group contains only one logical cluster and the logical cluster is deleted, the replication table node group will also be deleted. In this case, create tables in a logical cluster instead.
+Create a replication table node group using the CREATE NODE GROUP SQL statement and delete one using DROP NODE GROUP. Before deleting a replication table node group, delete all table objects in the node group.
+Creation of replication table node groups is supported in 8.1.2 or later.
+In the Unbalanced state, the number of primary instances on some nodes increases. As a result, the load pressure is high. In this case, the cluster is normal, but the overall performance is lower than that in the balanced state. During off-peak hours, you are advised to perform a switchback to restore the primary/standby relationship of your cluster.
+Data redistribution, where data in existing nodes is evenly allocated to the new nodes after you scale out a cluster, is a time-consuming yet crucial task that accelerates service response.
+By default, redistribution is automatically started after cluster scale-out. For enhanced reliability, disable the automatic redistribution function and manually start a redistribution task after the scale-out is successful. In this way, both scale-out and redistribution can be retried upon failures.
+Currently, offline redistribution and online redistribution are supported. The default mode is offline redistribution.
+Precautions
+Procedure
+Precautions
+In online redistribution mode, the database supports partial DDL and DCL operations.
+Procedure
+On the View Redistribution Details page, you can view the redistribution mode and progress of the current cluster. In offline scheduling mode, you can pause, resume, and modify redistribution, and perform retries upon failures.
+Precautions
+Procedure
+If redistribution fails, click Retry, as shown in the following figure.
+Much data (orders, stocks, materials, and payments) is generated in the business operation systems and background (transactional) database of enterprises.
+Decision makers categorize and analyze the data for business decision-making.
+Data categorization and analysis involve the concurrent access to the data in multiple database tables. That is, multiple tables being updated by different transactions may be locked at the same time, which may cause complications to the database systems during peak hours.
+Data warehouses excel in data aggregation and association, so users mine more data, get more information, and make better decisions. The mining requires complex queries that involve data on multiple tables.
+The ETL process copies data in business operation databases to data warehouses for analysis and computing. Data can be aggregated from multiple business operation systems into one data warehouse for better association, analysis, and actionable insights.
+Data warehouses and standard transaction-oriented databases such as Oracle, Microsoft SQL Server, and MySQL use different design modes. Data warehouses are optimized in terms of data aggregation and association but the transaction or data adding and deleting functions or performance may not be guaranteed. Therefore, data warehouses and databases apply to different scenarios. Transactional databases are dedicated to transaction processing (business operation of enterprises) whereas data warehouses excel at complex data analysis. In conclusion, databases apply to data updates whereas data warehouses apply to data analysis.
+The Hadoop big data platform can be regarded as a next-generation data warehousing system. It has the characteristics of modern data warehouses and is widely used by enterprises. Because of the scalability of MPP, the MPP-based data warehousing system is sometimes classified as a big data platform.
+However, data warehouses greatly differ from the Hadoop platform in function and user experience in different scenarios. For details, see the following table.
+ +Feature + |
+Hadoop + |
+Data Warehouse + |
+
---|---|---|
Number of compute nodes + |
+1000s + |
+Max 256 + |
+
Data volume + |
+Over 10 PB + |
+Max 10 PB + |
+
Data type + |
+Relational, semi-relational, unstructured (voice, images, and video) + |
+Relational only + |
+
Latency + |
+Medium to high + |
+Low + |
+
Application ecosystem + |
+Innovative/AI + |
+Traditional/BI + |
+
Application development API + |
+SQL and other programming language APIs, such as MapReduce + |
+Standard database SQL + |
+
Scalability + |
+Unlimited, with comprehensive programming APIs + |
+Limited, supported by UDFs + |
+
Transaction support + |
+Limited + |
+Comprehensive + |
+
Data warehouses and the Hadoop platform work together in different scenarios. GaussDB(DWS) on the public cloud can seamlessly integrate with Hadoop-based MRS on the public cloud to provide the SQL-over-Hadoop data sharing across platforms and services. GaussDB(DWS) serves as a data warehouse for managing massive data while relishing the openness, convenience, and innovation of the Hadoop platform. You can also enjoy the upper-layer applications of conventional data warehouses, especially BI applications, using GaussDB(DWS).
+Conventional data warehouses are not practical for smaller enterprises due to high cost, time-consuming device and system selection and procurement, and complex scale-out.
+GaussDB(DWS) on the public cloud is the better choice:
+FusionInsight LibrA is a next-generation distributed data warehousing system with independent intellectual property rights. Currently, it is widely used in government, finance, and carriers. FusionInsight LibrA is compatible with mainstream open-source Postgres databases, especially in Oracle and Teradata SQL statements. Our data warehouse engineers have designed a kernel of hybrid row-column stores not only for faster analysis but also for data processing, such as adding, deleting, modifying data. FusionInsight LibrA features the cost optimizer and warehouse technologies, including machine code vector computing and inter/intra-parallelism for operators and nodes. It uses LLVM to optimize the local code in compilation query plans. More powerful data query and analysis addresses service pain points and improves user experience.
+Both allow you to run conventional relational databases on the cloud and transfer database management loads. RDS databases are useful for OLTP, reporting, and analysis, but are less capable of handling read operations of a large amount of data (complex read-only queries). GaussDB(DWS) is useful for OLAP by reducing analysis and report workloads of large data sets by an order of magnitude, thanks to its multi-node scale and resources and optimized algorithms (column storage, vectorized executors, and distributed frameworks).
+You can scale out a GaussDB(DWS) cluster to address complex data and queries, or to handle overwhelming analysis and report workloads that affect OLTP performance.
+The following table shows the comparison between OLTP and OLAP.
+ +Feature + |
+RDS for OLTP + |
+GaussDB(DWS) for OLAP + |
+
---|---|---|
User + |
+Operations and low-level management + |
+Decision-makers and senior management + |
+
Function + |
+Daily operation processing + |
+Analysis and decision-making + |
+
Design + |
+By application + |
+By theme + |
+
Data + |
+Latest, detailed, two-dimensional, discrete + |
+Historical, integrated, multidimensional, unified + |
+
Access + |
+Dozens of read and write records + |
+Millions of read records + |
+
Coverage + |
+Simple read/write operations + |
+Complex queries + |
+
Database size + |
+Hundreds of GB + |
+TB or PB + |
+
MRS works better with big data processing frameworks such as Apache Spark, Hadoop, and HBase, to process and analyze ultra-large data sets through custom code. It allows you to control cluster configurations and software installed in the cluster.
+GaussDB(DWS) works better with complex queries of a large amount of structured data. It aims to pool data from different sources together, such as inventory, finance, and retail system. To ensure consistency and accuracy of enterprise reports, GaussDB(DWS) stores data in a highly structured manner. This structure can directly build the data consistency rule to the database table. Additionally, GaussDB(DWS) is highly compatible with standard SQL statements and the syntax of conventional transaction-supported databases.
+GaussDB(DWS) is preferred when you want to perform complex query of a large amount of structured data with high performance.
+No. Although SQL on OBS of GaussDB(DWS) can be used for GaussDB(DWS) and OBS data query, it cannot replace the processing frameworks of MRS.
+Apart from SQL query, MRS also provides other functions. Public cloud MRS is a hosting service. It helps you use the latest common big data processing frameworks, such as Spark, Hadoop, and HBase, to process and analyze big data sets on a customizable cluster. With public cloud MRS, you can run a wide variety of scale-out data processing tasks for applications such as machine learning, graph analytics, data transformation, and stream data. GaussDB(DWS) SQL on OBS works with MRS. If you have already use MRS to process large-size data storage, GaussDB(DWS) SQL on OBS can be used to query these data without affecting MRS tasks.
+In this case, the query service, data warehouses, and complex data processing frameworks play their own roles – simply select the appropriate tool for the task.
+ +Check:
+If cluster connection failed on the public cloud, check the following items:
+If cluster connection failed through the Internet, confirm the following items:
+Call the Customer Hotline for support.
+Telephone:
+Germany: 0800 330 44 44
+International: +800 44556600
+Check that you have enough quota for creating the cluster.
+Call the Customer Hotline for support.
+Telephone:
+Germany: 0800 330 44 44
+International: +800 44556600
+Yes, but GaussDB(DWS) clients and drivers are recommended. Unlike open-source PostgreSQL clients and drivers, GaussDB(DWS) clients and drivers have two key advantages:
+GaussDB(DWS) supports open-source PostgreSQL clients and JDBC and ODBC drivers.
+The compatible client and driver versions are:
+For details about how to use JDBC/ODBC to connect to GaussDB(DWS), see Tutorial: Development Using JDBC or ODBC.
+The file formats supported by OBS and GDS foreign tables are as follows:
+OBS file formats: CSV, TEXT, ORC, and CARBONDATA. The default format is TEXT.
+GDS file formats: CSV and TEXT. The default format is TEXT.
+Yes. In the big data era, data has become a core asset. The public cloud will adhere to the commitment made over the years that we do not touch your applications or data, helping you protect your core assets. This is our commitment to users and the society, laying the foundation for the business success of the public cloud and their partners.
+GaussDB(DWS) is a data warehousing system with telecom-class security to safeguard your data and privacy. Moreover, the public cloud GaussDB(DWS) delivers carrier-class quality, which can satisfy data security and privacy requirements of governments, financial organizations, and carriers. Therefore, it is widely used by various industries. GaussDB(DWS) of the public cloud won the following security authentication:
+GaussDB(DWS) is built on public cloud software infrastructure, including ECS and OBS.
+Service data of GaussDB(DWS) users is stored in the ECSs in the cluster. Neither users nor public cloud O&M administrators can log in to the ECSs.
+The operating system of ECSs is hardened for security, including kernel hardening, installation of the latest patch, permission control, port management, and protocol and port anti-attack.
+GaussDB(DWS) provides complete security measures, such as password policies, authentication, session management, user permissions management, and database audit.
+GaussDB(DWS) backups are snapshots stored in OBS. OBS supports access permission control, key access, and data encryption features. GaussDB(DWS) snapshot data can be used for data backup and restoration only and cannot be accessed by any user. GaussDB(DWS) administrators can view the OBS space occupied by snapshot data on the GaussDB(DWS) console and public cloud bills.
+GaussDB(DWS) is fully isolated between the layer-2 and layer-3 networks to fulfill security requirements of government and financial users.
+GaussDB(DWS) uses IAM and VPC to control user access and isolate cluster network. Cluster access is over SSL and cipher suite. Additionally, GaussDB(DWS) supports two-way digital certificate authentication.
+Node OSs in each cluster are hardened to allow valid access to only OS files.
+After the EIP is unbound, the network may be disconnected. However, the TCP layer does not detect a faulty physical connection in time due to keepalive settings. As a result, the gsql, ODBC, and JDBC clients also cannot identify the network fault in time.
+The duration when the database sends the disconnection message to the client depends on the keepalive settings. The specific algorithm for calculating the duration is:
+keepalive_time + keepalive_probes x keepalive_intvl
+Keepalive values affect network communication stability. Adjust them to service pressure and network conditions.
+On Linux, run the sysctl command to modify the following parameters:
+For example, if you want to change the value of net.ipv4.tcp_keepalive_time, run the following command to change it to 120.
+sysctl net.ipv4.tcp_keepalive_time=120
+On Windows, modify the following configuration information in registry HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\services\Tcpip\Parameters:
+If you cannot find the preceding parameters in registry HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\services\Tcpip\Parameters, add these parameters. Open Registry Editor, right-click the blank area on the right, and choose to add these parameters.
+GaussDB(DWS) supports efficient data import from multiple data sources. The following lists typical data import modes. For details, see "Import Modes" in the Data Warehouse Service (DWS) Developer Guide.
+Upload data to OBS and then export it to GaussDB(DWS) clusters. Data formats such as CSV and TEXT are supported.
+Use the gsql client tool provided by GaussDB(DWS) or the JDBC/ODBC driver to write data to GaussDB(DWS) from upper-layer applications. GaussDB(DWS) supports complete database transaction-level CRUD operations. This is the simplest method and is applicable to scenarios with small data volume and low concurrency.
+Each node in a data warehouse cluster has a default storage capacity of 160 GB, 256 GB, 1.6 TB, 1.8 TB, or 13 TB. A cluster can house 3 to 32 nodes and the total storage capacity of the cluster expands proportionally as the cluster scale grows.
+To enhance reliability, each node has a copy, which occupies half of the storage space.
+The GaussDB(DWS) system backs up data and generates indexes, temporary cache files, and run logs, which occupy storage space. Therefore, the actual storage space of each node is about half of the total storage capacity.
+Cluster patching or upgrading is automatic because GaussDB(DWS) upgrades its own version.
+For service patch:
+For service upgrade:
+Downgrade is not supported.
+The following figure describes the database version.
+After you delete data stored in GaussDB(DWS) data warehouses, dirty data may be generated from the unreleased disk space. This results in space waste and deteriorates snapshot creation and restoration performance. The following describes the impact on the system:
+Perform the following steps to clear and reclaim the storage space:
+By default, tables the current user has the permission on are deleted. Other tables are skipped.
+The following information is displayed once the space is cleared:
+1 | VACUUM
+ |
For cloud services, quotas limit the number of resources available to users. If you need more, submit a service ticket to increase your quotas. Once approved, we will update your resource quota accordingly and send you a notification.
+Due to the MPP architecture limitation of GaussDB(DWS), a few PostgreSQL methods and functions cannot be pushed to DNs for execution. As a result, performance bottlenecks occur on CNs.
+Explanation:
+Solutions:
+GaussDB(DWS) and Hive have different functions in the following aspects:
+Based on their respective functions, Hive is useful for offline analysis while GaussDB(DWS) is useful for both online analysis and ad-hoc query.
+No, direct access is not supported. VMs at the bottom layer of GaussDB(DWS) serve as the compute nodes for data analysis. Access cluster databases using the private or public network access address instead.
+A region and availability zone (AZ) identify the location of a data center. You can create resources in regions and AZs.
+Figure 1 shows the relationship between regions and AZs.
+ +You are advised to select a region close to you or your target users. This reduces network latency and improves access rate.
+Consider your requirements for DR and network latency when selecting an AZ:
+When you use resources with API calls, you must specify the regional endpoint. For details about public cloud regions and endpoints, see "Regions and Endpoints".
+Yes. When a data warehouse cluster is created, its security group cannot be changed. However, you can add, delete, or modify rules of the current security group.
+To edit the cluster security group:
+If you do not run VACUUM to clear and reclaim the storage space before the scale-out, the data deleted from GaussDB(DWS) may not free up the occupied disk space.
+During the scale-out, the system redistributes the data because the service data volume on the original nodes is significantly larger than that on the newly added nodes. When the redistribution starts, the system automatically performs VACUUM to free up the storage space. In this way, the used storage is reduced.
+You are advised to periodically clear and reclaim the storage space by running VACUUM FULL to prevent data expansion.
+If the used storage space is still large after you run VACUUM FULL, analyze whether the existing cluster flavor meets service requirements. If no, scale out the cluster.
+Partitioned table: Partitioning refers to splitting what is logically one large table into smaller physical pieces based on specific schemes. The table based on the logic is called a partitioned table, and a physical piece is called a partition. Data is stored on these smaller physical pieces, namely, partitions, instead of the larger logical partitioned table.
+Partition: In the GaussDB(DWS) distributed system, data partitioning is to horizontally partition table data within a node based on a specified policy. The table is divided into partitions that do not overlap within a specific range.
+Partition key: A partition key is an ordered set of one or more table columns. The values in the table partition keys are used to determine the data partition that a row belongs to.
+ +The permissions provided by Gauss(DWS) include the O&M permissions for components on the management plane. You can assign different permissions to users as needed. The management plane uses roles for better permissions management. You can select specified permissions and assign them to roles in a unified manner. In this way, permissions can be viewed and managed in a centralized manner.
+The following figure shows the relationships between permissions, roles, and users in unified permissions management.
+GaussDB(DWS) provides various permissions. Select and assign permissions to different users based on service scenarios. A role can be assigned one or more permissions.
+After a role is granted to a user through GRANT, the user will have all the permissions of the role. It is recommended that roles be used to efficiently grant permissions. A user has permissions only for their own tables, but does not have permissions for other users' tables in their schemas.
+When a database is used for a period of time, the table data increases as services grow, or the table data is frequently added, deleted, or modified. This results in bloating tables and inaccurate statistics, deteriorating database performance.
+You are advised to periodically perform VACUUM FULL and ANALYZE on tables that are frequently added, deleted, or modified.
+To test whether disk fragments affect database performance, use the following function:
+select * from pgxc_get_stat_dirty_tables(30,100000);+
GaussDB(DWS) is a fully managed service on the cloud. Users cannot log in to the background to import or export data by using COPY, so the COPY syntax is disabled. You are advised to store data files on OBS and use OBS foreign tables to import data. If you want to use COPY to import and export data, perform the following operations:
+\copy table_name from '/directory_name/file_name' with(...);+
\copy table_name to '/directory_name/file_name';+
\copy table_name to '/directory_name/file_name' CSV;+
\copy table_name to '/directory_name/file_name' with(format 'csv',delimiter '|') ;+
To import heterogeneous data to GaussDB(DWS), use CDM to migrate the entire MySQL or SQL Server database. Or migrate the entire GaussDB(DWS) database to another GaussDB(DWS) database. For details, see "Entire DB Migration" in the Cloud Data Migration User Guide.
+Alternatively, you can store data in OBS and then dump the data to GaussDB(DWS). For details, see "About Parallel Data Import from OBS" in the Data Warehouse Service (DWS) Developer Guide.
+No, you only need to set the primary key. By default, the first column of the primary key is selected as the distribution key. If both are set, the primary key must contain the distribution key.
+Yes.
+GaussDB(DWS) is compatible with PostgreSQL stored procedures. For details, see "Stored Procedures" in the Developer Guide.
+You are advised to use the Data Studio graphical client to export table data. You can export data from:
+For details, see "Exporting Table Data" in the Tool Guide.
+ + + +You can use pg_tables and pg_views to query all table information and views in a database. Example:
+SELECT * FROM pg_tables; +SELECT * FROM pg_views;+ +
For details about the returned columns, see "PG_TABLES" and "PG_VIEWS" in the Developer Guide.
+GaussDB(DWS) allows you to record the audit logs of specific operations, involving audit log retention policies, unauthorized access, as well as DML, DDL, SELECT and COPY operations performed on stored procedures and database objects.
+After configuring audit logs, you can query audit information to troubleshoot, or historical operation records for a malfunctioning GaussDB(DWS) cluster.
+The audit logs are stored in the database by default. Dump them to OBS to give users who are responsible for monitoring the database easier access.
+For details, see "Audit Logs" in the Management Guide.
+In GaussDB(DWS), the encoding format of a database cannot be changed. You need to create another database in the required format. For globalization purposes, set the encoding to UTF8 when creating a database.
+1 +2 +3 +4 +5 +6 +7 +8 | CREATE DATABASE database_name + [ [ WITH ] { [ OWNER [=] user_name ] | + [ TEMPLATE [=] template ] | + [ ENCODING [=] encoding ] | + [ LC_COLLATE [=] lc_collate ] | + [ LC_CTYPE [=] lc_ctype ] | + [ DBCOMPATIBILITY [=] compatibility_type ] | + [ CONNECTION LIMIT [=] connlimit ]}[...] ]; + |
Name of the template from which the database is created. GaussDB(DWS) creates a database by copying a template database. Initially, GaussDB(DWS) contains two template databases template0 and template1, and a default user database gaussdb.
+Value range: an existing database name. If this is not specified, the system copies template1 by default. Its value cannot be gaussdb.
+Currently, database templates cannot contain sequences. If sequences exist in the template library, database creation will fail.
+Character encoding used by the database. The value can be a character string (for example, SQL_ASCII') or an integer number.
+If this parameter is not specified, the encoding of the template database is used by default. The encoding of template databases template0 and template1 depends on the OS by default. The character encoding of template1 cannot be changed. To change the encoding, use template0 to create a database.
+Value range: GBK, UTF8, and Latin1
+The character set encoding of the new database must be compatible with the local settings (LC_COLLATE and LC_CTYPE).
+To create a UTF8 database music that can be modified later. (The encoding of the local environment must also be UTF8.)
+CREATE DATABASE music ENCODING 'UTF8' template = template0;+
Yes. TRUNCATE is more efficient than DELETE for deleting massive data.
+For details, see "TRUNCATE" in the Data Warehouse Service (DWS) Developer Guide.
+TRUNCATE quickly removes all rows from a database table.
+It has the same effect as the unconditional DELETE, but TRUNCATE is faster, especially for large tables, because it does not scan tables.
+1 +2 +3 +4 +5 | --Create a table.CREATE TABLE tpcds.reason_t1 AS TABLE tpcds.reason; + +--Truncate the table.TRUNCATE TABLE tpcds.reason_t1; + +--Drop the table.DROP TABLE tpcds.reason_t1; + |
1 + 2 + 3 + 4 + 5 + 6 + 7 + 8 + 9 +10 +11 +12 +13 +14 +15 +16 +17 +18 +19 +20 +21 +22 +23 +24 +25 +26 +27 +28 +29 | --Create a partitioned table. +CREATE TABLE tpcds.reason_p +( + r_reason_sk integer, + r_reason_id character(16), + r_reason_desc character(100) +)PARTITION BY RANGE (r_reason_sk) +( + partition p_05_before values less than (05), + partition p_15 values less than (15), + partition p_25 values less than (25), + partition p_35 values less than (35), + partition p_45_after values less than (MAXVALUE) +); + +--Insert data. +INSERT INTO tpcds.reason_p SELECT * FROM tpcds.reason; + +--Truncate the p_05_before partition. +ALTER TABLE tpcds.reason_p TRUNCATE PARTITION p_05_before; + +--Truncate the p_15 partition. +ALTER TABLE tpcds.reason_p TRUNCATE PARTITION for (13); + +--Truncate the partitioned table. +TRUNCATE TABLE tpcds.reason_p; + +--Drop the table. +DROP TABLE tpcds.reason_p; + |
Yes. For tables that involve frequent add, delete, or modify operations, perform VACUUM FULL and ANALYZE to reclaim the disk space occupied by updated or deleted data, preventing performance deterioration caused by data expansion and inaccurate statistics.
+Generally, you are advised to use ANALYZE after multiple add and modify operations are performed on a table, and use VACUUM FULL after delete operations are performed. VACUUM FULL can be used only on special occasions, such as when you want to physically narrow a table to decrease the occupied disk space after deleting most rows of the table. VACUUM FULL usually shrinks a table more than VACUUM does.
+-- Perform ANALYZE on a table. +ANALYZE Table name; +-- Perform ANALYZE on all tables (non-foreign tables) in the database. +ANALYZE; +-- Perform VACUUM on a table. +VACUUM Table name; +-- -- Perform VACUUM FULL on a table. +VACUUM FULL Table_name;+
For details, see in "VACUUM" and "ANALYZE | ANALYSE" in the Developer Guide.
+If the physical space usage does not decrease after you run the VACUUM FULL command, check whether there were other active transactions (started before you delete data transactions and not ended before you run VACUUM FULL). If yes, run this command again when the transactions have finished.
+A cluster with three data nodes of 320 GB each has a total capacity of 960 GB. When 1 GB data is stored, GaussDB(DWS) stores 1 GB data on two nodes due to duplication, a security mechanism, thereby occupying a total of 2 GB space. As a result, more than 2 GB space is occupied if metadata and indexes are calculated. Therefore, a three-node cluster with a total capacity of 960 GB can store 480 GB data. This mechanism ensures data security.
+When you create nodes on the console, you are billed by the available capacity of a node. For example, the actual space of dws.m3.xlarge is 320 GB and the available space displayed is 160 GB, the space you will be billed for.
+To change the password of the database administrator dbadmin, log in to the console and choose More > Reset Password in cluster row.
+For security, the following two parameters manage account passwords. Log in to the console, click the cluster name and switch to the parameter modification page to modify the parameters.
+ALTER USER user_name ACCOUNT UNLOCK;+
1 +2 | +SELECT * FROM pg_user; + |
1 +2 | +SELECT * FROM pg_authid; + |
1 | SELECT * FROM pg_authid where rolname = 'joe'; + |
The top SQL feature lets you view SQL statements executed in a specified period (in real time and historical). SQL statements of the current CN or all CNs are available for viewing.
+No, GaussDB(DWS) does not support OBS data import or export across regions. The GaussDB(DWS) cluster and OBS must be in the same region.
+You can view the used capacity of a cluster CPU, memory, and disks on the Cloud Eye management console. Perform the following steps to view the information:
+No. The GDS server and GaussDB(DWS) can only communicate with each other on the intranet. Each DN in the GaussDB(DWS) cluster is used to connect to the GDS server in parallel to import a large amount of data. The GDS server and the cluster must be in the same network. If GDS is deployed on an offline server, the firewall needs to be enabled and the cluster needs an EIP. However, one cluster can be bound only to one EIP, and data import with multiple DNs cannot be implemented.
+Resources in different AZs of the same region can communicate with each other directly if they belong to the same VPC.
+For resources in different AZs of the same region but not in the same VPC, create a VPC peering connection. .
+GaussDB(DWS) provides an implicitly defined group public that contains all roles. By default, all new users and roles have the permissions of public. To revoke permissions of public from a user or role, or re-grant these permissions to them, add the public keyword in the REVOKE or GRANT statement.
+GaussDB(DWS) grants the permissions for objects of certain types to public. By default, permissions on tables, columns, sequences, foreign data sources, foreign servers, schemas, and tablespaces are not granted to PUBLIC, but the following permissions are granted to PUBLIC: CONNECT and CREATE TEMP TABLE permissions on databases, EXECUTE permission on functions, and USAGE permission on languages and data types (including domains). An object owner can revoke the default permissions granted to public and grant permissions to other users. For security purposes, create an object and set its permissions in the same transaction so that other users do not have time windows to use the object. In addition, you can run the ALTER DEFAULT PRIVILEGES statement to modify the default permissions.
+The following shows an example of revoking the CONNECT ON DATABASE permission from a user.
+gsql -d gaussdb -h 192.168.0.89 -U dbadmin -p 8000 -r
+If the following information is displayed after you enter the password as prompted, the connection is successful.
+1 | gaussdb=> + |
CREATE USER u1 IDENTIFIED BY 'password'; +CREATE USER+
gsql -d gaussdb -h 192.168.0.89 -U u1 -p 8000 -W password -r
+gsql ((GaussDB 8.1.0 build be03b9a0) compiled at 2021-03-12 14:18:02 commit 1237 last mr 2001 release)
+SSL connection (protocol: TLSv1.3, cipher: TLS_AES_128_GCM_SHA256, bits: 128)
+Type "help" for help.
+gsql -d gaussdb -h 192.168.0.89 -U dbadmin -p 8000 -r +gaussdb=> + +REVOKE CONNECT ON database gaussdb FROM public; +REVOKE+
revoke connect on database postgres from u1 cannot be used directly because the CONNECT permission is granted to public.
+gsql -d gaussdb -h 192.168.0.89 -U u1 -p 8000
+gsql: FATAL: permission denied for database "gaussdb"
+DETAIL: User does not have CONNECT privilege.
+This section describes how to grant the query permission for a schema as an example. For more information, see "How Do I Grant Table Permissions to a User?" in FAQ. You can grant:
+Assume that there are users u1 and u2, and two schemas named after them. User u2 needs to access tables in schema u1.
+1 +2 | CREATE USER u1 PASSWORD '{password}'; +CREATE USER u2 PASSWORD '{password}'; + |
1 +2 | CREATE TABLE u1.t1 (c1 int, c2 int); +CREATE TABLE u1.t2 (c1 int, c2 int); + |
1 | GRANT USAGE ON SCHEMA u1 TO u2; + |
1 | GRANT SELECT ON u1.t1 TO u2; + |
1 +2 | SELECT * FROM u1.t1; +SELECT * FROM u1.t2; + |
1 | GRANT SELECT ON ALL TABLES IN SCHEMA u1 TO u2; + |
1 +2 | SELECT * FROM u1.t1; +SELECT * FROM u1.t2; + |
1 | CREATE TABLE u1.t3 (c1 int, c2 int); + |
1 | SELECT * FROM u1.t3; + |
1 +2 | ALTER DEFAULT PRIVILEGES FOR ROLE u1 IN SCHEMA u1 GRANT SELECT ON TABLES TO u2; +CREATE TABLE u1.t4 (c1 int, c2 int); + |
1 | SELECT * FROM u1.t4; + |
This section describes how to grant users the SELECT, INSERT, UPDATE, or full permissions for tables.
+1 +2 +3 +4 +5 +6 | GRANT { { SELECT | INSERT | UPDATE | DELETE | TRUNCATE | REFERENCES | TRIGGER | ANALYZE | ANALYSE } [, ...] + | ALL [ PRIVILEGES ] } + ON { [ TABLE ] table_name [, ...] + | ALL TABLES IN SCHEMA schema_name [, ...] } + TO { [ GROUP ] role_name | PUBLIC } [, ...] + [ WITH GRANT OPTION ]; + |
Assume there are users u1, u2, u3, u4, and u5 and five schemas named after these users. Their permission requirements are as follows:
+User + |
+Type + |
+GRANT Statement + |
+Query + |
+Insert + |
+Update + |
+Delete + |
+||
---|---|---|---|---|---|---|---|---|
u1 + |
+Owner + |
+- + |
+√ + |
+√ + |
+√ + |
+√ + |
+||
u2 + |
+Read-only user + |
+
|
+√ + |
+x + |
+x + |
+x + |
+||
u3 + |
+INSERT user + |
+
|
+x + |
+√ + |
+x + |
+x + |
+||
u4 + |
+UPDATE user + |
+
NOTICE:
+The UPDATE permission must be granted together with the SELECT permission, or information leakage may occur. + |
+√ + |
+x + |
+√ + |
+x + |
+||
u5 + |
+Super user + |
+
|
+√ + |
+√ + |
+√ + |
+√ + |
+
Perform the following steps to grant and verify permissions:
+1 +2 +3 +4 +5 | CREATE USER u1 PASSWORD '{password}'; +CREATE USER u2 PASSWORD '{password}'; +CREATE USER u3 PASSWORD '{password}'; +CREATE USER u4 PASSWORD '{password}'; +CREATE USER u5 PASSWORD '{password}'; + |
1 | CREATE TABLE u1.t1 (c1 int, c2 int); + |
1 +2 | INSERT INTO u1.t1 VALUES (1,2); +INSERT INTO u1.t1 VALUES (1,2); + |
1 | GRANT USAGE ON SCHEMA u1 TO u2,u3,u4,u5; + |
1 | GRANT SELECT ON u1.t1 TO u2; + |
1 +2 +3 | SELECT * FROM u1.t1; +INSERT INTO u1.t1 VALUES (1,20); +UPDATE u1.t1 SET c2 = 3 WHERE c1 =1; + |
1 +2 +3 | GRANT INSERT ON u1.t1 TO u3; -- Allow u3 to insert data. +GRANT SELECT,UPDATE ON u1.t1 TO u4; -- Allow u4 to modify the table. +GRANT ALL PRIVILEGES ON u1.t1 TO u5; -- Allow u5 to query, insert, modify, and delete table data. + |
1 +2 +3 | SELECT * FROM u1.t1; +INSERT INTO u1.t1 VALUES (1,20); +UPDATE u1.t1 SET c2 = 3 WHERE c1 =1; + |
1 +2 +3 | SELECT * FROM u1.t1; +INSERT INTO u1.t1 VALUES (1,20); +UPDATE u1.t1 SET c2 = 3 WHERE c1 =1; + |
1 +2 +3 +4 | SELECT * FROM u1.t1; +INSERT INTO u1.t1 VALUES (1,20); +UPDATE u1.t1 SET c2 = 3 WHERE c1 =1; +DELETE FROM u1.t1; + |
1 | SELECT * FROM pg_class WHERE relname = 't1'; + |
Check the relacl column in the command output. rolename=xxxx/yyyy indicates that rolename has the xxxx permission on the table and the permission is obtained from yyyy.
+The following figure shows the command output.
+The evolving Internet and IoT produce massive volumes of data. This data needs to be managed, using concepts like database, data warehouse, data lake, and lakehouse. Here is an overview of how they map with our products and solutions.
+A database is where data is organized, stored, and managed by data structure.
+Databases have been used in computers since the 1960s, with the two prevailing data models (hierarchical and network), and data and applications were very interdependent. This limited database applications.
+A database usually refers to a relational database. A relational database organizes data with a relational model, that is, data is stored in rows and columns. Therefore, database data is well-structured and independent with low redundancy. In 1970, relational databases were born to completely separate data from applications for software and have become an indispensable part of mainstream computer systems. Relational databases are the foundation of database products from all vendors, with relational API support even if a database is non-relational.
+Relational databases process basic and routine transactions using OLTP, such as bank transactions.
+Database growth has facilitated data growth. OLAP explores the relationship between data and mines more data value. However, it is difficult to share data between different databases, and data integration and analysis also face great challenges.
+To overcome these challenges for enterprises, Bill Inmon, proposed the idea of data warehousing in 1990. The data warehouse runs on a unique storage architecture to perform OLAP on a large amount of the OLTP data accumulated over the years. In this way, enterprises can obtain valuable information from massive data quickly and effectively to make informed decisions. Thanks to data warehouses, the information industry has evolved from operational systems based on relational databases to decision support systems.
+Unlike a database, a data warehouse has the following features:
+Dimension + |
+Data Warehouse + |
+Database + |
+
---|---|---|
Application scenario + |
+OLAP + |
+OLTP + |
+
Data source + |
+Multiple + |
+Single + |
+
Data normalization + |
+Denormalized schemas + |
+Highly normalized static schemas + |
+
Data access + |
+Optimized read operations + |
+Optimized write operations + |
+
Data is an important asset for enterprises. Production and operations data are saved and distilled into effective management policies.
+The data lake does that. It is a large data warehouse that centrally stores structured and unstructured data. It can store raw data of multiple data sources and types, meaning that data can be accessed, processed, analyzed, and transmitted without being structured first. The data lake helps enterprises quickly complete federated analysis of heterogeneous data sources and explore data value.
+Now with big data and AI, lake data is even more valuable and plays new roles. It represents more enterprise capabilities. For example, the data lake can centralize data management, helping enterprises build more optimized operation models. It also provides other enterprise capabilities such as prediction analysis and recommendation models. These models can stimulate further growth.
+Just like any other warehouse and lake, one stores goods, or data, from one source while the other stores water, or data, from many sources.
+ +Dimension + |
+Data Lake + |
+Data Warehouse + |
+
---|---|---|
Application scenario + |
+Exploratory analytics (machine learning, data discovery, profiling, prediction) + |
+Data analytics (based on historical structured data) + |
+
Cost + |
+Low initial cost, high subsequent cost + |
+High initial cost, low subsequent cost + |
+
Data quality + |
+Massive raw data to be cleaned and normalized before use + |
+High quality data that can be used as the basis of facts + |
+
Target user + |
+Data scientists and data developers + |
+Business analysts + |
+
Although the application scenarios and architectures of a data warehouse and a data lake are different, they can cooperate to resolve problems. A data warehouse stores structured data and is ideal for quick BI and decision-making support, while a data lake stores data in any format and can generate larger value by mining data. Therefore, their convergence can bring more benefits to enterprises in some scenarios.
+A lakehouse, the convergence of a data warehouse and a data lake, aims to enable data mobility and streamline construction. The key of the lakehouse architecture is to enable the free flow of data/metadata between the data warehouse and the data lake. The explicit-value data in the lake can flow to or even be directly used by the warehouse. The implicit-value data in the warehouse can also flow to the lake for long-term storage at a low cost and for future data mining.
+Data Lake Governance Center (DGC) is a data enablement platform that helps large government agencies and companies customize intelligent data resource management solutions. This solution can import all-domain data into the data lake, eliminating data silos, unleashing the value of data, and empowering data-driven digital transformation.
+DGC features the FusionInsight intelligent data lake as its core. Around it are computing engines such as the database, data warehouse, data lake, and data platform. DGC provides comprehensive data enablement, covering data collection, aggregation, computing, asset management, and data openness.
+Lake, warehouse, and database engines enable agile data lake construction, fast migration of GaussDB databases, and real-time analysis of the data warehouse. For more information, go to:
+To query information about OBS/GDS foreign tables such as OBS paths, run the following statement:
+1 | select * from pg_get_tabledef('Foreign_table_name') + |
The following uses table traffic_data.GCJL_OBS as an example:
+1 | select * from pg_get_tabledef('traffic_data.GCJL_OBS'); + |
If BI applications, client ECS, and DGC need to communicate with GaussDB(DWS), they must be in the same region and VPC as the GaussDB(DWS) cluster (different subnets are allowed).
+In the same region, communication is allowed between different AZs in the same VPC. In the case of different VPCs, create a VPC peering connection to enable communication. For details, see .
+In a data warehouse database, you need to carefully choose distribution columns for large tables, because they can affect your database and query performance. If an improper distribution key is used, data skew may occur after data is imported. As a result, the usage of some disks will be much higher than that of other disks, and the cluster may even become read-only. If the hash distribution policy is used and data skew occurs, the I/O performance of some DNs will be poor, affecting the overall query performance. You also need to consider how to adjust the distribution column of existing tables to improve performance.
+If the hash distribution policy is used, you need to check tables to ensure their data is evenly distributed on each DN. Generally, over 5% difference between the amount of data on different DNs is regarded as data skew. If the difference is over 10%, you have to choose another distribution column.
+For tables that are not evenly distributed, adjust their distribution columns to reduce data skew and avoid database performance problems.
+The distribution column in a hash table must meet the following requirements, which are ranked by priority in descending order:
+Run the select version(); statement to query the current database version. Required performance varies according to the version.
+In the following statements, table1 is the original table name and table1_new is the new table name. column1 and column2 are distribution column names.
+1 +2 +3 +4 | CREATE TABLE IF NOT EXISTS table1_new +( LIKE table1 INCLUDING ALL EXCLUDING DISTRIBUTION) +DISTRIBUTE BY +HASH (column1, column2); + |
1 +2 +3 +4 | START TRANSACTION; +LOCK TABLE table1 IN ACCESS EXCLUSIVE MODE; +INSERT INTO table1_new SELECT * FROM table1; +COMMIT; + |
1 +2 | SELECT COUNT(*) FROM table1_new; +DROP TABLE table1; + |
1 | ALTER TABLE table1_new RENAME TO table1; + |
1 | select pg_get_tabledef('customer_t1'); + |
1 | update customer_t1 set c_last_name = 'Jimy' where c_customer_sk = 6885; + |
1 | alter table customer_t1 DISTRIBUTE BY hash (c_customer_sk); + |
1 | update customer_t1 set c_last_name = 'Jimy' where c_customer_sk = 6885; + |
You can also log in to the VPC management console to manually create a security group. Then, go back to the page for creating data warehouse clusters, click the button next to the Security Group drop-down list to refresh the page, and select the new security group.
To enable the GaussDB(DWS) client to connect to the cluster, you need to add an inbound rule to the new security group to grant the access permission to the database port of the GaussDB(DWS) cluster.
+The whitelist will be added.
+