Synchronize DB Resources in Google Cloud

Overview

QueryPie supports integration with Google Cloud Platform (GCP) for database registration and management. By synchronizing resources from GCP, you can register them as managed databases in QueryPie, assign access permissions to users and groups, and configure policies for these synchronized databases.

Registering GCP Integration in QueryPie

1. Navigate to the Administrator > Databases > Connection Management > Cloud Providers menu.

2. Click the Create Provider button in the upper right corner.

3. Name: Enter a name to distinguish the provider.

4. Cloud Provider: Select Google Cloud Platform.

5. Project ID: Enter the Project ID for the resources to be synchronized.

6. Credential: Enter the required Credential information to synchronize the resources.

   1. By clicking the Synchronize button, a manual synchronization method is provided by default, where you input the GCP Service Account.

      1. Starting from QueryPie 10.2.2, the "Save Credential for Synchronization" option has been added, allowing synchronization through a schedule even when using the Service Account as the credential type.

7. Database Type Filter: Select the resources to be synchronized.

8. Replication Frequency: Choose the synchronization method:

   • Manual: Synchronize only when triggered manually.

   • Scheduling: Synchronize on a regular schedule using Cron Expressions.

9. Click Save to register the Cloud Provider.

Save Credential for Synchronization Option

• This option, once enabled and saved, cannot be disabled from the synchronization settings detail page, so it should be selected carefully. The saved credential cannot be replaced. If a different credential is needed, a new synchronization setting must be created. If a credential change is required, it is recommended to create a new credential with the same permissions, create a new synchronization setting, and then delete the existing synchronization setting.

• Synchronization settings saved without this option enabled can have the option activated by checking the checkbox on the detail page.

• When this option is enabled, synchronization can be done manually, or a schedule can be set.

Synchronizing and Managing GCP Cloud Providers

1. Navigate to the Administrator > Databases > Connection Management > Cloud Providers menu.

2. Click on the registered Cloud Provider to open the details screen.

3. Click the Sychronize button in the upper right corner to sync resources from GCP.

4. You can monitor synchronization progress in the Synchronization Log or view the history under Administrator > General > Systems > Jobs.

5. Once a Cloud Provider is registered, certain provider details cannot be modified:

   1. Name: Changeable

   2. Cloud Provider: Not changeable

   3. Project ID: Not changeable

   4. Credential: Not changeable

      1. "Save Credential for Synchronization": The option can be changed from inactive to active, but it cannot be switched from active to inactive.

   5. Database Type Filter: Changeable

   6. Replication Frequency: Changeable

Synchronization settings saved without the "Save Credential for Synchronization" option enabled can have the option activated by checking the checkbox on the detail page. Just like when creating a new setting, once this option is activated, it cannot be deactivated again, so it should be selected carefully.

Synchronizing via Service Account

1. After registering the Cloud Provider for GCP, click the Synchronize button in the details page.

2. Enter the Service Account JSON key in the provided field and click Ok.

   1. You can create a Service Account and obtain the JSON key from the Google Cloud Console under IAM & Admin > Service Accounts.

3. The resources synchronized with the provided JSON key can be viewed in the DB Connections menu.

Required Permissions for GCP Service Accounts

• CloudSQL : CloudSQL Viewer

• BigQuery : BigQuery Administrator