Transfer Service for On-premises Data
Introduction
Google Cloud's Transfer Service for on-premises data allows you to transfer large amounts of data from your local data center to Google Cloud Storage. This tutorial will guide you through the process, from initial setup to data transfer completion.
Prerequisites
Before starting, ensure you have the following:
- A Google Cloud project with billing enabled.
- Access to the Google Cloud Console.
- Google Cloud SDK installed on your local machine.
- Permissions to create and manage storage buckets in Google Cloud Storage.
Step 1: Setting Up Google Cloud Storage
First, you'll need to create a Google Cloud Storage bucket to hold your transferred data.
gsutil mb gs://your-bucket-name
Step 2: Installing the Transfer Service Agent
Next, install the Transfer Service agent on your on-premises server. The agent will facilitate the data transfer to Google Cloud Storage.
curl -O https://storage.googleapis.com/storage-transfer-service/agent-install.sh
chmod +x agent-install.sh
./agent-install.sh
Step 3: Configuring the Transfer Service
Now, configure the Transfer Service to connect to your on-premises data and Google Cloud Storage bucket.
gcloud transfer jobs create --source-agent-id=your-agent-id --destination=gs://your-bucket-name --source-root=/path/to/data
Step 4: Monitoring the Transfer
Once the transfer job is running, you can monitor its progress in the Google Cloud Console.
Navigate to the "Transfer" section in the Google Cloud Console to view real-time updates and logs.
Step 5: Verifying Data Integrity
After the transfer completes, verify the integrity of the transferred data.
Use the following command to compare checksums:
gsutil hash -m gs://your-bucket-name/*
Conclusion
By following these steps, you've successfully transferred data from your on-premises environment to Google Cloud Storage. This service is highly scalable and efficient, making it ideal for large-scale data migrations.