Once you have a Cloud Storage bucket, the next question is how to actually get data into it, and Google Cloud gives you three main paths for moving files and objects: the gcloud storage command line tool, the Storage Transfer Service, and the Transfer Appliance. They are not interchangeable. The right choice depends on three things, the source of the data, the volume you need to move, and the network connectivity you have available. The Professional Cloud Database Engineer exam expects you to read a scenario, pick out those three details, and map them to the correct tool. This article walks through each option and the boundaries between them.
The gcloud storage command line tool moves data from either an on-premises environment or from within Google Cloud itself. It is the best fit when you have less than one terabyte of data to move. Because the volume is relatively small, it uses an online transfer type, sending files directly over the internet to your bucket. There is no special hardware and no managed job to schedule, you run commands and the data goes up.
One naming detail is worth clearing up, because it shows up in older material. The gsutil tool was the original command line utility for Cloud Storage, and gcloud storage is the newer command that has taken over that role. They cover the same kind of work, moving objects in and out of buckets from a terminal. For exam purposes, treat the command line option as the small-volume, online path regardless of which name a question uses.
The Storage Transfer Service widens the set of sources you can pull from. It handles an on-premises source, data already in Google Cloud, or even another cloud storage provider such as AWS or Azure. That last part is the main thing that sets it apart, it is the option built to bring data across from a different cloud.
You would choose the Storage Transfer Service when your data scales from one terabyte up to hundreds of terabytes. It still performs an online transfer, moving the data over the network rather than through shipped hardware, and Google recommends at least 100 megabits per second of bandwidth so that those larger volumes move efficiently. The deciding signals in a scenario are the size sitting above a terabyte and, often, a source that lives in another cloud.
The Transfer Appliance is a physical high-capacity server that Google ships to your data center. Because it is hardware that arrives at a physical site, it is used exclusively for an on-premises source. It is designed for cases where you have more than hundreds of terabytes, where moving data over the internet is no longer practical or your available bandwidth is not enough to finish in a reasonable time.
This is the one offline option of the three. Instead of streaming data across the network, you load the appliance on site and physically ship the hardware back to a Google data center, where the data is uploaded into your bucket. When a scenario describes an enormous volume combined with limited or insufficient bandwidth, the Transfer Appliance is the path the exam is pointing at.
The three options line up along data size and transfer type. Less than one terabyte points to gcloud storage over an online transfer. One terabyte to hundreds of terabytes points to the Storage Transfer Service, also online, and it is the only one of the three that reaches another cloud provider as a source. More than hundreds of terabytes, especially where bandwidth is a constraint, points to the Transfer Appliance with its offline, ship-the-hardware approach. Reading the volume and the connectivity out of a question usually settles which tool applies.
One broader point is worth keeping in mind. These three tools are specifically for moving files and objects into Cloud Storage. On the Professional Cloud Database Engineer exam, many transfer scenarios are really about moving a database, and those are answered with database migration services rather than object transfer tools. So it helps to first decide whether a scenario is about generic files going into a bucket or about migrating a database, and only then reach for the Cloud Storage transfer options described here.
Our Professional Cloud Database Engineer course covers Cloud Storage data transfer options alongside Database Migration Service and Cloud Storage fundamentals, with practice questions that drill these distinctions.
