Manage Amazon S3 with s3cmd
Productivity Sauce
While Amazon S3 provides reliable and cheap backup, you need a third-party application to put the service to some practical use. JungleDisk is one of the most popular Amazon S3-based backup solutions out there, but it's not the only fish in the sea. If you are looking for a no-frills tool which can help you to manage the Amazon S3 service, try s3cmd -- a simple command-line utility written in Python.
Before you start, you have to sign up for the Amazon S3 service, if you haven't already done that. To install s3cmd on your machine, download the latest release of the utility, unpack the downloaded archive, use the terminal to switch to the resulting directory and run the python setup.py install command as root. Next, you have to configure it using the s3cmd --configure command (have your Amazon identification keys ready to enter when prompted). Once s3cmd is configured and ready to go, you have to create a so-called bucket -- a repository on Amazon S3 servers where you store your files. To do this, use the s3cmd mb s3://BUCKET command, where BUCKET is a unique name for your bucket. Keep in mind that the bucket name must be unique among all buckets on the Amazon S3 servers, so you have to come up with something more original than "myfiles" or "documents". Fortunately, you don't have to remember the exact name of the bucket, as you can use the s3cmd ls command to view all your existing buckets on Amazon S3. To upload a single file, use the s3cmd put command followed by the path to the file and the target bucket, for example:
s3cmd put /path/to/loremipsum.odt s3://20081113-1258zrtm7
To download a file from the bucket on your machine, you can use the s3cmd get command and specify the bucket and the name of the downloaded file:
s3cmd get s3://20081113-1258zrtm7/loremipsum.odt loremipsum.odt
If you want to back up an entire directory, uploading files one-by-one is not very practical. Fortunately, s3cmd features the sync command that allows you to synchronize a local directory with a directory in an S3 bucket:
s3cmd sync /path/to/dir s3://20081113-1258zrtm7/backup
Using the same command, you can also do a reverse synchronization which effectively acts as a restore operation:
s3cmd sync s3://20081113-1258zrtm7/backup /path/to/dir
To view a list of other commands supported by s3cmd, run the s3cmd --help command.
comments powered by DisqusSubscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters
Support Our Work
Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.
News
-
Systemd Fixes Bug While Facing New Challenger in GNU Shepherd
The systemd developers have fixed a really nasty bug amid the release of the new GNU Shepherd init system.
-
AlmaLinux 10.0 Beta Released
The AlmaLinux OS Foundation has announced the availability of AlmaLinux 10.0 Beta ("Purple Lion") for all supported devices with significant changes.
-
Gnome 47.2 Now Available
Gnome 47.2 is now available for general use but don't expect much in the way of newness, as this is all about improvements and bug fixes.
-
Latest Cinnamon Desktop Releases with a Bold New Look
Just in time for the holidays, the developer of the Cinnamon desktop has shipped a new release to help spice up your eggnog with new features and a new look.
-
Armbian 24.11 Released with Expanded Hardware Support
If you've been waiting for Armbian to support OrangePi 5 Max and Radxa ROCK 5B+, the wait is over.
-
SUSE Renames Several Products for Better Name Recognition
SUSE has been a very powerful player in the European market, but it knows it must branch out to gain serious traction. Will a name change do the trick?
-
ESET Discovers New Linux Malware
WolfsBane is an all-in-one malware that has hit the Linux operating system and includes a dropper, a launcher, and a backdoor.
-
New Linux Kernel Patch Allows Forcing a CPU Mitigation
Even when CPU mitigations can consume precious CPU cycles, it might not be a bad idea to allow users to enable them, even if your machine isn't vulnerable.
-
Red Hat Enterprise Linux 9.5 Released
Notify your friends, loved ones, and colleagues that the latest version of RHEL is available with plenty of enhancements.
-
Linux Sees Massive Performance Increase from a Single Line of Code
With one line of code, Intel was able to increase the performance of the Linux kernel by 4,000 percent.