Twitter opens MySQL migration tool

Jul 06, 2010

Trevan McGee

'Crane' allows MySQL data integration in Hadoop.

At last week's Hadoop Summit, Twitter Analytics Lead Kevin Weil announced that it would open source Crane, its data migration tool used to move MySQL data into Hadoop.

Hadoop is used by Twitter to examine collected analytics as well as data crunching for live tools such as name search. Weil said that Twitter uses Scribe to log data into Hadoop and Crane to manage tabular data.

Crane moves MySQL data to the Hadoop filesystem (HDFS), Hbase, another Hadoop-compatible database, Flock, Google Analytics, or Facebook Insights.

Comments

Twitter opens MySQL migration tool

Sherry Houck
'Crane' allows MySQL data integration in Hadoop. Should you think that the title of this post is useful, odds are you are considering about using Linux as your primary or even just an alternative Os when you're just sick of your old system. However many think that Linux is too complicated that it appeals only to geeks, Linux-magazine.com can prove that this great operating system is actually for everyone. It is often fascinating to read about Twitter opens MySQL migration tool.

Sherry Houck,
http://dentalinsuranceplanspro.com/la-ent/new-iberia-tne.php

comments powered by Disqus

Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters

Support Our Work

Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.

News

There's a New Open Source Terminal App in Town

Linux , open source

Ghostty is a new Linux terminal app that's fast, feature-rich, and offers a platform-native GUI while remaining cross-platform.
Fedora Asahi Remix 41 Available for Apple Silicon

Fedora , Linux , Mac

If you have an Apple Silicon Mac and you're hoping to install Fedora, you're in luck because the latest release supports the M1 and M2 chips.
Systemd Fixes Bug While Facing New Challenger in GNU Shepherd

Linux , Software , Systemd

The systemd developers have fixed a really nasty bug amid the release of the new GNU Shepherd init system.
AlmaLinux 10.0 Beta Released

AlmaLinux , Enterprise Linux , open source

The AlmaLinux OS Foundation has announced the availability of AlmaLinux 10.0 Beta ("Purple Lion") for all supported devices with significant changes.
Gnome 47.2 Now Available

Gnome , Linux , open source

Gnome 47.2 is now available for general use but don't expect much in the way of newness, as this is all about improvements and bug fixes.
Latest Cinnamon Desktop Releases with a Bold New Look

Cinnamon , Linux , open source

Just in time for the holidays, the developer of the Cinnamon desktop has shipped a new release to help spice up your eggnog with new features and a new look.
Armbian 24.11 Released with Expanded Hardware Support

Armbian , DEBIAN , Ubuntu

If you've been waiting for Armbian to support OrangePi 5 Max and Radxa ROCK 5B+, the wait is over.
SUSE Renames Several Products for Better Name Recognition

Enterprise Linux , SUSE , Virtualization

SUSE has been a very powerful player in the European market, but it knows it must branch out to gain serious traction. Will a name change do the trick?
ESET Discovers New Linux Malware

Linux , malware , Security

WolfsBane is an all-in-one malware that has hit the Linux operating system and includes a dropper, a launcher, and a backdoor.
New Linux Kernel Patch Allows Forcing a CPU Mitigation

Kernel , Linux , Security

Even when CPU mitigations can consume precious CPU cycles, it might not be a bad idea to allow users to enable them, even if your machine isn't vulnerable.

Twitter opens MySQL migration tool

Related content

Comments