120 petabytes: IBM building largest data storage array ever
August 29, 2011 by Bob Yirka
(PhysOrg.com) -- As computers big and small grow ever faster, new and better ways to store more data must be developed as well to keep up with the demand. It wasnt all that long ago that a 1 gigabyte hard drive on a personal computer seemed the stuff of science fiction. On the higher end, ever faster supercomputers require not just more data storage but an ability to save and retrieve data faster as well, otherwise theyd spend more and more time dedicated to doing nothing but searching for that data. To address the situation, IBM is apparently hard at work assembling the largest data array ever, which will utilize the fastest data storage and retrieval system ever devised, allowing for the storage of 120 petabytes of data (120 million gigabytes) using its newly refined GPFS file system that is capable of indexing 10 billion files in just forty three minutes.
Housed in IBMs Almaden, California research facility, the new as yet unnamed data array is reportedly being underwritten by an unnamed client with a lot of money to spend. Based on the situation with the U.S. governments financial situation, it seems more likely the client is someone like Microsoft, Apple or Google, though for what purpose such a huge array would serve is a mystery. Traditionally, supercomputers and their huge data servers have been used to model weather, military or physics experiments. Now however, the focus might be on ways to crunch ever more data in a faster fashion, which sounds a lot like something Google might be interested in doing, especially when you consider that so much data is moving onto the cloud.
The array works by connecting 200,000 standard (likely 1 terabyte drives) together in a traditional warehouse, though more tightly compacted together than usual in special extra wide drawers. The drives will be kept cool by normal air-conditioning in conjunction with a water cooling system, something IBM has been using for years with its supercomputers; when finished the array will dwarf current systems, which are typically able to store just 15 petabytes of data. To make sure drive failures dont slow down computations on the supercomputer, data is stored in a redundant fashion over multiple drives, which are striped to allow for accessing large chunks of data simultaneously. When a drive dies, data is moved slowly to its replacement, spreading processing time over a relatively long period, allowing the processor to focus on its main tasks.
The new array, while seemingly for the moment to be almost overkill, is likely to be followed by other even larger systems as more and more data storage becomes necessary. The hope though, is that some new breakthrough will occur that will allow for huge increases in data storage capacity that wont mean simply adding more and more conventional storage medium to existing technology.
More information: via Technology Review
© 2011 PhysOrg.com
-
From lemons to lemonade: Reaction uses carbon dioxide to make carbon-based semiconductor,
32 comments
-
Thioridazine kills cancer stem cells in human while avoiding toxic side-effects of conventional cancer treatments,
3 comments
-
SpaceX private rocket blasts off for space station (Update),
42 comments
-
Climate scientists say they have solved riddle of rising sea,
31 comments
-
SpaceX capsule has 'new car' smell, astronauts say (Update),
2 comments
-
Need a rigid insulation material???
15 hours ago
-
magnets or EMF in car bumpers to protect from fender bender
May 26, 2012
-
length of wire in a coil of known dimensions?
May 25, 2012
-
India Engineering Powerhouse
May 25, 2012
-
electromagnet core dereference between hard and soft iron
May 25, 2012
-
Measuring water pressure in an open tank
May 24, 2012
- More from Physics Forums - General Engineering
More news stories
Nvidia trumpets Tegra 3 phone design wins for 2012
(Phys.org) -- Nvidias competitive war paint has a name, Tegra 3. On the heels of Nvidia announcements about lowering costs of its Tegra 3 processors and Nvidia-enabled tablets running Android Ice Cream ...
Dell tablet leak: 10.1-inch display, two-battery choice
(Phys.org) -- Headline after headline talks about vendors tablets in the wings as likely number-one contenders for the iPad. Such claims have justifiably been taken with a grain of salt, considering ...
Nvidia says Kai platform will turn price tide for tablets
(Phys.org) -- In March, Nvidia gave some signs that they were working to lower the cost of their Tegra 3 processors and they suggested consumers might see prices for Android tablets as low as $199. Connect ...
OmniVision tops up sensors for cameras, phones
(Phys.org) -- OmniVision has announced two high-resolution image sensors for the digital still and digital video camera market (DS/DVC) and higher end smartphones. In end-user language, it is a claim for superior ...
MIT researchers devise new means to synchronize a group of robots (w/ Video)
(Phys.org) -- For several years, roboticists have been working out ways to get a group of robots to perform synchronized activities as demonstrated most often in dance routines. Its not just about trying ...
Browser wars flare in mobile space
The browser wars are heating up again, but this time the fight is for dominance of the mobile Internet.
Scientist: Evolution debate will soon be history
(AP) -- Richard Leakey predicts skepticism over evolution will soon be history. Not that the avowed atheist has any doubts himself.
Keep food safety in mind this memorial day weekend
(HealthDay) -- Picnics, parades and cookouts are as much a part of Memorial Day weekend as tributes to the United States' war veterans.
Social welfare cuts ultimately come with heavy price, researchers say
(Phys.org) -- Slashing government funding for Medicaid, food stamps and other programs that serve the poor while politically popular with some lawmakers and many conservatives may do more harm ...
Is a classical electrodynamics law incompatible with special relativity?
(Phys.org) -- The laws of classical electromagnetism that were developed in the 19th century are the same laws that scientists use today. They include Maxwell’s four equations along with the Lorentz la ...
Landmark calculation clears the way to answering how matter is formed
(Phys.org) -- An international collaboration of scientists, including Thomas Blum, associate professor of physics, is reporting in landmark detail the decay process of a subatomic particle called a kaon ...
Aug 29, 2011
Rank: 4.1 / 5 (12)
- We don't know who orderd it [insert speculation about some companies].
- We don't what it's for [insert speculation about some uses].
- And it's "likely to be followed by even larger systems" [insert speculation that there may be future technologies in the future...Duh].
Result: I don't know what I'm supposed to do with an article like that [insert speculation about the aptitude of the author for journalism].
Aug 29, 2011
Rank: not rated yet
IBM - and not - will be building the largest data storage system ever. May other companies jostle for the largest share of media hype and personality cult, IBM delivers.
Non-bloated PR as a pleasant touch of sobriety.
Aug 29, 2011
Rank: 1 / 5 (2)
Aug 29, 2011
Rank: 1 / 5 (2)
Aug 29, 2011
Rank: 1 / 5 (2)
Mapping of a persons brain after death could lead to immortality.
Aug 30, 2011
Rank: 5 / 5 (3)
Aug 30, 2011
Rank: not rated yet
Making a (working) copy still means that the (biological) original dies at some point. So from the point of view of the individual copied he hasn't gained anything.
Aug 30, 2011
Rank: not rated yet
Aug 30, 2011
Rank: not rated yet
I doubt a "working" model is possible using current technology. However in another decade or so a digital version might work containing all the memories and thoughts of the deceased. Further ahead, nano technology may be able to reproduce the brain and body using this saved data and stored DNA. Cryogenics for the digital age.
Sep 01, 2011
Rank: not rated yet
Correct me if I am wrong, but 1Petabyte is 1024Gigabyte.
So, 120PB = 120 * 1024GB which equals only 122,880 GigaBytes
Where did the author get 120 million? That's a thousand times more! This article has poor quality written all over it.
Sep 02, 2011
Rank: not rated yet
No. 1 terabyte is 1000 gigabytes. 1 petabyte is indeed a million gigabytes.
(As an aside: If you go by powers of two then it's not gigabytes (GB), terabytes (TB), etc. but gibibytes, tebibytes, ... and get the abbreviations GiB, TiB, etc. )
Sep 02, 2011
Rank: not rated yet
1024 bytes = 1kB
So when you're converting from kB to MB to GB and wherever from there, it's all 1 to 1.
But when you go back down to bytes, you need to add the extra 24 bytes for each kB.
So, 1PB = 1,000,000,000,000,000,000kB = 1,024,000,000,000,000,000,000 bytes
In actuality, it's all translating down to bytes, and to binary bits from there. the kB, MB, GB TB, PB, etc., are just for our convenience.
Sep 02, 2011
Rank: not rated yet
False.
Binary values are powers of 2. 2^10 = 1k, 2^20 = 1m... 2^20 = 1024 * 1024... not 1024 * 1000...
kilo = 2^10
mega = 2^20
giga = 2^30
tera = 2^40
peta = 2^50
I often wonder where people get their information...
Sep 02, 2011
Rank: 5 / 5 (1)
Sep 02, 2011
Rank: 5 / 5 (1)
kilo literally means "a thousand" (not 2^10). It's derived from a greek word.
("mega" just means "big", but in SI convention mega, giga, etc. are reserved for powers of ten, not two)
Sep 02, 2011
Rank: not rated yet
You're dropping context... I was not giving a lesson on etymology.
Sep 02, 2011
Rank: not rated yet
Sep 02, 2011
Rank: not rated yet
I wouldn't be surprised... but engineers don't have that "ripping off the customer" bias.
Sep 02, 2011
Rank: not rated yet
Actually, it's because 1024 is divisble by eight, whereas 1000 is not. Eight bits in a byte... Don't put more into it than there actually is.
Sep 02, 2011
Rank: not rated yet
(Just look at Apple. They have perfected the sell-overpriced-junk-through-media-hype marketing ploy. Their trinkets are fully 60% profit and the specs are abominable compared to other products on the market. )
Sep 04, 2011
Rank: not rated yet
Sep 04, 2011
Rank: not rated yet
Sep 04, 2011
Rank: not rated yet
I forgot there's Tera after Giga and before Peta!
Sep 06, 2011
Rank: not rated yet
And why are there 8 bits in a byte instead of, say, 10?... because it is a binary power of two.
The answer is that 1024 is a power of 2, and 1000 is not... as I said.
I'm a software and firmware engineer with 15 years of experience.