Air Force Supercomputer Made From PS3's 212
The Air Force's Research Lab in Rome, NY. has one of the cheapest supercomputers ever made, and best of all over 3,000 of your friends can play Tekken on it. The computer is made from 1,716 PlayStation 3s linked together, and is used to process images from spy planes. From the article: "The Air Force calls the souped-up PlayStations the Condor Supercomputer and says it is among the 40 fastest computers in the world. The Condor went online late last year, and it will likely change the way the Air Force and the Air National Guard watch things on the ground." We covered this story back in December when the Condor first went online.
old news is old (Score:5, Informative)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2, Interesting)
Re: (Score:2)
I'd really like to see this...
Re: (Score:2)
Then again, since PS3's are sold at a loss, they really don't have much power to complain.
I'm sure Sony would be willing to sell the Air Force 1,700 PS3 development kits.
Re: (Score:2)
How would Sony not gain from this? What is the cost to them of selling 1700 consumer PS3's and what would the equivalent advertising cost them?
Re: (Score:2)
Sony would not gain from this because they sell the PS3 at a loss.
A consumer would buy games and/or movies, turning the loss-leader into a profit, the Air Force would not.
Re: (Score:2)
Sony chose to sell the PS3 units at a loss, the air force is merely taking advantage of the system.
The slim ps3 models are apparently no longer sold at a loss, and they also consume less power and produce less heat making them a better choice for supercomputing... However the OtherOS option is not available at all on the slim models...
Ofcourse the air force could always jailbreak the slim models, that would not only give them the power benefits and a source of new hardware, but on a jailbroken system you ge
Re: (Score:2)
Then again, since PS3's are sold at a loss, they really don't have much power to complain.
It's not the USAF's fault that Sony has a retarded business model.
Re: (Score:2)
Then again, since PS3's are sold at a loss, they really don't have much power to complain.
Yes they do. Just because a manufacturer's business practices are akin to gambling (selling systems in the hopes of making it up later) in no way affects a consumer's rights under law.
Re: (Score:2)
Re: (Score:2)
I see some sneaky saboteur sticking a recent game disk in in the middle of the night....
Re: (Score:2)
Re: (Score:2)
I almost expected the US Military to sue Sony for killing "Other OS" because of this.
"We only purchased the machines to use the "Other OS" option. Now that you killed it, the consoles are useless to us."
I assume the military is not using the machines to play games so the boxes do not encounter a situation where they need to upgrade their firmware.
So what's new? (Score:2, Insightful)
We covered this story back in December when the Condor first went online.
And ... what's changed?
Re: (Score:2)
The anniversary of the removal of the install other os option is this week. It's also been a little over a year since I've purchased anything from sony. Other than that, not much.
Upgrades. (Score:5, Funny)
Watch out for that next firmware update!
Re: (Score:2)
Came here to say exactly that. Done in one :)
Re: (Score:2)
Re:Upgrades. (Score:5, Informative)
I would worry more about Sony lawyers. They have got to be salivating at the Air Force's bankroll and trying to come up with a reason to sue.
I don't think you're kidding, but OMG, I nearly fell out of my chair laughing when I read that. Seriously, unless they're delusional psychopaths[1], they're not salivating, they're shitting their pants at the thought of being sued by the Air Force. You don't sell something to the US government with certain advertised capabilities, then take away those capabilities, then sue the US government for using them. Instead, you get sued by the US government until you beg for mercy.
[1] This is a possibility.
Re:Upgrades. (Score:4, Insightful)
No, I think salivating is right - because it'll mean a very long, protracted law suit likely - which means a lot of billable hours and at a higher rate because after all, they're not just dealing with anyone, they're handling the US Govt (realistic or not). Win or lose, it doesn't matter.
Re: (Score:2, Insightful)
And then having an air force general take the stand (in uniform) to testify as to how that very same feature is being used to defeat al-qaeda by the brave men and women of the US armed forces.....
Re: (Score:2)
This. Particularly sentence 2. Also, the Air Force, being a part of the US Government can exempt itself from lawsuits at will.
Re: (Score:2)
I doubt if billable hours are a concern. Sony needs lawyers so often, they probably have them on staff—i.e., on salary. There are a ton of lawyers who are willing to make less money if it also means having an 8–5, 5-days-a-week, job instead of a 90-hour workweek.
Not updating over internet (Score:2)
... You don't sell something to the US government with certain advertised capabilities, then take away those capabilities, then sue the US government for using them ...
The Air Force is probably not connecting to the internet and getting firmware updates from Sony.
Re: (Score:2, Informative)
Re: (Score:3)
They have given access to numerous other agencies and universities (Cornell, Dartmouth College, Florida, Maryland, Tennesse) to the system - whose access will be over the internet.
Re: (Score:2)
i guess it being the airforce, they have some serious network security in place, so it wouldnt surprise me at all to see all of sony's IPs blacklisted in their firewall anyway (or they should, just to be sure)
so i guess it would take a 3G-ethernet modem and a cable to ruin their day
Re: (Score:2)
Lol. Sony is so fucking stupid they actually sued their own god damn selves. With intellectual capacity like that pissing off the USAF is the last of their worries.
Re: (Score:2)
I would worry more about Sony lawyers. They have got to be salivating at the Air Force's bankroll and trying to come up with a reason to sue.
I don't think you're kidding, but OMG, I nearly fell out of my chair laughing when I read that. Seriously, unless they're delusional psychopaths[1], they're not salivating, they're shitting their pants at the thought of being sued by the Air Force. You don't sell something to the US government with certain advertised capabilities, then take away those capabilities, then sue the US government for using them. Instead, you get sued by the US government until you beg for mercy.
[1] This is a possibility.
No. You simply don't upgrade them to take away the capability.
If one broke I doubt they even bother to send it back. Just set it aside for parts. The time and effort to process a return is probably moor ethan it's worth.
Re: (Score:2)
And what if they want to replace a broken node? No new units being sold today have OtherOS capability, so their cluster would gradually shrink in size until it became useless.
Re:Upgrades. (Score:5, Insightful)
Yes, that's the wise thing to do. Pick on the customer who not only has more lawyers, who not only has special laws which apply to their behavior as a defense organization, who not only has more money than Sony, but who also has more friends in Congress.
If you're the 9th grade bully you don't go picking on the 12th grade wrestling star who's the son of the Principal. Pick battles you can win.
The wise thing to do is to produce a new SKU of the PS3 designed for distributed computing and development which allows the Other OS option and has a special SDK but, for example, can't join PSN (and perhaps cannot even play PS3 games) or which uses a special PSN for this purpose. Then you no have a way to sell these devices to your customers and you can increase the price per unit because you can no longer expect to recoup your losses on game software purchases. Indeed, all you should need to do is put in an option that lets you enable a distributed computing mode. Perhaps entering a software key which the bootstrap firmware will recognize. Then it's just a matter of selling a site license software key. You don't even need a truly different SKU.
"But people will hack it!" Like they already have? This way you get paid for legitimate people to use your product as they wish. You do what you can to prevent loss from hacking and the like, but it's not a valid excuse for not selling what people are demanding from you. The secret of capitalism is to give people what they want at a price they will pay, not to punish them for doing something you didn't expect.
Re: (Score:2)
Surely IBM sells "computers" based on the Cell processor? I assume all this demand is because it was available as cheap commodity hardware more than anything that gears a PS3 to being a speciality clustered supercomputer.
Re: (Score:3, Informative)
bladecenter qs22 starts at $9995 for two processor 3.2 ghz.
Granted nobody is supposed to pay MSRP but even that price is order of magnitude and a multiple over PS3 retail
Re: (Score:2)
With no return to Sony from video game and Blu-Ray or on-line services. While cannibalizing sales of Sonu's own commercial HPC.product.
What the geek is asking for is a hardware subsidy from Sony's consumer products division - to be paid, ultimately, by PS3 gamers.
It is not going to happen.
The OtherOS made its exit from the PS2 with the introduction of the PS2 Slim. No one built a HPC cluster from the PS3 b
Re: (Score:2)
Re: (Score:2)
Bullshit.
It's a cluster of 1,700 PS3s which means 1,700 consumer grade hard drives. Let's assume they've thought of this and changed to, say, Western Digital Caviar Blacks (so-called enterprise grade). Those have a 1.2 million hours MTBF. Normal consumer grade hard drives are closer to 750,000 hours.
1,200,000 hours MTBF / 24 hours per day = 50,000 mean drive days between failures
50,000 mean drive days betwee
Re: (Score:2)
Sony sells those, they cost a LOT more than a PS3 though, and I don't know if they'll sell them to just any joe schmoe who wants to run LInux on one. In fact, I'm not for certain they can run YDL. They have more RAM and a second hard drive too!
http://arstechnica.com/gaming/news/2009/03/sony-announces-lower-cost-ps3-dev-tools.ars [arstechnica.com]
http://www.scei.co.jp/corporate/release/090324e.html [scei.co.jp]
Re: (Score:2)
They probably can't. IBM blade's cost almost 5k per cpu. I doubt that whatever deal they got with IBM allows them to get these chips allows that. If anything, I suspect its this reason they pulled the linux option and blamed it on the hackers as a smokescreen.
Re: (Score:2)
The problem with your little scheme is this bit:
"and you can increase the price per unit because you can no longer expect to recoup your losses on game software purchases."
And that's where you hit a problem. Selling something to the government at a higher rate than what you sell it at to the general public, or, really anyone else, is itself illegal, and will get your company into a mess of trouble. You're right that they could argue that it's not the same, bla bla bla, but try getting a jury to agree that
Re:Upgrades. (Score:4, Interesting)
Re: (Score:2)
Sony Lawyers vs. United States Air Force
Round I: FIGHT!
Sony Lawyers use: File Lawsuit
Lawsuit has no effect.
United States Air Force uses: A10 Thunderbolt with GAU-8
It is SUPER effective!
United States Air Force wins!
Re: (Score:2)
Just wait until some of the machines fail and need to be replaced and the Air Force finds out they can't get what they bought anymore. Sony might want to preemptively work out an arrangement to keep from getting sued.
Re: (Score:2)
Everybody's claiming the Air Force could Sue Sony over the OtherOS feature. But (1) are the Air Force even using the feature or do they have the machines hacked at a lower level? Perhaps Sony even provided them with custom firmware? (2) assuming the Air Force used the OtherOS feature, do they have any more legal rights than the rest of us? Apparently, Sony has stated in their EULA's that it could remove features.
Re: (Score:2)
EULA for PSN, not for the PS3
Re: (Score:2)
No kidding. I suppose they have a special license from Sony to be doing this?
No, they're as screwed as anybody else if they allow the firmware update. And I believe (though I'm not 100% sure) that I read that they're joining the class action lawsuit against Sony. (You know you've made a bad decision when it results in being sued by the US government! OK, well, *I* would know it--not so sure about the flaming fucktards running Sony right now...)
Re:Upgrades. (Score:4, Interesting)
Oh no, no suing. Air Force gentlemen are much more devious...
In the next firmware update, the Air Force bombs Tokyo instead of Libya and blame it on Sony!
See what Sony can do against that
Re: (Score:2)
Just claim that the target coordinates have been coordinated by that PS3 cluster.
Re: (Score:2)
Oh no, no suing. Air Force gentlemen are much more devious...
In the next firmware update, the Air Force bombs Tokyo instead of Libya and blame it on Sony!
See what Sony can do against that
It started already. Do you think that it was a coincidence that there was a huge earthquake when the US military was testing a secret military satellite?
Like in the movies... (Score:5, Funny)
The Air Force is also using the Condor to process ground-based radar images of space objects, again with extraordinary clarity. Barnell shows images of a space shuttle orbiting Earth at 5 miles a second. Without Condor processing, the shuttle image is a blurry black triangle. With Condor processing, it is sharp and distinct. It’s clear that its payload doors are open.
Zoom! Enhance!
Re: (Score:2)
Now zoom in on the reflection on his sunglasses and flip the image.
Now show me the reflection on that cars fender and enhance it.
Now we can see what was around the corner...
War Games (Score:5, Funny)
Halp (Score:4, Funny)
Can you imagine (Score:2, Funny)
Can you imagine what it would be like if it was made instead of 1716 XBOX 360's?
They would be replacing red-ringed XBOXes more often than scientists had to replace vacuum tubes on ENIAC. [wikipedia.org]
Re: (Score:3)
I tried to. But for some reason, I can only imagine a beowulf cluster of them... ):
Re: (Score:2)
Re: (Score:2)
"I've come to kill your Monster!"
Re: (Score:2)
"Current Xbox"?
The current xbox is the xbox 360, which has a 3-core powerpc cpu. Each core of it bears a striking resemblance to the cell's PPE.
Re: (Score:2)
Converse would be more fun (Score:2)
Sensible (Score:2)
Specialized graphics h/w may not be useful here (Score:2)
Gaming consoles to do graphics processing, makes sense. They must have quite some specialised graphics related horse power, considering their planned output.
Not necessarily. The specialized hardware is designed to take a mathematical model of a world and to render that model into an image. Image processing, or more accurately computer vision - the part of image processing and artificial intelligence that is more relevant here, goes in the opposite direction. Computer vision takes an image and tries to generate mathematical models that describe the objects in the scene. For example recognizing if an object is a rock or a tank or an ambulance.
So I suspect the
Re: (Score:2)
IIRC from previous discussions regarding this platform, is that the PS3 is particularly well suited for doing fourier transforms and related analyses - graphics cards were also very capable in filtering signals in the seti@home project. Sounds somewhat similar to me. Edge detection, for example. Filtering signals from the noise where the noise is almost as bad as the signal.
From those discussions I also recall that the PS3 is not considered strong in general purpose number crunching work; your run-of-the-m
Re: (Score:3)
From those discussions I also recall that the PS3 is not considered strong in general purpose number crunching work; your run-of-the-mill Intel is doing much better across the board. It's these specific tasks where [specialized] units like the PS3 can shine. Them being marketed as gaming consoles of course helps in keeping volume up and cost down, making them almost disposable and at least easily replaceable in case of hardware failure.
(emphasis mine) -- There is an issue with this statement. You assume that newly purchased units can actually be used beyond the capacity to run Sony signed code.
Let's not forget that the PS3 should only be used for gaming according to their manufacturer. As I recall, Sony removed the "other-os" option and are suing those that wish to re-enable that option. Thus, the units that the USAF are using are not disposable because they can not be easily replaced in case of hardware failure...
Re: (Score:2)
Of course, the graphics card can be utilized with OpenCL (but I rather suspect that is mere icing on the cake).
examples of image processing? (Score:2)
They mention what improvement it can do but I wasn't able to find any examples. Anyone at least have that space shuttle example they mentioned?
When Nodes Fail, They're Screwed (Score:2)
How do they deal with nodes failing? Did they buy a bunch of spares? If not, they might be in trouble because you can't buy the OtherOS PS3's anymore.
Re: (Score:2)
No worries, it's the air force. They will just set up a no fly zone around Sony, and the problem will solve itself.
Re: (Score:2)
I'm pretty sure what they do is just crack them. At this point I'm pretty sure they've got some way of putting older firmware on the devices, and Sony can't do anything about it. The Federal government tends to quash law suits about this sort of thing before they get anywhere.
Re: (Score:3)
1) they have spares 2) they know how to hack firmware 3) they're not afeared of apples lawyers
Apple's lawyers? When did Apple's lawyers start enforcing Sony's EULAs for Sony against Sony's users???
Woah (Score:2)
Hard resets must be a bitch...
Obligatory (Score:2)
1716? (Score:2)
It was 1760 back in December, does that mean 44 have died since then? Are they sure they aren't using Xbox 360s?
Hope they don't need to service one (Score:2)
What "stuff is for" (Score:5, Insightful)
There's an attitude that's commonplace among with regards to stuff that you are supposed to do a particular thing with it. When you buy a can of Pringles, you are supposed to throw away the can! You buy a microwave for cooking, and the PS3 is for video games, and crayons are for kids to draw with, etc.
It's considered anachronistic to use crayons as an electric insulator, or PS3 for calculating aerodynamics, or use a microwave for generating and studying R/F interference patterns. And making long-range communications equipment from a Pringles can is.... just odd.
Yet none of these alternative uses would be particularly surprising to the engineering type, who think nothing of making a filter out of pantie-hose and a plastic butter container, because our type not only thinks outside the box, we decide what would be the best way to slice up the box in order to satisfy the problem at hand.
Good show Air Force!
Re: (Score:2)
What's scary is that people are starting to believe that a manufacturer is perfectly within their rights to limit what you can and cannot do with your stuff after you've bought it from them.
I walked into a conversation about PS3 jail-breaking and asked how a hammer manufacturer can limit my use of the hammer I purchased. Should I have to purchase a framing hammer, a roofing hammer, a birdhouse hammer, etc.? I completely gave up on the idea of ever having a serious conversation with those coworkers when the
To find out why they are doing this ... (Score:2)
Re: (Score:2)
No, I think this is just IBM's stupidity? narrow mindedless? I can't work them out. Ride the monopoly as hard as possible but of course this isn't quite a monopoly. Two years ago we bought a new IBM SAN from the "broker market" for just over 1/2 the "best" price from IBM. Of course IBM *still* made profit on the deal. Their POWER servers are so over priced, for the same money (broker market mind you) we can buy 3 beefy Intel servers with quite adequate performance, so they are seriously losing a lot of mark
The next step (Score:5, Insightful)
Even though the Slashdot Pundits dismiss this as useless, obviously the user community it supports thinks it is a big success. The claim is that Condor is in the to 40 supercomputers and it costs 10 times less then getting the same results using other hardware. Not too shabby.
It's likely that one of the reasons that this is so useful is the the SPE/Cell processors are good at the kind of image processing that the USAF is interested in. They are doing a lot of work in the Fourier domain, which is common for radar processing, so the Cell streaming 64 bit floating point architecture is well suited to the task.
From the article:
This translates to "We're going to use ARM processors as soon as possible".
These researchers see the value in leveraging commercial technology for cost effective high performance computing. If you want good performance per watt driven by a big commercial market the ARM is the way to go. There are GPUs that work with the ARM architecture, as well as ARM vector processing units. I would guess that they plan to use the upcoming generation of 64 bit ARM processors as soon as they are available. They might even start with current generation 32 bit dual CPU 2GHz hardware.
Just because the ARM is not as cool as CUDA doesn't make it useless. IBM has announce that it will not do a next gen PS3/Cell processor, so the USAF funding that effort by itself would be costly and have long lead times. ARM CPUs are only going to get cheaper, faster and be very power efficient. It's the obvious next step.
Re: (Score:2)
When I was doing Cell programming for scientific computing, the Cell's 64-bit double-precision performance actually blew chunks. The Cell found in PS3's, unless they've updated it in the past few years, is first and foremost a videogame processor.
If the Airforce could start from scratch today, I wonder if they'd get better performance for their money using GPU cards rather than PS3's.
ARM+CUDA (Score:2)
Just because the ARM is not as cool as CUDA doesn't make it useless.
Just for notice : the Tegra platform is an ARM cpu core with an Nvidia GPU unit.
Also Imagination Technologie (maker of the PowerVR GPU often coupled to ARM CPU's like on Texas Instrument's OMAP chip) is among the companies collaborating on OpenCL standard.
Qualcom's GPU is a core previously developped by ATI/AMD.
(And AMD's Fusion technologie could be scaled down to lower power requirement in the future).
As smartphone, tablets and such are going to need more parallel processing in the future (for video proces
Re: (Score:2)
The reason it was cost effective is because, like all console manufacturers, Sony subsidizes the hardware with the expectation of recouping the cost via game developer license fees.
I bet I could (Score:2)
Re: (Score:3, Funny)
No, because they don't *have* to update the firmware and as long as they're not planning to connect to the Playstation Network with it, they don't even *need* to update to the latest firmware that removes that functionality. Of course, if they did have to, I bet it sure would come in handy if there was some guy who could "jailbreak" the system to allow people to make further use of it. *ahem*
Re: (Score:3)
That doesn't sound right. I haven't used it myself, but I understood that the other OS had access to all the Cell cores, it just couldn't access the RSX GPU, which wouldn't really matter for a number crunching cluster.
Re: (Score:3)
It might - the GPU is usually the bit that crunches vectors best, and that is something I imagine to be fairly useful for the kinds of purposes the Air Force might put it to. Anyone know if the Cell is more suited to this task?
Re: (Score:3, Interesting)
Re: (Score:2)
AFAK The original design of the ps3 didn't even have a GPU, the cell is more than capable.
You're right about the first part AFAIK, but no, it isn't. The cell is far too weedy for doing realtime rendering. It doesn't even have dedicated texture filtering support, so it would have to emulate that. A Bi/TriLerp being a horribly expensive thing to emulate...
The cell gets used a fair bit to take some load off of the GPU, by doing pre-culling of triangles and post-process effects, but it's still an order of magnitude less powerful than the GPU is.
Re: (Score:2)
The *original* PS3 design had no dedicated GPU. Then they found out how much perofrmance sucked and did a sony hack job by adding the RSX
Re: (Score:2)
Your right I think... I don't know I cant find anything definition either way. I do know that other os was hobbled to some extent. The graphics card is often better at very parallel tasks then the processor(IIRRC)... thats why you see all the distributed computing clients that can use them. So Ill stand by my point that its very likely the air force isn't using the same other os feature that we all know and love.
Re: (Score:2)
Re: (Score:3, Informative)
Fuckin' Goatse in the library again!!!
This is just another of those occasions when you WISH for a better content filter system... in the same library, when you try to look at a little bit of sleaze like Facebook you are told "Fortinet blah blah forget it".
Re: (Score:2)
Despite being slightly trolly about your opinion of PS3 games, you are probably nonetheless correct.
The PS3 is massively parallelised (spelling Nazis - go!) compared to XBOX, and is therefore harder to fully utilize by games progammers than the more serial XBOX but for supercomputing there is likely a notable difference, hence the adoption.
The parent troll's comment about RROD probably had a ring of truth to it, too, as the Cell CPU is on IBM originally intended for, you guessed it, supercomputing a
Re: (Score:2)
Your post really didn't sit well with me, so I looked it up. I found some conflicting viewpoints in different style guides, but Wikipedia surprisingly seems most concise (because it represents multiple views).
http://en.wikipedia.org/wiki/Acronym_and_initialism#Representing_plurals_and_possessives [wikipedia.org]
Re: (Score:2)
You still get 6 SPE's under Linux, ever watch the PS3 boot up Linux? Look for the 2 Big penguins and the 6 little ones. And if you're clustering PS3's you're probably running headless.
Re: (Score:2)
considering this has been happening since the xbox 1 days, wtf did sony even try the loss-leading model?
like my fucking phone company "improving" my service by ensuring i always run out of credit with the new pricing model. they're like "oops! sorry! we actually gave you too good a deal, so we'll have to fix that now that you're signed up. i'm sure you didn't sign up because of the fact it was a good deal, so it's not like we're misrepresenting ourselves or anything"
Re: (Score:2)
Then cancel your contract, without penalty, and walk away.
Re: (Score:2)
Sony makes a profit on each PS3 they sell, after they stripped out the extra chips and found other ways to economize they do make money on each console they ship. Just the amount is tiny compared to what they make licensing games to run on it.
Re: (Score:2)