New advances in non-volatile memory - PMC, PRAM and NRAM

The end is in sight for spinning rust....

While flash based memory is nibbling at the edges of the disk industry, some new techniques are opening up prospects of even greater capacity and speeds in the next few years.

PMC stands for Programmable Metallization Cell, see this MIT review article.

PRAM stands for Phase-change Random Access Memory, some recent news seems to indicate that good progress is being made on PRAM as well as larger and faster Flash memory.

Update:

This SC07 article from The Register states that NRAM stands for Nanotube RAM, the makers claim that they will beat Flash on every metric in a few years time, and several of the big semiconductor companies are looking into the technology.

More on the Cortex A9

Another update from Ashlee Vance at The Register gives more details on the Cortex A9. They say its a four issue superscalar (the Cortex A8 is dual issue), 8 times the performance of the iPhone CPU, runs at 250mW and should be in devices in around 2010. The A8 was announced in 2005 and three years is a typical lead time for CPU architectures to get into production, so I expect A8 based devices sometime next year, perhaps even a faster iPhone...

There is also some discussion of Intel moving down into this space over the next few years. Excellent! Competition will drive the market to develop faster and I don't personally care what the instruction set is any more (I used to...)

Multicore ARM Chips - Cortex A9

Performance is cranking up, now we have four core ARM chips on the horizon...

Infoworld article on the announcement.

Each of these cores seems to be based on the dual issue 1GHz Cortex A8 design that was announced a few years ago, and which isn't quite shipping yet in products.

So to put this in perspective, the CPU in the Gumstix Verdex and the iPhone is around 600MHz single issue, the Cortex A8 is around three times the raw performance and the new announcement is about twelve times the raw performance. These all seem to be around the same levels of power consumption, in the few hundred milliwatt range.

I would not expect to have the multicore ARM Cortex A9 in actual products in my pocket for a few years, but its good to have a roadmap into the future of millicomputing.

Qualcomm Scorpion - ARM Cortex based CPU

The first devices based on the new ARM Cortex generation are announced from Qualcomm, their Scorpion design runs at 1GHz, 250-500mW, and the Cortex based pipeline is dual issue, so the raw instruction issue rate is twice per MHz that of older ARM designs such as the PXA320.

Millicomputing Applications - ETL

Millicomputers have a very different balance of compute/memory/network/io resources compared to more conventional architectures. They are lower in absolute terms for compute/memory/network, but much higher for random access io.

The performance per watt and the price/performance are very competitive for compute/memory/network, as long as applications can be run at a smaller "grain size". However for io, the aggregate performance of a large number of direct attached flash devices is amazing.

One possible application is from the data warehousing space. Known as ETL, this is the Extract Transform and Load step that pulls data from online transaction processing systems, such as the collection of database back-ends for a web site, and puts it into a form that can be queried to answer questions about the business. There has been a lot of work put into making the ETL processes into decomposable parallel applications, and there is an open source ETL implementation in Java called KETL. KETL was originally written several years ago, when the typical systems of the day were similar in capacity to the millicomputers we have today, so I'm hopeful that the grain size will fit.

KETL is io intensive and it also supports running on a cluster of networked computers, so overall it looks like a plausible fit for an enterprise millicomputer application.

The Future of Millicomputing

There is a gap between the performance and memory capacity of Millicomputers and mainstream CPUs, that gap is shrinking but how fast, and what are the next steps?

The base technology from ARM can be seen in their Cortex designs. These were disclosed in late 2005, but have yet to appear in actual products. The overall performance is around 3-4 times the performance of the current generation of ARM based devices.

Since Intel sold off their ARM based CPU business to Marvell, it leaves them clear to move their core 32bit x86 platform architecture down into the millicomputing space.

So in the next few years, I expect to see x86 and ARM based system on a chip architectures with overlapping performance and power consumption characteristics in the millicomputing space.

Lower Power x86 Systems

There is quite a lot of activity in the low power x86 compatible space. The latest CPU from VIA is touted as a 1W CPU, with 0.1W standby power, but when the complete chipset and RAM are added its substantially higher, more like 10W. This article in LinuxDevices.com surveys the whole space very nicely.

The power trend is downwards, these chip sets are aimed at consumer devices, but not in the battery powered space. For commodity devices we can divide by the order of magnitude in power consumption and environmental conditions.

100-1000W Datacenter Server (air conditioned room)

10-100W Home PC/Laptop Space (fan cooled, on when in use, ambient room temp)

1-10W Home consumer devices (fanless, always on, ambient room temp) 

100-1000 mW Battery powered millicomputers (always on, cool enough for your pocket)

Interesting technology and product disruptions occur when we mix these spaces. In some ways, the original compute farms that Google built were leveraging the low end home PC power/price/performance point into the datacenter. There are additional opportunities to leverage home consumer devices and millicomputers into the enterprise space.