Photo

Opening up Aperture

Apple introduced Aperture, its professional workflow management application at the Photo Plus trade show in New York on 2005-10-19. Initial speculation was that Apple had finally decided to bring its deteriorating relationship with Adobe to a head and release a Photoshop competitor. This was quickly dispelled and its true positioning as a high-end workflow application for professional digital photographers became more apparent. This is not just a fig leaf to appease Adobe — Aperture does indeed lack most of Photoshop (or even Elements’) functionality. It is a Bridge-killer of sorts, not that the sluggish, resource-hogging piece of bugware that is Bridge could be really be qualified as “alive”. The simplest description of Aperture is that it is iPhoto for professional photographers.

I received my copy today, and will be putting it through its paces in a series of longer articles over the coming weeks, with this article as the central nexus:

  1. First impressions
  2. Asset management
  3. Under the hood: file format internals

The megapixel myth revisited

Introduction

As my family’s resident photo geek, I often get asked what camera to buy, specially now that most people are upgrading to digital. Almost invariably, the first question is “how many megapixels should I get?”. Unfortunately, it is not as simple as that, megapixels have become the photo industry’s equivalent of the personal computer industry’s megahertz myth, and in some cases this leads to counterproductive design decisions.

A digital photo is the output of a complex chain involving the lens, various filters and microlenses in front of the sensor, and the electronics and software that post-process the signals from the sensor to produce the image. The image quality is only as good as the weakest link in the chain. High quality lenses are expensive to manufacture, for instance, and often manufacturers skimp on them.

The problem with megapixels as a measure of camera performance is that not all pixels are born equal. No amount of pixels will compensate for a fuzzy lens, but even with a perfect lens, there are two factors that make the difference: noise and interpolation.

Noise

All electronic sensors introduce some measure of electronic noise, among others due to the random thermal motion of electrons. This shows itself as little colored flecks that give a grainy appearance to images (although the effect is quite different from film grain). The less noise, the better, obviously, and there are only so many ways to improve the signal to noise ratio:

  • Reduce noise by improving the process technology. Improvements in this area occur slowly, typically each process generation takes 12 to 18 months to appear.
  • Increase the signal by increasing the amount of light that strikes each sensor photosite. This can be done by using faster lenses or larger sensors with larger photosites. Or by only shooting photos in broad daylight where there are plenty of photons to go around.

Fast lenses are expensive to manufacture, specially fast zoom lenses (a Canon or Nikon 28-70mm f/2.8 zoom lens costs well over $1000). Large sensors are more expensive to manufacture than small ones because you can fit fewer on a wafer of silicon, and as the likelihood of one being ruined by an errant grain of dust is higher, large sensors have lower yields. A sensor twice the die area might cost four times as much. A “full-frame” 36mm x 24mm sensor (the same size as 35mm film) stresses the limits of current technology (it has 4 times the die size of the latest-generation “Sandy Bridge” quad-core Intel Core i7), which is why the cheapest full-frame bodies like the Canon EOS 5DmkII or Nikon D700 cost $2,500, whereas a DSLR with an APS-C sized sensor (that has 40% the surface area of a full-frame sensor) can be had for under $500. Larger professional medium-format digital backs can easily reach $25,000 and higher.

This page illustrates the difference in size of the sensors on various consumer digital cameras compared to those on some high-end digital SLRs. Most compact digital cameras have tiny 1/1.8″ or 2/3″ sensors at best (these numbers are a legacy of TV camera tube ratings and do not have a relationship with sensor dimensions, see DPReview’s glossary entry on sensor sizes for an explanation).

For any given generation of cameras, the conclusion is clear – bigger pixels are better, they yield sharper, smoother images with more latitude for creative manipulation of depth of field. This is not true across generations, however, Canon’s EOS-10D had twice as many pixels as the two generations older EOS-D30 for a sensor of the same size, but it still manages to have lower noise thanks to improvements in Canon’s CMOS process. Current bodies like the 7D have 6 times the pixels of the D30 while still having better noise levels, the benefits of 10 years of progress from sensor engineers.

The problem is, as most consumers fixate on megapixels, many camera manufacturers are deliberately cramming too many pixels in too little silicon real estate just to have megapixel ratings that look good on paper. The current batch of point-and-shoot cameras cram 14 million pixels in tiny 1/2.3″ sensors. Only slightly less egregious, the premium-priced Canon G12 puts 10.1M pixels in a 1/1.7″ sensor, the resulting photosites are 1/10 the size of those on the similarly priced 10 megapixel Nikon D3000. Canon Digital Rebel T3i (EOS-D600) and 1/16 of those on the significantly more expensive 21MP Canon 5DmkII.

Predictably, the noise levels of the G12 are poor in anything but bright sunlight, just as a “150 Watts” ghetto blaster is incapable of reproducing the fine nuances of real music. The camera masks this with digital signal processing that conceals noise by smoothing pictures, thus smudging noise but also removing the details those extra megapixels were supposed to deliver. The DSLR will yield far superior images in most circumstances, but naive purchasers could easily be swayed by the 2 extra megapixels into buying the inferior yet overpriced Sony product. Unfortunately, there is a Gresham’s law at work and manufacturers are still racing to the bottom, although: Nikon and Canon have also introduced 8 megapixel cameras with tiny sensors pushed too far. You will notice that for some reason camera makers seldom show sample images taken in low available light…

Interpolation

Interpolation (along with its cousin, “digital zoom”) is the other way unscrupulous marketers lie about their cameras’ real performance. Fuji is the most egregious example with its “SuperCCD” sensor, that is arranged in diagonal lines of octagons rather than horizontal rows of rectangles. Fuji apparently feel this somehow gives them the right to double the pixel rating (i.e. a sensor with 6 million individual photosites is marketed as yielding 12 megapixel images). You can’t get something for nothing, this is done by guessing the values for the missing pixels using a mathematical technique named interpolation. This makes the the image look larger, but does not add any real detail. You are just wasting disk space storing redundant information. My first digital camera was from Fuji, but I refuse to have anything to do with their current line due to shenanigans like these.

Most cameras use so-called Bayer interpolation, where each sensor pixel has a red, green or blue filter in front of it (the exact proportions are actually 25%, 50% and 25% as the human eye is more sensitive to green). An interpolation algorithm reconstructs the three color values from adjoining pixels, thus invariably leading to a loss of sharpness and sometimes to color artifacts like moiré patterns. Thus, a “6 megapixel sensor” has in reality only 1.5-2 million true color pixels.

A company called Foveon makes a distinctive sensor that has three photosites stacked vertically in the same location, yielding more accurate colors and sharper images. Foveon originally took the high road and called their sensor with 3×3 million photosites a 3MP sensor, but unfortunately they were forced to align themselves with the misleading megapixel ratings used by Bayer sensors.

Zooms

A final factor to consider is the zoom range on the camera. Many midrange cameras come with a 10x zoom, which seems mighty attractive in terms of versatility, until you pause to consider the compromises inherent in a superzoom design. The wider the zoom range, the more aberrations and distortion there will be that degrade image quality, such as chromatic aberration (a.k.a. purple fringing), barrel or pincushion distortion, and generally lower resolution and sharpness, specially in the corners of the frame.

In addition, most superzooms have smaller apertures (two exceptions being the remarkable constant f/2.8 aperture 12x Leica zoom on the Panasonic DMC-FZ10 and the 28-200mm equivalent f/2.0-f/2.8 Carl Zeiss zoom on the Sony DSC-F828), which means less light hitting the sensor, and a lower signal to noise ratio.

A reader was asking me about the Canon G2 and the Minolta A1. The G2 is 2 years older than the A1, and has 4 million 9 square micron pixels, as opposed to 5 million 11 square micron sensors, and should thus yield lower image quality, but the G2’s 3x zoom lens is fully one stop faster than the A1’s 7x zoom (i.e. it lets twice as much light in), and that more than compensates for the smaller pixels and older sensor generation.

Recommendations

If there is a lesson in all this, it’s that unscrupulous marketers will always find a way to twist any simple metric of performance in misleading and sometimes even counterproductive ways.

My recommendation? As of this writing, get either:

  • An inexpensive (under $400, everything is relative) small sensor camera rated at 2 or 3 megapixels (any more will just increase noise levels to yield extra resolution that cannot in any case be exploited by the cheap lenses usually found on such cameras). Preferably, get one with a 2/3″ sensor (although it is becoming harder to find 3 megapixel cameras nowadays, most will be leftover stock using an older, noisier sensor manufacturing process).
  • Or save up for the $1000 or so that entry-level large-sensor DSLRs like the Canon EOS-300D or Nikon D70 will cost. The DSLRs will yield much better pictures including low-light situations at ISO 800.
  • Film is your only option today for decent low-light performance in a compact camera. Fuji Neopan 1600 in an Olympus Stylus Epic or a Contax T3 will allow you to take shots in available light without a flash, and spare you the “red-eyed deer caught in headlights” look most on-camera flashes yield.

Conclusion

Hopefully, as the technology matures, large sensors will migrate into the midrange and make it worthwhile. I for one would love to see a digital Contax T3 with a fast prime lens and a low-noise APS-size sensor. Until then, there is no point in getting anything in between – midrange digicams do not offer better image quality than the cheaper models, while at the same time being significantly costlier, bulkier and more complex to use. In fact, the megapixel rat race and the wide-ranging but slow zoom lenses that find their way on these cameras actually degrade their image quality over their cheaper brethren. Sometimes, more is less.

Updates

Update (2005-09-08):

It seems Sony has finally seen the light and is including a large sensor in the DSC-R1, the successor to the DSC-F828. Hopefully, this is the beginning of a trend.

Update (2006-07-25):

Large-sensor pocket digicams haven’t arrived yet, but if you want a compact camera that can take acceptable photos in relatively low-light situations, there is currently only one game in town, the Fuji F30, which actually has decent performance up to ISO 800. That is in large part because Fuji uses a 1/1.7″ sensor, instead of the nasty 1/2.5″ sensors that are now the rule.

Update (2007-03-22):

The Fuji F30 has been superseded since by the mostly identical F31fd and now theF40fd. I doubt the F40fd will match the F30/F31fd in high-ISO performance because it has two million unnecessary pixels crammed in the sensor, and indeed the maximum ISO rating was lowered, so the F31fd is probably the way to go, even though the F40 uses standard SD cards instead of the incredibly annoying proprietary Olympus-Fuji xD format.

Sigma has announced the DP-1, a compact camera with an APS-C size sensor and a fixed 28mm (equivalent) f/4 lens (wider and slower than I would like, but since it is a fixed focal lens, it should be sharper and have less distortion than a zoom). This is the first (relatively) compact digital camera with a decent sensor, which is also a true three-color Foveon sensor as cherry on the icing. I lost my Fuji F30 in a taxi, and this will be its replacement.

Update (2010-01-12):

We are now facing an embarrassment of riches.

  • Sigma built on the DP1 with the excellent DP2, a camera with superlative optics and sensor (albeit limited in high-ISO situations, but not worse than film) but hamstrung by excruciatingly slow autofocus and generally not very responsive. In other words, best used for static subjects.
  • Panasonic and Olympus were unable to make a significant dent in the Canon-Nikon duopoly in digital SLRs with their Four-Thirds system (with one third less surface than an APS-C sensor, they really should be called “Two-Thirds”). After that false start, they redesigned the system to eliminate the clearance required for a SLR mirror, leading to the Micro Four Thirds system. Olympus launched the retro-styled E-P1, followed by the E-P2, and Panasonic struck gold with its GF1, accompanied by a stellar 20mm f/1.7lens (equivalent to 40mm f/1.7 in 35mm terms).
  • A resurgent Leica introduced the X1, the first pocket digicam with an APS-C sized sensor, essentially the same Sony sensor used in the Nikon D300. Extremely pricey, as usual with Leica. The relatively slow f/2.8 aperture means the advantage from its superior sensor compared to the Panasonic GF1 is negated by the GF1’s faster lens. The GF1 also has faster AF.
  • Ricoh introduced its curious interchangeable-camera camera, the GXR, one option being the A12 APS-C module with a 50mm f/2.5 equivalent lens. Unfortunately, it is not pocketable

According to Thom Hogan, Micro Four Thirds grabbed in a few months 11.5% of the market for interchangeable-lens cameras in Japan, something Pentax, Samsung and Sony have not managed despite years of trying. It’s probably just a matter of time before Canon and Nikon join the fray, after too long turning a deaf ear to the chorus of photographers like myself demanding a high-quality compact camera. As for myself, I have already voted with my feet, successively getting a Sigma DP1, Sigma DP2 and now a Panasonic GF1 with the 20mm f/1.7 pancake lens.

Update (2010-08-21):

I managed to score a Leica X1 last week from Camera West in Walnut Creek. Supplies are scarce and they usually cannot be found for love or money—many unscrupulous merchants are selling their limited stock on Amazon or eBay, at ridiculous (25%) markups over MSRP.

So far, I like it. It may not appear much smaller than the GF1 on paper, but in practice those few millimeters make a world of difference. The GF1 is a briefcase camera, not really a pocketable one, and I was subconsciously leaving at home most of the time. The X1 fits easily in any jacket pocket. It is also significantly lighter.

High ISO performance is significantly better than the GF1 – 1 to 1.5 stops. The lens is better than reported in technical reviews like DPReview’s—it exhibits curvature of field, which penalizes it in MTF tests.

The weak point in the X1 is its relatively mediocre AF performance. The GF1 uses a special sensor that reads out at 60fps, vs. 30fps for most conventional sensors (and probably even less for the Sony APS-C sensor used in the X1, possibly the same as in the Nikon D300). This doubles the AF speed of its contrast-detection algorithm over its competitors. Fuji recently introduced a special sensor that features on-chip phase-detection AF (the same kind used in DSLRs), let’s hope the technology spreads to other manufacturers.

 

Resisting camera bloat

I recently upgraded my DSLR from a Canon EOS 10D to a Digital Rebel XT. Thanks to the universal consumer electronics upgrade plan, the final cost ended up quite minimal.

Some may object, how can an entry-level $800 camera be considered an upgrade over an originally $1500 prosumer body with a magnesium shell, glass pentaprism and two control wheels? One word: plastics. More precisely, the weight reduction plastics can offer. I usually carry a professional-grade camera in my gadget bag, and the 10D never made the cut because it is so heavy. A camera that gathers dust at home is not all that useful, so off to eBay it went.

Certainly, the 10D feels better in the hand, its viewfinder is not a claustrophobic little tunnel (although compared to my other cameras like as a Leica MP, the 10D’s viewfinder is barely less squinty than the Rebel XT’s). The 8 megapixels vs. 6 are immaterial – they amount to only 15% improvement in linear resolution, and megapixels don’t matter that much anyway.

Film cameras have the bulk of their body forming an empty cavity to load film into. DSLRs, on the other hand, are densely packed with electronics, making them surprisingly heavy for their size. The 10D weighs 790 grams, compared to 715g for a rugged Nikon F3, 600g for the solid brass MP, and 490g for the Rebel XT. The weight around your shoulders is very perceptible at the end of the day. You are not even getting that much more in build quality, the thin magnesium shell on the 10D is there more for cosmetic effect than any real structural purpose — I have not found the 10D appreciably better constructed than the plastic-shelled D30. It certainly cannot compare with the 1.4mm thick copper-silumin-aluminum alloy walls on the F3.

This brings me to a pet peeve about high-end cameras. It seems Canon and Nikon have decided that for marketing reasons a professional camera has to be a heavy camera. I could easily afford a 1D MkII, but don’t feel like carting along a 1.2kg behemoth with all the quiet understated elegance of a Humvee. This camera weighs almost twice as much as a F3 or a MP, both of which are supremely robust professional bodies.

In the era of film, I could understand that an integral motor drive weighs less and is more reliable than an separate one (on the other hand, the film equivalent to the 1D, the EOS 1V, is available without the motor drive to cut down on weight). The bulk of the 1D MkII, and its Nikon equivalents the D2H and D2X, is taken by an oversized portrait grip with slots for heavy batteries.

For digital bodies, however, many of these design choices are unwarranted. The Canon 1D MkII and 1Ds MkII use CMOS sensors that do not require the bulky high-current NiMH battery pack necessary to power the original CCD EOS 1D. Unfortunately Canon have kept the ungainly form instead of adopting the approach, used in their amateur cameras, of providing an optional portrait grip with room for spare batteries for those who absolutely must have them, but not saddle all users with heft and cost they do not want or need. Nikon does no better, their pro cameras all exceed the 1 kilogram mark, as did their film F4 and F5 bodies (the new F6 is under a kilogram without batteries, however). Perhaps that is why the F3 was so enduringly popular compared to the F4. Galen Rowell certainly preferred the F100 over the F4, and the F4 over the F5

There used to be a time when quality and miniaturization went hand in hand. Oskar Barnack invented the lightweight Leica precisely because he was asthmatic and could not lug heavy glass plate view cameras while hiking. Yoshihisa Maitani is justly celebrated for his incredibly light Olympus OM system, accompanied by excellent compact lenses, some of which are still unmatched by Nikon or Canon. Many professional cameras were available in expensive titanium versions to shave a few precious grams. But it now seems that designing a pro camera involves embracing bulk and unnecessary weight, for the simple reason a heavy camera feels more solid and reliable when you handle it in the shop. What next, adding lead ballast? Perhaps lead is not dense enough and depleted uranium will soon be the camera steroid of choice.

I do not see this trend improving over time. I guess my next and probably final digital camera purchase will be a Leica M Digital or the Zeiss Ikon version when they finally arrive on the market. Rangefinder makers still understand ergonomics.

Update (2006-04-08):

It seems pros are doing the same, as in this post from one who downgraded from the Canon EOS 1Ds MkII to a 5D, and apparently it looks like his is not an isolated case. Perhaps Canon will get the message with free-falling sales of big and heavy cameras.

Traveling with film

X-rays can fog photographic film. The damage is cumulative, repeated passes will have an effect even on low-sensitivity film that would not suffer too much from a single pass. Most of the films I use are specialized professional emulsions not readily available in ordinary stores (or even in the USA, as with the three rolls of Fuji Natura 1600 I recently ordered from Japan). That is why I travel with film, and on general principle avoid having it passed through X-ray machines by requesting a hand inspection instead.

Grousing about the Transportation Security Administration (TSA) has almost become a national sport. I tend to disagree — TSA has set uniform standards and a measure of courtesy and customer-service orientation compared to the earlier hodgepodge of private contractors. It is much easier to travel with unexposed film in the US today than it used to be post-9/11, pre-TSA. In other countries, screeners will routinely ignore your protests and unceremoniously shove ISO 1600 film into a high-energy scanner, all but ensuring they have fried it.

These common-sense guidelines will ensure speedy processing and avoid aggravation, for yourself as well as for fellow passengers down the line:

  • Unpack your film from its cardboard boxes and plastic canisters (or foil wrappers for 120 film), and put it in a transparent zip-lock bag (the ones with the easy-open plastic sliders are best).
  • If you are (justifiably) afraid that film outside light-tight canisters may be fogged over time, carry your canisters separately (J&C photo sells inexpensive plastic canisters for 120 film, or you could splurge for the aluminum ones by Acratech). Probably a better option is to use a thick black plastic bag like the ones used to pack photographic paper.
  • Pack at least a couple of ISO 1600 or higher rolls of film so you can ask for hand screening. Some TSA personnel will ask you if you have any film higher than ISO 400, having some on hand is simpler than haggling for hand-inspection of low-ISO film. Only once did I have TSA staff separate my higher than ISO 400 rolls for hand screening and pass the rest through the X-ray machine.
  • Lead-lined, supposedly X-ray safe film pouches are a waste of money. Not only are they heavy and ungainly, but the X-ray operators will simply increase power when they see an opaque bag that could conceal a weapon or explosives. TSA policy allows you to ask for a hand inspection, just avail yourself of this.
  • Pack your film in your carry-on luggage, preferably in an easily accessed compartment

For more authoritative statements, check out the official TSA and ITIP pages.

Digital photographers are not completely off the hook. While ordinary X-ray machines do not affect flash media, the newer high-energy machines currently considered for deployment can alter electronic media. Another interesting aspect is that of cosmic rays, high-energy particles from outer space and which can “flip” bits in a flash card or magnetic media. In a negative, the blip will be imperceptible, but digital files are less tolerant of corrupted bits. IBM has spent quite a bit of R&D effort in quantifying the problem. When you have several billions of bits in RAM or trillions of bits in a hard drive, even an unlikely event like an alpha particle becomes statistically probable, and they have taken special measures against this. Many commonplace materials are also naturally radioactive.

The effect of cosmic rays at ground level is limited, but airplanes flying at 10-25km altitude are much more exposed to them, by a factor of hundred or so — see Dr. Ziegler’s article (PDF) on terrestrial cosmic rays. The impact of cosmic rays on flash and microdrive media is poorly understood today and the risk not fully assessed. Due to short-term financial thinking encouraged by Wall Street, few corporations invest today in the kind of R&D that could conclusively answer this question.

What to think of pocket digicams

Once you have used a digital SLR (DSLR) with a nice, clean, large, low-noise sensor, the poor image quality of most compact digicams becomes hard to tolerate. This is in contrast with film, where a $70 Olympus Stylus Epic can compete in image quality with thousand-dollar cameras.

Then it hit me: don’t consider a pocket digicam as a camera, think of it as a pocket photocopier/scanner instead, like HP’s ill-fated CapShare. I use my pocket digicam mostly to record specials in stores, flyers, magazine articles, diagrams on a whiteboard and the like. Japanese otaku teenagers are way ahead of me, as many bookstores in Tokyo now ban cameraphones because the kids would just snap photos of manga comic books and not pay.

A 5 megapixel digicam, pretty mainstream nowadays, with a 4:3 aspect ratio can “scan” a standard US Letter or A4 page at an approximate resolution of 240 spi. This is significantly better than a fax, which scans at 150 spi. Many pocket digicams have lenses that are serviceable in macro mode. The limiting factor is probably setting up the camera, as you can’t find portable copy stand like the vintage Leica BOOWU (also shown top left in this outfit photo).