Hidden Artist Strikes Again

I started with this-a 1949 cover for the Saturday Evening Post painted by Norman Rockwell

After I did my camera and photographer twisting and twirling I loaded the image into RT using the POP  profile.  This new addition to RT uses tonemapping and CIECAM02 to add, surprise, surprise, pop to your image.

To prevent one problem, jet black splotches that appear in highly over exposed areas when tonemapping and CIECAM02 are used together, Jacques, the developer who added CIECAN02 to our toolkit (applause, applause) made changes recently.  He compressed the highlights for well exposed images taken with bright scene illumination, the highlighted value of 2000 standard candles per meter squared.

 While that fixed one problem it added a second. For less well laminated scenes like indoor scenes with over exposed vistas viewed through windows, or like the low illumination I used to create this image, the histograms never go above 75%.  White areas end up too grey.

 The fix is blindingly obvious if you understand the intricate working of CIECAM02. You adjust the scene illumination slider to match the image. The histogram moves to the right; you stop when it starts to clip.  But the rest of us who think a standard candle is the long thin one you push into a brass candle stick we tend to miss what's needed to be done.

Yesterday afternoon I discovered that undocumented fix. Not by some brilliance on my part. In a not-so-secret forum where RT developers hang out and talk RT programming talk, this was being discussed in issue 1827. So last night, me, a lowly user, dared to tell Jacques, the developer, that his technically correct tool tip needed to be rewritten. In the middle of our night and his morning-the time difference between Wisconsin and France-Jacques wrote back saying of course he would do it

Took less than 8 hours. So if any users of commercial programs such as Lightroom happen to stumble over this blog please put in a request for the perfect fix you've been waiting to use. Then let us know how many weeks/months/years/eons it takes to get an answer back. RAWTherapee might bring on slider shock and have its quirks, but its developers listen. And when it rocks, it Rocks!

EDIT.  An Oops. Or semi Oops. What was less than blindingly obvious when I wrote this was that the real  cause of the problem was a bug in the CIECAM02  calculations. With build 4.0.10.69 that has been fixed, the problem no longer exist and the histograms no longer hang up at 75 percent no matter where you set the illumination slider.

A two slider adjustment in scene illumination and exposure moved the red channel to the clipping point and lightened the image.

A CIECAM02 contrast boost darkened the edges and clipped the red channel

.
A wild LAB custom CC curve made big changes to the image and brought all the channels together. Not the usual way to set a white balance.

A final scene illumination of 145 cd/m2 sets the overall image whiteness.

Two curve and slider adjustments didn't change the image that much. Running the chromaticity to the max, however, gave me a wild effect I could use.

The final masterpiece ready to be printed and matted for the masterclass.

And because it is also neat the black and white version created by clicking  BW tone mapping in the LAB section.

The Artist Hidden Within

I'm taking a master class on how to drag the 'artist hidden within' out into the daylight. So for the next several weeks that hidden artist will be raising his sarky head and inflicting his 'masterpieces' upon the innocent blogosphere.

As any regular reader of this blog knows, the non hidden artist's aesthetic tends towards photographic perfection, the sort you pixel peek at 100% or higher to see. Accurate colors, perfect sharpness, noise freedom has reigned here.

The hidden artist, on the other hand, favors this.



The original Playboy style image that posed for the 'artist within' is from a 40 year old Petersen's Master of Contemporary Photography book about Bert Stern.  If the name Bert Stern isn't instantaneously recognizable  he's the photographer whose 1950's ads turned vodka, then a cold war Russian commie pinko exotic, into an all American drink. This really dry vodka martini ad was worth $4000 plus travel expenses in 1955 bucks. If his reputation has slipped a little since then he lived very well in his time.

Enough dry history. Here is the 'hidden artist's' RT workflow.

First select a colorful page or double page image to mangle. Set the camera to manual, to ISO100 or lower, to between 2 to 10 sec exposure and to whatever iris opening gives a reasonable photo. Move camera while snapping the photo. Better yet, twist, roll and yaw the photographer while snapping  the photo. Since you will have no idea what you have on the card, do this a dozen or more times. Load  the most interesting photo into RAWTherapee. Or in this case, one that didn't violate Blogspot's prohibition of full frontal nudity. Finally start the masterpiece making.

This brought out the color in the wide tie, the subject of the photo.

A hue slider adjustment that shifted the colors towards green. The CIECAM02 algorithm is 'all'.

Playing around with the CIECAM02 sliders brought us to this color mixture.

Since the colors aren't changing much 'the artist within'  turned this into a tiff file. Then he loaded that back into RT for further processing.

This lighten the background.

With this 'the artist within' laid down his mouse.  And left it to 'the outer guy' to write this blog post. He liked this version the best.

RAWTherapee 4.0.10.36 is now here. Besides speedups and bug fixes, it offers a new set of packaged profiles and two new demosaicing algorithms intended  for use with HighISO images. (Big Grin)

http://www.visualbakery.com/RawTherapee/Downloads.aspx

Creating Noise Profiles

I was asked what I use to create noise profiles. It is ImageJ'  a free cross platform Java app from NIH.  The best and ad free download site is from NIH-- http://rsbweb.nih.gov/ij/download.html

Once you have it installed  open your photo and choose your line type. Drag it across  the area of your photo where you want to measure noise.  Cntrl+K creates the graph.

To  change the Y scale of the graph go to edit, options, plot profile options

For  my measurement in the black area of this poster I picked  min 0, max 40

Once you have a flat noise profile, go to analyse, measure or hit Cntrl+M

For an accurate noise measurement signal average several. This is a square law thing so 4 measurements doubles your accuracy and 9 measurements triples it. Summarize will do the math where your Signal to Noise (S/N) is the Mean divided by the StdDev (Standard Deviation)

Is this conventional statistical definition of S/N to best way to characterize photographic signal to noise?Probably not.  Noise peaks, especially colored noise peaks, that jump out of the average noise are far more distracting than a mild increase in the average noise. So is pattern noise.  Both these noise problems will become lost in these numbers. But if you do these comparisons carefully ImageJ is a very useful tool for working out how well the various combinations of sliders and methods work for you.

Final note.  You can not save a picture of your graph directly in ImageJ. 'Save as' creates a spread sheet file, 'Clear\' clears out you mistakes and 'Rename' allows you to start a new results list without losing your previous numbers.

Again if you want to know more about noise read Emil's article,  http://theory.uchicago.edu/~ejm/pix/20d/tests/noise/noise-p2.html

Shoot at ISO21000--Print at 30 by 45 inches

Sounds insane.  ISO21000 noise. Huge print size.  Welcome to the world of RAWTherapee noise reduction.

Rhianna is letting the world know she just bowled a strike.

The gory photo details. The camera was set to ISO6400-- which is just a conventional way of saying the D7000's sensor's true and only ISO100 signal is preamp boosted  by a factor of 64 before it enters the A/D.    Since the photo had to be boosted again by an exposure compensation of 1.8EV to shift the red histogram I multiplied the camera's ISO by 3.24 (1.8 squared)  to get a correct noise IS0 of 21000.

Ain't a cheating fudge factor. That's how sensor physics works.

Now the triumph of  RT noise reduction. But first here is what not to do.

I set the exposure compensation correctly before I went to the CIECAM02 tools to improve the color, contrast and lightness. But I forgot to return to exposure to readjust the histograms  When I caught my mistake, I checked the red color channel ( box at top) for blooming (red areas).  Because I liked my CIECAM02 fine tunings,  only one channel was effected  and the blooming area areas weren't in any critical part of the image (see http://scribble-jpc.blogspot.com/2013/02/rescuing-really-important-snapshots.html ) I decided to go with my mistake. After all I was getting a WOW Signal to Noise of 20!

Wrong move.  After wasting a bunch of time and discovering a few nagging inconsistencies  I corrected the exposure comp.  One measurement later and I discoverer the real double WOW WOW S/N was to be 28!!

A few points on experimental techniques. I took the noise line profile off Jilly's arm because that area has constant color--the curves are flat-- and the arm is close to the center of the tonal range--95 in a range of 0-255. These curves have to come out flat or don't bother doing the extra work to come up with a numerical signal to noise.  You will be measuring bumps and slopes.  Not the noise.

Looking more closely I should have shortened the length of the line profile of the last measurement  to get rid of the bump at the beginning. That error added about 0.5-1 to the last StdDev (standard deviation) number.  That's why I averaged 7 measurements to clean up these errors. Even without these moments of carelessness, remember we are dealing with noise. Three measurement are a minimum, 7 to 9 are better and a 100 measurements  would be an insane overkill.  We are doing a square law experiment and the Law of Diminishing Returns kicks in with the second measurment

Plus what's so wow about a S/N of 28. Why not 280 or even 2800. If you got  the bucks to buy the camera, like the Hubble Space Telescope or the Kepler Cosmic Background Radiation Telescope in the news recently, you can go for those high S/N ratios.  But for the rest of us, with this image taken under these exposure conditions, a S/N of 28 does equal a 30X45 poster pined to a bedroom wall.

With modern tech we can pixel-peep (and complain about what we see) far too easily. Rhianna's face is 8 inches wide on my super calibrated monitor (something that the world can't see --- for the complaint  http://scribble-jpc.blogspot.com/2013/02/in-search-of-perfect-eyeball-monitor.html ) . It is 3 inches on a 11 by 14 print I had made using the older 4.0.9.185 noise reduction.  Do the math and this is what you will see on a 30 X 45 inch wall poster.

That  print had a S/N of ~15.  If you were looking for noise there was a hint of it on Rhianna's face and in the brown area under the big number one in the background. But it's nothing that jumps out at you. I sure Rianna's mom won't complain when I give her the print next time I'm over in her part of the city.

EDIT--If you looked at this post before you might notice that Jilly has suddenly morphed into Rhianna.
Rhianna is Jilly's stepsister. They both live across the street from Charlotte. I got their names mixed up. Sorry girls. :-(

After I posted this I remember I do have a big display my flat screen LCD TV with its port in the side for usb sticks and memory cards.  When I displayed this image big it looked just like I said it would from my calculations.

The details from the pp3. I started with the HighISO profile. The exposure  comp of 0.88 I set. I may have fiddled with that other setting. Or they may have come with the profile.


[Exposure]
Auto=false
Clip=0.02
Compensation=0.88
Brightness=2
Contrast=22
Saturation=5
Black=332
HighlightCompr=0
HighlightComprThreshold=33
ShadowCompr=50
CurveMode=Standard
CurveMode2=Standard
Curve=0;
Curve2=0;

The image needed some sharpening. Except for 'only edges' the setting are the defaults. If it wasn't for the 'only edges' algorithm I never would have dared using sharpening on a high noise image.

[Sharpening]
Enabled=true
Method=usm
Radius=0.5
Amount=125
Threshold=20;80;2000;1200;
OnlyEdges=true
EdgedetectionRadius=1.8999999999999999
EdgeTolerance=1800
HalocontrolEnabled=false
HalocontrolAmount=85
DeconvRadius=0.75
DeconvAmount=75
DeconvDamping=20
DeconvIterations=30

White balance off Jilly's shirt

[White Balance]
Setting=Custom
Temperature=3058
Green=0.80500000000000005

The color and appearance fine tuning

[Color appearance]
Enabled=true
Degree=100
AutoDegree=true
Surround=Average
AdaptLum=16
Model=RawT
Algorithm=JC
J-Light=27.100000000000001
Q-Bright=-1
C-Chroma=-5
S-Chroma=0
M-Chroma=0
J-Contrast=44.5
Q-Contrast=64.5
H-Hue=0

The HighIso defaults. I could have fiddled with them for a better S/N but why bother. My 30 inch printer-imaginary- is out of ink-imaginary- and will stay that way given the cost of feeding a real printer. For five bucks and change I can get a 12 by 18 inch print from my local Woodmans-one that matches the image on my screen. As long as I switch the room lights back ovet to 5000K spots. Perfect color management ain't easy.

[Directional Pyramid Denoising]
Enabled=true
Luma=50
Ldetail=50
Chroma=50.689999999999998
Method=Lab
Redchro=0
Bluechro=0
Gamma=1.7


Find RAWTherapee  4.0.11.1 here
http://www.visualbakery.com/RawTherapee/Downloads.aspx

For an excellent tutorial on noise by Emil, the guru behind RT's new noise reduction systen
 http://theory.uchicago.edu/~ejm/pix/20d/tests/noise/noise-p2.html