Denoise Module Use

Notes from users, documentation addendums.

Denoise Module Use

Postby Guy » Wed Nov 23, 2016 8:15 am

Here are some notes relating to using the Denoise module.
Please let me know if anyone sees any errors or has any additional advice they think helpful.
I will update this as needed.
To see a full alphabetical list of module topics click here

Denoise Module

Purpose:
To get rid of different types of noise while preserving detail.

Description
For a general overview see De-Noise: Detail Aware Wavelet-based Noise Reduction
Noise reduction is applied at the very end when Tracking is switched off. Due to StarTools' noise evolution Tracking noise reduction will be much more targeted.
  • Separates Brightness and Colour - this allows separate control of brightness and colour noise.
  • Uses information gained while Tracking was on to help target the noise.
The Denoise module uses the following methods to separate detail from noise:
  • Tracking identifies the areas of higher noise
  • Scale Correlation techniques are used to identify detail.
This allows a high level of control over noise - with extra control over areas of detail.

Useful Sources
The Unofficial guide is a good source of help. It relates to version 1.3.5 so there may have been some changes. The notes below relate to StarTools version 1.4.
The processing video M8 in Color with modest data has a demonstration of the Denoise module between 8m16s and 9m43s
The Hangout discussion of StarTools with Ivo discusses the Denoise module between about 1h47m to 1h59m

When to use:
  • Final Denoise is usually done after the Color module - When turning 'Track' off select the option to 'Stop tracking, do final noise reduction'
  • The Denoise module can also be used in 'Preview Only' mode at any time when Tracking is on.
    - This allows you to see the effect the Denoise module will have when Tracking is switched off based on the current image.
    - It can show when you have overdone something (like the final Develop/AutoDev module stretch was too aggressive) and too much noise will remain visible even after applying the Denoise module.
    - It can show you need to go back and redo a step, or do further noise-reduction steps, prior to turning Tracking off and final Denoise.
  • Also, try using the Life modules' 'Isolate' preset with no mask set just before using the Color module then final Denoise module - this will help to push back the noise. Watch out for halos around the stars though.
Example Workflow:
AutoDev-{Band/Lens}-Bin-Crop-Wipe-AutoDev(or Develop)-{As needed: Decon/Sharp/Contrast/HDR/Flux/Life}-Color-{Filter}-Denoise-{If needed: Layer/Magic/Heal/Repair/Synth}
Key: {...} optional modules

Method:
This is a way of using the module which should give good results in most cases:
  1. Select Filter Type - try 'Gaussian Noise Diffusion' if the image is noisy - otherwise use the default.
  2. Select Grain Size so the noise grain and clumps can no longer be seen - as described below. Structures larger than the Grain Size are considered detail, not noise.
  3. Click 'Next' - StarTools will do its initial attempt using that grain size with other settings at their default values. When complete screen 2 is shown.
  4. Select an area to sample to speed up the processing while you adjust the parameters.
  5. Adjust the Smoothness - this sets how much structures that have been identified as detail can be smoothed to reduce noise.
  6. In many cases the remaining parameters can be left at their default values. However, if further adjustment is needed then experiment with the following controls:
    • Adjust Brightness Detail Loss and Color Detail Loss - to balance detail loss and noise reduction.
    • To control the balance between detail retention and noise reduction within the subject adjust the Scales (e.g. consider using Scale 5), Scale Correlation, and Smoothness.
      - Scale Correlation identifies how much or the smaller structure is considered detail.
      - Smoothness defines how much structures identified as detail can be smoothed to reduce noise.
    • If there is any remaining mottled appearance in the dark background, try adjusting Read Noise Compensation to remove it.
  7. Press 'Full' to apply the effect to the full Image.
  8. If you make a mistake, the 'Reset' button discards all the changes since you started using the module.
  9. Press Keep to exit, keeping the results.
What result to look for:
  • Background noise should be greatly reduced or eliminated without affecting detail significantly.
  • Look out for any remaining noise blotches - if found go back and check Grain Size, Smoothness settings.
  • Look out for any reductions in the detail.
  • Use the 'Before'/'After' button to see the effect of the module.
Ways of getting better results:
  • Improve the Signal-to-Noise ratio (SNR) of the original image - by taking more subs. Also, make sure the subs are long enough.
  • With light polluted data you will need many more subs to get equivalent results.
  • If you have pattern noise try Dithering if you don't already.
  • Make sure you have used the Bin module to reduce the resolution (and improve the SNR) if the image is oversampled.
  • Try using the Life module 'Isolate' preset with no mask set just before using Color and Denoise modules - to help push back the noise.
  • If there is background colour noise this may be de-emphasised by using the Dark Saturation control in the Color module.
  • If the background noise cannot be controlled successfully in Denoise - it may be necessary to go back and redo Develop/AutoDev to control the final stretch a little to limit the noise to a level Denoise can handle. To do this use the Restore - 'Linear, Wiped' button.
After Use:
  • Save the image and finish - or apply one of the modules not available when Tracking is on i.e: Heal, Magic, Repair or Synth as needed.
Special Techniques:

Selecting optimum noise reduction settings
In cases where you are struggling to find the right noise settings this approach may help.
- This is experimental - please let me know how well this works for you.
  1. Select an area which includes background and large scale structures.
  2. Set Read Noise Compensation as described below.
  3. Reduce Smoothness to 10%, increase Brightness Detail Loss to 30%, and reduce Scale Correlation to 2 - this allows us to see the effects of our changes.
  4. Increase Grain Size from 4.5 in increments until there is no further discernable smoothing of the background noise.
  5. Increase Scale correlation from 2 to 6 to see the increase in detail in the larger structures - stop when the level of detail is about right.
  6. Reduce the Brightness Detail Loss - making sure the background noise is smoothed enough.
  7. Increase Smoothness until the larger scale structures are smoothed the correct amount - you may need to adjust the Scale Correlation a little to get the right balance.
Find a good setting for Read Noise Compensation
This is a technique for finding the optimum Read Noise Compensation setting. It is described here.
  1. Create a preview area that has both background and DSO.
  2. Turn off noise reduction completely (set Brightness Detail Loss to 0%).
  3. Increase Read Noise Compensation until it affects the background and almost starts affecting the DSO.
  4. Increase Brightness Detail Loss to denoise the rest of the DSO and adjust other settings as normal.
Using the Denoise module with a Mask to protect the detail
Use this in cases where with Denoise on its own does not protect the detail enough - perhaps in high noise situations.
  1. Create a Mask - To just protect the central parts of the object and let the outer extremities be denoised:
    • For a well defined object either:
      - 'Flood Fill Darker Pixels' selects the darker background easily - and the fainter extremities of the object. Grow a little.
      - 'Flood Fill Lighter Pixels' defines the brighter core of the object easily but any fainter extremities are not selected - Invert.
    • For long thin wisps (e.g. the veil) - create a trail of individual green pixels over the detail (using the 'Single Pixel Toggle' Brush Mode) and then use 'Grow' until they merge.
  2. Do further changes to make sure that all the areas which you want denoised are green.
  3. Use the Denoise module as normal.
  4. Increase 'Mask Fuzz' until the transition between masked and unmasked areas looks natural.
  5. 'Keep' the result you are happy with.
Denoise Separate Colour Data with LRGB
See also M45: Advanced Processing in StarTools 1.3 Part 2.
The trick with colour data is to apply heavy noise reduction. The human eye is much less sensitive to loss of colour detail than it is to loss of luminance detail. Since, with LRGB, all the luminance detail will come from our luminance frame, we can be heavy handed with our noise reduction. Often this data set too has had much shorter total exposure time allocated to RGB, so it is quite noisy.
In Denoise Module:
  1. Set all Scale settings 1-5 to 100%.
  2. Set Brightness Detail Loss to 100%.
  3. Set Color Detail Loss to 100%.
  4. 'Keep' the result.
  5. Merge this with the luminance frame.
Description of Controls:

Screen 1 - Select filter type and grain size

Filter Type:
Select the noise filter type which will form the basis of noise reduction:
  • Gaussian Noise Diffusion - Yields good results when there is a lot of noise.
  • Distance Weighted Outlier Rejection - Yields very good results if there is not too much noise. [default]
  • Median - Very good at preserving edges when there is low to moderate noise.
Grain Size:
Specifies the maximum size of the noise grain that is visible in the image.
  • Once set tells module that anything larger in scale than this is not noise.
  • Specifies over how large an area it spreads the energy that was cointained in pixels that are smoothed.
  • Default is 4.5 pixels. Range is 1.0 to 30.9 pixels.
  • Choose as large a value as needed.
  • Experiment until you find a value which causes the noise grain and clumps to be dispersed so that can no longer be seen at any scale. Values up to 15-30 are fairly common with noisy data.
  • Do not exceed what is needed so as to preserve large scale detail as much as possible.
  • Concentrate on the noise and don't worry about the detail. This is a visual representation to help find the right setting and the signal is not being affected.
Screen 2 - Customise noise reduction

Identifying and protecting detail
  • Structures larger than the Grain Size are not considered to be noise.
  • Scale Correlation identifies how much the smaller structures are analysed when looking for detail.
  • Smoothness defines how much structures identified as detail are affected by the denoise algorithm.
Mask:
For general instructions on using masks see Mask.
  • If parts of the image will not benefit from noise reduction it helps to mask these off.
  • If a mask is used set Mask Fuzz to controls the blending of the transition between masked and non-masked parts of the image.
Grain Size (aka Redistribution Kernel):
See also the description above.
  • The Grain Size influences the noise reduction of all the other controls apart from:
    • Scale Correlation and Smoothness - which define how parts of the image are protected from noise reduction.
    • Read Noise Reduction - which uses a different algorithm to deal with noise below the noise floor.
  • Default 4.5 pixels. Range is 1.0 to 30.9 pixels.
  • Structures larger than the Grain Size are considered detail, not noise.
  • Defines a surface area over which it can safely redistribute energy that was taken away (denoised).
  • Typical values <30 pixels - there will be a value beyond which there will be little effect - don't exceed the maximum size needed.
Scale Settings:
Defines how hard the noise reduction is done for different sizes of noise.
  • Scales do not have absolute limits to the range - its is more like a particular scale brings detail of a certain size into focus - and that other size detail is out of focus to varying degrees depending on its size.
  • The following are broad guidelines:
    • The largest scale (Scale 5) is approximately 100-120 pixels.
    • The smallest size (Scale 1) is around one pixel.
    • The intervening scale sizes increase exponentially.
  • Increase the scale value if noise is noticeable at that scale. Decrease it if detail is being affected.
  • For Scales 1-4 the default is 90%. For Scale 5 the default is 0%. Range is 0% to 100%.
  • Scale 5 is increased to get rid of some large scale noise. Often this has been introduced artificially during debayering or subsequent processing and is not from natural Poisson noise sources. In these cases the correlation we look for to identify detail will have been corrupted - so we need to reduce Scale Correlation (to 4 - 2) to avoid the algorithm mistakenly identifying noise for signal.
  • Values up to 90% aren't unusual.
Scale Descriptions:
  • Scale 1 -This controls the extent of noise reduction in fine detail - such as single pixels.
  • Scale 2 - This controls the extent of noise reduction in small to medium detail.
  • Scale 3 - This controls the extent of noise reduction in medium detail.
  • Scale 4 - This controls the extent of noise reduction in medium to large detail.
  • Scale 5 - This controls the extent of noise reduction of large noise blotches/grain.
Scale Correlation:
Usually, when there is a correlation between image elements over multiple scales it indicates important detail in an image. This is how Denoise identifies detail. It can then provide the control to protect this detail from the denoising algorithm.
For every scale, the scale correlation algorithm looks at the immediate neighboring scales to see if detail in that scale exists. If detail in the neighboring scale exists, this is taken into account when determining how much noise reduction is applied. The Scale Correlation parameter specifies how many neighboring scales are evaluated. For example, if the Scale Correlation is set to 2 then it will look at scales +/- 2 from the current scale.
  • Defines how much Denoise identifies smaller scale features as being detail that correlates with large scale detail that contains it. The scale correlation value controls how far the correlation propagates to other scale levels.
  • Default value is 6. The range is 0 to 6.
  • Certain types of noise can have scale correlation that makes them look like detail. To avoid this mis-identification in noisy images the Scale Correlation value can be reduced so it doesn't search for correlation in the smaller elements. This can be a problem when:
    • There are too few sub-frames taken when using an OSC or DSLR or when using drizzle, or
    • Using insufficient dithering.
    • The noise has been introduced artificially during debayering or subsequent processing and not from natural Poisson noise sources.
  • Larger values mean smaller elements of a larger structure are searched for to identify detail.
  • Smaller values means that more of the smaller elements of detail will not be identified and so will not have the additional control over the denoise process.
Smoothness:
  • This controls how any detail identified using Scale Correlation is smoothed.
  • Default value is 75%. Range is 0% to 100%.
  • Reducing this lessens the amount of smoothing done to the detail - keeping intact more of the small detail that was correlated with the larger structure.
  • Increasing this allows greater smoothing, removing noise but potentially losing detail as well.
Read Noise Compensation:
  • This allows you to eliminate noise (and signal) below the noise floor - the point below which noise no longer has a 1:1 linear relationship with signal due to the predominance of noise which is not signal-related (e.g. read noise). Noise reduction below this level is done differently.
  • Use this after having used other parameters to eliminate as much of the noise as possible. This should remove any mottled appearance in the dark background if there is any.
  • Default is Off. Range is Off (0.00%) to 100.00%.
  • Change if the image shows a definite noise floor beyond which the signal is overwhelmed by noise. However, first try using other parameters to eliminate as much of the noise as possible. This value should be kept as low as possible.
  • Typical values 0-15% but can be as high as 40%.
  • If you increase Read Noise Compensation too much the stars will get a blurry halo around them - so check for this when adjusting.
Brightness Detail Loss:
This balances noise reduction with detail loss in brightness. Larger values will do more aggressive noise reduction possibly causing some detail loss. Smaller values will reduce noise reduction. 0% is no noise reduction.
  • Default is 12%. Range is 0% to 200%.
  • Reducing to 0% turns off noise reduction completely.
Color Detail Loss:
This balances noise reduction with detail loss in colour. Larger values will do more aggressive noise reduction possibly causing some colour loss.
  • Default is 12%. Range is 0% to 200%.
Mask Fuzz:
If a mask is used, Mask Fuzz controls the blending of the transition between masked and non-masked parts of the image.
  • Default is 1.0 pixels. Range is 1.0 to 40.0 pixels.
Background Notes:

Identifying Detail in an Image
The traditional method of identifying detail in an image is to use a mask - either based on luminance or created manually. To avoid this Startools identifies it automatically by using a technique called Scale correlation.
Usually, when there is a correlation between image elements over multiple scales it indicates important detail in an image. This is how the Denoise module identifies detail. It can then provide the control to protect this detail from the denoising algorithm.
By making the Denoise module scale aware it allows the comparison of elements at different scales. Looking for correlation between elements at different scales enables identification of likely detail.
The number of scale levels which the algorithm tries to correlate dictates the smallest detail that is identified - and therefore may be protected. If the scale is too small it is possible that you start to protect noise that is mistaken for detail. That is why we control the depth of the search for detail in the scale levels.

Outstanding Questions:
  1. Has anyone got a better method for Selecting the optimum noise reduction settings than the one described in the 'Special Techniques' section?
Guy
 
Posts: 55
Joined: Thu Feb 19, 2015 8:35 am

Return to User Notes

Who is online

Users browsing this forum: No registered users and 1 guest