Method and system for determining optimal exposure of structured light based 3D camera

US 7,957,639 B2
Filed: 02/15/2008
Issued: 06/07/2011
Est. Priority Date: 01/23/2008
Status: Expired

- Alert
- Pin

Associated Cases

Associated Defendants

First Claim

Patent Images

1. A method for determining an optimal exposure of a structured light based three dimensional (3D) camera system including a projecting means for illuminating a predetermined pattern on a target object, an image capturing means for capturing an image of the target object with the pattern projected, and a processing means for reconstructing 3D data based on the captured image, wherein the method comprises the steps of:

obtaining an image of a target object with a predetermined pattern projected thereon, which is illuminated from a projecting means, and an image of the target object without a predetermined pattern projected thereon; and

determining automatically an optimal exposure level of the structured light based 3D camera system using said two kinds of images.

View all claims

1 Assignment

Timeline View

Assignment View

Litigations

0 Petitions

Accused Products

Abstract

Provided are a method and system for determining an optimal exposure of a structured light based 3D camera. The system includes a projecting means for illuminating a predetermined pattern on a target object, an image capturing means for capturing an image of the target object with the pattern projected, and a processing means for reconstructing 3D data for the target object by identifying the pattern of the captured images from the image capturing means. The system automatically determines an optimal exposure of the structured light based 3D camera system through analyzing the captured image of the target object.

Citations

7 Claims

1. A method for determining an optimal exposure of a structured light based three dimensional (3D) camera system including a projecting means for illuminating a predetermined pattern on a target object, an image capturing means for capturing an image of the target object with the pattern projected, and a processing means for reconstructing 3D data based on the captured image, wherein the method comprises the steps of:
- obtaining an image of a target object with a predetermined pattern projected thereon, which is illuminated from a projecting means, and an image of the target object without a predetermined pattern projected thereon; and
  
  determining automatically an optimal exposure level of the structured light based 3D camera system using said two kinds of images.
- View Dependent Claims (2, 3, 4, 5, 6, 7)
- - 2. The method of claim 1, wherein the step of determining automatically an optimal exposure level comprisesa) dividing an intensity of a corresponding pixel into red intensity, green intensity, and blue intensity of three channels (R, G, B) for one same pixel at each of the captured images, and generating a characteristic curve for each of the three channels for showing the intensity of a pixel for each channel according to variation of exposure levels;
    - b) estimating intensity I of the corresponding pixel according to variation of exposure levels using the generated characteristic curves, and calculating an intensity difference Δ
      
      I or a brightness ratio SNR between the image of the target object with the predetermined pattern projected and the image of the target object without the predetermined pattern for the corresponding pixel using the estimated intensity;
      
      c) collecting brightness data about intensity differences Δ
      
      I or brightness ratios SNR according to variation of exposure levels for all pixels by repeating the steps a) and b) for all pixels of each image;
      
      d) discriminating pixels with spread phenomenon (saturation) occurred or the pixels without the predetermined pattern projected when the projecting means projects the predetermined pattern from the collected brightness data and excluding the brightness data of the discriminated pixels; and
      
      e) calculating the number of pixels having an intensity difference Δ
      
      I and a brightness ratio SNR exceeding a predetermined threshold Δ
      
      I_thor SNR_that every exposure levels using the brightness data filtered at the step d) and deciding an exposure level having a largest calculated number of pixels as an optimal exposure level.
  - 3. The method of claim 2, wherein the characteristic curves are created based on proportional relation between an intensity and an exposure, where the intensity denotes brightness of a pixel and the exposure is an amount of incoming light.
  - 4. The method of claim 3, wherein in the step a), proportional factors k_R, k_G, and k_Bare calculated by applying an exposure applied for capturing the images in the image obtaining step and red intensity, green intensity, and blue intensity for one same pixel in each of the obtained images to an equation:
    - I_R=k_R*E, I_G=k_G*E, I_B=k_B*E, intensities of a corresponding pixel are calculated for input exposures by inputting various exposures to the equation, and the characteristic curve is created by corresponding the calculated intensities of a corresponding pixel with the input exposures, where I_R, and I_Gand I_Bdenote the intensities in R, G, and B channels, k_R, k_G, and k_Bdenote a proportional factor, and E denotes an exposure in the equation.
  - 5. The method of claim 4, wherein in the step b), intensity of a gray level of a corresponding pixel is estimated according to variation of exposure levels by transforming the created characteristic curves for red, green, and blue channels to a characteristic curve of a gray level.
  - 6. The method of claim 5, wherein in the step d), anenable term is set as a factor for checking the collected brightness data, is checked as Disable for a pixel in which spread phenomenon (saturation) occurs when the projecting means illuminates the predetermined pattern and an intensity difference Δ
    - I or a brightness ratio SNR of the pixel is classified as unreliable data.
  - 7. The method of claim 6, wherein in the step e), the brightness threshold Δ
    - I_thor SNR_thfor the intensity difference or the brightness ratio is set as minimum intensity difference or minimum brightness ratio for discriminating an area with the predetermined pattern illuminated from an area without the predetermined pattern illuminated.

Specification

Resources

Litigation Campaign Assessment

Litigation Data

Current Assignee
Sungkyunkwan University Foundation For Corporate Collaboration (SungKyunKwan University (SKKU))
Original Assignee
Sungkyunkwan University Foundation For Corporate Collaboration (SungKyunKwan University (SKKU))
Inventors
Lee, Sukhan, Ryu, Moon Wook, Kim, Dae Sik
Primary Examiner(s)
Blackman, Rochelle-Ann J.
Assistant Examiner(s)
Fenwick, Warren K

Application Number

US12/032,375
Publication Number

US 20090185800A1
Time in Patent Office

1,208 Days
Field of Search

396/213, 396/324
US Class Current

396/213
CPC Class Codes

G03B 7/00 Control of exposure by sett...

G03B 7/003 setting of both shutter and...

Method and system for determining optimal exposure of structured light based 3D camera

First Claim

1 Assignment

Litigations

0 Petitions

Accused Products

Abstract

Citations

7 Claims

Specification

Solutions

Use Cases

Quick Links

	Alert Frequency
	Daily (M-F)
	Weekly

Method and system for determining optimal exposure of structured light based 3D camera

First Claim

1 Assignment

Subscription Required

Subscription Required

Litigations

0 Petitions

Subscription Required

Accused Products

Subscription Required

Abstract

Citations

7 Claims

Specification

Subscription Required

Solutions

Use Cases

Quick Links