Patent application number | Description | Published |
20090109230 | METHODS AND APPARATUSES FOR LOAD BALANCING BETWEEN MULTIPLE PROCESSING UNITS - Exemplary embodiments of methods and apparatuses to dynamically redistribute computational processes in a system that includes a plurality of processing units are described. The power consumption, the performance, and the power/performance value are determined for various computational processes between a plurality of subsystems where each of the subsystems is capable of performing the computational processes. The computational processes are exemplarily graphics rendering process, image processing process, signal processing process, Bayer decoding process, or video decoding process, which can be performed by a central processing unit, a graphics processing units or a digital signal processing unit. In one embodiment, the distribution of computational processes between capable subsystems is based on a power setting, a performance setting, a dynamic setting or a value setting. | 04-30-2009 |
20100020222 | Image Capturing Device with Touch Screen for Adjusting Camera Settings - Several methods for operating a built-in digital camera of a portable, handheld electronic device are described. In one embodiment, the device receives a user selection (e.g., tap, tap and hold, gesture) of a region displayed on the display screen (e.g., touch sensitive screen). A touch to focus mode may then be initiated in response to the user selection and exposure and focus parameters determined and adjusted. Then, an automatic scene detection mechanism can determine whether a scene has changed. If the scene has changed, then the touch to focus mode ends and a default automatic focus mode initiates. This mode sets a new exposure metering area and focus area prior to determining and adjusting exposure and focus parameters, respectively. | 01-28-2010 |
20100309321 | IMAGE CAPTURING DEVICES USING ORIENTATION DETECTORS TO IMPLEMENT AUTOMATIC EXPOSURE MECHANISMS - Several methods and apparatuses for implementing automatic exposure mechanisms for image capturing devices are described. In one embodiment, an orientation detector located in the device determines orientation data for the device. The automatic exposure mechanism projects an orientation vector into an image plane of an image sensor. Next, the automatic exposure mechanism adjusts an initial position of a metering area used for automatic exposure towards a target position based on the projected orientation vector. The automatic exposure mechanism optionally dampens the adjustment of the metering area. | 12-09-2010 |
20100309335 | IMAGE CAPTURING DEVICE HAVING CONTINUOUS IMAGE CAPTURE - Methods, devices, and systems for continuous image capturing are described herein. In one embodiment, a method includes continuously capturing a sequence of images with an image capturing device. The method may further include storing a predetermined number of the sequence of images in a buffer. The method may further include receiving a user request to capture an image. In response to the user request, the method may further include automatically selecting one of the buffered images based on an exposure time of one of the buffered images. The sequence of images is captured prior to or concurrently with receiving the user request. | 12-09-2010 |
20100309336 | SKIN TONE AWARE COLOR BOOST FOR CAMERAS - Increasing color saturation and contrast in images generally leads to more pleasing images; however, doing so uniformly to all colors in the image can make skin tones appear with an overly red tint. One embodiment of an improved method of skin tone aware color boosting identifies areas of the image which look like skin tones and areas that do not look like skin tones. A blurred “skin tone mask” can then be created over the image. One large boost operation and one small boost operation can be applied to the image. A final version of the image may then be created, applying the pixel values resulting from the small boosting operation to the skin tone regions and applying the pixel values resulting from the large boosting operation to the non-skin tone regions, using the blurred mask to provide a smooth transition between the skin tone and non-skin tone regions. | 12-09-2010 |
20100309344 | CHROMA NOISE REDUCTION FOR CAMERAS - A system, apparatus, computer readable medium, and method for noise reduction in image capturing devices involving an edge-preserving blur window is disclosed. In one embodiment, the edge-preserving blur includes only those pixels in the blur window that are visually close to the blur window's current center pixel in its blurring calculation. Limiting the pixels considered in the blur to those that are visually close to the center pixel ensures that the image's colors are not blurred along color edges within the image. Light-product information taken from the image's metadata, for example, the camera sensor's gain level, may be used to adjust the blur filter parameters dynamically. This allows the method to perform the appropriate amount of processing depending on the lighting situation of the image that is currently being processed. | 12-09-2010 |
20100309345 | Radially-Based Chroma Noise Reduction for Cameras - A system, apparatus, computer readable medium, and method for radially-dependent noise reduction in image capturing devices involving an edge-preserving blur window are disclosed. In one embodiment, the edge-preserving blur includes only those pixels in the blur window that are within a threshold value of the blur window's current center pixel in its blurring calculation. By creating a threshold function that varies radially from the center of the image sensor's light intensity falloff function, a more appropriate threshold value can be chosen for each pixel, allowing for more noise farther from the center of the image, and allowing for less noise closer to the center of the image. Light-product information taken from the image's metadata may be used to scale the threshold value parameters dynamically. This allows the method to perform the appropriate amount of processing depending on the lighting situation of the image that is currently being processed. | 12-09-2010 |
20100309346 | AUTOMATIC TONE MAPPING FOR CAMERAS - A device, method, computer useable medium, and processor programmed to automatically generate tone mapping curves in a digital camera based on image metadata are described. By examining image metadata from a digital camera's sensor, such as the light-product, one can detect sun-lit, high-light, and low-light scenes. Once the light-product value has been calculated for a given image, a tone mapping curve can automatically be generated within the sensor and adjusted appropriately for the scene based on predetermined parameters. Further, it has been determined that independently varying the slopes of the tone mapping curve at the low end (S | 12-09-2010 |
20100309364 | CONTINUOUS AUTOFOCUS MECHANISMS FOR IMAGE CAPTURING DEVICES - At least certain embodiments described herein provide a continuous autofocus mechanism for an image capturing device. The continuous autofocus mechanism can perform an autofocus scan for a lens of the image capturing device and obtain focus scores associated with the autofocus scan. The continuous autofocus mechanism can determine an acceptable band of focus scores based on the obtained focus scores. Next, the continuous autofocus mechanism can determine whether a current focus score is within the acceptable band of focus scores. A refocus scan may be performed if the current focus score is outside of the acceptable band of focus scores. | 12-09-2010 |
20110169857 | System for Optimizing Graphics Operations - Disclosed is a system for producing images including techniques for reducing the memory and processing power required for such operations. The system provides techniques for programmatically representing a graphics problem. The system further provides techniques for reducing and optimizing graphics problems for rendering with consideration of the system resources, such as the availability of a compatible GPU. | 07-14-2011 |
20110216079 | Partial Display Updates in a Windowing System Using a Programmable Graphics Processing Unit - Techniques to generate partial display updates in a buffered window system in which arbitrary visual effects are permitted to any one or more windows (e.g., application-specific window buffers) are described. Once a display output region is identified for updating, the buffered window system is interrogated to determine which regions within each window, if any, may effect the identified output region. Such determination considers the consequences any filters associated with a window impose on the region needed to make the output update. | 09-08-2011 |
20110249142 | Face Detection Using Orientation Sensor Data - Techniques for reducing the amount of time a camera device requires to automatically adjust focus and/or exposure settings prior to image capture are described. As disclosed, sensor data is used to identify the camera device's orientation. Once known, face detection operations are performed for only that orientation thereby dramatically reducing the amount of processing time required to perform the face detection. The result of the face detection operations may be used to automatically adjust the image capture device's focus and/or exposure. | 10-13-2011 |
20110249961 | Dynamic Exposure Metering Based on Face Detection - A system, computer readable medium, and method for dynamically setting a camera's exposure parameters based on face detection are disclosed. When taking a picture or video of a person in front of a bright background, standard exposure algorithms tend to overexpose the background. In one embodiment disclosed herein, a face detection algorithm is run on the current picture or video frame, and the exposure metering region is inset over the detected face. Exposure time, gain, or other exposure parameters may be set based on the pixels within the exposure metering region. In another embodiment, the exposure metering region tracks a moving face according to lag parameters so that the exposure metering region remains substantially over the face. In yet another embodiment, a plurality of faces may be tracked, with the exposure parameters set based on a weighted average of the pixels within the plurality of face-containing exposure metering regions. | 10-13-2011 |
20110273464 | Framework for Graphics Animation and Compositing Operations - A framework for performing graphics animation and compositing operations has a layer tree for interfacing with the application and a render tree for interfacing with a render engine. Layers in the layer tree can be content, windows, views, video, images, text, media, or any other type of object for a user interface of an application. The application commits change to the state of the layers of the layer tree. The application does not need to include explicit code for animating the changes to the layers. Instead, an animation is determined for animating the change in state. In determining the animation, the framework can define a set of predetermined animations based on motion, visibility, and transition. The determined animation is explicitly applied to the affected layers in the render tree. A render engine renders from the render tree into a frame buffer for display on the computer system. Those portions of the render tree that have changed relative to prior versions can be tracked to improve resource management. | 11-10-2011 |
20110292246 | Automatic Tone Mapping Curve Generation Based on Dynamically Stretched Image Histogram Distribution - An apparatus, method, computer useable medium, and processor programmed to automatically generate tone mapping curves in a digital camera based on image metadata are described. Rather than having a static tone mapping curve for all images, the curve can be varied automatically based on, e.g., the brightness histogram of the image. In one embodiment, a certain percentage of the least bright pixels and a certain percentage of the brightest pixels can be disregarded, while the remaining pixels can be linearly stretched to encompass the original range of brightness values. Based on the distribution of the resultant stretched brightness histogram, slopes for the low end (S | 12-01-2011 |
20110293259 | Scene Adaptive Auto Exposure - Systems, methods, and a computer readable medium for an improved automatic exposure algorithm attempt to classify an image into a particular “scene category,” and, based on the determined scene category, meter the scene according to a generated metering weighting matrix. In one embodiment, the average luminance is calculated for a central exposure metering region of the image and a plurality of peripheral exposure metering regions surrounding the central exposure metering region. Based on comparisons of the average luminance values of the peripheral exposure regions to the average luminance of the central exposure region, a target metering weighting matrix may be generated. In another embodiment, the scene category corresponds to a predetermined metering weighting matrix. In video applications, it may be desirable to reduce oscillations in metering parameter values to limit any visually jarring effects on the camera's preview screen by only adjusting metering parameter values when predetermined criteria are met. | 12-01-2011 |
20120105672 | Auto Exposure Blowout Prevention - Systems, methods, and a computer readable medium for performing an improved blowout prevention process in an image capture device are provided to compensate for occurrences of exposure “blowouts,” i.e., areas in a captured image where pixel brightness exceeds the sensor's dynamic range of capturing capability. In one embodiment, the captured image's histogram may be analyzed to determine if the image is indicative of the presence of exposure blowouts. Once it has been determined that there likely are blowouts in the image, an exposure bias for the image capture device may be set accordingly. Particularly, the exposure value (EV) for the image capture device may be gradually corrected, e.g., by one-eighth of a stop per captured frame, until the image histogram is no longer indicative of blown out regions, at which point the image capture device's exposure value may gradually be corrected back to “normal,” i.e., non-exposure bias compensated, levels. | 05-03-2012 |
20120147011 | System for Optimizing Graphics Operations - Disclosed is a system for producing images including techniques for reducing the memory and processing power required for such operations. The system provides techniques for programmatically representing a graphics problem. The system further provides techniques for reducing and optimizing graphics problems for rendering with consideration of the system resources, such as the availability of a compatible GPU. | 06-14-2012 |
20120154415 | FRAMEWORK FOR GRAPHICS ANIMATION AND COMPOSITING OPERATIONS - A graphics animation and compositing operations framework has a layer tree for interfacing with the application and a render tree for interfacing with a render engine. Layers in the layer tree can be content, windows, views, video, images, text, media, or other types of objects for an application's user interface. The application commits state changes to the layers of the layer tree. The application does not need to include explicit code for animating the changes to the layers. Instead, an animation is determined for animating the change in state by the framework which can define a set of predetermined animations based on motion, visibility, and transition. The determined animation is explicitly applied to the affected layers in the render tree. A render engine renders from the render tree into a frame buffer. Portions of the render tree changing relative to prior versions can be tracked to improve resource management. | 06-21-2012 |
20120188255 | Framework for Graphics Animation and Compositing Operations - A framework for performing graphics animation and compositing operations has a layer tree for interfacing with the application and a render tree for interfacing with a render engine. Layers in the layer tree can be content, windows, views, video, images, text, media, or any other type of object for a user interface of an application. The application commits change to the state of the layers of the layer tree. The application does not need to include explicit code for animating the changes to the layers. Instead, an animation is determined for animating the change in state. The determined animation is explicitly applied to the affected layers in the render tree. A render engine renders from the render tree into a frame buffer for display on the processing device. Those portions of the render tree that have changed relative to prior versions can be tracked to improve resource management. | 07-26-2012 |
20120262599 | Dynamic Exposure Metering Based on Face Detection - A system, computer readable medium, and method for dynamically setting a camera's exposure parameters based on face detection are disclosed. When taking a picture or video of a person in front of a bright background, standard exposure algorithms tend to overexpose the background. In one embodiment disclosed herein, a face detection algorithm is run on the current picture or video frame, and the exposure metering region is inset over the detected face. Exposure time, gain, or other exposure parameters may be set based on the pixels within the exposure metering region. In another embodiment, the exposure metering region tracks a moving face according to lag parameters so that the exposure metering region remains substantially over the face. In yet another embodiment, a plurality of faces may be tracked, with the exposure parameters set based on a weighted average of the pixels within the plurality of face-containing exposure metering regions. | 10-18-2012 |
20120274644 | Framework for Graphics Animation and Compositing Operations - A graphics animation and compositing operations framework has a layer tree for interfacing with the application and a render tree for interfacing with a render engine. Layers in the layer tree can be content, windows, views, video, images, text, media, or other types of objects for an application's user interface. The application commits state changes to the layers of the layer tree. The application does not need to include explicit code for animating the changes to the layers. Instead, an animation is determined for animating the change in state by the framework which can define a set of predetermined animations based on motion, visibility, and transition. The determined animation is explicitly applied to the affected layers in the render tree. A render engine renders from the render tree into a frame buffer. Portions of the render tree changing relative to prior versions can be tracked to improve resource management. | 11-01-2012 |
20120293610 | Intelligent Image Blending for Panoramic Photography - This disclosure pertains to devices, methods, and computer readable media for performing positional sensor-assisted panoramic photography techniques in handheld personal electronic devices. Generalized steps that may be used to carry out the panoramic photography techniques described herein include, but are not necessarily limited to: 1.) acquiring image data from the electronic device's image sensor; 2.) performing “motion filtering” on the acquired image data, e.g., using information returned from positional sensors of the electronic device to inform the processing of the image data; 3.) performing image registration between adjacent captured images; 4.) performing geometric corrections on captured image data, e.g., due to perspective changes and/or camera rotation about a non-center of perspective (COP) camera point; and 5.) “stitching” the captured images together to create the panoramic scene, e.g., blending the image data in the overlap area between adjacent captured images. The resultant stitched panoramic image may be cropped before final storage. | 11-22-2012 |
20120307107 | Automatic Exposure Control Based on Multiple Regions - Systems, methods, and computer readable media for performing auto-exposure operations in a digital image capture device. An image capture device's auto-exposure settings may be automatically adjusted by generating and then combining, in a dynamically weighted fashion, two sets of exposure values. One set of exposure values may be based on detected faces while the other set may be based on the image as a whole. Each set of exposure values may include a “measured” value and a “target” value, wherein each of these values may, in turn, be based on one or more (different) aspects of the image. Illustrative digital image capture devices in which the disclosed technology may be used include, but are not limited, to portable digital cameras, mobile telephones, personal digital assistants, mobile music and video devices, and portable computer platforms such as notebook and tablet computers. | 12-06-2012 |
20120307110 | Image Noise Reduction - Systems, methods, and computer readable media for removing noise from the luminance (luma) channel in a digital image represented in the YUV color space are described. In general, an element from the luma channel may be selected and a region about that element defined. Using a threshold that is based on the selected luma element's value, similar luma values within the defined region may be identified and combined to provide a substitute value. The substitute value may be blended with the value of the selected element within the image's luma channel. In another implementation, element values from both an image's luma and chroma channels may be used to identify similar luma values. | 12-06-2012 |
20130038771 | IMAGE CAPTURING DEVICE HAVING CONTINUOUS IMAGE CAPTURE - Methods, devices, and systems for continuous image capturing are described herein. In one embodiment, a method includes continuously capturing a sequence of images with an image capturing device. The method may further include storing a predetermined number of the sequence of images in a buffer. The method may further include receiving a user request to capture an image. In response to the user request, the method may further include automatically selecting one of the buffered images based on an exposure time of one of the buffered images. The sequence of images is captured prior to or concurrently with receiving the user request. | 02-14-2013 |
20130063644 | IMAGE CAPTURING DEVICE WITH TOUCH SCREEN FOR ADJUSTING CAMERA SETTINGS - Several methods for operating a built-in digital camera of a portable, handheld electronic device are described. In one embodiment, the device receives a user selection (e.g., tap, tap and hold, gesture) of a region displayed on the display screen (e.g., touch sensitive screen). A touch to focus mode may then be initiated in response to the user selection and exposure and focus parameters determined and adjusted. Then, an automatic scene detection mechanism can determine whether a scene has changed. If the scene has changed, then the touch to focus mode ends and a default automatic focus mode initiates. This mode sets a new exposure metering area and focus area prior to determining and adjusting exposure and focus parameters, respectively. | 03-14-2013 |
20130074077 | Methods and Apparatuses for Load Balancing Between Multiple Processing Units - Exemplary embodiments of methods and apparatuses to dynamically redistribute computational processes in a system that includes a plurality of processing units are described. The power consumption, the performance, and the power/performance value are determined for various computational processes between a plurality of subsystems where each of the subsystems is capable of performing the computational processes. The computational processes are exemplarily graphics rendering process, image processing process, signal processing process, Bayer decoding process, or video decoding process, which can be performed by a central processing unit, a graphics processing units or a digital signal processing unit. In one embodiment, the distribution of computational processes between capable subsystems is based on a power setting, a performance setting, a dynamic setting or a value setting. | 03-21-2013 |
20130076967 | Dynamic Autofocus Opertions - Systems, methods, and computer readable media for dynamically adjusting an image capture device's autofocus (AF) operation based, at least in part, on the device's orientation are described. In general, information about an image capture device's orientation may be used to either increase the speed or improve the resolution of autofocus operations. More particularly, orientation information such as that available from an accelerometer may be used to reduce the number of lens positions (points-of-interest) used during an autofocus operation, thereby improving the operation's speed. Alternatively, orientation information may be used to reduce the lens' range of motion while maintaining the number of points-of-interest, thereby improving the operation's resolution. | 03-28-2013 |
20130182139 | Orientation Detection Using Image Processing - Devices, methods, and computer readable media for performing image orientation detection using image processing techniques are described. In one implementation, an image processing method is disclosed that obtains image data from a first image captured by an image sensor (e.g., from any image capture electronic device). Positional sensor data captured by the device and corresponding to the image data may also be acquired (e.g., through an accelerometer). If the orientation of the device is not reliably discernible from the positional sensor data, the method may attempt to use rotationally invariant character detection metrics to determine the most likely orientation of the image, e.g., by using a decision forest algorithm. Face detection information may be used in conjunction with, or as a substitute for, the character detection data based on one or more priority parameters. Image orientation information may then be included within the image's metadata. | 07-18-2013 |
20130240628 | Barcode Recognition Using Data-Driven Classifier - A barcode decoding system and method are disclosed that use a data-driven classifier for transforming a potentially degraded barcode signal into a digit sequence. The disclosed implementations are robust to signal degradation through incorporation of a noise model into the classifier construction phase. The run-time computational cost is low, allowing for efficient implementations on portable devices. Implementations are disclosed for intelligent preview scaling, barcode-aware autofocus augmentation and multi-scale signal feature extraction. | 09-19-2013 |
20130300884 | IMAGE CAPTURING DEVICES USING ORIENTATION DETECTORS TO IMPLEMENT AUTOMATIC EXPOSURE MECHANISMS - Several methods and apparatuses for implementing automatic exposure mechanisms for image capturing devices are described. In one embodiment, an orientation detector located in the device determines orientation data for the device, The automatic exposure mechanism projects an orientation vector into an image plane of an image sensor, Next, the automatic exposure mechanism adjusts an initial position of a metering area used for automatic exposure towards a target position based on the projected orientation vector. The automatic exposure mechanism optionally dampens the adjustment of the metering area. | 11-14-2013 |
20140184634 | System for Optimizing Graphics Operations - Disclosed is a system for producing images including techniques for reducing the memory and processing power required for such operations. The system provides techniques for programmatically representing a graphics problem. The system further provides techniques for reducing and optimizing graphics problems for rendering with consideration of the system resources, such as the availability of a compatible GPU. | 07-03-2014 |
20140292797 | System And Method For Computing An Image - Disclosed are a system and method for computing a picture. Instead of loading a file that contains the image from memory, the present invention provides for a system and method for opening and retaining a procedural recipe and a small set of instructions that can be executed to compute a picture. The picture can be computed very quickly using a GPU (graphics processing unit), and can be made to move on demand. When a part of the image is needed to composite, that part is computed using a fragment program on the GPU using the procedural recipe and a specially written fragment program into a temporary VRAM buffer. After it is computed and composited, the buffer containing the result of the fragment program may be discarded. | 10-02-2014 |
20140362256 | Reference Frame Selection for Still Image Stabilization - Systems, methods, and computer readable media to improve image stabilization operations are described. A novel combination of image quality and commonality metrics are used to identify a reference frame from a set of commonly captured images which, when the set's other images are combined with it, results in a quality stabilized image. The disclosed image quality and commonality metrics may also be used to optimize the use of a limited amount of image buffer memory during image capture sequences that return more images that the memory may accommodate at one time. Image quality and commonality metrics may also be used to effect the combination of multiple relatively long-exposure images which, when combined with a one or more final (relatively) short-exposure images, yields images exhibiting motion-induced blurring in interesting and visually pleasing ways. | 12-11-2014 |
20140362275 | Autofocus - Systems, methods, and computer readable media to provide improved autofocus operations are described. In general, techniques are disclosed that show how to improve contrast-based autofocus operations by applying a novel threshold-and-select action to window-specific focus scores. More particularly, techniques disclosed herein may evaluate a multi-window autofocus area over a burst collected group of images. For each captured image, focus scores for each window within an autofocus area may be collected, aggregated and then consolidated to identify a single focus metric and its associated lens position for each window. The window-specific focus scores may be reviewed and selection of a “best” autofocus lens position made using a selection criteria. The specified criteria may be used to bias the selection to either a front-of-plane (macro) or back-of-plane (infinity) focus position. | 12-11-2014 |
20140368725 | CONTINUOUS AUTOFOCUS MECHANISMS FOR IMAGE CAPTURING DEVICES - At least certain embodiments described herein provide a continuous autofocus mechanism for an image capturing device, The continuous autofocus mechanism can perform an autofocus scan for a lens of the image capturing device and obtain focus scores associated with the autofocus scan. The continuous autofocus mechanism can determine an acceptable band of focus scores based on the obtained focus scores. Next, the continuous autofocus mechanism can determine whether a current focus score is within the acceptable band of focus scores. A refocus scan may be performed if the current focus score is outside of the acceptable band of focus scores. | 12-18-2014 |