| Patent application number | Description | Published |
|---|
| 20080212676 | Motion parameter engine for true motion - Local motion estimation is described herein. Each picture of a video is partitioned into blocks for the local motion estimation. An extended-block FFT is calculated for each block, where the extended-block denotes that a certain area around the block is also included for applying FFT. Extending the block for FFT helps to account for the motion of objects that are moving into or out of the block. Phase correlation is applied to attain a set of Motion Vector (MV) candidates for the blocks, and a cost function is evaluated for each MV. If no MV candidate produces a cost function below a pre-defined threshold, a hierarchical variable block matching search is applied and the process is repeated with blocks for finer resolution. Also, predictive MV candidates are used during the block matching search along with temporal constraints tracking to select an MV that yields the minimum cost function. | 09-04-2008 |
| 20080212687 | High accurate subspace extension of phase correlation for global motion estimation - A method for achieving high sub-unit accuracy during global motion estimation of sequential video frame images is described herein. The method estimates the global motion using an existing phase-correlation approach, and further refines it to a sub-unit level using the neighborhood values of the phase correlation surface peak The method determines the sub-unit displacement direction by examining the signs of the peak of phase correlation surface and its two nearest neighbors. The method determines the sub-unit displacement magnitude by applying the ratio of associated phase correlation values to a 5 | 09-04-2008 |
| 20090074058 | CODING TOOL SELECTION IN VIDEO CODING BASED ON HUMAN VISUAL TOLERANCE - In one embodiment, a coding mode selection method is provided to improve the visual quality of an encoded video sequence. The coding mode is selected based on a human visual tolerance level. Picture data may be received for a video coding process. The picture data is then analyzed to determine human visual tolerance adjustment information. For example, parameters of a cost equation may be adjusted based on the human visual tolerance level, which may be a tolerance that is based on a distortion bound that the human visual system can tolerate. The picture data may be analyzed in places that are considered visually sensitive areas, such as trailing suspicious areas, stripping suspicious areas, picture boundary areas, and/or blocking suspicious areas. Depending on what kind of visually sensitive area is found in the picture data, a parameter in a cost equation may be adjusted based on different visual tolerance thresholds. The coding mode is then determined based on the cost. | 03-19-2009 |
| 20090238535 | MERGING VIDEO WITH TIME-DECIMATED HIGH-RESOLUTION IMAGERY TO FORM HIGH-RESOLUTION VIDEO FRAMES - Apparatus and methods for generating a shutter-time compensated high spatial resolution (HR) image output by enhancing lower spatial resolution (LR) video images with information obtained from higher spatial resolution still images which are temporally decimated. Super-resolved images and LR SAD information is generated from the LR images and used for directing the extracting of information from the temporally decimated HR images to enhance the spatial resolution of the LR images in a blending process. By way of example blending can comprise: motion estimation, motion compensation of a temporally displaced HR still images and a super-resolved (SR) image input, transformation (e.g., DCT), generating motion error output, blending motion compensated images in response to LR motion error information; inverse-transformation into a shutter-time compensated HR video image output. Accordingly, a more cost effective solution is taught for obtaining a desired shutter time and video resolution. | 09-24-2009 |
| 20090245375 | RECURSIVE IMAGE QUALITY ENHANCEMENT ON SUPER RESOLUTION VIDEO - Method and apparatus for improving the quality of super-resolution video imaging by suppressing ringing artifacts, reducing high-frequency noise, reducing blocking artifacts, and smoothing out jagged edges of the image to generate pictures that appear cleaner with less edge degradation. The method operates in a recursive manner within a sequence of low resolution images. Conventional SR processing is primarily enhanced within the invention by adding an artifact suppression section which creates a high frequency component signal ΔSR | 10-01-2009 |
| 20090257652 | AUTOMATIC IMAGE COLOR TONE CORRECTION - A method of image color tone correction is disclosed, which may include the steps of (a) providing a reference image and one or more source images, wherein all images are comprised of pixels of a scene; (b) correcting a designated portion of one of the source images based on the reference image to create a color tone corrected image; and (c) outputting the color tone corrected image to a computer readable medium. The designated portion may be any subset of one of the source images, and may be a simple cropping, interlace, or other form of selection, such as areas of interest in the scene. Additionally, the designated portion may be used for determining a set of coefficients for overall color image correction of the complement of the source images. This method brings the increased tonal and saturation qualities of still images to those in motion. | 10-15-2009 |
| 20090257684 | METHOD AND APPARATUS FOR SUPPRESSING RINGING ARTIFACTS WITHIN SUPER-RESOLUTION IMAGE PROCESSING - Apparatus and methods for reducing ringing artifacts when generating super-resolution pictures and/or videos and for controlling the balance between sharpness and introduction of artifacts. After motion estimation and motion masking for all input frames, the method enters a frame loop within which high frequency information is extracted from the input SR image for each low-resolution input image. Extracted information from each input frame is not directly utilized within the frame loop for changing the SR input as with conventional SR processes, but is used within a means for averaging high frequency information over a desired number of frames (N) and outputting higher resolution versions of low resolution images. Changing (N) alters the tradeoff between ringing suppression and sharpness boosting. Invention can be implemented in a number of imaging apparatus, in particular those having a processor for executing the method steps. | 10-15-2009 |
| 20090262800 | Block based codec friendly edge detection and transform selection - Low complexity edge detection and DCT type selection method to improve the visual quality of H.264/AVC encoded video sequence is described. Encoding-generated information is reused to detect an edge macroblock. Variance and Mean Absolute Difference (MAD) of one macroblock shows a certain relationship that is able to be used to differentiate the edge macroblock and the non-edge macroblock. Also, the variance difference of neighbor macroblocks provides a hint for edge existence. Then, a block-based edge detection method uses this information. To determine the DCT type for each block, the detected edges are differentiated as visual obvious edge, texture-like edge, soft edge and strong edge. 8×8 DCT is used for texture-like edges and the 4×4 DCT is used for all the other edges. The result is an efficient and accurate edge detection and transform selection method. | 10-22-2009 |
| 20100027905 | System and method for image and video encoding artifacts reduction and quality improvement - Reducing artifacts and improving quality for image and video encoding is performed in one pass to preserve natural edge smoothness and sharpness. To reduce artifacts and improve quality, several steps are implemented including spatial variation extraction, determining if a block is flat or texture/edge, classifying the pixels as texture or noise, detecting a dominant edge, checking the spatial variation of neighboring blocks, generating base weights, generating filter coefficients, filtering pixels and adaptive enhancement. A device which utilizes the method of reducing artifacts and improving quality achieves higher quality images and/or video with reduced artifacts. | 02-04-2010 |
| 20100067818 | System and method for high quality image and video upscaling - A low complexity upscaling method to generate higher resolution image and video with high quality is described herein. Natural edge smoothness and sharpness are preserved while overshooting artifacts and the “edge dilation” problem are eliminated. To obtain edge smoothness and remove jaggy artifacts along the edge, a bi-directional filtering which is based on two orthogonal directions is used to generate higher resolution pixels. The direction close to the edge direction is heavily weighted, and the direction far from the edge direction is lightly weighted. The weight of each direction is determined by the developed directional vector difference measurement method. To eliminate the overshooting artifacts and solving the thick edge problem, a dual-sided interpolation method is implemented. By using the dual-sided interpolation method, the interpolation result is pushed towards a dominant transition desired location which removes overshooting artifacts. A thin and sharp edge is obtained instead of a blurred, thick edge. | 03-18-2010 |
| 20100226437 | REDUCED-RESOLUTION DECODING OF AVC BIT STREAMS FOR TRANSCODING OR DISPLAY AT LOWER RESOLUTION - A method of and system for reducing complexity for transcoding Advanced Video Coding (AVC) videos is described herein. Transcoding from higher resolution signals to lower resolution signals or to signals for a lower resolution display is implemented. The complexity is reduced by decoding the AVC video at reduced horizontal and/or vertical resolution. This results in the reduction of computation cost for decoding and re-sampling the AVC video to lower resolution. | 09-09-2010 |
| 20100226567 | COLOR EFFECTS FOR COMPRESSED DIGITAL VIDEO - Implementing color effects in compressed digital video is improved upon by re-using the original video's compression parameters during the re-encoding stage, such that the parameters do not need to be re-estimated by the encoder. This improved method reduces complexity and also improves quality. Quality is improved due to re-use of the compression parameters since accumulated error which is common when re-encoding compressed video is prevented. For digital negatives, the effect is able to be implemented even more efficiently. | 09-09-2010 |
| 20100253817 | ORIENTATION-BASED APPROACH FOR FORMING A DEMOSAICED IMAGE, AND FOR COLOR CORRECTING AND ZOOMING THE DEMOSAICED IMAGE - A method and apparatus for forming a demosaiced image from a color-filter-array (“CFA”) image is provided. The CFA image comprises a first set of pixels colored according to a first (e.g., a green) color channel, a second set of pixels colored according to a second (e.g., a red) color channel and a third set of pixels colored according to a third (e.g., blue) color channel. The method may include obtaining an orientation map, which includes, for each pixel of the color-filter-array image, an indicator of orientation of an edge bounding such pixel. The method may further include interpolating the first color channel at the second and third sets of pixels as a function of the orientation map so as to form a fourth set of pixels. The method may also include interpolating the second color channel at the first and third sets of pixels as a function of the orientation map and the fourth set of pixels; and interpolating the third color channel at the first and second sets of pixels as a function of the orientation map and the fourth set of pixels. | 10-07-2010 |
| 20100254630 | METHOD AND APPARATUS FOR FORMING SUPER RESOLUTION IMAGES FROM RAW DATA REPRESENTATIVE OF COLOR FILTER ARRAY IMAGES - A method and apparatus for generating a super-resolution image are provided. The method may include obtaining a first set of RAW data representing a first image captured at a first resolution and obtaining, from the first set of RAW data, at least one first sample of data associated with the first image. The method may also include obtaining a second set of RAW data representing a second image captured at the first resolution, and performing image registration as a function of the first set of RAW data and the second set of RAW data so as to obtain at least one second sample of data associated with the second image. The first set of RAW data is used as a reference for the second set of RAW data. The method further includes combining the at least one first sample of data with at least one second sample of data to form a collection of samples, and interpolating the collection of samples to form the super-resolution image. | 10-07-2010 |
| 20100265313 | IN-CAMERA GENERATION OF HIGH QUALITY COMPOSITE PANORAMIC IMAGES - Apparatus and method for automatically generating panoramic still photographs from a sequence of images collected during panning. Programming within the camera allows creating the panoramic image output from multiple captured stills and/or video frames without laborious user “stitching”. A sequence of images are captured under control of the camera which span a desired subject area being panned (in any direction) by the user. As the images are being captured, the programming assures that the edges of adjacent images in the sequence sufficiently overlap one another as the desired subject area is being panned, as well as controlling other necessary camera adjustments (e.g., maintaining fixed focus). A set of sequential overlapping image frames is collected and combined to create at least one panoramic still photograph. The user can preferably change settings to control how the images are put together into the panoramic image output. | 10-21-2010 |
| 20100265357 | GENERATION OF SIMULATED LONG EXPOSURE IMAGES IN RESPONSE TO MULTIPLE SHORT EXPOSURES - Simulating a long exposure-time image from a sequence of short exposure-time images captured at slightly different times. The sequence of images is combined in a temporal integration process to create a long exposure image that simulates the output from a still camera, steadied by a tripod, whose light-sensitive material has been exposed to the same scene from the time of the beginning of the first input image of the sequence to the last image of the input sequence. The method overcomes limitations of hand-held video and image recording devices, allowing the user to easily create effects normally associated with high-end digital still cameras under expert control. | 10-21-2010 |
| 20100321513 | CONTENT ADAPTIVE DETECTION OF IMAGES WITH STAND-OUT OBJECT - Content adaptive detection of images having stand-out objects involves block variance-based detection and determining if an object includes a stand-out object. The images with a stand-out object are further processed to isolate an object of interest. The images without a detected stand-out object are further processed with a transition map-based detection method which includes generating a transition map. If an object portrait is determined from the transition map, then the image is further processed to isolate the object of interest. | 12-23-2010 |
| 20100321531 | SYSTEM AND METHOD FOR IMAGE QUALITY ENHANCEMENT BY REDUCING THE EFFECTS OF AIR POLLUTION AND HAZE - A low cost image quality enhancement method to be utilized in an ordinary consumer camera and for post processing of an existing image database is described herein. The quality enhancement is transferred into an adaptive intensity stretching process in the YUV domain. A different enhancement process is designed for a luminance (Y) channel and chrominance (UV) channel. The parameters in the enhancement process are estimated based on the contents of the image. After the stretching-based enhancement, an adaptive unsharp masking process is applied to the luminance data. The quality is significantly improved for the images shot under unfavorable conditions. | 12-23-2010 |
| 20110069884 | SYSTEM AND METHOD FOR "BOKEH-AJI" SHOT DETECTION AND REGION OF INTEREST ISOLATION - A “Bokeh-Aji” image is one in which the region of interest is in focus and the background is out of focus. Detection of “Bokeh-Aji” type images and then isolation to the region of interest area in a low complexity way without any human intervention is beneficial. A set of tools for performing this task include SAD and high pass filtering based in-focus/out-of-focus area separation, in-focus/out-of-focus block distribution based “Bokeh-Aji” shot detection and region of interest isolation. By effectively integrating these tools together, the “Bokeh-Aji” images are successfully identified, and the region of interest area is successfully isolated. | 03-24-2011 |
