US 5,638,131 AGrant
Method to Synchronize Video Modulation Using a Constant Time Base
Issue Date:1997-06-10
•4 Claims
•3 Drawing Sheets
Abstract
Successive pixels representing video data in successive lines in a raster scan are buffered. Each of the lines has a sync pulse defining the line beginning. A phase adjustment is determined between the sync pulse, preferably at a particular level in the sync pulse, and an adjacent one of system adjacent clock signals at a particular frequency. The actual or expected phase adjustment between the pixels at the end of each line is also determined. The difference between the phase adjustments at the beginning and end of each line is then determined. Progressive adjustments are made in the phase of each successive pixel in the line relative to the system clock signals in accordance with the number of system clock signals in the line and the determined difference in the phase adjustment between the line beginning and end. In this way, the pixels of video data are synchronized with the system clock signals. When the actual phase adjustment relative to the system clock signals is determined at the end of each line, the difference in the phase adjustments at the beginning and end of such line is determined from the phase adjustment for such line and the phase adjustment stored for the previous line. When the expected phase adjustment is provided for the end of each line, this estimated value is altered for each line by an amount equal to the actual phase adjustment at the beginning of such line and the estimated phase adjustment at the end of such line.
Metadata
Assignee
- Brooktree Corporation
Inventors
- Gregory C. Parrish
- Benjamin E. Felts, III
- Sanjay K. Jha
- David J. Wicker
Application Information
Application Number:US 320166&
Filing Date:1994-10-07
Priority Date:1993-03-10
Art Unit:262
Classifications
IPC:
H04N 504H04N 506
Field of Search:
348331536;537;538;539;497;498;714;71517;18;20;25
Patent Drawings (3 sheets)
Description
This invention relates to apparatus for, and methods of synchronizing incoming video data in the form of pixels in successive lines in a raster scan to coincide with successive system clock signals at a particular frequency. The invention is especially adapted to be used in a graphics system.
Video data in the form of successive pixels in each line of a raster scan is often provided for use in a graphics system. For example, graphics data may be displayed on the face of a video monitor and the video may be displayed on a window on the face of this video monitor. The pixels are often presented from an external source such as from a tape at a frequency different from the clock in the graphics system in which the video data is to be displayed. Furthermore, the frequency of the video data sometimes varies somewhat. This results from the fact that the lengths of the successive lines of the pixels tend to vary somewhat.
Conventionally, the frequency of the system clock signals has been varied to attempt to have this frequency conform to the frequency at which the pixels in the video data are presented. This has presented complications. For example, since the frequency of the video data is not constant, the frequency of the system clock signals tends to vary with time. Furthermore, since the operation of the system is tied to the frequency of the system clock signals, variations in the frequency of the system clock signals tends to produce complications in the operation of the system.
In addition to the horizontal sync signal at the beginning of each line, there is also a burst of sinusoidal signals at a sub-carrier frequency. In the NTSC system used in the United States, this frequency is at approximately 3.56 megahertz. In a system developed by Fujitsu and disclosed in "SINGLE-CHIP DIGITAL PLL LSI FOR TELEVISION IMAGE-PROCESSING SYSTEMS" published in FIND, Vol. 10, No. 1, February 1991, the pixels of video data are synchronized in time with the signals at the sub-carrier frequency. Although this system constitutes an improvement over the conventional system discussed in the previous paragraph, it still has significant limitations. It does not synchronize the video data with the system clock signal, thereby still producing complications in the operation of the system. Furthermore, the Fujitsu system provides only one adjustment per line. This causes deviations to occur in the successive pixels in each line from the sub-carrier frequency as a reference.
Video data in the form of successive pixels in a raster scan have been provided for display on the face of a video monitor for many years. In that period of time, the limitations in the systems of the prior art have been known and consideration has been given in all of that period to providing a system which will surmount these limitations.
This system provides a system which surmounts the limitations specified above. The system synchronizes the video data with the system clock signals. Furthermore, the system of this invention provides progressive corrections in the timing of progressive pixels in each line of video data in accordance with the timing of the successive system clock signals in that line.
In one embodiment of the invention, successive pixels representing video data in each of successive lines in a raster scan are buffered. Each of the lines has a sync pulse defining the beginning of the line. System clock signals are provided at a particular frequency. A phase adjustment is determined between the sync pulse, preferably at a particular level in the sync pulse, and the adjacent system clock signal. The actual or expected phase adjustment between the pixels at the end of each line are also determined.
The difference between the phase adjustments at the beginning and end of each line is then determined. Progressive adjustments are made in the phase of each successive pixel in the line relative to the system clock signals in accordance with the number of the system clock signals in the line and the determined difference in the phase adjustment between the beginning and end of the line. In this way, the pixels of video data are synchronized with the system clock signals.
When the actual phase adjustment relative to the system clock signals is determined at the end of each line, the difference in the phase adjustments between the beginning and the end of such line is determined from the phase adjustment for such line and the phase adjustment stored for the previous line. When the expected phase adjustment is provided for the end of each line, this estimated value is altered for each line by an amount equal to the actual phase adjustment at the beginning of such line and the estimated phase adjustment at the end of such line.
In the drawings:
FIG. 1 is a circuit diagram in simplified block form of one embodiment of the invention;
FIG. 2 is a circuit diagram in simplified block form and shows in additional detail a first embodiment of a particular one of the stages shown in FIG. 1,
FIG. 3 is a circuit diagram in simplified block form and shows in additional detail another embodiment of the particular one of the stages shown in FIG. 1;
FIG. 4 is a circuit diagram in simplified block form and shows in additional detail another of the stages shown in FIG. 1;
FIG. 5 shows a modification in simplified block form of the embodiment shown in FIG. 1;
FIG. 6 is a chart showing the combinations of the different types of stages which can be included in the blocks designated as "1", "2" and "3" in the embodiments shown in FIGS. 1 and 5; and
FIG. 7 is a schematic representation of one of the lines of video data provided to the embodiments shown in the previous Figures.
In the embodiment of the invention shown in FIG. 1, a system generally indicated at 10 is provided as on an integrated circuit chip for synchronizing video data with a system clock signal which is introduced on a line 12 with a substantially constant frequency. For example, the system clock frequency may be generated as by a crystal. The system clock signal synchronizes the operation of a graphics system 14 which operates in conjunction with this invention. For example, the graphics system 14 may receive the video data after processing of the data by the embodiment shown in FIG. 1 and may combine the processed video data with graphics data from the graphics system 14. As one illustration, the graphics data may be visually presented on the face of a video monitor (not shown) and the video data may be visually presented in a window on the face of the video monitor.
The video data may be in the form conventionally presented as in broadcast video or in a video tape recorder or in S- video. S- video provides two (2) channels of information such as shown in FIG. 5 and described in detail subsequently. The video data may be presented in successive lines in a conventional raster scan. One of these lines is generally indicated at 16 in FIG. 7. It includes a horizontal sync signal 18 which defines the beginning of the line. It also includes a plurality of burst signals at a particular frequency such as approximately 3.56 megahertz schematically illustrated at 20 in FIG. 7. It further includes video data schematically illustrated at 21 in FIG. 7. The video data may be in the form of successive pixels for presentation on the face of a video monitor (not shown).
The video data is introduced in analog form on a line 22 in FIG. 1 and is converted to a digital form in a stage 24. The information in digital form is then introduced to a stage 26 designated in FIG. 1 as "1". This stage may have several different forms as indicated in a chart shown in FIG. 6 and as will be discussed in detail subsequently. The information from the stage 26 may then be introduced to a buffer 28 which may be constructed in a conventional manner. The buffer 28 stores the digital information for the successive pixels and releases the pixels in sequence from the buffer in the order in which the pixels are introduced to the buffer. In effect, the buffer 28 constitutes a first-in first-out (FIFO) shift register. The buffer 28 may store the visual data for a whole line or a part of a line.
The digital signals from the converter 24 are introduced to a low pass filter 30 which passes signals in a relatively low range of frequencies such as approximately zero to five megahertz (0-5 Mhz). The low pass signals from the filter 30 then pass to a threshold stage 32 which produces a signal when the low pass signals pass through a particular voltage level. The threshold stage 32 also receives the system clock signals on a line 12 and produces a phase adjustment signal representing the difference in phase between the threshold level of the low pass signals and a particular portion, such as the rising edge, of the adjacent system clock signal. The phase adjustment signal represents the phase adjustment at the beginning of each line of pixels representing the video data.
A phase adjustment determinator 34 receives the phase adjustment at the beginning of each line of pixels and the phase adjustment at the end of the line and determines the difference between these phase adjustments. This difference represents the change in the phase adjustment through the line. The phase adjustment at the end of each line of pixels may be either an actual phase adjustment or an estimated phase adjustment at the end of the line.
The circuitry for determining the actual phase adjustment through each line on the basis of the difference between the actual phase adjustment at the beginning and end of each line is shown in FIG. 2. It includes the threshold stage 32 and a register 40. The phase adjustment signal from the threshold stage for each line of pixels is introduced to a register 40 which stores the phase adjustment signal and introduces the stored signal to an arithmetic stage 42. The arithmetic stage 42 also receives the phase adjustment signal from the threshold stage 32. In this way, the arithmetic signal determines the difference between the phase adjustment signals at the beginning of successive pairs of lines. The difference signal from the arithmetic stage 42 is introduced to a line 44.
The circuitry for determining the estimated phase adjustment through each line on the basis of the difference between the estimated phase adjustment at the end of each line and the actual phase adjustment at the beginning of each line is shown in FIG. 3. The system shown in FIG. 3 includes the threshold stage 32 and a stage 50 indicating the estimated phase adjustment at the end of each line. The phase adjustments from the threshold stage 32 and the phase adjustment estimator 50 are introduced to an arithmetic stage 52 which determines the difference between such phase adjustments. The signal from the arithmetic stage 52 for each line of pixels represents the expected phase adjustment through such line of pixels.
The signal from the arithmetic stage 52 for each line of pixels is introduced to a low pass filter 53 which introduces signals at relatively low frequencies such as zero to five megahertz (0-5 Mhz) to a line 54. The signals on the line 54 pass to an arithmetic stage 56. The arithmetic stage 56 also receives the output from the phase adjustment estimator 50 and adjusts the estimated phase adjustment in accordance with the signal on the line 54. In this way, the phase adjustment estimator 50 adjusts the estimated phase adjustment for each line of pixels in accordance with the adjustments made on the line 54 for the previous line of pixels.
The signal on the line 44 in FIG. 2 in representation of the actual phase adjustment through a line of pixels or the signal on the line 54 in representation of the estimated phase adjustment through a line of pixels is introduced to an interpolation phase generator 60 in FIG. 1. The interpolation phase generator 60 also receives the system clock signals in each line of pixels and determines the number of the system clock signals in such line. The interpolation phase generator 60 then determines the phase adjustment for each system clock signal in each line. In effect, the interpolation phase generator 60 divides the actual or estimated phase adjustment per line by the number of the system clock signals in the line. Thus, the interpolation phase generator 60 may be considered as a multiplier which multiplies the actual or expected phase adjustment per line by 1/N where N is the number of system clock signals per line. The results of the division are provided on a line 62 in FIGS. 1, 4 and 5.
The signals from the interpolation phase generator 60 in FIG. 1 are introduced to an interpolator 70 in FIG. 1. The interpolator 70 also receives the output from a stage 78 which is designated as "2" in FIG. 1. The input of the stage 78 is connected to the output of the line buffer 28 in FIG. 1. The stage 78 may take a number of different forms as shown in FIG. 6 and as described in detail subsequently.
The interpolator 70 accumulates the phase adjustment per system clock signal on the line 62 in FIG. 1 for the successive clock signals in each line of pixels and adjusts the phases of the successive pixels from the line buffer 28 in accordance with the accumulated phase adjustments for the successive system clock signals in that line. The interpolator 70 is shown in additional detail in FIG. 4.
The interpolator 70 includes an arithmetic stage 72 and an accumulator 74 of the stored interpolation phase in FIG. 4. The arithmetic stage 72 receives the output on the line 62 (also shown in FIG. 1) in representation of the phase adjustment per system clock signal in each line of pixels. The arithmetic stage 72 also receives the output from the accumulator 74 and adds this output to the phase adjustment per system clock signal every time that a system clock signal appears on the line 12. In this way, the accumulator 74 progressively accumulates the phase adjustment per system clock signal as the system clock signals progressively occur throughout each line of pixels. This phase adjustment is then introduced to a phase shifter 80. The pixel data is shifted accordingly in phase.
The signals from the interpolator 70 are introduced to a stage 76 designated as "3" in FIG. 1. The stage 76 has various possibilities of forms as shown in FIG. 6 and discussed in detail subsequently. The signals from the stage 76 pass to the graphics system 14 the operation of which is synchronized with the system clock signals on the line 12. The graphics system 14 may illustratively provide graphics information from a display memory (not shown) at the frequency of the system clock signals. The information in the display memory may be displayed on the face of a video monitor (not shown). The visual data represented by the pixels in each line may be displayed in a window on the video monitor.
FIG. 6 illustrates some of the various forms in which the stages 26, 76 and 78 may operate. Three columns are shown in FIG. 6. The first column indicates the form in which the stage 26 may operate. This column is designated as "1" to conform to the designation for the stage 26 in FIG. 1. The second column is designated as "2" to correspond to the designation "2" for the stage 78 in FIG. 1. The indications in column 2 in FIG. 6 indicate the different forms in which the stage 78 may operate. The third column in FIG. 6 indicates the form in which the stage 76 may operate. The third column in FIG. 6 has the designation "3" to correspond to the designation "3" for the stage 76 in FIG. 1.
As will be seen, the indications in the three (3) different columns in FIG. 6 have the designations "a", "b", "c", "d". Below the columns in FIG. 6, but included in FIG. 6, are descriptions of the forms identified by the designations "a", "b", "c" and "d". All of the forms "a", "b", "c" and "d" are well known in the art. A stage such as the stage "1" (the stage 26) may have the designation "a, b, c". This means that the stage "1" (the stage 26) may have either the form "a", the form "b" or the form "c". Alternatively, the designation "a", "b", "c" for the stage "1" (the stage 26) may have a combination of some or all of the stages "a", "b" and "c". The above description for the stage "1" (the stage 26) also applies to the stage "2" (the stage 72) and the stage "3" (the stage 76).
The designation "a" is identified at the bottom of FIG. 6 as a "Y/C Separator". As will be appreciated, the designation "Y" indicates the luminance of color pixels and the designation "C" indicates the chrominance of the color pixels. The "Y" and "C" components of color pixels are provided in an S-band video. FIG. 5 indicates an S-band video system generally indicated at 80 and corresponding to the system shown in FIG. 1. The system 80 has two (2) channels, one (1) for processing the "Y" component and the other for processing the "C" component. Each of these channels corresponds to the channel including the stages 26, 28, 78, 70 and 76 in FIG. 1. The stages in the "Y" channel are accordingly designated as "26a", "28a" "78a", "70a" and "76a" in FIG. 5. The stages in the "C" channel are similarly designated as "26b", "78b", "70b" and "76b". The outputs from the stages 76a and 76b are introduced to the graphics system 14 also shown in FIG. 1. The system shown in FIG. 6 additionally includes the stages 30, 32, 34 and 60 also shown in FIG. 1.
The designation "b" in FIG. 6 identifies a demodulator for separating the chrominance information "C" for the color pixels into the two (2) quadrature components "I" and "Q". The designation "C" in FIG. 6 identifies a color space converter. The color space converter changes the luminance and chrominance components of the color in the pixels in each line into indications of the three (3) primary colors red, green and blue.
The designation "d" identifies a gamma translator. The gamma translator is disclosed and claimed in application Ser. No. 07/987,367 filed by James Corona on Dec. 7, 1992 for "Apparatus For, and Methods of, Providing a Universal Format of Pixels and For Scaling Fields in the Pixels" and assigned of record to the assignee of record of this application. The gamma corrector receives binary bits, less than a particular number, of information for each of the primary colors and converts such information to binary bits of a particular number to identify each of such primary colors. For example, the gamma corrector converts six (6) bits of binary indications for each of the primary colors red, green and blue to eight (8) bits of binary indications for each of such primary colors. The gamma corrector provides such conversion with an error less than one half (1/2) of the value of the least significant binary bit for each of the primary colors.
The system constituting this invention has certain important advantages. It provides for the transfer of video data representing successive pixels in each line in a raster scan in synchronism with the system clock signals. Furthermore, the system determines the phase adjustment between the video pixels and the system clock signals at the beginning and the end of each line and then determines the difference between these phase adjustments. The system then uses this difference and the number of system clock signals in each line to provide progressive adjustments for the successive pixels in each line in accordance with the occurrence of the successive system clock signals in such line.
In another embodiment, it is possible to generate data at a sampling resolution different from the system clock which is provided in the integrated circuit chip. By adding or subtracting a (programmable) constant to the output 62 of the interpolation phase generator 60 (FIGS. 1 and 5), it is possible to vary the effective output rate from the frequency of the system clock signals on the line 12. The data will be aligned to signals at a constant frequency above or below the system clock frequency.
Although this invention has been disclosed and illustrated with reference to particular embodiments, the principles involved are susceptible for use in numerous other embodiments which will be apparent to persons skilled in the art. The invention is, therefore, to be limited only as indicated by the scope of the appended claims.
Claims
We claim:
1. In combination, first means for providing system clock signals at a substantially constant frequency, second means for providing video data in the form of successive pixels at a frequency different from the frequency of the system clock signals, the successive pixels being disposed in lines and the successive pixels in the lines being provided in a raster scan, the video data including a horizontal sync pulse at the beginning of each line, third means responsive to each horizontal sync pulse and to the system clock signals for determining a phase adjustment between such horizontal sync pulse in each line and the system clock signals, and fourth means for adjusting the phases of each of the successive pixels of the video data for each line in accordance with the determinations of the phase adjustments by the third means between the system clock signals and the horizontal sync pulses for that line and for the previous line.
2. In a combination as set forth in claim 1, the video data being in analog form, fifth means for converting the video data to a digital form, and the third means including sixth means for passing only the digital signals at the low frequencies and including seventh means responsive to the digital signals from the sixth means in representation of the horizontal sync pulse and to the system clock signals for determining the phase adjustment between such horizontal sync pulse in each line and the system clock signals, and eighth means responsive to the video pixels from the second means for buffering such pixels, and the fourth means being responsive to the buffered pixels from the eighth means and to the determinations of the phase adjustments by the third means between the system clock signals in each line and the horizontal sync pulses for adjusting the phases of each of the successive buffered pixels in the video data for each line.
3. In combination, first means for providing system clock signals at a substantially constant frequency, second means for providing video data in the form of successive pixels at a frequency different from the frequency of the system clock signals, the successive pixels being disposed in lines and the successive pixels in the lines being provided in a raster scan, the video data including a horizontal sync pulse at the beginning of each line, third means responsive to each horizontal sync pulse and to the system clock signals for determining a particular phase adjustment between such horizontal sync pulse in each line and the system clock signals, and fourth means for adjusting the phases of the successive pixels of the video data for each line in accordance with the determinations of the particular phase adjustment by the third means between horizontal sync pulse in that line and the system clock signals, the fourth means including fifth means for determining the number of system clock signals in each line and including sixth means for dividing the particular phase adjustment from the third means by the number of the system clock signals determined by the fifth means to determine a clock signal phase adjustment to be provided for each system clock signal in each line and including seventh means for providing a clock signal phase adjustment for the successive pixels in each line between each successive pair of the system clock signals in such line in accordance with the clock signal phase adjustment determined by the sixth means for each of the system clock signals in such line.
4. In a combination as set forth in claim 1, the fourth means being operative to adjust the phases of each of the successive pixels of the video data for each line by adjustments of equal value in accordance with the determinations of the phase adjustments by the third means between the system clock signals and the horizontal sync pulses for that line.