Patent
US 12,524,930 B2Patent
Atlas literature
Patent
US 12,524,930 B2Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1 is a block diagram of an electronic device and a network according to various embodiments of the present disclosure;
FIG. 2 is a diagram for describing an operation of colorizing a black and white image using a GAN-based model including a transformer by means of an electronic …
FIG. 3 is a diagram for describing the structure of the transformer block included in the GAN-based model accord- ing to various embodiments;
FIG. 4 is a diagram for describing the structure of a W-MSA layer in the transformer block according to various embodiments;
FIG. 5 is a diagram for describing the structure of a CFF layer according to various embodiments;
FIG. 6 shows an embodiment of generating a final color image from a black and white image using a GAN-based model by means of the electronic device according to …
FIGS. 7A and 7B are diagrams showing the difference between a GAN-based model to which the present disclo- sure has been applied and another colorizing model …
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
An electronic device for colorizing a black and white image using a Generative Adversarial Network (GAN)- based model comprising a transformer block, the electronic device comprising a processor, wherein the processor is set to: obtain a black and white image including only first information about a luminance channel; and generate a pseudo color image including only second information about a chrominance channel by applying the black and white image to the GAN-based model, the GAN-based model includes a generator network including a plurality of transformer blocks for color conversion, a plurality of convolution layers, and a plurality of transpose convolution layers, the plurality of transformer blocks each include a Depth Wise Convolution (DWC) layer, a first Layer Normal-ization (LN) layer, a Window-based Multi-head Self Attention (W-MSA) layer, a second LN layer, and a Colorization Feed Forward (CFF) block, B₂ the W-MSA layer includes a first-group MSA and a second-group MSA, and the first-group MSA is provided with a feature map divided into first-type windows and the second-group MSA is provided with a feature map divided into second-type windows obtained by shifting the first-type windows.
The electronic device of claim 1, wherein the first-group MSA and the second-group MSA are each composed of four heads.
Layer stacks claimed or described, ordered top of device to substrate.
GAN-based image colorization electronic device
No layer stack recorded.
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 6
Patent
Atlas literature
Patent
US 12,524,930 B2Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1 is a block diagram of an electronic device and a network according to various embodiments of the present disclosure;
FIG. 2 is a diagram for describing an operation of colorizing a black and white image using a GAN-based model including a transformer by means of an electronic …
FIG. 3 is a diagram for describing the structure of the transformer block included in the GAN-based model accord- ing to various embodiments;
FIG. 4 is a diagram for describing the structure of a W-MSA layer in the transformer block according to various embodiments;
FIG. 5 is a diagram for describing the structure of a CFF layer according to various embodiments;
FIG. 6 shows an embodiment of generating a final color image from a black and white image using a GAN-based model by means of the electronic device according to …
FIGS. 7A and 7B are diagrams showing the difference between a GAN-based model to which the present disclo- sure has been applied and another colorizing model …
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
An electronic device for colorizing a black and white image using a Generative Adversarial Network (GAN)- based model comprising a transformer block, the electronic device comprising a processor, wherein the processor is set to: obtain a black and white image including only first information about a luminance channel; and generate a pseudo color image including only second information about a chrominance channel by applying the black and white image to the GAN-based model, the GAN-based model includes a generator network including a plurality of transformer blocks for color conversion, a plurality of convolution layers, and a plurality of transpose convolution layers, the plurality of transformer blocks each include a Depth Wise Convolution (DWC) layer, a first Layer Normal-ization (LN) layer, a Window-based Multi-head Self Attention (W-MSA) layer, a second LN layer, and a Colorization Feed Forward (CFF) block, B₂ the W-MSA layer includes a first-group MSA and a second-group MSA, and the first-group MSA is provided with a feature map divided into first-type windows and the second-group MSA is provided with a feature map divided into second-type windows obtained by shifting the first-type windows.
The electronic device of claim 1, wherein the first-group MSA and the second-group MSA are each composed of four heads.
Layer stacks claimed or described, ordered top of device to substrate.
GAN-based image colorization electronic device
No layer stack recorded.
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 6
Patent
Atlas literature
Patent
US 12,524,930 B2Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1 is a block diagram of an electronic device and a network according to various embodiments of the present disclosure;
FIG. 2 is a diagram for describing an operation of colorizing a black and white image using a GAN-based model including a transformer by means of an electronic …
FIG. 3 is a diagram for describing the structure of the transformer block included in the GAN-based model accord- ing to various embodiments;
FIG. 4 is a diagram for describing the structure of a W-MSA layer in the transformer block according to various embodiments;
FIG. 5 is a diagram for describing the structure of a CFF layer according to various embodiments;
FIG. 6 shows an embodiment of generating a final color image from a black and white image using a GAN-based model by means of the electronic device according to …
FIGS. 7A and 7B are diagrams showing the difference between a GAN-based model to which the present disclo- sure has been applied and another colorizing model …
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
An electronic device for colorizing a black and white image using a Generative Adversarial Network (GAN)- based model comprising a transformer block, the electronic device comprising a processor, wherein the processor is set to: obtain a black and white image including only first information about a luminance channel; and generate a pseudo color image including only second information about a chrominance channel by applying the black and white image to the GAN-based model, the GAN-based model includes a generator network including a plurality of transformer blocks for color conversion, a plurality of convolution layers, and a plurality of transpose convolution layers, the plurality of transformer blocks each include a Depth Wise Convolution (DWC) layer, a first Layer Normal-ization (LN) layer, a Window-based Multi-head Self Attention (W-MSA) layer, a second LN layer, and a Colorization Feed Forward (CFF) block, B₂ the W-MSA layer includes a first-group MSA and a second-group MSA, and the first-group MSA is provided with a feature map divided into first-type windows and the second-group MSA is provided with a feature map divided into second-type windows obtained by shifting the first-type windows.
The electronic device of claim 1, wherein the first-group MSA and the second-group MSA are each composed of four heads.
Layer stacks claimed or described, ordered top of device to substrate.
GAN-based image colorization electronic device
No layer stack recorded.
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 6
Patent
Atlas literature
Patent
US 12,524,930 B2Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1 is a block diagram of an electronic device and a network according to various embodiments of the present disclosure;
FIG. 2 is a diagram for describing an operation of colorizing a black and white image using a GAN-based model including a transformer by means of an electronic …
FIG. 3 is a diagram for describing the structure of the transformer block included in the GAN-based model accord- ing to various embodiments;
FIG. 4 is a diagram for describing the structure of a W-MSA layer in the transformer block according to various embodiments;
FIG. 5 is a diagram for describing the structure of a CFF layer according to various embodiments;
FIG. 6 shows an embodiment of generating a final color image from a black and white image using a GAN-based model by means of the electronic device according to …
FIGS. 7A and 7B are diagrams showing the difference between a GAN-based model to which the present disclo- sure has been applied and another colorizing model …
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
An electronic device for colorizing a black and white image using a Generative Adversarial Network (GAN)- based model comprising a transformer block, the electronic device comprising a processor, wherein the processor is set to: obtain a black and white image including only first information about a luminance channel; and generate a pseudo color image including only second information about a chrominance channel by applying the black and white image to the GAN-based model, the GAN-based model includes a generator network including a plurality of transformer blocks for color conversion, a plurality of convolution layers, and a plurality of transpose convolution layers, the plurality of transformer blocks each include a Depth Wise Convolution (DWC) layer, a first Layer Normal-ization (LN) layer, a Window-based Multi-head Self Attention (W-MSA) layer, a second LN layer, and a Colorization Feed Forward (CFF) block, B₂ the W-MSA layer includes a first-group MSA and a second-group MSA, and the first-group MSA is provided with a feature map divided into first-type windows and the second-group MSA is provided with a feature map divided into second-type windows obtained by shifting the first-type windows.
The electronic device of claim 1, wherein the first-group MSA and the second-group MSA are each composed of four heads.
Layer stacks claimed or described, ordered top of device to substrate.
GAN-based image colorization electronic device
No layer stack recorded.
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 6
Cited non-patent literature · 1
Cited non-patent literature · 1
Cited non-patent literature · 1
Cited non-patent literature · 1
