Patent
Atlas literature
Patent
US 11,651,205 B2Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1 shows a block diagram of a GAN, trained accord- ing to the present invention.
FIG. 2 shows a flow chart of a training method according to the present invention.
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
A method for training a Wasserstein generative adver-sarial network, the generative adversarial network including a generator and a discriminator, the generator and the discriminator being artificial neuronal networks, the method including the following: training the discriminator, the training of the discriminator including adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condi-tion as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input datum being created starting from the first input datum by applying a method of a virtual adversarial training.
The method as recited in claim 1, wherein the first input datum is either retrieved from a data memory for real training data or generated using the generator.
The method as recited in claim 1, wherein the first input datum is changed into its adversarial direction for creation while applying the method of the virtual adversarial training, the adversarial direction being approximated by applying a power iteration.
The method as recited in claim 1, wherein the method includes a first step of training the generator and a second step of training the generator, multiple iterations of the step of the training of the discriminator being carried out between the first step of training the generator and the second step of training the generator.
The method as recited in claim 1, wherein the discrimi-nator is near 1-Lipschitz and near optimal.
A generative adversarial network, comprising: a generator; and a discriminator; wherein the generator and the discriminator are artificial neuronal networks, the discriminator being trained by adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condition as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input datum being created starting from the first input datum by applying a method of a virtual adversarial training.
The generative adversarial network as recited in claim 6, wherein the discriminator is near 1-Lipschitz and near optimal.
A non-transitory machine-readable memory medium on which is stored a computer program for training an artificial neuronal network including a generator and a discriminator, the computer program, when executed by a computer, caus-ing the computer to perform: training the discriminator, the training of the discriminator including adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condi-tion as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input datum being created starting from the first input datum by applying a method of a virtual adversarial training.
A device configured to train a Wasserstein generative adversarial network, the generative adversarial network including a generator and a discriminator, the generator and the discriminator being artificial neuronal networks, the device configured to: train the discriminator, the training of the discriminator including adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condi-tion as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 21
Patent
Atlas literature
Patent
US 11,651,205 B2Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1 shows a block diagram of a GAN, trained accord- ing to the present invention.
FIG. 2 shows a flow chart of a training method according to the present invention.
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
A method for training a Wasserstein generative adver-sarial network, the generative adversarial network including a generator and a discriminator, the generator and the discriminator being artificial neuronal networks, the method including the following: training the discriminator, the training of the discriminator including adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condi-tion as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input datum being created starting from the first input datum by applying a method of a virtual adversarial training.
The method as recited in claim 1, wherein the first input datum is either retrieved from a data memory for real training data or generated using the generator.
The method as recited in claim 1, wherein the first input datum is changed into its adversarial direction for creation while applying the method of the virtual adversarial training, the adversarial direction being approximated by applying a power iteration.
The method as recited in claim 1, wherein the method includes a first step of training the generator and a second step of training the generator, multiple iterations of the step of the training of the discriminator being carried out between the first step of training the generator and the second step of training the generator.
The method as recited in claim 1, wherein the discrimi-nator is near 1-Lipschitz and near optimal.
A generative adversarial network, comprising: a generator; and a discriminator; wherein the generator and the discriminator are artificial neuronal networks, the discriminator being trained by adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condition as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input datum being created starting from the first input datum by applying a method of a virtual adversarial training.
The generative adversarial network as recited in claim 6, wherein the discriminator is near 1-Lipschitz and near optimal.
A non-transitory machine-readable memory medium on which is stored a computer program for training an artificial neuronal network including a generator and a discriminator, the computer program, when executed by a computer, caus-ing the computer to perform: training the discriminator, the training of the discriminator including adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condi-tion as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input datum being created starting from the first input datum by applying a method of a virtual adversarial training.
A device configured to train a Wasserstein generative adversarial network, the generative adversarial network including a generator and a discriminator, the generator and the discriminator being artificial neuronal networks, the device configured to: train the discriminator, the training of the discriminator including adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condi-tion as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 21
Patent
Atlas literature
Patent
US 11,651,205 B2Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1 shows a block diagram of a GAN, trained accord- ing to the present invention.
FIG. 2 shows a flow chart of a training method according to the present invention.
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
A method for training a Wasserstein generative adver-sarial network, the generative adversarial network including a generator and a discriminator, the generator and the discriminator being artificial neuronal networks, the method including the following: training the discriminator, the training of the discriminator including adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condi-tion as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input datum being created starting from the first input datum by applying a method of a virtual adversarial training.
The method as recited in claim 1, wherein the first input datum is either retrieved from a data memory for real training data or generated using the generator.
The method as recited in claim 1, wherein the first input datum is changed into its adversarial direction for creation while applying the method of the virtual adversarial training, the adversarial direction being approximated by applying a power iteration.
The method as recited in claim 1, wherein the method includes a first step of training the generator and a second step of training the generator, multiple iterations of the step of the training of the discriminator being carried out between the first step of training the generator and the second step of training the generator.
The method as recited in claim 1, wherein the discrimi-nator is near 1-Lipschitz and near optimal.
A generative adversarial network, comprising: a generator; and a discriminator; wherein the generator and the discriminator are artificial neuronal networks, the discriminator being trained by adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condition as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input datum being created starting from the first input datum by applying a method of a virtual adversarial training.
The generative adversarial network as recited in claim 6, wherein the discriminator is near 1-Lipschitz and near optimal.
A non-transitory machine-readable memory medium on which is stored a computer program for training an artificial neuronal network including a generator and a discriminator, the computer program, when executed by a computer, caus-ing the computer to perform: training the discriminator, the training of the discriminator including adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condi-tion as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input datum being created starting from the first input datum by applying a method of a virtual adversarial training.
A device configured to train a Wasserstein generative adversarial network, the generative adversarial network including a generator and a discriminator, the generator and the discriminator being artificial neuronal networks, the device configured to: train the discriminator, the training of the discriminator including adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condi-tion as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 21
Patent
Atlas literature
Patent
US 11,651,205 B2Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1 shows a block diagram of a GAN, trained accord- ing to the present invention.
FIG. 2 shows a flow chart of a training method according to the present invention.
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
A method for training a Wasserstein generative adver-sarial network, the generative adversarial network including a generator and a discriminator, the generator and the discriminator being artificial neuronal networks, the method including the following: training the discriminator, the training of the discriminator including adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condi-tion as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input datum being created starting from the first input datum by applying a method of a virtual adversarial training.
The method as recited in claim 1, wherein the first input datum is either retrieved from a data memory for real training data or generated using the generator.
The method as recited in claim 1, wherein the first input datum is changed into its adversarial direction for creation while applying the method of the virtual adversarial training, the adversarial direction being approximated by applying a power iteration.
The method as recited in claim 1, wherein the method includes a first step of training the generator and a second step of training the generator, multiple iterations of the step of the training of the discriminator being carried out between the first step of training the generator and the second step of training the generator.
The method as recited in claim 1, wherein the discrimi-nator is near 1-Lipschitz and near optimal.
A generative adversarial network, comprising: a generator; and a discriminator; wherein the generator and the discriminator are artificial neuronal networks, the discriminator being trained by adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condition as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input datum being created starting from the first input datum by applying a method of a virtual adversarial training.
The generative adversarial network as recited in claim 6, wherein the discriminator is near 1-Lipschitz and near optimal.
A non-transitory machine-readable memory medium on which is stored a computer program for training an artificial neuronal network including a generator and a discriminator, the computer program, when executed by a computer, caus-ing the computer to perform: training the discriminator, the training of the discriminator including adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condi-tion as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input datum being created starting from the first input datum by applying a method of a virtual adversarial training.
A device configured to train a Wasserstein generative adversarial network, the generative adversarial network including a generator and a discriminator, the generator and the discriminator being artificial neuronal networks, the device configured to: train the discriminator, the training of the discriminator including adapting a parameter of the discriminator as a function of a loss function, the loss function including a term that represents a violation of a Lipschitz condi-tion as a function of a first input datum and a second input datum, and as a function of: (i) a first output of the discriminator when processing the first input datum, and (ii) a second output of the discriminator when processing the second input datum, the second input
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 21
Cited non-patent literature · 2
Cited non-patent literature · 2
Cited non-patent literature · 2
Cited non-patent literature · 2
