UNSUPERVISED EMBEDDINGS DISENTANGLEMENT USING A GAN FOR MERCHANT RECOMMENDATIONS | Matter42 Literature
Patent
Atlas literature
Patent
US 12,175,504 B2
UNSUPERVISED EMBEDDINGS DISENTANGLEMENT USING A GAN FOR MERCHANT RECOMMENDATIONS
Yan Zheng, Yuwei Wang, Wei Zhang, Michael Yeh et al.
VISA INTERNATIONAL SERVICE ASSOCIATION, San Francisco, CA (US)·Dec. 24, 2024·US
Drawings
Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1
FIG. 1 is a diagram of one embodiment of a card payment processing system in which the disclosed embodiments may be implemented.
FIG. 2
FIG. 2 illustrates a flow diagram of a process for unsu- pervised embeddings disentanglement using a GAN to gen- erate merchant recommendations to according to …
FIG. 3
FIG. 3 is a diagram illustrating processing of the raw merchant embeddings and the raw user embeddings.
FIG. 4
FIG. 4B is a diagram illustrating a principal component analysis (PCA) view of 200-dimension merchant embed- dings of Subway® and McDonalds® restaurants in San …
FIG. 5
FIG. 5C illustrates an implementation of the discriminator according to one example embodiment.
FIG. 6
FIG. 6 illustrates a mapping transition into 3D space from newly generated modified merchant embeddings of west states (lighter points) to target merchant …
FIG. 7
FIG. 7 shows the results of the classification using the GAN without feature enhancement.
FIG. 8
FIG. 8 shows the results of the classification using the GAN with feature enhancement.
FIG. 9
FIG. 9 illustrates results of a location classification with the different alpha (a) values.
FIG. 10
FIG. 10 illustrates results of a category classification with different a values.
FIG. 11
FIG. 11 illustrates a Table showing results on nearest neighbor of the SF and NY dataset.
FIG. 12
FIG. 12 illustrates a Table showing results on nearest neighbor of the East and West dataset.
Claims
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
3 independent · 14 dependent
1
Independent
A computer-implemented method for training a recom-mendation system to provide merchant recommendations to a target user, comprising: receiving, by one or more processors, historical payment transaction records of transactions made between users and merchants; generating, by the one or more processors, from the historical payment transaction records a training set of raw merchant embeddings that represent the merchants and raw user embeddings that represent the users within an embedding space using a word embedding process, wherein the raw merchant embeddings include a plurality of embedded features from the historical payment transaction records including a location fea-ture, a price feature, and a number of transactions feature, wherein the raw merchant embeddings include source merchant embeddings from a home location of the target user and target merchant embeddings from a target location; training, by the one or more processors, a generative adversarial network (GAN) to generate modified mer-chant embeddings from the raw merchant embeddings, where the modified merchant embeddings have an effect of the location feature removed, the GAN com-prising a generator and a discriminator, the GAN operational for: receiving, by the generator, the source merchant embeddings as a set X of n embeddings X=x1,..., xn from the home location; receiving, by the discriminator, the target merchant embeddings as a set Y of m embeddings Y=y1,..., ym from the target location; and generating, by the generator, the modified merchant embeddings by applying a mapping function F to the set X of the source merchant embeddings, F (X)=F (x1),..., F (xn), wherein the generator uses F (X) to map the modified merchant embeddings to an embeddings space such that the discriminator cannot tell a difference between F (x1),..., F (xn) and the set Y of the target merchant embeddings; and discriminating, by the discriminator, between elements randomly sampled from F (X)=F (x1),..., F (xn) and Y to identify an origin of the modified merchant embeddings; continue, by the one or more processors, training the GAN until the discriminator cannot tell a difference between the target merchant embeddings and the modi-fied merchant embeddings, indicating the location fea-ture in the source merchant embeddings is mapped to the target merchant embeddings; and subsequent to the training and responsive to receiving a request for merchant recommendations in the target location for the target user, generating by the GAN a list of merchant rankings based on a new set of modi-fied merchant embeddings generated from a new set of payment transaction records made between the users and merchants, past preferences of the target user, and the target location to recommend merchants in the target location.
2
Dependent← claim 1
The method of claim 1, wherein the plurality of embedded features include a cuisine type feature.
3
Dependent← claim 1
The method of claim 1, wherein generating a list of merchant rankings based on the new set of modified mer-chant embeddings further comprises: receiving, by the one or more processors, the new set of payment transaction records of transactions made between the users and the merchants; generating, by the one or more processors, from the new set of payment transaction records new raw merchant embeddings and new raw user embeddings; performing, by the one or more processors, a domain-adversarial approach to map the plurality of embedded features from the source merchant embeddings to the target location together to a common embedding space using the GAN that performs a disentanglement pro-cess on the new raw merchant embeddings to remove the effect of the location feature by generating a new set of modified merchant embeddings that are free of the location feature; using, by the one or more processors, a preference model to determine new past preferences of the target user for the merchants based on the new modified merchant embeddings and the new raw user embeddings; automatically generating, by the one or more processors, the list of merchant rankings based on the new set of modified merchant embeddings, the new past prefer-ences of the target user, and the target location to recommend merchants in the target location; and providing, by the one or more processors, the list of merchant rankings to the target user.
8
Dependent← claim 1
The method of claim 1 wherein automatically gener-ating the list of merchant rankings further comprises: generating merchant preferences for the target user based on the modified merchant embeddings and the raw user embeddings; searching for local merchants located within proximity of a current location of the target user; and ranking the local merchants found within proximity of the target user based on the merchant preferences for the target user.
9
Independent
A merchant recommendation system, comprising: a transaction database storing historical payment transac-tion records; one or more processors having access to the transaction database; and a software component executed by the processor that is configured to: receive the historical payment transaction records made between users and merchants; generate from the historical payment transaction records a training set of raw merchant embeddings that repre-sent the merchants and raw user embeddings that represent the users within an embedding space using a word embedding process, wherein the raw merchant embeddings include a plurality of embedded features from the historical payment transaction records includ-ing a location feature, a price feature, and a number of transactions feature, wherein the raw merchant embed-dings include source merchant embeddings from a home location of a target user and target merchant embeddings from a target location; train a generative adversarial network (GAN) to generate modified merchant embeddings from the raw merchant embeddings, where the modified merchant embeddings have an effect of the location feature removed, the GAN comprising a generator and a discriminator, the GAN operational to: receive, by the generator, the source merchant embed-dings as a set X of n embeddings X=x1,..., xn from the home location; receive, by the discriminator, the target merchant embeddings as a set Y of m embeddings Y=y1,..., ym from the target location; and generate, by the generator, the modified merchant embeddings by applying a mapping function F to the set X of the source merchant embeddings, F (X)=F (x1),..., F (xn), wherein the generator uses F (X) to map the modified merchant embeddings to an embeddings space such that the discriminator cannot tell a difference between F (x1),..., F (xn) and the set Y of the target merchant embeddings; and discriminate, by the discriminator, between elements randomly sampled from F (X)=F (x1),..., F (xn) and Y to identify an origin of the modified merchant embeddings; continue, by the one or more processors, to train the GAN until the discriminator cannot tell a difference between the target merchant embeddings and the modified mer-chant embeddings, indicating the location feature in the source merchant embeddings is mapped to the target merchant embeddings; and subsequent to training and responsive to receiving a request for merchant recommendations in the target location for the target user, generating by, the GAN a list of merchant rankings based on a new set of modi-fied merchant embeddings generated from a new set of payment transaction records made between the users and merchants, and the target location to recommend merchants in the target location.
10
Dependent← claim 9
The system of claim 9, wherein the plurality of embedded features include a cuisine type feature.
11
Dependent← claim 9
The system of claim 9, the software component further configured to: receive, by the one or more processors, the new set of payment transaction records of transactions made between the users and the merchants; generate, by the one or more processors, from the new set of payment transaction records new raw merchant embeddings and new raw user embeddings; perform, by the one or more processors, a domain-adversarial approach to map the plurality of embedded features from the source merchant embeddings to the target location together to a common embedding space using the GAN that performs a disentanglement pro-cess on new the raw merchant embeddings to remove the effect of the location feature by generating a new set of modified merchant embeddings that are free of the location feature; use, by the one or more processors, a preference model to determine new past preferences of the target user for the merchants based on the new modified merchant embeddings and the new raw user embeddings; automatically generate, by the one or more processors, the list of merchant rankings based on the new set of modified merchant embeddings, the new past prefer-ences of the target user, and the target location to recommend merchants in the target location; and provide, by the one or more processors, the list of mer-chant rankings to the target user.
16
Dependent← claim 9
The system of claim 9, wherein when generating the list of merchant rankings, the software component is further configured to: generate merchant preferences for the target user based on the modified merchant embeddings and the raw user embeddings; search for local merchants located within proximity of a current location of the target user; and rank the local merchants found within proximity of the target user based on the merchant preferences for the target user.
17
Independent
A non-transitory computer-readable medium contain-ing program instructions for training a recommendation system to provide merchant recommendations to a target user, the program instructions for: receiving, by one or more processors, historical payment transaction records of transactions made between users and merchants; generating, by the one or more processors, from the historical payment transaction records a training set of raw merchant embeddings that represent the merchants and raw user embeddings that represent the users within an embedding space using a word embedding process, wherein the raw merchant embeddings include a plurality of embedded features from the historical payment transaction records including a location fea-ture, a price feature, and a number of transactions feature, wherein the raw merchant embeddings include source merchant embeddings from a home location of the target user and target merchant embeddings from a target location; training, by the one or more processors, a generative adversarial network (GAN) to generate modified mer-chant embeddings from the raw merchant embeddings, where the modified merchant embeddings have an effect of the location feature removed, the GAN com-prising a generator and a discriminator, the GAN operational for: 21 22 receiving, by the generator, the source merchant embeddings as a set X of n embeddings X=x1,..., xn from the home location; receiving, by the discriminator, the target merchant embeddings as a set Y of m embeddings Y=y1,..., ym from the target location; and generating, by the generator, the modified merchant embeddings by applying a mapping function F to the set X of the source merchant embeddings, F (X)=F (x1),..., F (xn), wherein the generator uses F (X) to map the modified merchant embeddings to an embeddings space such that the discriminator cannot tell a difference between F (x1),..., F (xn) and the set Y of the target merchant embeddings; and discriminating, by the discriminator, between elements randomly sampled from F (X)=F (x1),..., F (xn) and Y to identify an origin of the modified merchant embeddings; continuing, by the one or more processors, training the GAN until the discriminator cannot tell a difference between the target merchant embeddings and the modi-fied merchant embeddings, indicating the location fea-ture in the source merchant embeddings is mapped to the target merchant embeddings; and subsequent to the training and responsive to receiving a request for merchant recommendations in the target location for the target user, generating by the GAN a list of merchant rankings based on a new set of modi-fied merchant embeddings generated from a new set of payment transaction records made between users and merchants, and the target location to recommend mer-chants in the target location. ∗ ∗ ∗ ∗ ∗
Reported properties
Performance values and ranges asserted in the specification or claims.
Property
Value
Material
Temperature
0–30 k
—
Cited prior art
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 11
US 6,839,682 B16,839,682 B1 * 1/2005 Blume............... G06Q 30/0255examiner
US 10,339,586 B110,339,586 B1 * 7/2019 Khobragade...... G06Q 30/0631examiner
UNSUPERVISED EMBEDDINGS DISENTANGLEMENT USING A GAN FOR MERCHANT RECOMMENDATIONS
Yan Zheng, Yuwei Wang, Wei Zhang, Michael Yeh et al.
VISA INTERNATIONAL SERVICE ASSOCIATION, San Francisco, CA (US)·Dec. 24, 2024·US
Drawings
Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1
FIG. 1 is a diagram of one embodiment of a card payment processing system in which the disclosed embodiments may be implemented.
FIG. 2
FIG. 2 illustrates a flow diagram of a process for unsu- pervised embeddings disentanglement using a GAN to gen- erate merchant recommendations to according to …
FIG. 3
FIG. 3 is a diagram illustrating processing of the raw merchant embeddings and the raw user embeddings.
FIG. 4
FIG. 4B is a diagram illustrating a principal component analysis (PCA) view of 200-dimension merchant embed- dings of Subway® and McDonalds® restaurants in San …
FIG. 5
FIG. 5C illustrates an implementation of the discriminator according to one example embodiment.
FIG. 6
FIG. 6 illustrates a mapping transition into 3D space from newly generated modified merchant embeddings of west states (lighter points) to target merchant …
FIG. 7
FIG. 7 shows the results of the classification using the GAN without feature enhancement.
FIG. 8
FIG. 8 shows the results of the classification using the GAN with feature enhancement.
FIG. 9
FIG. 9 illustrates results of a location classification with the different alpha (a) values.
FIG. 10
FIG. 10 illustrates results of a category classification with different a values.
FIG. 11
FIG. 11 illustrates a Table showing results on nearest neighbor of the SF and NY dataset.
FIG. 12
FIG. 12 illustrates a Table showing results on nearest neighbor of the East and West dataset.
Claims
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
3 independent · 14 dependent
1
Independent
A computer-implemented method for training a recom-mendation system to provide merchant recommendations to a target user, comprising: receiving, by one or more processors, historical payment transaction records of transactions made between users and merchants; generating, by the one or more processors, from the historical payment transaction records a training set of raw merchant embeddings that represent the merchants and raw user embeddings that represent the users within an embedding space using a word embedding process, wherein the raw merchant embeddings include a plurality of embedded features from the historical payment transaction records including a location fea-ture, a price feature, and a number of transactions feature, wherein the raw merchant embeddings include source merchant embeddings from a home location of the target user and target merchant embeddings from a target location; training, by the one or more processors, a generative adversarial network (GAN) to generate modified mer-chant embeddings from the raw merchant embeddings, where the modified merchant embeddings have an effect of the location feature removed, the GAN com-prising a generator and a discriminator, the GAN operational for: receiving, by the generator, the source merchant embeddings as a set X of n embeddings X=x1,..., xn from the home location; receiving, by the discriminator, the target merchant embeddings as a set Y of m embeddings Y=y1,..., ym from the target location; and generating, by the generator, the modified merchant embeddings by applying a mapping function F to the set X of the source merchant embeddings, F (X)=F (x1),..., F (xn), wherein the generator uses F (X) to map the modified merchant embeddings to an embeddings space such that the discriminator cannot tell a difference between F (x1),..., F (xn) and the set Y of the target merchant embeddings; and discriminating, by the discriminator, between elements randomly sampled from F (X)=F (x1),..., F (xn) and Y to identify an origin of the modified merchant embeddings; continue, by the one or more processors, training the GAN until the discriminator cannot tell a difference between the target merchant embeddings and the modi-fied merchant embeddings, indicating the location fea-ture in the source merchant embeddings is mapped to the target merchant embeddings; and subsequent to the training and responsive to receiving a request for merchant recommendations in the target location for the target user, generating by the GAN a list of merchant rankings based on a new set of modi-fied merchant embeddings generated from a new set of payment transaction records made between the users and merchants, past preferences of the target user, and the target location to recommend merchants in the target location.
2
Dependent← claim 1
The method of claim 1, wherein the plurality of embedded features include a cuisine type feature.
3
Dependent← claim 1
The method of claim 1, wherein generating a list of merchant rankings based on the new set of modified mer-chant embeddings further comprises: receiving, by the one or more processors, the new set of payment transaction records of transactions made between the users and the merchants; generating, by the one or more processors, from the new set of payment transaction records new raw merchant embeddings and new raw user embeddings; performing, by the one or more processors, a domain-adversarial approach to map the plurality of embedded features from the source merchant embeddings to the target location together to a common embedding space using the GAN that performs a disentanglement pro-cess on the new raw merchant embeddings to remove the effect of the location feature by generating a new set of modified merchant embeddings that are free of the location feature; using, by the one or more processors, a preference model to determine new past preferences of the target user for the merchants based on the new modified merchant embeddings and the new raw user embeddings; automatically generating, by the one or more processors, the list of merchant rankings based on the new set of modified merchant embeddings, the new past prefer-ences of the target user, and the target location to recommend merchants in the target location; and providing, by the one or more processors, the list of merchant rankings to the target user.
8
Dependent← claim 1
The method of claim 1 wherein automatically gener-ating the list of merchant rankings further comprises: generating merchant preferences for the target user based on the modified merchant embeddings and the raw user embeddings; searching for local merchants located within proximity of a current location of the target user; and ranking the local merchants found within proximity of the target user based on the merchant preferences for the target user.
9
Independent
A merchant recommendation system, comprising: a transaction database storing historical payment transac-tion records; one or more processors having access to the transaction database; and a software component executed by the processor that is configured to: receive the historical payment transaction records made between users and merchants; generate from the historical payment transaction records a training set of raw merchant embeddings that repre-sent the merchants and raw user embeddings that represent the users within an embedding space using a word embedding process, wherein the raw merchant embeddings include a plurality of embedded features from the historical payment transaction records includ-ing a location feature, a price feature, and a number of transactions feature, wherein the raw merchant embed-dings include source merchant embeddings from a home location of a target user and target merchant embeddings from a target location; train a generative adversarial network (GAN) to generate modified merchant embeddings from the raw merchant embeddings, where the modified merchant embeddings have an effect of the location feature removed, the GAN comprising a generator and a discriminator, the GAN operational to: receive, by the generator, the source merchant embed-dings as a set X of n embeddings X=x1,..., xn from the home location; receive, by the discriminator, the target merchant embeddings as a set Y of m embeddings Y=y1,..., ym from the target location; and generate, by the generator, the modified merchant embeddings by applying a mapping function F to the set X of the source merchant embeddings, F (X)=F (x1),..., F (xn), wherein the generator uses F (X) to map the modified merchant embeddings to an embeddings space such that the discriminator cannot tell a difference between F (x1),..., F (xn) and the set Y of the target merchant embeddings; and discriminate, by the discriminator, between elements randomly sampled from F (X)=F (x1),..., F (xn) and Y to identify an origin of the modified merchant embeddings; continue, by the one or more processors, to train the GAN until the discriminator cannot tell a difference between the target merchant embeddings and the modified mer-chant embeddings, indicating the location feature in the source merchant embeddings is mapped to the target merchant embeddings; and subsequent to training and responsive to receiving a request for merchant recommendations in the target location for the target user, generating by, the GAN a list of merchant rankings based on a new set of modi-fied merchant embeddings generated from a new set of payment transaction records made between the users and merchants, and the target location to recommend merchants in the target location.
10
Dependent← claim 9
The system of claim 9, wherein the plurality of embedded features include a cuisine type feature.
11
Dependent← claim 9
The system of claim 9, the software component further configured to: receive, by the one or more processors, the new set of payment transaction records of transactions made between the users and the merchants; generate, by the one or more processors, from the new set of payment transaction records new raw merchant embeddings and new raw user embeddings; perform, by the one or more processors, a domain-adversarial approach to map the plurality of embedded features from the source merchant embeddings to the target location together to a common embedding space using the GAN that performs a disentanglement pro-cess on new the raw merchant embeddings to remove the effect of the location feature by generating a new set of modified merchant embeddings that are free of the location feature; use, by the one or more processors, a preference model to determine new past preferences of the target user for the merchants based on the new modified merchant embeddings and the new raw user embeddings; automatically generate, by the one or more processors, the list of merchant rankings based on the new set of modified merchant embeddings, the new past prefer-ences of the target user, and the target location to recommend merchants in the target location; and provide, by the one or more processors, the list of mer-chant rankings to the target user.
16
Dependent← claim 9
The system of claim 9, wherein when generating the list of merchant rankings, the software component is further configured to: generate merchant preferences for the target user based on the modified merchant embeddings and the raw user embeddings; search for local merchants located within proximity of a current location of the target user; and rank the local merchants found within proximity of the target user based on the merchant preferences for the target user.
17
Independent
A non-transitory computer-readable medium contain-ing program instructions for training a recommendation system to provide merchant recommendations to a target user, the program instructions for: receiving, by one or more processors, historical payment transaction records of transactions made between users and merchants; generating, by the one or more processors, from the historical payment transaction records a training set of raw merchant embeddings that represent the merchants and raw user embeddings that represent the users within an embedding space using a word embedding process, wherein the raw merchant embeddings include a plurality of embedded features from the historical payment transaction records including a location fea-ture, a price feature, and a number of transactions feature, wherein the raw merchant embeddings include source merchant embeddings from a home location of the target user and target merchant embeddings from a target location; training, by the one or more processors, a generative adversarial network (GAN) to generate modified mer-chant embeddings from the raw merchant embeddings, where the modified merchant embeddings have an effect of the location feature removed, the GAN com-prising a generator and a discriminator, the GAN operational for: 21 22 receiving, by the generator, the source merchant embeddings as a set X of n embeddings X=x1,..., xn from the home location; receiving, by the discriminator, the target merchant embeddings as a set Y of m embeddings Y=y1,..., ym from the target location; and generating, by the generator, the modified merchant embeddings by applying a mapping function F to the set X of the source merchant embeddings, F (X)=F (x1),..., F (xn), wherein the generator uses F (X) to map the modified merchant embeddings to an embeddings space such that the discriminator cannot tell a difference between F (x1),..., F (xn) and the set Y of the target merchant embeddings; and discriminating, by the discriminator, between elements randomly sampled from F (X)=F (x1),..., F (xn) and Y to identify an origin of the modified merchant embeddings; continuing, by the one or more processors, training the GAN until the discriminator cannot tell a difference between the target merchant embeddings and the modi-fied merchant embeddings, indicating the location fea-ture in the source merchant embeddings is mapped to the target merchant embeddings; and subsequent to the training and responsive to receiving a request for merchant recommendations in the target location for the target user, generating by the GAN a list of merchant rankings based on a new set of modi-fied merchant embeddings generated from a new set of payment transaction records made between users and merchants, and the target location to recommend mer-chants in the target location. ∗ ∗ ∗ ∗ ∗
Reported properties
Performance values and ranges asserted in the specification or claims.
Property
Value
Material
Temperature
0–30 k
—
Cited prior art
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 11
US 6,839,682 B16,839,682 B1 * 1/2005 Blume............... G06Q 30/0255examiner
US 10,339,586 B110,339,586 B1 * 7/2019 Khobragade...... G06Q 30/0631examiner
UNSUPERVISED EMBEDDINGS DISENTANGLEMENT USING A GAN FOR MERCHANT RECOMMENDATIONS
Yan Zheng, Yuwei Wang, Wei Zhang, Michael Yeh et al.
VISA INTERNATIONAL SERVICE ASSOCIATION, San Francisco, CA (US)·Dec. 24, 2024·US
Drawings
Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1
FIG. 1 is a diagram of one embodiment of a card payment processing system in which the disclosed embodiments may be implemented.
FIG. 2
FIG. 2 illustrates a flow diagram of a process for unsu- pervised embeddings disentanglement using a GAN to gen- erate merchant recommendations to according to …
FIG. 3
FIG. 3 is a diagram illustrating processing of the raw merchant embeddings and the raw user embeddings.
FIG. 4
FIG. 4B is a diagram illustrating a principal component analysis (PCA) view of 200-dimension merchant embed- dings of Subway® and McDonalds® restaurants in San …
FIG. 5
FIG. 5C illustrates an implementation of the discriminator according to one example embodiment.
FIG. 6
FIG. 6 illustrates a mapping transition into 3D space from newly generated modified merchant embeddings of west states (lighter points) to target merchant …
FIG. 7
FIG. 7 shows the results of the classification using the GAN without feature enhancement.
FIG. 8
FIG. 8 shows the results of the classification using the GAN with feature enhancement.
FIG. 9
FIG. 9 illustrates results of a location classification with the different alpha (a) values.
FIG. 10
FIG. 10 illustrates results of a category classification with different a values.
FIG. 11
FIG. 11 illustrates a Table showing results on nearest neighbor of the SF and NY dataset.
FIG. 12
FIG. 12 illustrates a Table showing results on nearest neighbor of the East and West dataset.
Claims
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
3 independent · 14 dependent
1
Independent
A computer-implemented method for training a recom-mendation system to provide merchant recommendations to a target user, comprising: receiving, by one or more processors, historical payment transaction records of transactions made between users and merchants; generating, by the one or more processors, from the historical payment transaction records a training set of raw merchant embeddings that represent the merchants and raw user embeddings that represent the users within an embedding space using a word embedding process, wherein the raw merchant embeddings include a plurality of embedded features from the historical payment transaction records including a location fea-ture, a price feature, and a number of transactions feature, wherein the raw merchant embeddings include source merchant embeddings from a home location of the target user and target merchant embeddings from a target location; training, by the one or more processors, a generative adversarial network (GAN) to generate modified mer-chant embeddings from the raw merchant embeddings, where the modified merchant embeddings have an effect of the location feature removed, the GAN com-prising a generator and a discriminator, the GAN operational for: receiving, by the generator, the source merchant embeddings as a set X of n embeddings X=x1,..., xn from the home location; receiving, by the discriminator, the target merchant embeddings as a set Y of m embeddings Y=y1,..., ym from the target location; and generating, by the generator, the modified merchant embeddings by applying a mapping function F to the set X of the source merchant embeddings, F (X)=F (x1),..., F (xn), wherein the generator uses F (X) to map the modified merchant embeddings to an embeddings space such that the discriminator cannot tell a difference between F (x1),..., F (xn) and the set Y of the target merchant embeddings; and discriminating, by the discriminator, between elements randomly sampled from F (X)=F (x1),..., F (xn) and Y to identify an origin of the modified merchant embeddings; continue, by the one or more processors, training the GAN until the discriminator cannot tell a difference between the target merchant embeddings and the modi-fied merchant embeddings, indicating the location fea-ture in the source merchant embeddings is mapped to the target merchant embeddings; and subsequent to the training and responsive to receiving a request for merchant recommendations in the target location for the target user, generating by the GAN a list of merchant rankings based on a new set of modi-fied merchant embeddings generated from a new set of payment transaction records made between the users and merchants, past preferences of the target user, and the target location to recommend merchants in the target location.
2
Dependent← claim 1
The method of claim 1, wherein the plurality of embedded features include a cuisine type feature.
3
Dependent← claim 1
The method of claim 1, wherein generating a list of merchant rankings based on the new set of modified mer-chant embeddings further comprises: receiving, by the one or more processors, the new set of payment transaction records of transactions made between the users and the merchants; generating, by the one or more processors, from the new set of payment transaction records new raw merchant embeddings and new raw user embeddings; performing, by the one or more processors, a domain-adversarial approach to map the plurality of embedded features from the source merchant embeddings to the target location together to a common embedding space using the GAN that performs a disentanglement pro-cess on the new raw merchant embeddings to remove the effect of the location feature by generating a new set of modified merchant embeddings that are free of the location feature; using, by the one or more processors, a preference model to determine new past preferences of the target user for the merchants based on the new modified merchant embeddings and the new raw user embeddings; automatically generating, by the one or more processors, the list of merchant rankings based on the new set of modified merchant embeddings, the new past prefer-ences of the target user, and the target location to recommend merchants in the target location; and providing, by the one or more processors, the list of merchant rankings to the target user.
8
Dependent← claim 1
The method of claim 1 wherein automatically gener-ating the list of merchant rankings further comprises: generating merchant preferences for the target user based on the modified merchant embeddings and the raw user embeddings; searching for local merchants located within proximity of a current location of the target user; and ranking the local merchants found within proximity of the target user based on the merchant preferences for the target user.
9
Independent
A merchant recommendation system, comprising: a transaction database storing historical payment transac-tion records; one or more processors having access to the transaction database; and a software component executed by the processor that is configured to: receive the historical payment transaction records made between users and merchants; generate from the historical payment transaction records a training set of raw merchant embeddings that repre-sent the merchants and raw user embeddings that represent the users within an embedding space using a word embedding process, wherein the raw merchant embeddings include a plurality of embedded features from the historical payment transaction records includ-ing a location feature, a price feature, and a number of transactions feature, wherein the raw merchant embed-dings include source merchant embeddings from a home location of a target user and target merchant embeddings from a target location; train a generative adversarial network (GAN) to generate modified merchant embeddings from the raw merchant embeddings, where the modified merchant embeddings have an effect of the location feature removed, the GAN comprising a generator and a discriminator, the GAN operational to: receive, by the generator, the source merchant embed-dings as a set X of n embeddings X=x1,..., xn from the home location; receive, by the discriminator, the target merchant embeddings as a set Y of m embeddings Y=y1,..., ym from the target location; and generate, by the generator, the modified merchant embeddings by applying a mapping function F to the set X of the source merchant embeddings, F (X)=F (x1),..., F (xn), wherein the generator uses F (X) to map the modified merchant embeddings to an embeddings space such that the discriminator cannot tell a difference between F (x1),..., F (xn) and the set Y of the target merchant embeddings; and discriminate, by the discriminator, between elements randomly sampled from F (X)=F (x1),..., F (xn) and Y to identify an origin of the modified merchant embeddings; continue, by the one or more processors, to train the GAN until the discriminator cannot tell a difference between the target merchant embeddings and the modified mer-chant embeddings, indicating the location feature in the source merchant embeddings is mapped to the target merchant embeddings; and subsequent to training and responsive to receiving a request for merchant recommendations in the target location for the target user, generating by, the GAN a list of merchant rankings based on a new set of modi-fied merchant embeddings generated from a new set of payment transaction records made between the users and merchants, and the target location to recommend merchants in the target location.
10
Dependent← claim 9
The system of claim 9, wherein the plurality of embedded features include a cuisine type feature.
11
Dependent← claim 9
The system of claim 9, the software component further configured to: receive, by the one or more processors, the new set of payment transaction records of transactions made between the users and the merchants; generate, by the one or more processors, from the new set of payment transaction records new raw merchant embeddings and new raw user embeddings; perform, by the one or more processors, a domain-adversarial approach to map the plurality of embedded features from the source merchant embeddings to the target location together to a common embedding space using the GAN that performs a disentanglement pro-cess on new the raw merchant embeddings to remove the effect of the location feature by generating a new set of modified merchant embeddings that are free of the location feature; use, by the one or more processors, a preference model to determine new past preferences of the target user for the merchants based on the new modified merchant embeddings and the new raw user embeddings; automatically generate, by the one or more processors, the list of merchant rankings based on the new set of modified merchant embeddings, the new past prefer-ences of the target user, and the target location to recommend merchants in the target location; and provide, by the one or more processors, the list of mer-chant rankings to the target user.
16
Dependent← claim 9
The system of claim 9, wherein when generating the list of merchant rankings, the software component is further configured to: generate merchant preferences for the target user based on the modified merchant embeddings and the raw user embeddings; search for local merchants located within proximity of a current location of the target user; and rank the local merchants found within proximity of the target user based on the merchant preferences for the target user.
17
Independent
A non-transitory computer-readable medium contain-ing program instructions for training a recommendation system to provide merchant recommendations to a target user, the program instructions for: receiving, by one or more processors, historical payment transaction records of transactions made between users and merchants; generating, by the one or more processors, from the historical payment transaction records a training set of raw merchant embeddings that represent the merchants and raw user embeddings that represent the users within an embedding space using a word embedding process, wherein the raw merchant embeddings include a plurality of embedded features from the historical payment transaction records including a location fea-ture, a price feature, and a number of transactions feature, wherein the raw merchant embeddings include source merchant embeddings from a home location of the target user and target merchant embeddings from a target location; training, by the one or more processors, a generative adversarial network (GAN) to generate modified mer-chant embeddings from the raw merchant embeddings, where the modified merchant embeddings have an effect of the location feature removed, the GAN com-prising a generator and a discriminator, the GAN operational for: 21 22 receiving, by the generator, the source merchant embeddings as a set X of n embeddings X=x1,..., xn from the home location; receiving, by the discriminator, the target merchant embeddings as a set Y of m embeddings Y=y1,..., ym from the target location; and generating, by the generator, the modified merchant embeddings by applying a mapping function F to the set X of the source merchant embeddings, F (X)=F (x1),..., F (xn), wherein the generator uses F (X) to map the modified merchant embeddings to an embeddings space such that the discriminator cannot tell a difference between F (x1),..., F (xn) and the set Y of the target merchant embeddings; and discriminating, by the discriminator, between elements randomly sampled from F (X)=F (x1),..., F (xn) and Y to identify an origin of the modified merchant embeddings; continuing, by the one or more processors, training the GAN until the discriminator cannot tell a difference between the target merchant embeddings and the modi-fied merchant embeddings, indicating the location fea-ture in the source merchant embeddings is mapped to the target merchant embeddings; and subsequent to the training and responsive to receiving a request for merchant recommendations in the target location for the target user, generating by the GAN a list of merchant rankings based on a new set of modi-fied merchant embeddings generated from a new set of payment transaction records made between users and merchants, and the target location to recommend mer-chants in the target location. ∗ ∗ ∗ ∗ ∗
Reported properties
Performance values and ranges asserted in the specification or claims.
Property
Value
Material
Temperature
0–30 k
—
Cited prior art
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 11
US 6,839,682 B16,839,682 B1 * 1/2005 Blume............... G06Q 30/0255examiner
US 10,339,586 B110,339,586 B1 * 7/2019 Khobragade...... G06Q 30/0631examiner
UNSUPERVISED EMBEDDINGS DISENTANGLEMENT USING A GAN FOR MERCHANT RECOMMENDATIONS
Yan Zheng, Yuwei Wang, Wei Zhang, Michael Yeh et al.
VISA INTERNATIONAL SERVICE ASSOCIATION, San Francisco, CA (US)·Dec. 24, 2024·US
Drawings
Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1
FIG. 1 is a diagram of one embodiment of a card payment processing system in which the disclosed embodiments may be implemented.
FIG. 2
FIG. 2 illustrates a flow diagram of a process for unsu- pervised embeddings disentanglement using a GAN to gen- erate merchant recommendations to according to …
FIG. 3
FIG. 3 is a diagram illustrating processing of the raw merchant embeddings and the raw user embeddings.
FIG. 4
FIG. 4B is a diagram illustrating a principal component analysis (PCA) view of 200-dimension merchant embed- dings of Subway® and McDonalds® restaurants in San …
FIG. 5
FIG. 5C illustrates an implementation of the discriminator according to one example embodiment.
FIG. 6
FIG. 6 illustrates a mapping transition into 3D space from newly generated modified merchant embeddings of west states (lighter points) to target merchant …
FIG. 7
FIG. 7 shows the results of the classification using the GAN without feature enhancement.
FIG. 8
FIG. 8 shows the results of the classification using the GAN with feature enhancement.
FIG. 9
FIG. 9 illustrates results of a location classification with the different alpha (a) values.
FIG. 10
FIG. 10 illustrates results of a category classification with different a values.
FIG. 11
FIG. 11 illustrates a Table showing results on nearest neighbor of the SF and NY dataset.
FIG. 12
FIG. 12 illustrates a Table showing results on nearest neighbor of the East and West dataset.
Claims
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
3 independent · 14 dependent
1
Independent
A computer-implemented method for training a recom-mendation system to provide merchant recommendations to a target user, comprising: receiving, by one or more processors, historical payment transaction records of transactions made between users and merchants; generating, by the one or more processors, from the historical payment transaction records a training set of raw merchant embeddings that represent the merchants and raw user embeddings that represent the users within an embedding space using a word embedding process, wherein the raw merchant embeddings include a plurality of embedded features from the historical payment transaction records including a location fea-ture, a price feature, and a number of transactions feature, wherein the raw merchant embeddings include source merchant embeddings from a home location of the target user and target merchant embeddings from a target location; training, by the one or more processors, a generative adversarial network (GAN) to generate modified mer-chant embeddings from the raw merchant embeddings, where the modified merchant embeddings have an effect of the location feature removed, the GAN com-prising a generator and a discriminator, the GAN operational for: receiving, by the generator, the source merchant embeddings as a set X of n embeddings X=x1,..., xn from the home location; receiving, by the discriminator, the target merchant embeddings as a set Y of m embeddings Y=y1,..., ym from the target location; and generating, by the generator, the modified merchant embeddings by applying a mapping function F to the set X of the source merchant embeddings, F (X)=F (x1),..., F (xn), wherein the generator uses F (X) to map the modified merchant embeddings to an embeddings space such that the discriminator cannot tell a difference between F (x1),..., F (xn) and the set Y of the target merchant embeddings; and discriminating, by the discriminator, between elements randomly sampled from F (X)=F (x1),..., F (xn) and Y to identify an origin of the modified merchant embeddings; continue, by the one or more processors, training the GAN until the discriminator cannot tell a difference between the target merchant embeddings and the modi-fied merchant embeddings, indicating the location fea-ture in the source merchant embeddings is mapped to the target merchant embeddings; and subsequent to the training and responsive to receiving a request for merchant recommendations in the target location for the target user, generating by the GAN a list of merchant rankings based on a new set of modi-fied merchant embeddings generated from a new set of payment transaction records made between the users and merchants, past preferences of the target user, and the target location to recommend merchants in the target location.
2
Dependent← claim 1
The method of claim 1, wherein the plurality of embedded features include a cuisine type feature.
3
Dependent← claim 1
The method of claim 1, wherein generating a list of merchant rankings based on the new set of modified mer-chant embeddings further comprises: receiving, by the one or more processors, the new set of payment transaction records of transactions made between the users and the merchants; generating, by the one or more processors, from the new set of payment transaction records new raw merchant embeddings and new raw user embeddings; performing, by the one or more processors, a domain-adversarial approach to map the plurality of embedded features from the source merchant embeddings to the target location together to a common embedding space using the GAN that performs a disentanglement pro-cess on the new raw merchant embeddings to remove the effect of the location feature by generating a new set of modified merchant embeddings that are free of the location feature; using, by the one or more processors, a preference model to determine new past preferences of the target user for the merchants based on the new modified merchant embeddings and the new raw user embeddings; automatically generating, by the one or more processors, the list of merchant rankings based on the new set of modified merchant embeddings, the new past prefer-ences of the target user, and the target location to recommend merchants in the target location; and providing, by the one or more processors, the list of merchant rankings to the target user.
8
Dependent← claim 1
The method of claim 1 wherein automatically gener-ating the list of merchant rankings further comprises: generating merchant preferences for the target user based on the modified merchant embeddings and the raw user embeddings; searching for local merchants located within proximity of a current location of the target user; and ranking the local merchants found within proximity of the target user based on the merchant preferences for the target user.
9
Independent
A merchant recommendation system, comprising: a transaction database storing historical payment transac-tion records; one or more processors having access to the transaction database; and a software component executed by the processor that is configured to: receive the historical payment transaction records made between users and merchants; generate from the historical payment transaction records a training set of raw merchant embeddings that repre-sent the merchants and raw user embeddings that represent the users within an embedding space using a word embedding process, wherein the raw merchant embeddings include a plurality of embedded features from the historical payment transaction records includ-ing a location feature, a price feature, and a number of transactions feature, wherein the raw merchant embed-dings include source merchant embeddings from a home location of a target user and target merchant embeddings from a target location; train a generative adversarial network (GAN) to generate modified merchant embeddings from the raw merchant embeddings, where the modified merchant embeddings have an effect of the location feature removed, the GAN comprising a generator and a discriminator, the GAN operational to: receive, by the generator, the source merchant embed-dings as a set X of n embeddings X=x1,..., xn from the home location; receive, by the discriminator, the target merchant embeddings as a set Y of m embeddings Y=y1,..., ym from the target location; and generate, by the generator, the modified merchant embeddings by applying a mapping function F to the set X of the source merchant embeddings, F (X)=F (x1),..., F (xn), wherein the generator uses F (X) to map the modified merchant embeddings to an embeddings space such that the discriminator cannot tell a difference between F (x1),..., F (xn) and the set Y of the target merchant embeddings; and discriminate, by the discriminator, between elements randomly sampled from F (X)=F (x1),..., F (xn) and Y to identify an origin of the modified merchant embeddings; continue, by the one or more processors, to train the GAN until the discriminator cannot tell a difference between the target merchant embeddings and the modified mer-chant embeddings, indicating the location feature in the source merchant embeddings is mapped to the target merchant embeddings; and subsequent to training and responsive to receiving a request for merchant recommendations in the target location for the target user, generating by, the GAN a list of merchant rankings based on a new set of modi-fied merchant embeddings generated from a new set of payment transaction records made between the users and merchants, and the target location to recommend merchants in the target location.
10
Dependent← claim 9
The system of claim 9, wherein the plurality of embedded features include a cuisine type feature.
11
Dependent← claim 9
The system of claim 9, the software component further configured to: receive, by the one or more processors, the new set of payment transaction records of transactions made between the users and the merchants; generate, by the one or more processors, from the new set of payment transaction records new raw merchant embeddings and new raw user embeddings; perform, by the one or more processors, a domain-adversarial approach to map the plurality of embedded features from the source merchant embeddings to the target location together to a common embedding space using the GAN that performs a disentanglement pro-cess on new the raw merchant embeddings to remove the effect of the location feature by generating a new set of modified merchant embeddings that are free of the location feature; use, by the one or more processors, a preference model to determine new past preferences of the target user for the merchants based on the new modified merchant embeddings and the new raw user embeddings; automatically generate, by the one or more processors, the list of merchant rankings based on the new set of modified merchant embeddings, the new past prefer-ences of the target user, and the target location to recommend merchants in the target location; and provide, by the one or more processors, the list of mer-chant rankings to the target user.
16
Dependent← claim 9
The system of claim 9, wherein when generating the list of merchant rankings, the software component is further configured to: generate merchant preferences for the target user based on the modified merchant embeddings and the raw user embeddings; search for local merchants located within proximity of a current location of the target user; and rank the local merchants found within proximity of the target user based on the merchant preferences for the target user.
17
Independent
A non-transitory computer-readable medium contain-ing program instructions for training a recommendation system to provide merchant recommendations to a target user, the program instructions for: receiving, by one or more processors, historical payment transaction records of transactions made between users and merchants; generating, by the one or more processors, from the historical payment transaction records a training set of raw merchant embeddings that represent the merchants and raw user embeddings that represent the users within an embedding space using a word embedding process, wherein the raw merchant embeddings include a plurality of embedded features from the historical payment transaction records including a location fea-ture, a price feature, and a number of transactions feature, wherein the raw merchant embeddings include source merchant embeddings from a home location of the target user and target merchant embeddings from a target location; training, by the one or more processors, a generative adversarial network (GAN) to generate modified mer-chant embeddings from the raw merchant embeddings, where the modified merchant embeddings have an effect of the location feature removed, the GAN com-prising a generator and a discriminator, the GAN operational for: 21 22 receiving, by the generator, the source merchant embeddings as a set X of n embeddings X=x1,..., xn from the home location; receiving, by the discriminator, the target merchant embeddings as a set Y of m embeddings Y=y1,..., ym from the target location; and generating, by the generator, the modified merchant embeddings by applying a mapping function F to the set X of the source merchant embeddings, F (X)=F (x1),..., F (xn), wherein the generator uses F (X) to map the modified merchant embeddings to an embeddings space such that the discriminator cannot tell a difference between F (x1),..., F (xn) and the set Y of the target merchant embeddings; and discriminating, by the discriminator, between elements randomly sampled from F (X)=F (x1),..., F (xn) and Y to identify an origin of the modified merchant embeddings; continuing, by the one or more processors, training the GAN until the discriminator cannot tell a difference between the target merchant embeddings and the modi-fied merchant embeddings, indicating the location fea-ture in the source merchant embeddings is mapped to the target merchant embeddings; and subsequent to the training and responsive to receiving a request for merchant recommendations in the target location for the target user, generating by the GAN a list of merchant rankings based on a new set of modi-fied merchant embeddings generated from a new set of payment transaction records made between users and merchants, and the target location to recommend mer-chants in the target location. ∗ ∗ ∗ ∗ ∗
Reported properties
Performance values and ranges asserted in the specification or claims.
Property
Value
Material
Temperature
0–30 k
—
Cited prior art
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 11
US 6,839,682 B16,839,682 B1 * 1/2005 Blume............... G06Q 30/0255examiner
US 10,339,586 B110,339,586 B1 * 7/2019 Khobragade...... G06Q 30/0631examiner
US 10,789,530 B210,789,530 B2 * 9/2020 Bruss....................... G06N 3/08examiner
US 2015/0220835 A12015/0220835 A1 8/2015 Wilson
US 2017/0148081 A12017/0148081 A1 * 5/2017 Chauhan............ G06Q 30/0631examiner
US 2019/0163832 A12019/0163832 A1 * 5/2019 Drake................... H04L 67/535examiner
US 2020/0065812 A12020/0065812 A1 2/2020 Walters
US 2020/0098010 A12020/0098010 A1 * 3/2020 Agarwal............ G06Q 30/0261examiner
Cited non-patent literature · 7
Mobile Marketing recommendation method based on user location feedback. “Mobile Marketing recommendation method based on user location feedback,” by Chunyong Yin, Shilei Ding, and Jin Wang, Human- centric Computing and Information Sciences, Springer Nature, May 1, 2019 (Year: 2019).
Massively Multilingual Word Embeddings. Ammar et al., “Massively Multilingual Word Embeddings” CoRR abs/1602.01925; 2016.
Enriching Word Vectors with Subword Infor- mation. Bojanowski et al., “Enriching Word Vectors with Subword Infor- mation” TACL 5:135-146; 2017.
Unsupervised Multilingual Word Embeddings. Chen et al., “Unsupervised Multilingual Word Embeddings” Pro- ceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, Oct. 31, Nov. 4, 2018, 261-270. Association for Computational Linguistics. Conneau, et al., “Word Translation Without Parallel Data” CoRR abs/1710.04087; 2017. Du, et al., “Pcard: Personalized Restaurant Recommendation from Card Payment Transaction Records” in Proceedings of the 28th International Conference on World Wide Web, 2687-2693; 2019. Farugui, et al., “Improving Vector Space Word Representations Using Multilingual Correlation” Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics; pp. 462-471; 2014. Goodfellow, et al., “Generative Adversarial Nets” in Advances in Neural Information Processing Systems 27; Curran Associates, Inc., 2014, pp. 2672-2680. Harris, “Distributional Structure” Word 10(23):146-162; 1954. Mikilov, et al., “Distributed Representations of Words and Phrases and their Compositionality” in Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Infor- mation Processing Systems 2013. Proceedings of a meeting held Dec. 5-8, 2013, Lake Tahoe, Nevada, United States., 3111-3119.
Exploiting SimilaritiesAmong Language for Machine Translation. Mikolov et al., “Exploiting SimilaritiesAmong Language for Machine Translation” CoRR abs/1309.4168; 2013.
GloVe: Global Vectors for Word Representation. Pennington et al., “GloVe: Global Vectors for Word Representation” in Empirical Methods in Natural Language Processing (EMNLP), 1532-1543; 2014. Zou, et al., “Bilingual Word Embeddings for Phrase-Based Machine Translation” In EMNLP, 1393-1398; 2013. Kumar, et al., “eCommerce Gan: a Generative Adversarial Network for E-commerce,” ArXiv: 1801.03244v1 [cs. LG], Apr. 2018; 10 pages.
Mobile marketing recommendation method based on user location feedback. Yin et al., “Mobile marketing recommendation method based on user location feedback,” Human-centric Computing and Informa- tion Sciences, (2019) 9:14; May 1, 2019; 18 pages.
US 10,789,530 B210,789,530 B2 * 9/2020 Bruss....................... G06N 3/08examiner
US 2015/0220835 A12015/0220835 A1 8/2015 Wilson
US 2017/0148081 A12017/0148081 A1 * 5/2017 Chauhan............ G06Q 30/0631examiner
US 2019/0163832 A12019/0163832 A1 * 5/2019 Drake................... H04L 67/535examiner
US 2020/0065812 A12020/0065812 A1 2/2020 Walters
US 2020/0098010 A12020/0098010 A1 * 3/2020 Agarwal............ G06Q 30/0261examiner
Cited non-patent literature · 7
Mobile Marketing recommendation method based on user location feedback. “Mobile Marketing recommendation method based on user location feedback,” by Chunyong Yin, Shilei Ding, and Jin Wang, Human- centric Computing and Information Sciences, Springer Nature, May 1, 2019 (Year: 2019).
Massively Multilingual Word Embeddings. Ammar et al., “Massively Multilingual Word Embeddings” CoRR abs/1602.01925; 2016.
Enriching Word Vectors with Subword Infor- mation. Bojanowski et al., “Enriching Word Vectors with Subword Infor- mation” TACL 5:135-146; 2017.
Unsupervised Multilingual Word Embeddings. Chen et al., “Unsupervised Multilingual Word Embeddings” Pro- ceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, Oct. 31, Nov. 4, 2018, 261-270. Association for Computational Linguistics. Conneau, et al., “Word Translation Without Parallel Data” CoRR abs/1710.04087; 2017. Du, et al., “Pcard: Personalized Restaurant Recommendation from Card Payment Transaction Records” in Proceedings of the 28th International Conference on World Wide Web, 2687-2693; 2019. Farugui, et al., “Improving Vector Space Word Representations Using Multilingual Correlation” Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics; pp. 462-471; 2014. Goodfellow, et al., “Generative Adversarial Nets” in Advances in Neural Information Processing Systems 27; Curran Associates, Inc., 2014, pp. 2672-2680. Harris, “Distributional Structure” Word 10(23):146-162; 1954. Mikilov, et al., “Distributed Representations of Words and Phrases and their Compositionality” in Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Infor- mation Processing Systems 2013. Proceedings of a meeting held Dec. 5-8, 2013, Lake Tahoe, Nevada, United States., 3111-3119.
Exploiting SimilaritiesAmong Language for Machine Translation. Mikolov et al., “Exploiting SimilaritiesAmong Language for Machine Translation” CoRR abs/1309.4168; 2013.
GloVe: Global Vectors for Word Representation. Pennington et al., “GloVe: Global Vectors for Word Representation” in Empirical Methods in Natural Language Processing (EMNLP), 1532-1543; 2014. Zou, et al., “Bilingual Word Embeddings for Phrase-Based Machine Translation” In EMNLP, 1393-1398; 2013. Kumar, et al., “eCommerce Gan: a Generative Adversarial Network for E-commerce,” ArXiv: 1801.03244v1 [cs. LG], Apr. 2018; 10 pages.
Mobile marketing recommendation method based on user location feedback. Yin et al., “Mobile marketing recommendation method based on user location feedback,” Human-centric Computing and Informa- tion Sciences, (2019) 9:14; May 1, 2019; 18 pages.
US 10,789,530 B210,789,530 B2 * 9/2020 Bruss....................... G06N 3/08examiner
US 2015/0220835 A12015/0220835 A1 8/2015 Wilson
US 2017/0148081 A12017/0148081 A1 * 5/2017 Chauhan............ G06Q 30/0631examiner
US 2019/0163832 A12019/0163832 A1 * 5/2019 Drake................... H04L 67/535examiner
US 2020/0065812 A12020/0065812 A1 2/2020 Walters
US 2020/0098010 A12020/0098010 A1 * 3/2020 Agarwal............ G06Q 30/0261examiner
Cited non-patent literature · 7
Mobile Marketing recommendation method based on user location feedback. “Mobile Marketing recommendation method based on user location feedback,” by Chunyong Yin, Shilei Ding, and Jin Wang, Human- centric Computing and Information Sciences, Springer Nature, May 1, 2019 (Year: 2019).
Massively Multilingual Word Embeddings. Ammar et al., “Massively Multilingual Word Embeddings” CoRR abs/1602.01925; 2016.
Enriching Word Vectors with Subword Infor- mation. Bojanowski et al., “Enriching Word Vectors with Subword Infor- mation” TACL 5:135-146; 2017.
Unsupervised Multilingual Word Embeddings. Chen et al., “Unsupervised Multilingual Word Embeddings” Pro- ceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, Oct. 31, Nov. 4, 2018, 261-270. Association for Computational Linguistics. Conneau, et al., “Word Translation Without Parallel Data” CoRR abs/1710.04087; 2017. Du, et al., “Pcard: Personalized Restaurant Recommendation from Card Payment Transaction Records” in Proceedings of the 28th International Conference on World Wide Web, 2687-2693; 2019. Farugui, et al., “Improving Vector Space Word Representations Using Multilingual Correlation” Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics; pp. 462-471; 2014. Goodfellow, et al., “Generative Adversarial Nets” in Advances in Neural Information Processing Systems 27; Curran Associates, Inc., 2014, pp. 2672-2680. Harris, “Distributional Structure” Word 10(23):146-162; 1954. Mikilov, et al., “Distributed Representations of Words and Phrases and their Compositionality” in Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Infor- mation Processing Systems 2013. Proceedings of a meeting held Dec. 5-8, 2013, Lake Tahoe, Nevada, United States., 3111-3119.
Exploiting SimilaritiesAmong Language for Machine Translation. Mikolov et al., “Exploiting SimilaritiesAmong Language for Machine Translation” CoRR abs/1309.4168; 2013.
GloVe: Global Vectors for Word Representation. Pennington et al., “GloVe: Global Vectors for Word Representation” in Empirical Methods in Natural Language Processing (EMNLP), 1532-1543; 2014. Zou, et al., “Bilingual Word Embeddings for Phrase-Based Machine Translation” In EMNLP, 1393-1398; 2013. Kumar, et al., “eCommerce Gan: a Generative Adversarial Network for E-commerce,” ArXiv: 1801.03244v1 [cs. LG], Apr. 2018; 10 pages.
Mobile marketing recommendation method based on user location feedback. Yin et al., “Mobile marketing recommendation method based on user location feedback,” Human-centric Computing and Informa- tion Sciences, (2019) 9:14; May 1, 2019; 18 pages.
US 10,789,530 B210,789,530 B2 * 9/2020 Bruss....................... G06N 3/08examiner
US 2015/0220835 A12015/0220835 A1 8/2015 Wilson
US 2017/0148081 A12017/0148081 A1 * 5/2017 Chauhan............ G06Q 30/0631examiner
US 2019/0163832 A12019/0163832 A1 * 5/2019 Drake................... H04L 67/535examiner
US 2020/0065812 A12020/0065812 A1 2/2020 Walters
US 2020/0098010 A12020/0098010 A1 * 3/2020 Agarwal............ G06Q 30/0261examiner
Cited non-patent literature · 7
Mobile Marketing recommendation method based on user location feedback. “Mobile Marketing recommendation method based on user location feedback,” by Chunyong Yin, Shilei Ding, and Jin Wang, Human- centric Computing and Information Sciences, Springer Nature, May 1, 2019 (Year: 2019).
Massively Multilingual Word Embeddings. Ammar et al., “Massively Multilingual Word Embeddings” CoRR abs/1602.01925; 2016.
Enriching Word Vectors with Subword Infor- mation. Bojanowski et al., “Enriching Word Vectors with Subword Infor- mation” TACL 5:135-146; 2017.
Unsupervised Multilingual Word Embeddings. Chen et al., “Unsupervised Multilingual Word Embeddings” Pro- ceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, Oct. 31, Nov. 4, 2018, 261-270. Association for Computational Linguistics. Conneau, et al., “Word Translation Without Parallel Data” CoRR abs/1710.04087; 2017. Du, et al., “Pcard: Personalized Restaurant Recommendation from Card Payment Transaction Records” in Proceedings of the 28th International Conference on World Wide Web, 2687-2693; 2019. Farugui, et al., “Improving Vector Space Word Representations Using Multilingual Correlation” Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics; pp. 462-471; 2014. Goodfellow, et al., “Generative Adversarial Nets” in Advances in Neural Information Processing Systems 27; Curran Associates, Inc., 2014, pp. 2672-2680. Harris, “Distributional Structure” Word 10(23):146-162; 1954. Mikilov, et al., “Distributed Representations of Words and Phrases and their Compositionality” in Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Infor- mation Processing Systems 2013. Proceedings of a meeting held Dec. 5-8, 2013, Lake Tahoe, Nevada, United States., 3111-3119.
Exploiting SimilaritiesAmong Language for Machine Translation. Mikolov et al., “Exploiting SimilaritiesAmong Language for Machine Translation” CoRR abs/1309.4168; 2013.
GloVe: Global Vectors for Word Representation. Pennington et al., “GloVe: Global Vectors for Word Representation” in Empirical Methods in Natural Language Processing (EMNLP), 1532-1543; 2014. Zou, et al., “Bilingual Word Embeddings for Phrase-Based Machine Translation” In EMNLP, 1393-1398; 2013. Kumar, et al., “eCommerce Gan: a Generative Adversarial Network for E-commerce,” ArXiv: 1801.03244v1 [cs. LG], Apr. 2018; 10 pages.
Mobile marketing recommendation method based on user location feedback. Yin et al., “Mobile marketing recommendation method based on user location feedback,” Human-centric Computing and Informa- tion Sciences, (2019) 9:14; May 1, 2019; 18 pages.