UGAN: Untraceable GAN for Multi-Domain Face Translation
Defa Zhu Si Liu Wentao Jiang Chen Gao Tianyi Wu Qaingchang Wang Guodong Guo
cs.CV








































UGAN: Untraceable GAN for Multi-Domain Face Translation
    
Defa Zhu1, Si Liu 2, Wentao Jiang 2, Chen Gao1, Tianyi Wu3, Qiangchang Wang4, Guodong Guo3
 



1Chinese Academy of Sciences, 
2Beihang University, 
3Baidu Research, 
4West Virginia University 




{zhudefa, gaochen}@iie.ac.cn, {liusi, jiangwentao}@buaa.edu.cn
 {wutianyi01, guoguodong01}@baidu.com, qw0007@mix.wvu.edu 

    December 30, 2023
=====================================================================================================================================================================================================================================================================================================================================






  
  
  
  
  The multi-domain image-to-image translation is a challenging task where the goal is to translate an image into multiple different domains. The target-only characteristics are desired for translated images, while the source-only characteristics should be erased. However, recent methods often suffer from retaining the characteristics of the source domain, which are incompatible with the target domain. To address this issue, we propose a method called Untraceable GAN, which has a novel source classifier to differentiate which domain an image is translated from, and determines whether the translated image still retains the characteristics of the source domain. Furthermore, we take the prototype of the target domain as the guidance for the translator to effectively synthesize the target-only characteristics. The translator is learned to synthesize the target-only characteristics and make the source domain untraceable for the discriminator, so that the source-only characteristics are erased. Finally, extensive experiments on three face editing tasks, including face aging, makeup, and expression editing, show that the proposed UGAN can produce superior results over the state-of-the-art models. The source code will be released. 

  

   




§ INTRODUCTION

  
 
Multi-domain image-to-image translation <cit.> refers to image translation among multiple domains, where each domain is characterized by different attributes. 

For example, the face aging task, with age groups as domains, aims to translate a given face into other age groups using a single translator.  
As shown in Figure <ref> Row 1, the input face image is translated into different age groups. 



  

Although prior works <cit.> have made significant progress, the translated results still suffer from retaining the characteristics of the source domain (incompatible with the target domain), which is the so-called phenomenon of source retaining. 




As illustrated in Figure <ref> Row 1, 
when StarGAN translates a female face from the age group 31∼40 to 0∼10, the translated image still looks like an adult. 

In makeup editing shown in Figure <ref> Row 2, StarGAN fails to eliminate the eye shadows in makeup removing. 

For expression editing, as shown in Figure <ref> Row 3, the results of StarGAN show visible teeth shadows around the mouth region. 


  



The reason for phenomenon of source retaining is that the explicit and effective mechanisms to erase the characteristics of the source domain have not been explored in the prior works. 
Most of them just simply apply a domain classifier, which is only trained to recognize the domain class of real data, to guide the image translation. However, the domain classifier is not sensitive to the non-qualified synthesized image containing incompatible characteristics. 
As shown in Figure <ref> Row 1, the discriminator correctly judges an adult face to be within 31∼40 age group. Translating the adult face into a child face (0∼10), the translated face heavily retains adult characteristics, e.g., beard and expression wrinkles (Figure <ref> Row 2). However, the discriminator judges it to be within 0∼10 age group with the confidence of 1. 
That is, the synthesized image containing incompatible characteristics has almost no punishment from the domain classifier, which results in the phenomenon of source retaining. 



  










 








To tackle the problem of source retaining, we propose a new method untraceable GAN (UGAN), which introduces untraceable constraint and prototype injection. 






The untraceable constraint is employed to encourage the translator to erase all the source-only characteristics and synthesize certain target-only ones. 
As shown in Figure <ref>, the process of an image from 31∼40 years old (source domain) translated to 0∼10 years old (target domain), 
the beard and wrinkles (source-only characteristics) need to be erased, while a smooth skin and round face (target-only characteristics) should be synthesized.

To endow the proposed UGAN with the above capabilities, a discriminator is trained to track which domain the synthesized image is translated from, while the translator is trained to make the source domain of the synthesized image being untraceable for the discriminator.
Furthermore, To effectively synthesize the target-only characteristics, we take the prototype <cit.> of the target domain as the guidance for the translator. The prototype is a statistic of the target domain, which aims to provide the essential characteristics, like the round face of 0∼10 years old domain. 








Our contributions include: 





 
  * To the best of our knowledge, this is the first work to present the phenomenon of source retaining in multi-domain image-to-image translation, and propose a novel UGAN to explicitly erase the characteristics of the source domain for improving the image translation.
 
  * A novel source classifier is introduced to differentiate which domain an image is translated from, and determines whether the translated image still retains the characteristics of the source domain.  
 
  * The propose UGAN is the first work to take the target prototype into the translator for synthesizing the target domain characteristics. 
 
  * Extensive qualitative and quantitative experiments are conducted for three face editing tasks that demonstrate the superiority of our proposed UGAN.  




















§ RELATED WORK


In this section, we give a brief review on three aspects related to our work: Generative Adversarial Network, Conditional GANs and Image-to-Image Translation.



Generative Adversarial Networks (GANs) <cit.> are popular generative models that employ adversarial learning between a generator and discriminator to synthesize the realistic data, which have gained astonishing successes in many computer vision tasks, such as image-to-image translation <cit.>, domain adaptation <cit.> and super-resolution <cit.>. 
In this work, the proposed UGAN enjoys the adversarial learning <cit.>, which approximately minimizes the Wasserstein distance between the synthesized distribution and real distribution. 




Conditional GANs <cit.> are variants of GANs, which aim to controllably synthesize examples under the given condition. 
Many prior works focus on generating samples under different forms of conditions, such as category label in the form of one-hot code <cit.> or learnable parameters <cit.>, and text with word embedding <cit.>, etc. 





Different from these works, for synthesizing the required characteristics, we introduce the prototype of the condition to provide prior information, where the prototype is one of the statistics of the target domain.  



















Image-to-Image Translation
is first defined in pix2pix <cit.>, which is improved from various aspects, such as 
skip connection for maintaining useful original information <cit.>, cascade training from coarse to fine <cit.>, extra relevant data <cit.>, buffer of history fake image <cit.>, multi-discriminator <cit.>, 3D technology <cit.>, variational sampling <cit.>. 


If the translator only models directed translation between two domains, C· (C-1) translators are required among C domains. A single conditional translator for multi-domain translation is seriously demanded. Thus we focus on multi-domain translation with such a single translator. 
The current multi-domain image translation methods <cit.> using the vanilla one-hot condition for the translator, without considering the information contained in each domain.
We are the first to adopt the statistics of each domain as a condition of the translator to efficiently inject the essential characteristics. 
Furthermore, the prior methods apply the domain classifier for condition constraints. However, limited by the classifier, they often suffer from the phenomenon of source retaining. 
Thus, we change the role of this auxiliary classifier in UGAN and make it classify which source domain the given datum is translated from, instead of classifying which domain the given datum is sampled from. 







§ OUR APPROACH




The framework of UGAN is shown in Figure <ref>. The input image and the target condition are fed into the translator G. 
The discriminator D has two heads: one head is named as the authenticity classifier to distinguish whether the input sample is real or fake; the other is called the source classifier, aiming to determine which domain the sample is translated from, where the real data are supposed to be translated from themselves. 
For erasing source-only characteristics and synthesizing the target-only characteristics, translator G is trained to fool the source classifier of D to believe that the synthesized image is translated from the target domain. 
Moreover, to effectively synthesize the target characteristics, we introduce the “prototype” of the target domain and inject it into the translated image. 















For convenience, we then introduce the used mathematical annotations. 
Discriminator D here contains two heads including the authenticity classifier D_a and the source classifier D_s, where D_a and D_s share the same feature extraction module D_f. D_a(D_f(·)) and D_s(D_f(·)) are abbreviated as D_a(·) and D_s(·) respectively. {x_s, y_s} is a sample pair from the source domain, where x_s represents the image and y_s is its label. By feeding the image x_s and the target label y_t into G, it produces x̃_s→t=G(x_s,y_t). 
We use q(x,y) to denote the joint distribution of image x and domain label y. q(x) and q(y) are the marginal distribution of images and labels, respectively. 






 §.§ Untraceable Constraint




To tackle the problem of source retaining, the source classifier D_s is trained to classify which domain image x is translated from. 
For an real image-label pair {x_s,y_s}, we regard x_s as translated from domain y_s to domain y_s. Since D_s aims to classify where an image is translated from, the real datum x_s should be classified into y_s, meaning x_s is translated from domain y_s. The synthesized image x̃_s→t should be classified into y_s, meaning x̃_s→t is translated from y_s. 
Translator G is trained to fool D_s to classify x̃_s→t into the y_t. 


In this way, G is trained to make the source domain of x̃_s→t is untraceable and the target domain characteristics are injected to x̃_s→t. 
The adversarial training is formulated as follows:

    [         L_D^S_1=-E_(x_s,y_s)[logD_s(x_s,y_s)]; -λ_u E_(x_s,y_s),y_t[logD_s(G(x_s,y_t),y_s)], ]


    L_G^S_1=-λ_u E_(x_s,y_s),y_t[logD_s(G(x_s,y_t),y_t)],

where λ_u is the penalty coefficient of source retaining. For space limit, E_(x,y)∼q(x,y)[·] and E_y∼q(y)[·] are abbreviated as E_(x,y)[·] and E_y[·], respectively. 




Note that the x̃_s→t should be injected with certain target-only characteristics. 
Recall that in Eq. (<ref>), G is trained to fool D_s to classify x̃_s→t into y_t. 
However, the class y_t here is not pure that mixed with the characteristics of x_t and synthesized data x̃_t→?. 
Refer to Eq. (<ref>), the source classifier D_s treats the real sample x_t sampled from y_t and fake sample x̃_t→? translated from y_t as the same class y_t. 

To accurately synthesize the characteristics of the target domain, the number of categories of D_s is augmented as 2C. The first C categories are real data and those sampled (translated) from the corresponding domain. The latter C categories are fake data, and those translated from the corresponding domain. y_s+C means input datum is fake and translated from y_s. In addition, the translator G is trained to fool D_s to classify x̃_s→t into the y_t category. The untraceable constraint conducted via optimizing the following:

    [           L_D^S_2=-E_(x_s,y_s)[logD_s(x_s,y_s)]; -λ_u E_(x_s,y_s),y_t[logD_s(G(x_s,y_t),y_s+C)], ]


    L_G^S_2=-λ_u E_(x_s,y_s),y_t[logD_s(G(x_s,y_t),y_t)].
 
In this process, D_s is trained to identify whether x̃_s→t is a fake image and the source domain. G is trained to approximate the true untraceable translator. 




 §.§ Prototype Injection


The statistics of the target domain can provide guidance information for image translation. Refer to Figure <ref> (b), the average image of each age group shows the essential characteristics, like round face and flat nose characteristics of age group 1 (0∼10). 
Thus, We leverage the statistics of the target domain to further inject the essential characteristics of the target domain into the translated image, where we call the statistic, containing the essential characteristics, as the “prototypes” following the classic aging method <cit.>. 
However, the posture of the source image and target prototype may be misaligned. Thus, concatenating or summing up the image feature and prototype feature will hurt the performance. 
To naturally inject these essential characteristics, we design an adaptive prototype injection (API) module inspired by non-local operation <cit.>. 

Refer to Figure <ref> (c), the injection process of API is formulated as follows: 

    [ 𝒜_ij = 
        exp( 
          ϕ (f^x_i)
          ·ϕ (f^p_j)
          )
        /∑_∀ k
          exp(
            ϕ (f^x_i)
            ·ϕ (f^p_k)
            )
        ,;                                                                                                f^inject_i = f^x_i + ∑_∀ j𝒜_ij· f^p_j, ]

where f^x and f^p are the feature maps of the source image and target prototype, respectively. i is the index of an feature map position. ϕ is a linear mapping to reduce the dimension. 
Since the computation of the correlation matrix 𝒜 is computationally expensive, we apply the API module on the low-resolution feature maps. 
To simultaneously maintain resolution and inject the prototype, the translator G is designed with two parallel networks, with parameter sharing at both ends (gray color, Figure <ref>). For maintaining the resolution, one network is a common architecture in image translation <cit.>. The other one applies the API module on the low-resolution feature maps. Finally, the outputs of these two networks are fused by element-wise sum to generate the translated image. 






 §.§ Objective Function

Authenticity constraint: The adversarial loss of WGAN-gp <cit.> is adopted to constrain the synthetic joint distribution to approximate the real distribution. 

    [                                        L_D^A= -E_x_s[D_a(x_s)] 
    +E_x_s,y_t[D_a(G(x_s,y_t))];                                                            +λ_gpE_x̂[(∇_x̂[D_a(x̂)_2-1)^2], ]


    L_G^A=-E_x_s,y_t[D_a(G(x_s,y_t))],

where x̂=α·x_s+(1-α)·G(x_s,y_t), and α∼U(0,1). The third term in Eq. (<ref>) is a gradient penalty term that enforces the discriminator as a 1-Lipschitz function.


Cycle Consistency: The input and output are regularized to satisfy the correspondence <cit.>:

    L_G^C=λ_c E_(x_s,y_s),y_t[G(G(x_s,y_t),y_s)-x_s_1].S












































Overall loss function: D and G are trained by optimizing

    L_D^U=L_D^A+L_D^S,


    L_G^U=L_G^C+L_G^A+L_G^S,

where L^S could be L^S_1 or L^S_2. The Eq. (<ref>) and Eq. (<ref>) are optimized alternatively. 





















 §.§ Discussions

We now explain why phenomenon of source retaining happens and how UGAN effectively handles it.
We briefly review one of the most representative multi-domain translation model StarGAN. It also has an authenticity classifier and a cycle consistency constraint L_G^C. 
The only difference between StarGAN and UGAN is that the discriminator D_ŝ of StarGAN classifies which domain the real image is sampled from. 
For StarGAN, the following loss is optimized:

    [ L_D^Ŝ=-E_(x,y)∼q(x,y)[logD_ŝ(x,y)], ]


    L_G^Ŝ=-E_x∼q(x),y∼q(y)[logD_ŝ(G(x,y),y)],

where Eq. (<ref>) trains D_ŝ to distinguish different domains while  Eq. (<ref>) trains G to fool D_ŝ to classify x̃_s→t as y_t. x̃_s→t is expected to increasingly fit y_t. 
To take the authenticity classifier and the cycle consistency constraint into consideration, the overall loss of D and G of StarGAN is

    L_D^ST=L_D^A+L_D^Ŝ,


    L_G^ST=L_G^C+L_G^A+L_G^Ŝ.



StarGAN suffers from the source retaining for the following reasons.
First, the first two terms in Eq. (<ref>) may result in lazy editing. This is because x̃_s→t=x_s is a trivial solution to satisfy the cycle consistency loss L_G^C and adversarial loss L_G^A terms. 
Second, D_ŝ in StarGAN is easy to be deceived. 
L_G^Ŝ is the only term that constrains the translated image towards the target domain. However the value of L_G^Ŝ quickly drops, while x̃_s→t still does not look like sampled from y_t and instead like the adversarial example <cit.> of D_ŝ. 
Third, D_ŝ is just like a whitelisting system to inject the characteristics of y_t into x̃_s→t, without explicitly erasing the source-only characteristics. 
That is, StarGAN only knows what characteristics the translated images should contain, and does not know what should not be contained.  


Compared with StarGAN, our proposed UGAN has its unique L_G^S and L_D^S. D_s can tell x̃_s→t is translated from y_s until all source-only characteristics have been erased from x̃_s→t. Analogically, x̃_s→t will not be judged as translated from y_t until x̃_s→t is injected with some target-only characteristics.
The configuration not only reduces the source-only characteristics but also forces the translated samples towards the target domain. 



§ EXPERIMENTS



 §.§ Datasets


 



























Face aging dataset is collected by C-GAN <cit.> including 15,030 face images. Ages are divided into 7 age groups including 0∼10, 11∼18, 19∼30, 31∼40, 41∼50, 51∼60 and 60+. 10% of the dataset is randomly selected as the test set, and the rest is the training set. 

MAKEUP-A5 is a makeup-labeled dataset <cit.> containing 6,095 aligned Asian woman faces with 5 makeup categories including retro, Korean, Japanese, non-makeup and smoky. The training set contains 5,485 images and the remaining is the test set. 

CFEE is an expression dataset <cit.> of 22 expressions with 5,060 images. The categories of facial expressions include (A) neutral, (B) happy, (C) sad, (D) fearful, (E) angry, (F) surprised, (G) disgusted, (H) happily surprised, (I) happily disgusted, (J) sadly fearful, (K) sadly angry, (L) sadly surprised, (M) sadly disgusted, (N) fearfully angry, (O) fearfully surprised, (P) fearfully disgusted, (Q) angrily surprised, (R) angrily disgusted, (S) disgustedly surprised, (T) appalled, (U) hatred and (V) awed. We randomly select 23 identities (506 images) as the test set and use the other images for training. 
All images are aligned and resized to 256×256 resolution.




 §.§ Measurements


Intra FIDs <cit.> on each domain and mean of them are used for evaluation. FID is a common quantitative measure for generative models, which measures the 2-Wasserstein distance between the two distributions q and p on the features extracted from InceptionV3 model. It is defined as <cit.>

    [ F(q, p) = μ_q-μ_p_2^2 +tr(σ_q+σ_p-2(σ_qσ_p)^1/2), ]

where q and p are feature distributions of real data and synthesized data, (μ_q,σ_q) and (μ_p,σ_p) are the mean and the covariance of q and p. The mean intra FID is calculated by

    [ mF_intra(q, p) = 1/C∑_i=1^C F(q(·|y_i), p(·|y_i)), ]

where y is the domain label for the total C domains. 

User studies by Amazon Mechanical Turk (AMT):  Given an input image, target domain images translated by different methods are displayed to the Turkers who are asked to choose the best one.

Cosine similarity: For the face aging task, cosine similarity between the features of real images and the corresponding translated images is used to measure the degree of source retaining. Features are extracted by a ResNet-18 model <cit.> trained on the same training set.  









 §.§ Implementation Details

We perform experiments with three versions of our methods named as UGAN^†, UGAN^ and UGAN, where the methods with superscripts (^† and ^) mean adopting the same translator as StarGAN (without prototype), “UGAN^†” means adopting L^S_1 as untraceable constraint, while “UGAN^” adopting L^S_2. “UGAN” means the final method that adopting L^S_2 as an untraceable constraint and the proposed translator with an API module. 


For a fair comparison, our learning rate is fixed as 0.0001, while the other hyper-parameters are kept the same as StarGAN. 

All experiments are optimized by Adam with β_1=0.5 and β_2=0.999. The discriminator is iterated 5 times per iteration of the translator. All baselines and our methods are trained 200 epochs. The mini-batch size is set to 16. All images are horizontally flipped with a probability of 0.5 as data augmentation.


Baselines: StarGAN <cit.> has shown the best performance than DIAT <cit.>, CycleGAN <cit.> and IcGAN <cit.>. We, therefore, select StarGAN as our baseline to verify the superiority of our method. For the face aging task, we additionally compare two classic GAN-based methods of face aging, including CAAE <cit.> and C-GAN (without transition pattern network) <cit.>. 










 §.§ Quantitative Experiments

Given the domain label y_i, we traverse all images in the test set to generate fake images. All the synthetic images of each domain are adopted to calculate intra FID, while 
300 synthetic images of each domain are randomly sampled to be evaluated by AMT.

Face aging: The comparison of results on face aging dataset is shown in Table <ref>. Face aging involves deformations and texture synthesis. For example, deformation, such as the face shape and eye size, are the main differences between babies and adults. Texture synthesis, like adding wrinkles, is also essential when translating a middle-aged man to a senior man.  
In Table <ref>, both UGAN^† and UGAN^ are significantly better than StarGAN on all age groups, where UGAN^ are better than UGAN^†.
The mean intra FID drops from 41.9 (StarGAN) to 29.2 (UGAN^). The relative drop is more than 30%. Furthermore, UGAN achieves the best performance with mean intra FID 27.4. 


Makeup editing: The comparison of results on MAKEUP-A5 dataset is shown in Table <ref>. Both texture and color need to be altered in makeup editing.
UGAN has the best performance in all categories. 
The mean intra FID has declined from 89.6 (StarGAN) to 71.3 (UGAN).


Expression editing: The comparisons on CFEE dataset are shown in Table <ref>. The expression editing task aims to change the emotion of a face by deformation. The CFEE dataset contains 22 kinds of fine-grained expressions, which makes the expression editing problem very challenging. From the results, 
we can conclude that UGAN again achieves the best performance. 
The mean intra FID is 58.2 (StarGAN), 49.6 (UGAN^†), 46.1 (UGAN^), and 44.8 (UGAN), respectively. It can be seen that the reduction is significant.


AMT user studies: 
For further evaluation, user studies are conducted on AMT [https://www.mturk.com/] to compare StarGAN and our method. Since UGAN outperforms UGAN^† and UGAN^ for mean intra FID, only UGAN is compared. With datasets mentioned above, we synthesize 300 pairs of images per domain by UGAN and StarGAN. All image pairs are shown to 102 Turkers who are asked to choose the better one considering image realism and satisfaction of target characteristics. 
Table <ref>, <ref> and <ref> show the percentage of our method beating StarGAN. 
For example, in Table <ref>, when changing a face to 0∼10 years old, StarGAN wins in 13.2% cases while our method wins in 86.8% cases. It again shows the advantages of our method when transforming a face into childhood. 
Generally, our method is better than StarGAN in every category of each dataset. 




Tackling the phenomenon of source retaining:
The effect of erasing source characteristics on face aging is shown in Table <ref>. 
A well-trained ResNet-18 (for age recognition) is adopted to extract features (the second last layer). We calculate average cosine similarity on the neural feature of all source images and translated image pairs from the test set. 
Intuitively, the smaller the similarity, the more thoroughly source characteristics are erased.
Since the images of adjacent age groups are similar, we only consider translation across a large age gap, e.g., across three age groups. In Table <ref>, we perform the experiments on multiple age group gaps, and the similarities of UGAN are smaller on all age group gaps.



 §.§ Qualitative Experiments

The visualization results are shown in Figure <ref>, <ref> and <ref>. More results are provided in supplementary material. 

Face aging: 






Results on the face aging dataset are shown in Figure <ref>. In the first example, an input image is a woman.
By comparing the results of 0∼10 years old (second column), our result has obvious childish characteristics, e.g. round face, big eyes, and small nose, while the result of StarGAN does not look like a child.
Another example is the 60+ years old case (last column). Our result has white hair, wrinkles, while StarGAN produces a middle-aged face.

These results show that UGAN can explicitly erase the characteristics of the source image by the source classifier in the discriminator. 


Makeup editing: Two exemplary results on MAKEUP-A5 dataset are displayed in Figure <ref>. For the first woman, by comparing the results of the second (retro) and last (smoky) columns, we find that blusher and eye shadows of UGAN are more natural, while StarGAN draws asymmetrical blusher and strange eye shadows. 
The result of UGAN is relatively natural when translating it to a non-makeup face. Therefore, we conclude that UGAN has learned the precise color and texture characteristics of different makeups. 


Expression editing: Results on CFEE dataset are demonstrated in Figure <ref>. We have the following observations. First, UGAN can well edit 22 kinds of fine-grained facial expressions. Also, UGAN captures the subtle differences between basic and compound expressions. For example, “Happily surprised” has bigger eyes and raising eyebrows compared to “Happy”. Besides, the results of StarGAN under various expressions still retain the original expressions. For example, when changing the man from “Hatred” to “Happy”, the result of StarGAN still has tight brows. 
Comparatively, UGAN can effectively synthesize the “Happy” expression by generating a grin and relaxed brows and erasing the tight brows.





§ CONCLUSION

The phenomenon of source retaining often occurs in the image-to-image translation task. 

To address it, the Untraceable GAN (UGAN) model has been proposed, where the discriminator estimates the source domain.

The translator G is trained to fool the discriminator D to believe that the generated data is translated from the target domain. 
In this way, the source domain of the synthesized image is untraceable.

In addition, we have further presented the prototype of each domain and inject it into the translated image to generate the target characteristics. 
Extensive experiments on three tasks have proven the significant advantages of our method over the state-of-the-art StarGAN. 




The source retaining phenomenon is common in various fields, where the UGAN idea may be widely used to alleviate the issue. 
For example, language translation <cit.> often preserves the grammatical structure of the source language. UGAN may serve as a solution to improve translation quality. Furthermore, the prototype injection idea also can be introduced to the universal conditional generation. We plan to study these ideas in-depth and apply them to broader applications. 

   

ieee

   



 
  
  


§ NETWORK ARCHITECTURE

The architectures of the generator and discriminator are shown in Figure. <ref> and <ref>. 






























§ PROTOTYPE

We take the average image of as the prototype of each domain. The average images of the datasets are shown in Figure <ref>, <ref>, <ref>.  







§ QUALITATIVE RESULTS 

The face editing results on face aging, MAKEUP-A5 (makeup editing) and CFEE (expression editing) datasets are shown in Figure <ref>, <ref>, <ref>, <ref>, <ref> and <ref>.

Face aging: the results on face aging dataset are shown in Figure <ref> and <ref>. In the Figure <ref>, the women images are used as input and synthesized faces of seven age groups are shown in second to seventh columns. 
Observing the second and last columns, our method generates very realistic results. 
For example, in the sixth row and fourth column ⟨ row   6, col  4 ⟩ of Figure <ref>, the woman is successfully transformed into a child with baby teeth, big eyes, etc. 
For another example, in ⟨ row  4, col  8 ⟩ the woman is aged to a senior woman with white hair and wrinkles.
Similar conclusions can be drawn by taking men as input as shown in <ref>. 
For example, in ⟨ row  2, col  4 ∼ 6 ⟩, the beard of the translated images become increasingly thicker.

Makeup editing: 4 exemplar results of StarGAN and UGAN on MAKEUP-A5 are displayed in Figure <ref> and <ref> respectively. Observing the images of the fifth column, all makeup can be removed to be a naked face. 
By observing the others columns, the makeup results of our method correspond to the specified categories.
For example, in ⟨ row  8, col   2 ⟩ of Figure <ref>, the translated face belongs to “Retro” with pink blush, lipstick, eye shadow. 
For another example, in ⟨ row  8, col   6 ⟩ of Figure <ref>, the translated face belongs to “Smoky” with black eyeliner and eye shadow.

Expression editing: 2 exemplar results of expression editing on CFEE are demonstrated in Figure <ref> and <ref> respectively. Our method is able to edit 22 kinds of fine-grained facial expression well.
For example, for the image in the second row of Figure <ref>, when translating it to “happy”, our method successfully synthesizes the real teeth and accurately expresses the happy expression.
Our method also can vividly synthesize other expressions. 














