Editing Skill

Regenerating by wiping

Using the wiping constraint, participants can select an area in the input image to conceal from CLIP's "translation." The wiping constraint is in a black and white format where the black areas indicate which parts of the image constraint will be concealed while the white areas will be redrawn in the resulting image.

There are also three types of redrawing：

• The first uses the corresponding area of the image constraint to draw content similar to the input image area (using the original image as a constraint, very similar).

• The second option is to only use the color matching of the corresponding area of the image constraint as a constraint (redrawing, color matching is similar).

• The third option is to use a new constraint or random noise from the model as a constraint to draw content that is not as similar to the input image area. The demo below shows an example of regenerating facial images of an Asian guy from a Caucasian guy by using a new constraint.

Removing by wiping

Users can also remove the subject in the wiped areas. By combining regeneration and removal, users can add or remove subjects in an image where they see fit.

Merging subjects for new creation: By setting weights, it is possible for two text constraints to simultaneously affect the result. For example, if "cow" and "rabbit" are fused as text constraints, it will generate a new creature that features a rabbit’s head on a cows’ body or vice versa. With the ability to control the weights of the text constraints, users can fine-tune the results of their creations to achieve the desired effects and outcomes.