1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
import requests
api_key = "YOUR_API_KEY"
url = "https://api.segmind.com/v1/face-to-sticker"
# Prepare data and files
data = {}
files = {}
data['seed'] = 411
# For parameter "image", you can send a raw file or a URI:
# files['image'] = open('IMAGE_PATH', 'rb') # To send a file
# data['image'] = 'IMAGE_URI' # To send a URI
data['steps'] = 20
data['width'] = 1024
data['height'] = 1024
data['prompt'] = "a person"
data['upscale'] = False
data['upscale_steps'] = 10
data['negative_prompt'] = ""
data['prompt_strength'] = 7
data['ip_adapter_noise'] = 0.5
data['ip_adapter_weight'] = 0.2
data['instant_id_strength'] = 1
headers = {'x-api-key': api_key}
response = requests.post(url, data=data, files=files, headers=headers)
print(response.content) # The response is the generated imageAttributes
Fix the random seed for reproducibility
An image of a person to be converted to a sticker
2x upscale the sticker
Number of steps to upscale
Things you do not want in the image
Strength of the prompt. This is the CFG scale, higher numbers lead to stronger prompt, lower numbers will keep more of a likeness to the original.
How much noise is added to the IP adapter input
min : 0,
max : 1
How much the IP adapter will influence the image
min : 0,
max : 1
How strong the InstantID will be.
min : 0,
max : 1
To keep track of your credit usage, you can inspect the response headers of each API call. The x-remaining-credits property will indicate the number of remaining credits in your account. Ensure you monitor this value to avoid any disruptions in your API usage.
Face to Sticker
Face to sticker model takes an image of a person and creates a sticker image. This is based on style transfer, where essentially the sticker style is created for an input image of a person. The output is a new image that looks like a sticker but retains the facial features of the person in the input image. This model helps in the creation of personalized stickers from just about any image of a person.
Key Components of Face to Sticker
Under the hood of Face to sticker model is a combination of Instant ID + IP Adapter + ControlNet Depth + Background removal.
-
Instant ID is responsible for identifying the unique features of the face of the person in the input image.
-
An image encoder (IP Adapter) helps in transferring the sticker style on to the face image of the person in the input image.
-
ControlNet Depth estimates the depth of different parts of the face. This helps in creating a 3D representation of the face, which can then be used to apply the sticker style in a way that looks natural and realistic.
-
Background Removal removes the background, resulting in a clean sticker image.
How to use Face to Sticker
-
Input image: Choose an image that you want to transform into a sticker. A close-up portrait shot is ideal because it allows the model to clearly identify and process the facial features.
-
Prompt: Provide a text prompt based on the input image. This could be a simple description of the person in the image, such as “a man” etc. The model uses this prompt to guide the style transfer process.
-
Parameters: Adjust the below parameters to guide the final image output.
a. Prompt Strength: This parameter is similar to the CGF scale. It determines how closely the image generation follows the text prompt. A higher value will result in an output image that more closely matches the prompt.
b. IP Adapter Noise: This parameter determines the degree of influence of the sticker style. A higher value will result in a more stylized output image
c. IP Adapter Strength: This parameter determines the weight of influence of the sticker style. A higher value will result in a stronger application of the sticker style to the output image.
d. Instant ID strength: This parameter determines how closely the output image resembles the person in the input image. A higher value will result in an output image that more closely resembles the input image.
