Update README.md
Browse files
README.md
CHANGED
@@ -3,19 +3,20 @@ license: cc-by-nc-nd-4.0
|
|
3 |
---
|
4 |
|
5 |
# RealCustom Series
|
6 |
-
|
7 |
-
<
|
8 |
-
|
9 |
-
|
|
|
|
|
|
|
|
|
10 |
|
11 |
## 📖 Introduction
|
12 |
|
13 |
Existing text-to-image customization methods (i.e., subject-driven generation) face a fundamental challenge due to the entangled influence of visual and textual conditions. This inherent conflict forces a trade-off between subject fidelity and textual controllability, preventing simultaneous optimization of both objectives.We present RealCustom to disentangle subject similarity from text controllability and thereby allows both to be optimized simultaneously without conflicts. The core idea of RealCustom is to represent given subjects as real words that can be seamlessly integrated with given texts, and further leveraging the relevance between real words and image regions to disentangle visual condition from text condition.
|
14 |
|
15 |
-
|
16 |
-
<img src="assets/process.svg" width=95% height=95%
|
17 |
-
class="center">
|
18 |
-
</p>
|
19 |
|
20 |
## ⚡️ Quick Start
|
21 |
|
@@ -36,26 +37,6 @@ bash inference/inference_single_image.sh
|
|
36 |
python inference/app.py
|
37 |
```
|
38 |
|
39 |
-
### 🎨 Enjoy on [Dreamina](https://jimeng.jianying.com/ai-tool/home)
|
40 |
-
RealCustom is previously commercially applied in Dreamina and Doubao, ByteDance. You can also enjoy the more advanced customization algorithm in Dreamina!
|
41 |
-
|
42 |
-
#### Step 1: Create A Character:
|
43 |
-
Create character images and corresponding appearance descriptions through prompt descriptions, uploading reference images. Specifically:
|
44 |
-
1. **Character Image**: Best in clean background, close-up, prominent subject, high-quality resolution.
|
45 |
-
2. **Character Description**: Brief, includes the subject and key appearance elements.
|
46 |
-
<p align="center">
|
47 |
-
<img src="./assets/dreamina_character.jpg" width=50% height=50%
|
48 |
-
class="center">
|
49 |
-
</p>
|
50 |
-
|
51 |
-
#### Step 2: Character-Driven Generation:
|
52 |
-
Input prompts where the subject is replaced by the selected character, guiding the character to make corresponding changes such as style, actions, expressions, scenes, and modifiers.
|
53 |
-
There is no need to add descriptions of the subject in the prompt. "Face Reference Strength" is the weight for ID retention, and "Body Reference Strength" is the weight for IP retention.
|
54 |
-
<p align="center">
|
55 |
-
<img src="./assets/dreamina_generation.jpg" width=50% height=50%
|
56 |
-
class="center">
|
57 |
-
</p>
|
58 |
-
|
59 |
## Citation
|
60 |
If you find this project useful for your research, please consider citing our papers:
|
61 |
```bibtex
|
|
|
3 |
---
|
4 |
|
5 |
# RealCustom Series
|
6 |
+
|
7 |
+
<div style="display:flex;justify-content: center">
|
8 |
+
<a href="https://corleone-huang.github.io/RealCustom_plus_plus/"><img alt="Build" src="https://img.shields.io/badge/Project%20Page-RealCustom-yellow"></a>
|
9 |
+
<a href="https://arxiv.org/pdf/2408.09744"><img alt="Build" src="https://img.shields.io/badge/arXiv%20paper-2504.02160-b31b1b.svg"></a>
|
10 |
+
<a href="https://github.com/bytedance/RealCustom"><img src="https://img.shields.io/static/v1?label=GitHub&message=Code&color=green&logo=github"></a>
|
11 |
+
</div>
|
12 |
+
|
13 |
+

|
14 |
|
15 |
## 📖 Introduction
|
16 |
|
17 |
Existing text-to-image customization methods (i.e., subject-driven generation) face a fundamental challenge due to the entangled influence of visual and textual conditions. This inherent conflict forces a trade-off between subject fidelity and textual controllability, preventing simultaneous optimization of both objectives.We present RealCustom to disentangle subject similarity from text controllability and thereby allows both to be optimized simultaneously without conflicts. The core idea of RealCustom is to represent given subjects as real words that can be seamlessly integrated with given texts, and further leveraging the relevance between real words and image regions to disentangle visual condition from text condition.
|
18 |
|
19 |
+

|
|
|
|
|
|
|
20 |
|
21 |
## ⚡️ Quick Start
|
22 |
|
|
|
37 |
python inference/app.py
|
38 |
```
|
39 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
40 |
## Citation
|
41 |
If you find this project useful for your research, please consider citing our papers:
|
42 |
```bibtex
|