mlabonne commited on
Commit
38101da
·
verified ·
1 Parent(s): 48e4a71

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -7
README.md CHANGED
@@ -12,7 +12,7 @@ It is designed to summarize Reddit posts using ~50 characters.
12
 
13
  You can reproduce this training using this [colab notebook](https://colab.research.google.com/drive/13mRqgRIvMGGgkQfJL4CS0lzcL4Vl9xUN?usp=sharing). It takes about 40 minutes to train the model.
14
 
15
- Takeaways from these experiments:
16
  * Adding a system prompt like "Summarize the following text concisely" doesn't help
17
  * You can get faster convergence with a higher learning rate and fewer samples, but it's prone to overshooting your target.
18
  * I tried many reward functions to play with reward shaping but it didn't seem to help
@@ -20,15 +20,13 @@ Takeaways from these experiments:
20
  ## Example
21
 
22
  Input:
23
- > SUBREDDIT: r/relationship_advice
24
  >
25
- > TITLE: I am a girl (18) that wants to let a guy (18) know that im hurt.
26
  >
27
- > POST: OK so theres this guy I had sex with earlier this year twice and he was really nice to me and everything . But then he rooted and booted me. Fast forward maybe 5 months and he calls me up one night when, drunk, wanting to see me. I saw him at a party the week before so maybe I got in his head again. Either way he rooted and booted me again and hasn't talk to me since and when I tried it was just him and his mates being silly and saying stuff. Like it's pretty much impossible to see him when I want to as he's a player and is always with the boys.
28
- >
29
- > So what I want to know is, next time he calls me up wanting a booty call or whatever I need to know what to say to let him know that he really really hurt me and it hurts to be had sex with and then him not care? Do any guys know a way that will make him actually CARE and get the picture.
30
  >
31
  > TL;DR:
32
 
33
  Output:
34
- > I'm a girl who wants to let a guy know that I'm really hurt.
 
12
 
13
  You can reproduce this training using this [colab notebook](https://colab.research.google.com/drive/13mRqgRIvMGGgkQfJL4CS0lzcL4Vl9xUN?usp=sharing). It takes about 40 minutes to train the model.
14
 
15
+ **Takeaways from these experiments**:
16
  * Adding a system prompt like "Summarize the following text concisely" doesn't help
17
  * You can get faster convergence with a higher learning rate and fewer samples, but it's prone to overshooting your target.
18
  * I tried many reward functions to play with reward shaping but it didn't seem to help
 
20
  ## Example
21
 
22
  Input:
23
+ > SUBREDDIT: r/Advice
24
  >
25
+ > TITLE: I have big dreams and goals, but they are kind of cloudy.[m20]
26
  >
27
+ > POST: I live at home with my family right now and I don't go to school. I went to college for a year and decided to stop. My best friend convinced me that I don't need college to do what I want to do. Besides, I hated taking classes I wasn't interested in. The things I want to do in life (I know it seems like too much) included producing music, making a cartoon, making comics, designing clothes and shoes, and other smaller things related to that. I grew up with a good family with a father that had similar dreams. He niw has a job he's been working for 20+ years that he doesn't like. I too am afraid of falling into that path. I've been pretty down and frustrated and feeling things are quite impossible although I know there's always hope. I don't really want to do anything else, but I'm stuck. I'll be pretty down for a week, then by the next week I'm in high spirits with a game plan that always fails. I've been doing this for quite a while now. My parents are starting to get on my case now and when they ask what I'm gonna do in life I don't know how to respond. Maybe I should try looking for lessons in nyc to get me out of the house? I practice drawing and making music a lot, but I can never feel satisfied and feel like I'm moving in the right direction. Everything seems like a scary cycle of ups and downs. I have faith I can turn it around, but I just don't know how.
 
 
28
  >
29
  > TL;DR:
30
 
31
  Output:
32
+ > I have big dreams and goals, but they are kind of cloudy. I'm going to try to figure out a plan to get out of that house, but I'm not sure what that plan will be.