Bot responses degrading with iteration #145
Description
The more I'm training the bot ... The worse are the responses....
Check it out : -
HUMAN ++++ Hi
BOT ++++ dennings dennings dennings dennings dennings shed grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer
HUMAN ++++ Hey
BOT ++++ dennings dennings dennings dennings dennings dennings grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer
HUMAN ++++ What's your name?
BOT ++++ grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer grocer
=============================================
<after 1500 iterations>
HUMAN ++++ Hi
BOT ++++ ?
HUMAN ++++ What is your name
BOT ++++ me .
HUMAN ++++ WHere are you from
BOT ++++ of the .
HUMAN ++++ Let's go
BOT ++++ you ' re going to do you do ?
=============================================
<after 7000 iterations>
HUMAN ++++ Hi
BOT ++++
HUMAN ++++ Hey
BOT ++++ .
HUMAN ++++ Hello
BOT ++++ .
HUMAN ++++ What are you doing?
BOT ++++ .
HUMAN ++++ What is your name
BOT ++++ .
HUMAN ++++ Speak
BOT ++++ .
HUMAN ++++ Tell me your name
BOT ++++ .
HUMAN ++++ Who am I
BOT ++++ .
HUMAN ++++ You
BOT ++++
HUMAN ++++ I
BOT ++++
HUMAN ++++ Am
BOT ++++
HUMAN ++++ WHats
BOT ++++
HUMAN ++++ Should i go
BOT ++++ .
=============================================
<after 8000 iterations>
HUMAN ++++ Hi
BOT ++++ ?
HUMAN ++++ Hello
BOT ++++ ?
HUMAN ++++ What is your name
BOT ++++ .
HUMAN ++++ Where are you from
BOT ++++ .
HUMAN ++++ Let's Go
BOT ++++ . . .
HUMAN ++++ Let us go
BOT ++++ .
=============================================
<8000 iterations>
HUMAN ++++ Hi
BOT ++++ .
HUMAN ++++ Hey
BOT ++++ .
HUMAN ++++ Hi
BOT ++++ .
HUMAN ++++ Let us go
BOT ++++ .
HUMAN ++++ Let me in
BOT ++++ .
HUMAN ++++ Tell me his name again
BOT ++++ .
HUMAN ++++ .
BOT ++++
HUMAN ++++ No dots plz
BOT ++++ .
HUMAN ++++ no dot
BOT ++++ .
HUMAN ++++ stop
BOT ++++ .
HUMAN ++++ idiot
BOT ++++ .
HUMAN ++++ clr
BOT ++++ .
HUMAN ++++ Gufdc
BOT ++++ .
HUMAN ++++ hoy
BOT ++++ .
=============================================
<9000 iterations
HUMAN ++++ You always been this selfish?
BOT ++++ .
HUMAN ++++ Hey dude... What have you been up to ?
BOT ++++ .
HUMAN ++++ Hello
BOT ++++ .
HUMAN ++++ Hi
BOT ++++ .
HUMAN ++++ gyfjgjxxjygkyfdyfykuhkudtufbkudgchjgkudt
BOT ++++ .
HUMAN ++++ drgfth
BOT ++++ .
HUMAN ++++ gfthfthgyjdesfgbdc
BOT ++++ .
HUMAN ++++ ggd rg gtfh
BOT ++++ .
HUMAN ++++ yjygvhrh ygmjvhgsdg
BOT ++++ .
HUMAN ++++ fth fhgyjvgrdgd h
BOT ++++ .
HUMAN ++++ fthfth
BOT ++++ .
HUMAN ++++ ft hyjujmfgrdsg
BOT ++++ .
HUMAN ++++ f
BOT ++++ .
=============================================
The attached image shows the current training progress
>
The config.py is as follows :
`DATA_PATH = 'cornell movie-dialogs corpus'
CONVO_FILE = 'movie_conversations.txt'
LINE_FILE = 'movie_lines.txt'
OUTPUT_FILE = 'output_convo.txt'
PROCESSED_PATH = 'processed'
CPT_PATH = 'checkpoints'
THRESHOLD = 2
PAD_ID = 0
UNK_ID = 1
START_ID = 2
EOS_ID = 3
TESTSET_SIZE = 25000
BUCKETS = [(19, 19), (28, 28), (33, 33), (40, 43), (50, 53), (60, 63)]
#BUCKETS = [(16, 19)]
CONTRACTIONS = [("i ' m ", "i 'm "), ("' d ", "'d "), ("' s ", "'s "),
("don ' t ", "do n't "), ("didn ' t ", "did n't "), ("doesn ' t ", "does n't "),
("can ' t ", "ca n't "), ("shouldn ' t ", "should n't "), ("wouldn ' t ", "would n't "),
("' ve ", "'ve "), ("' re ", "'re "), ("in ' ", "in' ")]
NUM_LAYERS = 3
HIDDEN_SIZE = 256
BATCH_SIZE = 64
LR = 0.5
MAX_GRAD_NORM = 5.0
NUM_SAMPLES = 512
ENC_VOCAB = 24360
DEC_VOCAB = 24686
`