If you watched every episode with simultaneous Japanese and English captions, you technically could. Just need to focus on memorizing things and writing things down, as well as deciphering grammar.