I would say the day you noticed the brown discharge. You can also buy an ovulation test or kit which would help out a lot. If it were up to me, I'd buy an ovulation test and have sex on the day it says to, maybe even a couple days before AND after that date. Good luck!