Should I go to Embassy to get my eVisa after approval?

No. As you have already applied through the electronic visa application system, you will be able to download your e-Visa directly from www.evisa.com.az after getting e-Visa approval.