No, you don't need Chrome extension if you have Adguard installed. Adguard assistant is part of Adguard application and that's why you see the Adguard icon in all browsers.
It's not mandatory. But Chrome extension may be a good addition to the standalone Adguard. It can fully replace Adguard Assistant module for you.