Is it allowable for marketing/promotion to appear in a sidebar outside of the window where my online CE activity is viewed?

No.  According to Standard 5.2b, when offering online activities, providers need to make sure that ANY marketing for the products of ineligible companies is NOT presented to learners before, during, or after an accredited activity (and this would include a visible sidebar).