3531862 - Message "404 - Not Found" in Analysis for Office while connecting to BW4HANA using SSO

While connecting to BW4HANA from Analysis for Office, message "404 - Not Found. We could not find the resource you're trying to access" is coming up and the user is able to access the required system just by closing the dialog. See screen shot below from the message:

"Image/data in this KBA is from SAP internal systems, sample data, or demo systems. Any resemblance to real data is purely coincidental." 

• SAP Analysis for Microsoft Office
• SAP Analysis for Microsoft Office, edition for SAP Analytics Cloud

Not Found, 404, Analysis, Office, certificate, authentication, dialog, popup, connection, BW4HANA, We could not find the resource you're trying to access, SSO, Single Sign On, Insert Data Source, Create Connection, login , KBA , BI-RA-AO-XLA , Excel Addin , Problem