Log In
Home
Topic RSS
8:05 pm
December 4, 2014
Offline
Is there a way to exclude password protected pages and posts from a dynamic sitemap. What’s happening is Facebook scrapes our pages while they’re password-protected. Once they become public, when someone shares the page, the page’s title says “protected” and it shows a default image. If I manually use Facebook’s debugger to re-scrape the page, it works fine.
In our situation, it’s not practical to manually exclude and then include the pages individually. I’m looking for a way for all password protected posts and pages to be excluded from the sitemap. Is this possible?
8:26 pm
January 5, 2012
Offline
** You currently do not have permission to see this post. To obtain access to these Premium Support Forums, please purchase a plugin and support subscription from Semper Plugins **
9:47 am
December 4, 2014
Offline
I setup a test to illustrate this. This post is password-protected: http://www.sideshowtoy.com/sam…..e-contest/ (this template intentionally doesn’t have a login, but it is definitely password-protected). This post is showing in our sitemap: http://www.sideshowtoy.com/sitemap.xml
We see the same thing with Pages. Any ideas?
10:20 am
January 5, 2012
Offline
** You currently do not have permission to see this post. To obtain access to these Premium Support Forums, please purchase a plugin and support subscription from Semper Plugins **
10:56 am
December 4, 2014
Offline
Right. So there’s no global setting that allows us to exclude password-protected content from the sitemap, right? If not, I think it could definitely be a useful feature.
Our problem is, Facebook scrapes the protected url (because it’s in our sitemap) and caches the incorrect content of the page. Once the page becomes live and someone shares it, Facebook uses that incorrect content as the image and summary on the FB post. Things don’t correct themselves until Facebook scrapes the url again (or we manually use the Open Graph debugger to force FB to scrape again). Sounds like we’re stuck with that situation for now unless we manually check/uncheck the exclusion box on each individual post and page.
11:00 am
January 5, 2012
Offline
** You currently do not have permission to see this post. To obtain access to these Premium Support Forums, please purchase a plugin and support subscription from Semper Plugins **
11:31 am
December 4, 2014
Offline
Great – thanks for opening that issue.
As a temporary fix, I added “has_password” -> false to the get_all_post_type_data function on line #2863 of the /modules/aioseop_sitemap.php
That seems to have fixed the issue for now, but obviously not a longterm solution. It’ll be great to get that as an option in the admin.
Thanks again
11:34 am
December 4, 2014
Offline
Sorry – for others’ reference, the exact code I added:
2:07 pm
October 13, 2011
Offline
** You currently do not have permission to see this post. To obtain access to these Premium Support Forums, please purchase a plugin and support subscription from Semper Plugins **
13
1 Guest(s)
