Sitemap - Exclude Password Protected Posts and Pages | Troubleshooting All in One SEO Pack Pro | Support | Semper Plugins

Avatar

Lost password?
Advanced Search

— Forum Scope —




— Match —





— Forum Options —





Minimum search word length is 3 characters - maximum search word length is 84 characters

sp_Feed Topic RSS sp_TopicIcon
Sitemap - Exclude Password Protected Posts and Pages
January 5, 2017
8:05 pm
Avatar
Member
Guests
Forum Posts: 6
Member Since:
December 4, 2014
sp_UserOfflineSmall Offline

Is there a way to exclude password protected pages and posts from a dynamic sitemap. What’s happening is Facebook scrapes our pages while they’re password-protected. Once they become public, when someone shares the page, the page’s title says “protected” and it shows a default image. If I manually use Facebook’s debugger to re-scrape the page, it works fine.

 

In our situation, it’s not practical to manually exclude and then include the pages individually. I’m looking for a way for all password protected posts and pages to be excluded from the sitemap. Is this possible?

January 5, 2017
8:26 pm
Avatar
Steve Mortiboy
Admin
Forum Posts: 1790
Member Since:
January 5, 2012
sp_UserOfflineSmall Offline

** You currently do not have permission to see this post. To obtain access to these Premium Support Forums, please purchase a plugin and support subscription from Semper Plugins **

January 6, 2017
9:47 am
Avatar
Member
Guests
Forum Posts: 6
Member Since:
December 4, 2014
sp_UserOfflineSmall Offline

I setup a test to illustrate this. This post is password-protected: http://www.sideshowtoy.com/sam…..e-contest/ (this template intentionally doesn’t have a login, but it is definitely password-protected). This post is showing in our sitemap: http://www.sideshowtoy.com/sitemap.xml

 

We see the same thing with Pages. Any ideas?

January 6, 2017
10:20 am
Avatar
Steve Mortiboy
Admin
Forum Posts: 1790
Member Since:
January 5, 2012
sp_UserOfflineSmall Offline

** You currently do not have permission to see this post. To obtain access to these Premium Support Forums, please purchase a plugin and support subscription from Semper Plugins **

January 6, 2017
10:56 am
Avatar
Member
Guests
Forum Posts: 6
Member Since:
December 4, 2014
sp_UserOfflineSmall Offline

Right. So there’s no global setting that allows us to exclude password-protected content from the sitemap, right? If not, I think it could definitely be a useful feature.

Our problem is, Facebook scrapes the protected url (because it’s in our sitemap) and caches the incorrect content of the page. Once the page becomes live and someone shares it, Facebook uses that incorrect content as the image and summary on the FB post. Things don’t correct themselves until Facebook scrapes the url again (or we manually use the Open Graph debugger to force FB to scrape again). Sounds like we’re stuck with that situation for now unless we manually check/uncheck the exclusion box on each individual post and page.

January 6, 2017
11:00 am
Avatar
Steve Mortiboy
Admin
Forum Posts: 1790
Member Since:
January 5, 2012
sp_UserOfflineSmall Offline

** You currently do not have permission to see this post. To obtain access to these Premium Support Forums, please purchase a plugin and support subscription from Semper Plugins **

January 6, 2017
11:31 am
Avatar
Member
Guests
Forum Posts: 6
Member Since:
December 4, 2014
sp_UserOfflineSmall Offline

Great – thanks for opening that issue.

As a temporary fix, I added “has_password” -> false to the get_all_post_type_data function on line #2863 of the /modules/aioseop_sitemap.php

That seems to have fixed the issue for now, but obviously not a longterm solution. It’ll be great to get that as an option in the admin.

Thanks again

January 6, 2017
11:34 am
Avatar
Member
Guests
Forum Posts: 6
Member Since:
December 4, 2014
sp_UserOfflineSmall Offline

Sorry – for others’ reference, the exact code I added: 

‘has_password’ => false,
January 16, 2017
2:07 pm
Avatar
Michael Torbert
Admin
Forum Posts: 353
Member Since:
October 13, 2011
sp_UserOfflineSmall Offline

** You currently do not have permission to see this post. To obtain access to these Premium Support Forums, please purchase a plugin and support subscription from Semper Plugins **

January 16, 2017
2:09 pm
Avatar
Member
Guests
Forum Posts: 6
Member Since:
December 4, 2014
sp_UserOfflineSmall Offline

Awesome – thanks for the quick turnaround!

Forum Timezone: America/New_York

Most Users Ever Online: 964

Currently Online:
20 Guest(s)

Currently Browsing this Page:
1 Guest(s)

Top Posters:

Member Stats:

Guest Posters: 35

Members: 18952

Moderators: 0

Admins: 8

Forum Stats:

Groups: 4

Forums: 28

Topics: 1825

Posts: 7747

Newest Members:

ARANTZAZU VALLADARES

Administrators: Michael TorbertPeter BayliesSupport TeamSteve MortiboyMatthew RobinsonSteve KlasenArnaud BroesAsh R

[i]
[i]
Skip to toolbar