Skip to Content Skip to Menu

Allow google to crawl paywalled content

  • Leobici
  • Leobici
  • ONLINE
  • Posts: 54
  • Thanks: 10
  • Karma: 0
4 days 3 hours ago #340068 by Leobici
I have implemented a subscription system with cbsubs, with some paid articles only available to users with certain subscription plans.
In order to hide the content behind a paywall I use an if statement only in the full text of the article, leaving the intro visible to everyone.

I managed to correctly implement the paywalled markup required by Google but now I would like the Googlebot to be able to correctly crawl the entire content of the article and not just the introduction. How can I allow the Google bot to access content available only for users in specific groups?
Thanks

Please Log in or Create an account to join the conversation.

  • krileon
  • krileon
  • ONLINE
  • Posts: 48734
  • Thanks: 8321
  • Karma: 1448
2 days 4 hours ago - 2 days 4 hours ago #340108 by krileon
Replied by krileon on topic Allow google to crawl paywalled content
There isn't a way to do that without exposing the contents of the article publicly. That's why a lot of article paywalled sites can actually be accessed by just turning JavaScript off as they're just hiding the article with JavaScript and CSS or by switching browser agent to act like they're a Google crawler.

The best way to have your articles accurately indexed is to use SEO methods like JSON-LD structured data (Schema), which is built into Joomla 5. There you can describe exactly what the article is about. This would avoid exposing your articles for the purpose of crawling.

We've also released a plugin to take SEO to the next level and bring Joomla 5's Schema support to Joomla menu items so you can have solid SEO no matter the page. CB SEO also implements OpenGraph so when your website is shared on social media you can have the image you want and the text you want displayed properly.

www.joomlapolis.com/addons/cb-seo


Kyle (Krileon)
Community Builder Team Member
Before posting on forums: Read FAQ thoroughly + Read our Documentation + Search the forums
CB links: Documentation - Localization - CB Quickstart - CB Paid Subscriptions - Add-Ons - Forge
--
If you are a Professional, Developer, or CB Paid Subscriptions subscriber and have a support issue please always post in your respective support forums for best results!
--
If I've missed your support post with a delay of 3 days or greater and are a Professional, Developer, or CBSubs subscriber please send me a private message with your thread and will reply when possible!
--
Please note I am available Monday - Friday from 8:00 AM CST to 4:00 PM CST. I am away on weekends (Saturday and Sunday) and if I've missed your post on or before a weekend after business hours please wait for the next following business day (Monday) and will get to your issue as soon as possible, thank you.
--
My role here is to provide guidance and assistance. I cannot provide custom code for each custom requirement. Please do not inquire me about custom development.
Last edit: 2 days 4 hours ago by krileon.

Please Log in or Create an account to join the conversation.

  • Leobici
  • Leobici
  • ONLINE
  • Posts: 54
  • Thanks: 10
  • Karma: 0
1 day 13 hours ago #340116 by Leobici
Replied by Leobici on topic Allow google to crawl paywalled content
Hi krileon,
thanks for your reply,
everything is clear now and i will investigate further your information!
The following user(s) said Thank You: krileon

Please Log in or Create an account to join the conversation.

Moderators: beatnantkrileon
Powered by Kunena Forum