New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

create xml sitemap #324

Closed
AndyatFocallocal opened this Issue Jul 1, 2017 · 11 comments

Comments

Projects
None yet
4 participants
@AndyatFocallocal
Member

AndyatFocallocal commented Jul 1, 2017

the map isn't indexing well ..or at all in search engines.

can someone please add a sitemap to both maps, including the page at action.focallocal.org, news.focallocal.org, shop.focallocal.org

also send it to me so i can add it to google analytics. right now our site is basically on the dark web

here is a guide: https://juststartworking.com/meteor-and-seo-the-right-way/

@nsrtky

This comment has been minimized.

Show comment
Hide comment
@nsrtky

nsrtky Jul 1, 2017

Contributor

its better do it byself here i am going to share google help link.

https://support.google.com/webmasters/answer/183668?hl=en

Contributor

nsrtky commented Jul 1, 2017

its better do it byself here i am going to share google help link.

https://support.google.com/webmasters/answer/183668?hl=en

@AndyatFocallocal

This comment has been minimized.

Show comment
Hide comment
@AndyatFocallocal

AndyatFocallocal Jul 1, 2017

Member

@nsrtky meteor has issues with seo, so the site map doesn't work properly or link to other areas of the website. we need to install a package to make it easier for bots to crawl

Member

AndyatFocallocal commented Jul 1, 2017

@nsrtky meteor has issues with seo, so the site map doesn't work properly or link to other areas of the website. we need to install a package to make it easier for bots to crawl

@ydaniel98

This comment has been minimized.

Show comment
Hide comment
@ydaniel98

ydaniel98 Jul 19, 2017

Contributor

@nsrtky Are you on this or can I give it a go?
@AndyatFocallocal Was the site map added?

Contributor

ydaniel98 commented Jul 19, 2017

@nsrtky Are you on this or can I give it a go?
@AndyatFocallocal Was the site map added?

@AndyatFocallocal

This comment has been minimized.

Show comment
Hide comment
@AndyatFocallocal

AndyatFocallocal Jul 21, 2017

Member

@ydaniel98 i haven't heard from @nsrtky for a few days and he was going to push his updates across next time he works on the map. he's using the forum so you can contact him there and ask - but pretty sure he'd be happy for you to do this

Member

AndyatFocallocal commented Jul 21, 2017

@ydaniel98 i haven't heard from @nsrtky for a few days and he was going to push his updates across next time he works on the map. he's using the forum so you can contact him there and ask - but pretty sure he'd be happy for you to do this

@AndyatFocallocal

This comment has been minimized.

Show comment
Hide comment
@AndyatFocallocal

AndyatFocallocal Apr 15, 2018

Member

the sitemap was not added. i'd suggest a little research 1st as it sounds like spiderly is a bit behind times and vulnerable to google crawls overwhelming it in the semblance for a DDOS attack.

prerender.io is an opensource alternative. i'm not sure whether docker would make this a longer task to set up. here's a relevant discussion: https://forums.meteor.com/t/what-is-prerender-io-doing-that-i-cant-implement-on-my-own/17459/17

Member

AndyatFocallocal commented Apr 15, 2018

the sitemap was not added. i'd suggest a little research 1st as it sounds like spiderly is a bit behind times and vulnerable to google crawls overwhelming it in the semblance for a DDOS attack.

prerender.io is an opensource alternative. i'm not sure whether docker would make this a longer task to set up. here's a relevant discussion: https://forums.meteor.com/t/what-is-prerender-io-doing-that-i-cant-implement-on-my-own/17459/17

@nsrtky

This comment has been minimized.

Show comment
Hide comment
@nsrtky

nsrtky Apr 16, 2018

Contributor

Hi Andy we can use google web master tool for agile solution. https://www.google.com/webmasters/tools/ still looking for ssl certificate for production Does anyone else found something?

Contributor

nsrtky commented Apr 16, 2018

Hi Andy we can use google web master tool for agile solution. https://www.google.com/webmasters/tools/ still looking for ssl certificate for production Does anyone else found something?

@AndyatFocallocal

This comment has been minimized.

Show comment
Hide comment
@AndyatFocallocal

AndyatFocallocal Apr 16, 2018

Member

nice to hear from you @nsrtky. visit the slack channel if you'd like to know more about SSL, @ydaniel98 and flooded77 i believe have solved the issue and the Maps should be live shortly using Lets Encrypt. Once that's complete it should be fairly easy to set up on the other two servers.

We have the maps linked to google webmaster tools. the issue with them seems to be that google can't index Meteor as its dynamic content and the bots cant see it correctly. Other Meteor devs have used Prerender to display a static html page of all the content just for the bots to crawl.

I've created sitemaps at all the other non meteor subdomains in the site we're building, and a master sitemap pointing to them ready to go into the focallocal.org root directory. I included in them a link to sitemaps in our map builds but i'm not able to build those sitemaps myself (yet) ..and they need the prerender plugin to make them followable. they are already set up on Googles Webmaster Tools ready

Member

AndyatFocallocal commented Apr 16, 2018

nice to hear from you @nsrtky. visit the slack channel if you'd like to know more about SSL, @ydaniel98 and flooded77 i believe have solved the issue and the Maps should be live shortly using Lets Encrypt. Once that's complete it should be fairly easy to set up on the other two servers.

We have the maps linked to google webmaster tools. the issue with them seems to be that google can't index Meteor as its dynamic content and the bots cant see it correctly. Other Meteor devs have used Prerender to display a static html page of all the content just for the bots to crawl.

I've created sitemaps at all the other non meteor subdomains in the site we're building, and a master sitemap pointing to them ready to go into the focallocal.org root directory. I included in them a link to sitemaps in our map builds but i'm not able to build those sitemaps myself (yet) ..and they need the prerender plugin to make them followable. they are already set up on Googles Webmaster Tools ready

@AndyatFocallocal

This comment has been minimized.

Show comment
Hide comment
@AndyatFocallocal

AndyatFocallocal Apr 16, 2018

Member

@nsrtky would you like to have a go at it?

Member

AndyatFocallocal commented Apr 16, 2018

@nsrtky would you like to have a go at it?

@mordka

This comment has been minimized.

Show comment
Hide comment
@mordka

mordka Apr 16, 2018

Collaborator
Collaborator

mordka commented Apr 16, 2018

@AndyatFocallocal

This comment has been minimized.

Show comment
Hide comment
@AndyatFocallocal

AndyatFocallocal Apr 16, 2018

Member

Nice, thanks for the update @mordka. i read that Spiderable had been largely abandoned as Google's crawl bots can flood it with requests which keep repeating on themselves, creating an accidental DDOS attack.

Some people mentioned limiting the rate of crawl requests accepted. Is anything in place to prevent that?

https://www.reddit.com/r/Meteor/comments/48ljrb/spiderable_prerender/

as google will treat each post and member as a page we will end up with a lot of pages quickly

Member

AndyatFocallocal commented Apr 16, 2018

Nice, thanks for the update @mordka. i read that Spiderable had been largely abandoned as Google's crawl bots can flood it with requests which keep repeating on themselves, creating an accidental DDOS attack.

Some people mentioned limiting the rate of crawl requests accepted. Is anything in place to prevent that?

https://www.reddit.com/r/Meteor/comments/48ljrb/spiderable_prerender/

as google will treat each post and member as a page we will end up with a lot of pages quickly

@AndyatFocallocal

This comment has been minimized.

Show comment
Hide comment
@AndyatFocallocal

AndyatFocallocal Apr 28, 2018

Member

This issue was moved to AndyatFocallocal/temp#21

Member

AndyatFocallocal commented Apr 28, 2018

This issue was moved to AndyatFocallocal/temp#21

This was referenced Apr 28, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment