ftp.mersenneforum.org

[Mark Rose]

I notice that the forum is available at http://ftp.mersenneforum.org and that Google indexes that. It might be an idea to disable the forum from being accessible on ftp.mersenneforum.org or to set a canonical URL to point to the www version so Google returns results only on www.

[TObject]

Add the following to the Apache host configuration (somewhere within VirtualHost tag, for example):

RewriteEngine on
RewriteCond %{HTTP_HOST} !^www\.mersenneforum\.org$ [NC]
RewriteCond %{SERVER_PORT}s ^(443(s)|[0-9]+s)$
RewriteRule ^(.*)$ http%2://www.mersenneforum.org%{REQUEST_URI} [R=301,L]

[Xyzzy]

Originally Posted by TObject

Add the following to the Apache host configuration (somewhere within VirtualHost tag, for example):

RewriteEngine on
RewriteCond %{HTTP_HOST} !^www\.mersenneforum\.org$ [NC]
RewriteCond %{SERVER_PORT}s ^(443(s)|[0-9]+s)$
RewriteRule ^(.*)$ http%2://www.mersenneforum.org%{REQUEST_URI} [R=301,L]

Will this work in a directory-specific .htaccess file? We do not have access to the "big boy" file.

(Also, what does it do?)

[TObject]

If the AllowOverride FileInfo configuration option is set, then this should work from .htaccess file.

Apache mod_rewrite module is required (usually it is on).

What does this do? It permanently redirects everything that does not look like www.mersenneforum.org to www.mersenneforum.org, and keeps the correct protocol (http/https) and correct request string after the domain name.

For example, when somebody or a robot goes to

http://ftp.mersenneforum.org/showthread.php?p=401885#post401885

They/it will be automatically redirected to

http://www.mersenneforum.org/showthread.php?p=401885#post401885

[Xyzzy]

We applied your change and it looks like it worked. Thanks!

[TObject]

You are welcome.

As Google spider re-visits the offending pages it will make a note of the correct destinations and the search index should get updated accordingly. This usually takes a while…

[Xyzzy]

Somehow the new rewrite rules are not working for links like this:

http://mersenneforum.org/gimps/mprime276-linux64.tar.gz

Instead it shows the "banned" message.

ErrorDocument 403 "Your IP address has been banned. If you think this is a mistake, please email xyzzyATmersenneforumDOTorg for assistance."
Options -Indexes
<ifModule mod_deflate.c>
  AddOutputFilterByType DEFLATE text/html text/xml text/css text/plain
  AddOutputFilterByType DEFLATE image/svg+xml application/xhtml+xml application/xml
  AddOutputFilterByType DEFLATE application/rdf+xml application/rss+xml application/atom+xml
  AddOutputFilterByType DEFLATE text/javascript application/javascript application/x-javascript application/json
  AddOutputFilterByType DEFLATE application/x-font-ttf application/x-font-otf
  AddOutputFilterByType DEFLATE font/truetype font/opentype
</ifModule>
<ifModule mod_expires.c>
  ExpiresActive On
  ExpiresDefault "access plus 5 seconds"
  ExpiresByType image/x-icon "access plus 604800 seconds"
  ExpiresByType image/jpeg "access plus 604800 seconds"
  ExpiresByType image/png "access plus 604800 seconds"
  ExpiresByType image/gif "access plus 604800 seconds"
  ExpiresByType text/css "access plus 604800 seconds"
  ExpiresByType text/javascript "access plus 604800 seconds"
  ExpiresByType application/javascript "access plus 604800 seconds"
  ExpiresByType application/x-javascript "access plus 604800 seconds"
 </ifModule>
RewriteEngine on
RewriteCond %{HTTP_HOST} !^www\.mersenneforum\.org$ [NC]
RewriteCond %{SERVER_PORT}s ^(443(s)|[0-9]+s)$
RewriteRule ^(.*)$ http%2://www.mersenneforum.org%{REQUEST_URI} [R=301,L]
order allow,deny
    Lots of IP addresses!
allow from all

[Mark Rose]

Try changing

RewriteCond %{HTTP_HOST} !^www\.mersenneforum\.org$ [NC]

to

RewriteCond %{HTTP_HOST} ^ftp\.mersenneforum\.org$ [NC]

that will only rewrite links to ftp.mersenneforum.org, not anything that isn't www.mersenneforum.org.

[TObject]

Not sure what is going on here... Check a couple of things, please:
* The /gimps folder does not have an .htaccess file of its own, right?
* Is there any evidence in the web server log files (errors are often in a separate log file), maybe file locations looking wrong or folders missing in the file paths?

[Xyzzy]

Originally Posted by Mark Rose

Try changing

RewriteCond %{HTTP_HOST} !^www\.mersenneforum\.org$ [NC]

to

RewriteCond %{HTTP_HOST} ^ftp\.mersenneforum\.org$ [NC]

that will only rewrite links to ftp.mersenneforum.org, not anything that isn't www.mersenneforum.org.

We tried the change and it did not fix anything. For now we have commented out the entire section.

[Xyzzy]

Originally Posted by TObject

* The /gimps folder does not have an .htaccess file of its own, right?

Yes, it has one:

Options Indexes
IndexIgnore HEADER.html
IndexOptions IgnoreCase FancyIndexing FoldersFirst NameWidth=* SuppressHTMLPreamble SuppressDescription
HeaderName HEADER.html

* Is there any evidence in the web server log files (errors are often in a separate log file), maybe file locations looking wrong or folders missing in the file paths?

We don't have access to real-time log files. We do have daily archived log files. If you want we could send you one to analyze.