Blogs about: Robotstxt

Featured Blog

How to Use a Robots.txt to Control Your Website?

xlw064 wrote 3 weeks ago: A robots.txt file is a simple text file that is used to tell the search engines (robots) of what sho … more →

Tags: HOW TO?, Wordpress SEO, no follow, robots meta tag

Connecting with Google

greenchair wrote 4 weeks ago: We have been working with a client who has a very large web site — several thousand pages. The … more →

Tags: Search Engine Optimization, google indexing, Keyword Research, denver internet marketing

Crafty fuckers' robots.txt

loosecuts wrote 1 month ago: I can’t believe that it’s taken me 7 months of learning SEO to spot this trick. A partic … more →

Tags: Cunts, PageRank, NOFOLLOW">, SEO tricks for cunts, crafty

Robots, HTML Meta và Google, Yahoo, Microsoft

seobloggoogle wrote 2 months ago: Nguồn : Robots, HTML Meta và Google, Yahoo, Microsoft Robots Exclusion Protocol (REP) Một tron … more →

Tags: Indexability, Blog, bo tim kiem, crawl, Crawling, Google, HTML, index, indexing

jawaban apa itu robots.txt...

adjay wrote 3 months ago: Setelah berkeliling”, browsing”, chating”, eating”, sleeping”, dreamin … more →

Tags: Internet, SEO, googlebot

apaan sih robot.txt?

adjay wrote 3 months ago: Gw jg blm tau apaan robot.txt, yang jelas gw nemu ini... http://www.google.com/robots.txt User-agen … more →

Tags: Internet, Google

Expanding Our Support1 comment

basileios wrote 4 months ago: Users of Advanced Robots.txt Generator know that we are proud of the support we provide as we tend t … more →

Tags: News, Support

Updated Robots List1 comment

basileios wrote 5 months ago: Today we publish a new updated robots and crawlers list that can be used with Advanced Robots.txt Ge … more →

Tags: News

Search Engine Optimization (SEO) enabled development (tips and tricks)

sushantp wrote 5 months ago: So what is SEO aka Search Engine Optimization all about. To find the answer lets first look into an … more →

Tags: technology, SEO, Search Engine, Optimization, autodiscover, Urllist, info.txt, Page Rank, Webmaster

Advanced Usage of Robots.txt w/ Querystrings1 comment

sanzon wrote 5 months ago: When you first learn robots.txt you think it’s fairly simple, allow, disallow.  Well while ro … more →

Tags: Search Engines, Google, querystrings, wildcard

Yahoo! Slurp 3.0

basileios wrote 5 months ago: Yahoo! announced the launch of a new crawler version Slurp 3.0. According to the Yahoo! Search blog: … more →

Tags: Slurp!, Yahoo

How does a spam blog look like: See here!

mouth2mouth wrote 6 months ago: I know of someone whose blog was identified as spam by the intelligent Google robots. I won’t … more →

Tags: SERP, SEO, Bots, spam blogs, Blogger, Blogspot, Google

Bad Robots

basileios wrote 6 months ago: You may have noticed that in the basisoft.com webpage there is hardly any notice about ‘bad ro … more →

Tags: Options, bad robots

Video Tutorials

basileios wrote 6 months ago: We launch today the first in a series of video tutorials that aim to help users in their first attem … more →

Tags: how to make a robots.txt file, robots.txt tutorial

Updated Robots and Crawlers List

basileios wrote 6 months ago: Today we publish our updated robots and crawlers list that can be used with Advanced Robots.txt Gene … more →

Teaching the Search Engine Robots to Focus on your Blog Topic1 comment

Hummerbie wrote 7 months ago: The Robots Metatag Plugin from Joost de Valk is a must have Plugins if you are looking to improve y … more →

Tags: Wordpress SEO, Options, Plugin, Search Engine Optimization, SEO, WordPress

A Notice to Existing Customers

basileios wrote 7 months ago: Customers of previous versions of Advanced Robots.txt Generator that own a version prior to the pres … more →

Tags: upgrade

We are up!

basileios wrote 7 months ago: The new version 3.2 is now available on the website in two flavours Standard and Professional. The w … more →

Tags: version 3.2

New Version

basileios wrote 8 months ago: The new version is nearly ready and should appear on your screens within a week. The plan is to have … more →

Tags: News


Have your say. Start a blog.

See our free features →

Related Tags
All →

Follow this tag via RSS

Find other items tagged with “robotstxt”:
Technorati Del.icio.us IceRocket