robots.txtµÄ¹æÔòÎóÇø¼°°Ù¶ÈºÍGoogleµÄrobots¹¤¾ßµÄʹÓÃ
¶ÔÓÚrobots.txtÎļþ¶ÔÓÚÍøÕ¾µÄ×÷Óôó¼Ò¶¼ÖªµÀ£¬µ«ÊÇͨ¹ý¹Û²ì·¢ÏÖ£¬ÓÐЩÅóÓѶÔÓÚrobots.txtÎļþµÄ¹æÔò»¹ÊÇÓÐÒ»¶¨µÄÎóÇø¡£
±ÈÈçÓкܶàÈËÕâÑùд£º
User-agent: *
Allow: /
Disallow: /mulu/
²»ÖªµÀ´ó¼ÒÓÐûÓп´³öÀ´£¬Õâ¸ö¹æÔòÆäʵÊDz»Æð×÷Óõģ¬µÚÒ»¾äAllow: / Ö¸µÄÊÇÔÊÐíÖ©ÖëÅÀÐÐËùÓÐÄÚÈÝ£¬µÚ¶þ¾äDisallow: /mulu/Ö¸µÄÊǽûÖ¹/mulu/ÏÂÃæµÄËùÓÐÄÚÈÝ¡£
±íÃæÉÏ¿´Õâ¸ö¹æÔòÏë´ïµ½µÄÄ¿µÄÊÇ£ºÔÊÐíÖ©ÖëÅÀÐгýÁË/mulu/Ö®ÍâµÄÍøÕ¾ËùÓÐÒ³Ãæ¡£
µ«ÊÇËÑË÷ÒýÇæÖ©ÖëÖ´ÐеĹæÔòÊÇ´ÓÉϵ½Ï£¬ÕâÑù»áÔì³ÉµÚ¶þ¾äÃüÁîʧЧ¡£
ÕýÈ·µÄ¹æÔòÓ¦¸ÃÊÇ£º
User-agent: *
Disallow: /mulu/
Allow: /
Ò²¾ÍÊÇÏÈÖ´ÐнûÖ¹ÃüÁÔÙÖ´ÐÐÔÊÐíÃüÁÕâÑù¾Í²»»áʧЧÁË¡£
ÁíÍâ¶ÔÓÚ°Ù¶ÈÖ©ÖëÀ´Ëµ£¬»¹ÓÐÒ»¸öÈÝÒ×·¸µÄ´íÎó£¬ÄǾÍÊÇDisallowÃüÁîºÍAllowÃüÁîÖ®ºóÒªÒÔб¸Ü/¿ªÍ·£¬ËùÒÔÓÐЩÈËÕâÑùд£ºDisallow: *.html ÕâÑù¶Ô°Ù¶ÈÖ©ÖëÀ´ËµÊÇ´íÎóµÄ£¬Ó¦¸Ãд³É£ºDisallow: /*.html ¡£
ÓÐʱºòÎÒÃÇдÕâЩ¹æÔò¿ÉÄÜ»áÓÐһЩûÓÐ×¢Òâµ½µÄÎÊÌ⣬ÏÖÔÚ¿ÉÒÔͨ¹ý°Ù¶ÈÕ¾³¤¹¤¾ß£¨zhanzhang.baidu.com£©ºÍGoogleÕ¾³¤¹¤¾ßÀ´²âÊÔ¡£
Ïà¶ÔÀ´Ëµ°Ù¶ÈÕ¾³¤¹¤¾ßrobots¹¤¾ßÏà¶Ô¼òªһЩ£º
ÍƼöÐÅÏ¢
- Seo×Ô¶¯»¯Ö®Ò» tagºÍÄÚÈÝÒ³¹ØÁªµÄ×Ô¶¯ÓÅ»¯
- GTmetrixרҵµÄÃâ·ÑÍøÒ³ÔØÈëËÙ¶ÈÆÀ²â
- ÌáÉýÍøÕ¾¹Ø¼ü´ÊÅÅÃûµÄ5¸ö²½Öè
- Ëѹ·ÍøÒ³ÆÀ¼¶¹¦ÄÜÉý¼¶ÓÐËƹȸèPR
- Óð룺seoer±Ø±¸¸ß¼¶ËÑË÷ÒýÇæÖ¸Áî½ø½×£¨ÉÏ£©
- SEO·þÎñÉ̵ÄÀ§»óÓë¿ÉÒɵÄËÑË÷ÒýÇæÓÅ»¯·þÎñ
- dz̸ÍøÕ¾SEOerµÄÕæÕý¾³½ç
- ÓÑÇéÁ´½Ó²¢²»ÊÇSEOµÄÍâÁ´½¨ÉèÄ¿±ê
- °Ù¶ÈÊÕ¼ϰ¹ßʵÑ鱨¸æ
- ½ÌÄãÈýÕÐÇáËÉ¢¶Ï³¤Î²¹Ø¼ü´Ê(ÏÂ)
ÈÈÃÅÐÅÏ¢
- nohup: redirecting stderr to stdou....
- ʹÓÃlog_formatΪNginx·þÎñÆ÷ÉèÖøüÏêϸµÄÈÕÖ¾¸ñʽ
- jquery easyUI--dataGrid-Json
- [Ô´´]·ÂGoogle Reader¡¢ÐÂÀË΢²©¡¢ÌÚѶ΢²©µ....
- ÀûÓÃKeepalived+mysql¹¹½¨¸ß¿ÉÓÃMySQLË«Ö÷×Ô¶....
- Nginx+keepalivedʵÏÖ¸ºÔؾùºâºÍË«»úÈȱ¸¸ß¿ÉÓÃ
- jqueryʵÏÖÒ³Ãæ¼ÓÔؽø¶ÈÌõ
- Rolling cURL: PHP²¢·¢×î¼Ñʵ¼ù
- codeigniter ·ÓÉÖÕ¼«ÓÅ»¯(url rewrite)
- linuxÏÂÉèÖÃsshÎÞÃÜÂëµÇ¼
×î½ü¸üÐÂ
- ÀÏÕ¾³¤½»ÄãÈçºÎ×öºÃ×ö¾«ÍøÕ¾ÄÚÁ´¹¤×÷
- ½áºÏSEOÓÅ»¯ÐÔÄܵÄCMSÌõ¼þ̸¼¸µã
- ÍøվǰÆÚ²»½¨ÉèÄÚÁ´ÊÇ·ñÕæµÄÓÐÀûÓÚÊÕ¼£¿
- ËÑË÷ÒýÇæÓÅ»¯ÖеÄÍøÕ¾ÄÚÈÝ¡¢½á¹¹¼°¹Ø¼ü×Ö
- ÍøÕ¾±êÌâ±êÇ©ÓÅ»¯´óÓÐѧÎÊ
- ·ÖÎöÓ°ÏìÍøÕ¾ÓÅ»¯µÄ30ÌõÒòËØ
- ×öSEO²»ÒªÍ¶»úÈ¡ÇÉ Ï¸½ÚºÍÖ´ÐÐÁ¦·Ç³£ÖØÒª
- ¡¶´óÐÍÍøÕ¾SEOÓÅ»¯Êµ¼ù¡·Ñ§Ï°·ÖÏí
- Ò»¸öÍøÕ¾ÍêÕûÏêϸµÄSEOÓÅ»¯·½°¸
- ×öºÃ³¤Î²¹Ø¼ü´Ê£¬ÎªÍøÕ¾ÌáÉýÁ÷Á¿
ÆÀÂÛ