+ Reply to Thread
Page 1 of 2 1 2 LastLast
Results 1 to 10 of 12

Thread: A tool to crawl through site to find your link

  1. #1
    Join Date
    May 2004
    Location
    San Diego, CA
    Posts
    142

    Default A tool to crawl through site to find your link

    Has anyone seen a tool that does this? A lot of link partners will have directory pages where the location of your link may shift by a page or two thereby making it difficult to track.

    A tool that could crawl their site and find your link would be real handy.

  2. #2
    Join Date
    Jan 2005
    Location
    Orland Park/Homer Glen
    Posts
    3,345

    Default Re: A tool to crawl through site to find your link

    I'd like one of these too! When I first tried a link checker I was disappointed that I had to know the exact page where my link was supposed to be.
    Money Magazine says that Orland Park real estate is one of the best places to live in the U.S. Check out Homer Glen homes if you're interested in living in the newest Chicago suburb. Next door, Lemont homes are the priciest in the southwest suburbs and have held their value, even appreciating while prices in other areas have gone down.

  3. #3
    Join Date
    Mar 2005
    Posts
    388

    Default Re: A tool to crawl through site to find your link

    Try SEO Elite.

  4. #4
    Join Date
    May 2004
    Location
    San Diego, CA
    Posts
    142

    Default Re: A tool to crawl through site to find your link

    I saw that seoelite but it's a little more than I needed...a simple tool to do the job would be nicer...or if seoelite could build directories like arelis can.

  5. #5
    Join Date
    May 2004
    Location
    Portland, OR
    Posts
    797

    Default Re: A tool to crawl through site to find your link

    linkwrangler.com
    1) My second published story - Read it! One Soldier's Reason - If you like it, please tell others.

    Terry Light - Professional Contrarian
    LloydDistrict.com - one man on foot in Portland, Oregon.
    Creator of RealEstate ABC & co-creator of HomeSurfer.com

  6. #6
    Join Date
    May 2004
    Posts
    391

    Default Re: A tool to crawl through site to find your link

    The reason you don't see link crawlers is because they use up valuable resources. They would put an undue load on a server just to find one link. Imagine if everyone set a crawler loose on DMOZ every day/week to find one link. If you don't understand that, then just trust me that it is not a cool thing to do to someone.

  7. #7
    Join Date
    Dec 2004
    Posts
    1,740

    Default Re: A tool to crawl through site to find your link

    Quote Originally Posted by chachi
    The reason you don't see link crawlers is because they use up valuable resources. They would put an undue load on a server just to find one link. Imagine if everyone set a crawler loose on DMOZ every day/week to find one link. If you don't understand that, then just trust me that it is not a cool thing to do to someone.
    It's a huge waste of resources and that is ONE of many problems I have with Linksmanager.com. They scan my whole site to find one lousy link, it would be fine if they found the link stored the page it was on then went back to that page each time. If it moved then scan the site as it's my fault for being moving the link and not letting my link partner know about it.

    Wish I could find that site that I traded with that uses LM so I could get rid of them.

  8. #8
    Join Date
    May 2005
    Location
    Nashville
    Posts
    507

    Default Re: A tool to crawl through site to find your link

    Hi Kensmithkw,

    I use linksmanager.com and have turned off the automatic link checker feature. Once a month, I manually check the link page that was submitted and if my link is not there, I email the webmaster. If I cannot get a response within 2 weeks, I delete the link. I don't think that linksmanager is a bad product, it's just that people don't use it correctly. I've also read in other threads that you can block the linksmanager spider too.

  9. #9
    Join Date
    May 2004
    Location
    San Diego, CA
    Posts
    142

    Default Re: A tool to crawl through site to find your link

    the obnoxious part is that all the products that do sites crawls to find a link are bundled with a full link management system. I just want that small piece. And it would be nice if it outputted the page it found the link on so I could then update my database. It would save a lot of trouble for when people move links...it would avoid all the extra communication back and forth because of a misplaced link. I certainly have a respect for the desire to NOT hammer a site every time you want to do a link check, but crawling would be very handy for people who have dynamic directories.

    Anyone know how to code that kind of thing?

  10. #10
    Join Date
    Jun 2004
    Location
    Auckland, New Zealand
    Posts
    594

    Default Re: A tool to crawl through site to find your link

    I use Xenu and it's indispensable for when you have the a) home page, and b) the link page but can't work out to get from a) to b)

    It's not bundled, it's a single purpose, free, desktop tool. I've used it for years and it's great.

    When you find the links page you can look at the properties for the page(s) it's linked from and trace it back. There's a page map feature too.

    Sarah

+ Reply to Thread
Page 1 of 2 1 2 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts