TalkPHP

TalkPHP (http://www.talkphp.com/forums.php)
-   General (http://www.talkphp.com/general/)
-   -   Need Help: Getting Meta Description, Keywords and URL (http://www.talkphp.com/general/4567-need-help-getting-meta-description-keywords-url.html)

zxt3st 06-17-2009 04:21 PM

Need Help: Getting Meta Description, Keywords and URL
 
Any suggestions on how can I start on these simple search utility.

Project: Search Utility (specifically video sharing scripts like phpmotion)

Details:
1. Search for different video sharing script name
2. Take the url, meta keywords and description and store it in a table.
3. Check the url's by google pr to see which is better to have links exchange.
4. Search should not be too fast to prevent being shut by google.

Question:
1. Topics I should read on how to capture meta description and keywords from a web page.
2. How will I determine a web site that its a video sharing script site among from the others.

Just a little guidance and thought is greatly appreciated. :-)

Wildhoney 06-17-2009 04:59 PM

For the first question you really have 3 good options:

zxt3st 06-17-2009 05:11 PM

thanks for that..i already read those articles and find them quite useful in starting my another venture to this simple project.

Question:
How can I implement this project to run through google search results.

Example:
I will search for php sites in the address bar, then I would like to run my script then let my script go over the results and have those details I wanted to be stored in the databases.

I don't know if I am doing it in the hard way of I am just too confuse on how should I start this one.

Thank You!

Wildhoney 06-17-2009 11:59 PM

Something to be aware of, but officially you're not allowed to trawl Google's results. I have done myself, and you can do, but any system that draws attention to the fact you're crawling Google, and they will ban the IP address.

Bing, on the other hand, offer an API, and so do Yahoo, so if you're not too fussed about the search engine, then you can use either of those two, and avoid Google. Google actually prompt you with a Captcha if you hammer their server.

zxt3st 06-18-2009 01:19 AM

How can I obtain that Bing's API? And thanks for ticking me off bout that google...

Wildhoney 06-18-2009 01:58 AM

You can see the Bing API here. You'll need to obtain an API key first, and then the API for the search result page is a nicely XML formatted document.

zxt3st 06-18-2009 07:03 AM

So I need to sign up for them in order for me to get a key right? Then I can explore and read, study about them for a while to start my project..

This will be another full of fun : )

Wildhoney 06-18-2009 11:24 AM

Hehe, yes. Something like that. It does look fairly easy though, with the search results being in XML and/or JSON format.

zxt3st 06-18-2009 02:27 PM

I see, i will try this, and will consult on later... Thank you Adam : ) it is such a great help.

zxt3st 06-18-2009 04:40 PM

Just read their guidelines.

Quote:

What you cannot do
> Use API results for search engine optimization (SEO). In particular, using the API for rank checks is
explicitly prohibited.

> Display advertisements in positions other than the mainline and sidebar.
> Change the order of the results the API returns from a SourceType other than the Web SourceType.
I guess I can't use their API. :(

Wildhoney 06-18-2009 05:09 PM

They won't know :-) !

zxt3st 06-18-2009 05:12 PM

LOL, your teaching me others stuff huh? : ) I will give it a try...

OT: we are on irc, come on here..: )


All times are GMT. The time now is 07:08 AM.

Powered by vBulletin® Version 3.6.8
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.1.0