Skip to main content

Inside AdSense

This is the first post in our two-part AdSense Crawler Errors series.

There are many ways that publishers can go about optimizing their site for AdSense; opting-in to text/image ads, upgrading to our preferred ad formats, and increasing ad coverage across a site are just a few of the more well-known ones. But did you know that there’s another straightforward optimization tip that many publishers often overlook?

A bit of context
Your site’s robots.txt file essentially acts as a gatekeeper that determines which web crawlers, web robots, and search engines have access to your site and which do not. Those that are granted permission can do things like view your pages and index your site. Those that don’t have permission are not able to view or index specific sections of your site, depending on what you’ve specified.

AdSense ads are displayed through the use of anAdSense web crawler. That crawler scans your page’s content and determines which ads to display, according to specific keywords. If our AdSensecrawler is being blocked by yourrobots.txt file, we’re going to have a difficult time displaying relevant ads on your site. As a result, your users may see less relevant ads, which can lead to a lower CTR.

How you can help yourself

View the contents of yourrobots.txt file by going to[yourdomain.com]/robots.txt.  (If you have a subdomain, it likely has a robots.txt file as well, located at[sub.yourdomain.com]/robots.txt.) Be sure that the file is configured to allow our AdSense ad crawler to view your site. You can do that by simply adding the following two lines to the very top of the file:
User-agent: Mediapartners-Google
Disallow:
This will ensure that our AdSense ad crawler can access your site and will help display more relevant ads. As a result, you can potentially benefit from increased ad revenue. Please note that making this change will not impact your Google search rankings. Adding these two lines to your robots.txt file will only help to deliver better, more relevant ads to pages with AdSense code already on them. Pages that don’t have AdSense ad code will not be affected.

If you have URLs with any errors, you can see what they are by logging into your AdSense account and clicking on ‘Account Settings’ from the home page. From there, click on ‘View errors’ under ‘Access and Authorization.’
Stay tuned for the second post in ourAdSense Crawler Errorsseries, where we’ll cover crawler login issues and how you can solve them.

Comments

Popular posts from this blog

Adsense PIN verification and Payment options in India

New Bloggers who have started using Adsense are in lot of confusions because staying on Adsense is not so easy. most of the spam Adsense accounts are created in India, Pakistan hence Sometimes a ethical account is banned. I have received various of questions by our online readers weather Adsense pays through Check, Local bank transfer or EFT. Let me answer all your questions in this post. First of all when you sign up on Google Adsense as a publisher and you have earned minimum of $10 (rs.500) Google will initiate the process to verify your Address by sending you a Letter (PIN) most commonly known as “Adsense PIN Verification Letter†That letter is sent you via local post and it should arrive on your Address between 2 to 4 weeks. your Personal Identification Number (PIN) is written on that letter, you will need to enter the same PIN on your Adsense dashboard to Verify your Address and this will enable your payments. Adsense PIN Verification New Bloggers and webmaster at initia...

How to Verify Google Adsense Account without PIN?

Google Adsense is the best advertising network to earn money online for bloggers and webmasters. When you get Google Adsense approval, Google start showing ads on your blog or website. Once you reach $10 threshold earning, you can set payment mode in your Google Adsense account. Before sending payment to you, Google verifies your address by sending Address Verification PIN (Personal Identification Number) at your address. You have to verify your account address by entering 4 digits PIN which comes in a 4.5 x 6 inch (11.4 x 15.2 cm) postcards. How does the PIN mailer look like? According to Google Adsense, PINs are printed on PIN mailers, which are white 4.5 x 6 inch (11.4 x 15.2 cm) postcards. Please see below for images of the front and back of the PIN mailer that we send to publishers via standard mail. Verify your Google Adsense Account Address using PIN: Just follow below mentioned process to verify Google Adsense Account address using PIN: Step-1: Google ge...

What are the average CPM/CPC rates in India?

It's impossible to know the average CPM / CPC rates in India without any information on targeting parameters, your process of buying media (direct, agency, network or DSP), the channels you want to buy (mobile or web), and whether you want to target specific audience segments from DMPs. There are so many factors that drive CPM / CPC rates: categories, channel, ad placements and publishers, device, and many more. And even if you simply want to target all the online audience in India without any other targeting parameters, the rates will still vary based on the placements, the agencies, networks, and platforms that you will use. Example, GDN has more expensive rates than ad networks. And across hundreds of ad networks, they have different rate cards for India even for remnant traffic. When you use a DSP like Bluagile, your CPM rates depend on how much you want to pay. The higher your max CPM bid, the more traffic you will get. Even bidding for traffic will not get you the ex...