noitcudni / google-search-console-bulk-url-removal

A chrome extension that allows for bulk url removal.

Google Search Console Bulk Url Removal Chrome Extension

• Tutorial Video
• Video on CSV Format
• Video on Error Messages
• Just released a version for Bing https://github.com/noitcudni/bing-webmaster-tools-bulk-url-removal

Install from Google Webstore

https://chrome.google.com/webstore/detail/webmaster-tools-bulk-url/pmnpibilljafelnghknefahibdnfeece

Installation

1. Install Java.
2. Install leiningen.
3. Either git clone [email protected]:noitcudni/google-webmaster-tools-bulk-url-removal.git or download the zip file from github and unzip it.
4. cd into the project root directory.

• Run in the terminal

lein release && lein package

5. Go to chrome://extensions/ and turn on Developer mode.
6. Click on Load unpacked extension . . . and load the extension.

Usage

1. Create a list of urls to be removed and store them in a file. See below for format.
2. Go to Google's Search Console formerly known as Google's Webmaster Tools. (https://search.google.com/u/1/search-console)
3. Click on Removals on the left panel.
4. Open up the extension popup by clicking on the green trash can icon.
5. Click on the "Submit CSV File" button to upload your csv file. It will start running automatically.

Local Storage

The extension uses chrome's local storage to keep track of state for each URL. You can use the Clear cache button to clear your local storage content to start anew.

You may run into the quota exceeded error. Should you encounter this error, the extension will pause of the removal process and present to you a continue button. Wait a considerable amount of time (I have no idea how long) and click on `continue** to pick up where it has left off.
I haven't run into this yet with the new google search console. Please open an issue should you encounter it and let me know how many URLs you've submitted to trigger this.

While the extension is at a paused state, you can also inspect what URLs are still pending to be removed. Right click anywhere on the page and select Inspect. Then, click on the View local storage button. The current local storage state will be printed out under the Console tab.

CSV Format

url (required), removal-method (optional: remove-url, clear-cached), url-type (optional: url-only, prefix)
By default removal-method is set to removel-url, and url-type is set to url-only

End-user license agreement (EULA)

By using Google Search Console Bulk URL Removal, you are agreeing to Google Search Console Bulk Url Removal's EULA.

Bulk Outdated Content Removal

For removing outdated content in bulk, please visit https://github.com/noitcudni/google-webmaster-tools-bulk-outdated-content-removal

google-search-console-bulk-url-removal's Issues

URL Are Concatenated

No matter which save format I try (MSDOS, Unix, UTF-8), some URLs are submitted like this:

https://domain.com/http://domain.com/actual-url-that-needs-to-be-removed

Looks like submitting both HTTPS & HTTP URLs screws things up.

Showing two urls on one line

When I upload urls it is showing 2 on a line. I canceled and did again but still the same is happening. I did with both csv and txt. Do I need to do it again?

internal server error 500

Hi
I just purchased the extension and i keep getting the above message when I try to submit
can you advice, please

extension not working

I paid for the extension in the google chrome store and the extension automatically loaded in the chrome browser. When I click the extension icon it keeps bringing me back to extensions page and says the extension is installed and says its added to chrome but will not allow me to use the extension

New Search Console

When will the tool be available for the new search console? If it is not soon, I will need to cancel and get a refund. I am unable to use the legacy tool.

Chrome can't see the file in zip & Thank YOU

Make sure you unpack the file first before uploading to Chrome Extension http://themercen.com/

Bulk URL removal tool error not automatic

hi there,

I have been using the tool for several months and from night to following day I upload the target csv file and only detects the first URL and I have to push the "Send" button every time one per one
Automatic function has been deactivated, I did not add any new extension, I tested in Windows and in Mac OS,
I guess Chrome updated itself automatically to the last version and now the automatic function does not work

Any ideas please?
thanks in advance

Error - Manifest file is missing or unreadable

" Error
Manifest file is missing or unreadable
Could not load manifest. "

I followed every step. every step goes well but just couldn't add it to chrome.
Please help

413. That’s an error.

I'm now getting following error from search console:

"
413. That’s an error.
Your client issued a request that was too large. That’s all we know.
"

Download Failed - Forbidden

Hello,

I just purchased this and when it started to download it said 'failed - forbidden' (please see in attached screenshot).

Internal Server Error Error 500

error search console--> Internal Server Error Error 500

https://www.google.com/webmasters/tools/removals

Hi,

Would it be possible to adapt your script in order to manage https://www.google.com/webmasters/tools/removals submissions ?

Internal Server Error 500

Hello Everybody, i follow the instructions, but when i uploaded the .CSV file i get and Internar Server Error 500.

Is this something momentary or anything else?

I will appreciate your support.
Regards.

Error to install this extension

Not installed this extension please update latest version

Show error message is:-
Manifest file is missing or unreadable
Could not load manifest.

.CSV help

What should be inside my .csv file before I request for bulk removal.

I've tried it and it shows this at the end .html,,,,, at the end of the link. But on the .csv file its not there.

Thank you so much

Domain URL added in the beginning

I have an issue with the Bulk URL Removal tool. When I use it the URLs gets wrong. I have an URL that looks like this:
http://xxxx.yyyy.com/?s=zzzzzzzz
When the Bulk URL Removal tool have uploaded the URL from the txt file, the domain URL is added in the beginning, so it looks like this:
http://yyyy.com/http://xxxx.yyyy.com/?s=zzzzzzzz

[Feature Request] Bulk "Fetch as Google"

Your script is awesome man, I wish you could make something similar for fetch as google section! Thanks anyway <3

Discussion about your tool

Your tool is very useful and if possible I would like to discuss some ideas that I have to make similar tools for my company. If you are interested please send your email to me via a direct message.

Publish to web store

Can you publish it to the Chrome Web Store? If you don't mind I can do it on my account.

Reporting a bug

Hi,

There is a bug. Because Google Removal Outdated Content tool is old and probably not very well updated and integrated with the other systems, sometimes it will force local language despite IP, OS settings, Chrome settings, Google Account settings and preferences, clearing the cache and logging in and logging out. All other services would be in English from the modern ones that are maintained, but not that one. That way, when you load the URL https://www.google.com/webmasters/tools/removals it will always show local language. I did had that issue before and I found a special hack to add ?hl=en to the URL, which will force the English version and then your button will appear.

I would consider telling people they have to add ?hl=en and/or adding languages to your tool to fix that. Maybe it is the size of the button in other languages or something else that is not helping your button to appear. Not sure.

Again, that is an issue with the Google service as it doesn't respect any settings as it is outdated. I think you need to address your tool, I've seen feedback that it doesn't work and I believe it is for that reason.

[Feature Request] Bulk Url Removal in unverified sites

Google Search Console allows to remove outdated content in unverified sites:
https://www.google.com/webmasters/tools/removals

Is possible add Bulk Url Removal to unverified sites too?

Thank you.

Chrome extension often pauses the process

Hi there, I really like your chrome extension. However, I have the impression that it does not work as good as in the past. The tool often paused and I manually have to click on "submit" that the process continues. Do you have ideas what is the reason behind that?

With the new version, is does not make automatic

Hello, I have to push Send to every url in order to make the bulk removal. Before it was everything atuomatic. Do you know where is the problem?

Add to Chrome button is not working

Hi,
I have purchased the plugin however after purchasing the 'Add to Chrome' button isn't responding after clicking on it.

Please help ASAP.

Order No. is CWS.0500-8758-7608-00708

Link to "How to Extract a List of All URLs Indexed by Google for Your Website" is dead.

"How to Extract a List of All URLs Indexed by Google for Your Website" link in description is dead, so I suggest to replace it with another one.

For example, there is a link for working bookmarklet to retrieve urls of google:
http://www.onlinesales.co.uk/tools/tools/bookmarklet-serps.php
(Bookmarklet code mirror1 and mirror2)

Instruction:

1. Type site:[your site url] e.g. site:reddit.com in http://google.com
2. Click bookmarklet
3. Copy links to text file and save

BTW Thanks for this tool. It saved me a lot of work!

Blanks registering after every row

Hi,

I've been using your very helpful tool for several months now without a problem. All of a sudden, I am now getting a blank submission after every row in my CSV file. So the removal tool is attempting to submit a specific URL and then after each one it sees a blank and attempts to do a full Site Removal. It hadn't been happening until just the past few days.

Any idea why this might be occurring and how to resolve?

Thanks!

You have exceeded your quota

Your script is working well, but after a couple of submitted URLs (the amount differs) a blank page appears with a message like "You have exceeded your quota". Clicking the Back-Button (also several times) keeps the script working again.

Thank you.

Just a quick thank you.

I had to remove 160 urls from google, this stopped me getting RSI.

Official Invoice after I bought the Plugin?

Hello there,

Sorry, this is none technical question, the plugin works perfectly fine btw. Would it be possible if I get the official invoice?

Best Regards
Dean

Internal Server Error 500

Hi
I just purchased the extension and get "Internal Server Error 500" every time I try to run it. I'm running the Crome 79.0.3945.117 on MacOS Catalina. Any idea what the problem is? I really need this one!

How Should I Stop The Process

I started the process but now I have to stop it and there is no a pause button? Also, I could'nt understand how to seperate URL's from each other? Can you give an advice for this?

len vs lein

Should it be len release && lein package
OR
lein release && lein package?

The description now says "len release && lein package".

New search console question

I know that the new search console has a different interface, is the removals section hidden in there? I can still access the old site, and use this tool, but wondering if this extension will support the new style one?

The tool get stuck after "A removal request for this URL has already been made." error

When I get the warning "A removal request for this URL has already been made.", the input batch process is stopped and doesn't move to next url when i click Continue button. Is there a way to fix this?

I am unable to pay the amount to buy it because I am from Pakistan and there is no any payment option for Pakistan

I am unable to pay the amount to buy it because I am from Pakistan and there is no any payment option for Pakistan

You have reached your submission limit. Please try again later

getting below error in search console Remove URLs
You have reached your submission limit. Please try again later

can you help me in that

Unable to upload csv file

Manifest file error

I installed java and leiningen and compiled the file but when i try to unpack the file in the browser chrome etccc i get the manisfest file error can anyone please tell me what i did wrong i followed the instructions thouroughly and i can't seem to find the solution p.s i did enable developer mode

Cant seperate URL's

Hi how do i separate the urls?
i tried this : /n
in php but it doesn't work. The URLS are not getting sperated.
Also do i export the file in txt format?

Error: cannot set property value of null

When I am submitting url's it's just getting the home directory but not the whole url.
Screenshot (99)_00000

Google Changing Interface for URL Removal

he comprado la extension y no sale donde poner el archivo csv

tengo instalado la extension de chrome que he comprado en la strore.
en principio me sale el icono en la pagina de chrome en verde pero cuando voy a la herramienta de eliminacion de google no me aparece el recuadro donde puedo poner el archivo csv

Search console only detects first url of the file uploaded

Hi,

i have purchased this extension but when i upload the csv file with the url's, one per line, Search Console only detects the first url. How can i fix it?

Thanks!

link where extension can be used to upload file

what is the exact link where this extension can be used to upload the file ?
there is no link from the readme...

Broken URL

Hi there,

I used your add-ons to remove 900 urls and after submitting this is what my links look like http://take.ms/hjPVN

thanks

API limit hit on 30+ urls in file

Query API limit is hit if file contain 30+ URLs. Since Query API limit is related to no more than 10 requests per second limit, script in extension should not query Google APIs more frequently than 9 requests per second. The easiest way may be add some wait 1s parameter after posting URL to removal.

Manifest File Error - Tried to find Solution all over the Web but no success.

Failed to load extension
File
E:\Software\Google Webmaster Tools Bulk URLs\google-webmaster-tools-bulk-url-removal-master\google-webmaster-tools-bulk-url-removal-master
Error
Manifest file is missing or unreadable
Could not load manifest.

WebMaster Tools - Bulk URL removal - Error

Hi,

I'm receiving an error everytime I try to purchase the extension on Chrome Web store. Is there an issue right now?

error message:An unexpected error has occurred. Please try again later. [OR-CAC-20]

One click processing?

Hey,
Just purchased this extension and have my work cut out for me trying to remove several thousand pharma spam urls. I have my CSV file saved with about 1000 URLs to start with, however, after submitting the file I need to manually hit continue each time to process subsequent URLS.

I get this error in developer's console:

Uncaught TypeError: Cannot read property 'b' of null
at Object.setBubbleVisible (4227820770-wmx__en.js:561)
at window.scLinkBubble (removals-request?hl=en&siteUrl=[Redacted])
at :1:23

as well as this warning:

[Deprecation] chrome.loadTimes() is deprecated, instead use standardized API: nextHopProtocol in Navigation Timing 2

I tried running the script in both my normal chrome window as well as an incognito window with limited extensions loaded (in case of a conflict). Appreciate any help.

Bad Request Error

Hi, I uploaded my txt file containing 300 URLs that I want to remove but upon uploading I got Bad Request Error. Pls check the video https://www.useloom.com/share/6eac229c8fb049d1b39f35b923fca3d4

The txt file only contains the URLs and nothing else. I tried with CSV format and same error