Apr 292016 Tagged with , 2 Responses

Powerful Web Scraping Software – Content Grabber Review

web scraperThere are many web scraping software and cloud based web scraping services available in the market for extracting data from the websites. They vary widely in cost and features. In this article, I am going to introduce one such advanced web scraping tool “Content Grabber”, which is widely used and the best web scraping software in the market.

Content Grabber is used for web extraction, web scraping and web automation. It can extract content from complex websites and export it as structured data in a variety of formats like Excel Spreadsheets, XML, CSV and databases. Content Grabber can also extract data from highly dynamic websites. It can extract from AJAX-enabled websites, submit forms repeatedly to cover all possible input values, and manage website logins. Read More…

Feb 232016 Tagged with , , 0 Responses

Self-Contained Agent – Amazing feature of Content Grabber

Most organizations depend on the web to collect data that is important to their decision making process. Automating data collection from websites can significantly help businesses reduce time, costs and manual errors.

Content Grabber logo and spiderContent Grabber – an advanced web scraping software application can help businesses automatically harvest data from the web. Content Grabber requires no programming. Content Grabber has a very unique feature – “self-contained agent” that provides a way for web scraping via agent assisted automation.

The self-contained agent feature is only available in the Professional & Premium version of Content Grabber. Read More…

Jul 302015 Tagged with , , 0 Responses

Web Scraping using Chrome Scraper Extension

chrome scraper extensionDo you want to get data from a web page or website to CSV or Excel Spreadsheet? The answer is web scraping. There are number of web scraping software and services available in the market like Visual Web Ripper, Mozenda, Kimono Labs, Outwit Hub, ScraperWiki and Automation Anywhere etc. for web data extraction. These all tools and services are paid and not easy to use for non-technical persons. Now I am going to discuss another method of doing web scraping that is easy to use and free.  There are various Google Chrome browser extensions available at Google Web Store (https://chrome.google.com/webstore/category/apps) using that we can do screen scraping/web scraping. Read More…

Jul 122015 Tagged with , , 0 Responses

PHP script for renaming files

You might downloaded large amount of images or PDFs while doing web scraping of e-commerce store products, blog posts and in many other cases. Most of web scraping tool provides file downloading either they are csv, vcf, images (jpg,jpeg,gif,png), pdf or other kind of files but many of them do not provide way to rename them or add extension to them if it’s not present.

php script to rename images

I have encountered a problem specially with image files – many websites have images but they do not have the extension and web scraper just download files as it is as example given below, they are the file names downloaded using web scraper but they don’t have extension .jpg or .png!! Read More…

Jul 112015 Tagged with , , , 0 Responses

Run Code Template – New Feature Added to Fminer Web Scraping Tool

Fminer-Run-Code-Template-Scraping-ToolFminer is one of the powerful web scraping software, I already given brief of all the Fminer features in previous post. In this post I am going to introduce one of the interesting feature of fminer which is Run Code Template that is recently added to Fminer, this feature is similar to “Fminer Run Code” action but it’s different in a way you can use it. The Run Code Action you can use inside the data scraping flow and python code get executed when scraper start running. Read More…

Apr 252015 Tagged with , , 0 Responses

Things to take care while doing Web Scraping!!!

In the present day and age, web scraping word becomes most popular in data science. Basically web scraping is extracting the information from the websites using pre-written programs and web scraping scripts. Many organizations have successfully used web site scraping to build relevant and useful database that they use on a daily basis to enhance their business interests. This is the age of the Big Data and web scraping is one of the trending techniques in the data science. Read More…

Mar 222015 Tagged with , , , 1 Response

Python code to connect with MySQL and SQL Server database in Fminer

Fminer Run CodeFminer is powerful web scraping tool as well as best browser automation tool that support many features that web scraping software needs. Some of the Fminer’s key feature are Support of Multithreading, Captcha solving feature, set actions to deal with browser automation like Input text into text field, select option from drop down, choose radio button and check boxes, project scheduling and email feature, custom  Proxy support and many more. You can read detail on each feature of fminer on my previous post Fminer – Visual Web Scraping Software With Macro Recorder and Diagram Designer Read More…

Jan 112015 Tagged with , , 0 Responses

Web Scraping – A trending technique in data science!!!

Web scraping as a market segment is trending to be an emerging technique in data science to become an integral part of many businesses – sometimes whole companies are formed based on web scraping. Web scraping and extraction of relevant data gives businesses an insight into market trends, competition, potential customers, business performance etc.  Now question is that “what is actually web scraping and where is it used???” Let us explore web scraping, web data extraction, web mining/data mining or screen scraping in details.

Web Scraping Process

Read More…

1 2 3