Data Import & Website Scraping

We are looking for an intermediate to advanced (PHP or Rails) developer to scrape information from a particular website for specific list of data that will be provided. The final deliverables are: 1. An excel spreadsheet with all the collected information in a format that will be provided 2. Either a PHP script or a Rails task (either is fine) which is used to scrape the information, including an SQL file for your MySQL database. It is anticipated that the steps in this project will be similar to: 1. Analyze a few sample pages from the site to map required fields to the excel spreadsheet. 2. Propose a list of changes to the spreadsheet if necessary. 3. Build the import script to save data into a MySQL database. The database structure is up to you, so long as you can easily complete step 3 below with your structure. - Note that at the start of the project you will be given another excel spreadsheet with the same structure but it will include existing data in our system. Your import script will need to include a step to check for duplicates (i.e. if a data point with a similar name and address is already in the system, do not import). Export from MySQL into an Excel sheet in the same format as the example sheet provided. This does not have to be automated because we are not expecting to run the import script regularly, you can do this manually (e.g. export and remove columns, etc).