Find Jobs
Hire Freelancers

Web scrape of 5-7 online retailers using Ruby Mechanize/Watir/Nokogiri

$25-50 AUD / hour

Cerrado
Publicado hace más de 6 años

$25-50 AUD / hour

I run a data analytics consultancy in Sydney, Australia. I have a requirement to setup weekly scrapes of at least 5 large (50,000+ SKUs) online retail websites. The project will be split to scrape a single website to start with, extending to the others assuming satisfaction with the work completed. Technical requirements: - Scrapes must be written in Ruby using Mechanize/Nokogiri or Watir as appropriate - Where possible, avoiding JS and scrape via direct HTTP requests using Mechanize - i.e requires strong skills in tracing/debugging HTTP requests/responses - Alternatively, load page using Watir webdriver then pass off cookies to Mechanize - Last resort would be brute force Watir webdriver approach (scroll, point, click, etc) - Implement utilities for use of proxy / IP rotation where required (access to pool of anonymous IP addresses will be provided) - Scheduling via cron job to run at least weekly - Must use object oriented approach and design in a DRY manner so that code can be leveraged for future scrapes of additional sites and ensure future code manageability - Must use Activerecord to persist records scraped - Must implement logging (production logging to file + verbose debug option to STDOUT) Personal requirements: - Must be a great communicator both in terms of coding concepts and project management - Good at clearly laying out the workplan, milestones and progress - Must be available for 2x daily stand-up calls with Sydney AUS (timing TBC at mutually agreed time) - Must be able to demonstrate prior experience with ruby web scrape projects similar to above - Code must be well-structured and well-documented / commented Opportunity for ongoing Ruby backend and RoR web app build if this project is a success.
ID del proyecto: 15682987

Información sobre el proyecto

13 propuestas
Proyecto remoto
Activo hace 6 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
13 freelancers están ofertando un promedio de $36 AUD /hora por este trabajo
Avatar del usuario
Hi, aaronjcowper! I’m experienced Python developer, and web-scraping is one of my main fields of knowledge, so I’m 100% confident that I can complete your project using Python as programming language. I completed hundreds of web-scraping projects and there were no situations when I could not retrieve some data.
$45 AUD en 40 días
5,0 (56 comentarios)
7,6
7,6
Avatar del usuario
Hi, I am Full stack Ruby on Rails developer. I can provide you best design, highly secure & best performance website regarding your needs. From development to production respecting testing & continuos-zero downtime deployment. I can assure you quality of my work. My Skills: - Ruby - Ruby on Rails - System Admin - Git, Bitbucket - MySQL , PostgreSQL - HTML5 , CSS3, SCSS, HAML, slim - javascript, coffeescript, jQuery - Ajax - Hosting & Maintaining any platform - RSpec (Test Driven Development) - Spree Ecommerce - Web Scraping - Shopify Thank you for your time and consideration. I look forward to speaking with you about this employment opportunity. Sincerely, Mezbah Alam
$27 AUD en 40 días
5,0 (32 comentarios)
5,8
5,8
Avatar del usuario
Hi, I'm Prem. I have 5+ years experience with scraping and automating the web with Ruby. I have used Watir, Nokogiri and Mechanize in the past. I have experience scraping fb, twitter, G+, aliexpress, amazon and many more. I can handle proxies and have solved Recaptcha's by using Deathbycaptcha service. Since I'm also a Rails dev I don't have to problem using AR to persist the data. Initiate chat to discuss. Thanks
$44 AUD en 40 días
5,0 (14 comentarios)
4,5
4,5
Avatar del usuario
Hi! After reading your job description, I noticed I'm fit freelancer for your project. I agree all of your requirements from you job description. Please send me a message so that we can discuss more. Andrey
$55 AUD en 40 días
5,0 (1 comentario)
4,3
4,3
Avatar del usuario
We are team of Developers having rich experience with Ruby on Rails & Ruby. We have done extensive research on Heroku/AWS. The Technical team consists of Programmers having experience more than 6 years.
$45 AUD en 58 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de AUSTRALIA
Maroubra, Australia
5,0
3
Forma de pago verificada
Miembro desde jun 2, 2017

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.