Skip to content
  • Home
  • Real Estate
  • Secretary Of States
  • Learn to Web Scrape

Javascript Web Scraping Guy

Jordan's Adventures Through Web Automation

You Are Here
  • Home
  • Web Scraping
  • Page 6

Category: Web Scraping

Jordan Scrapes Amazon For Private Label Products (work in progress)
March 25, 2019March 25, 2019 Jordan Hansen

Jordan Scrapes Amazon For Private Label Products (work in progress)

Amazon Tools, Web Scraping

So. I have some code ready here but it’s not actually “ready”. This post is going to be some discussion about my goals and some

Read More
March 18, 2019 Jordan Hansen

Jordan Scrapes Pinterest for Recipes (with infinite scrolling)

Web Scraping

Demo code here I have a confession to make. I’m not on the Pinterest bandwagon. My wife loves it. I don’t know how to use

Read More
March 11, 2019March 6, 2019 Jordan Hansen

Jordan Automates Builds and Testing with Travis-CI

Unit Tests, Web Scraping

Demo Code Here I talked a lot about unit testing last week. I really feel that unit testing is a critical part of maintaining code.

Read More
Jordan Unit Tests Web Scraping Done with Request
March 4, 2019March 3, 2019 Jordan Hansen

Jordan Unit Tests Web Scraping Done with Request

Unit Tests, Web Scraping

Demo code here Okay, it’s not actually request I’m testing here but request-promise. I am just going to test the code I built last week

Read More
Jordan scrapes Craigslist and then automates emailing the results to himself
February 25, 2019March 5, 2019 Jordan Hansen

Jordan scrapes Craigslist and then automates emailing the results to himself

Web Scraping

Demo code here Note that this code has been refactored to be more testable on 3/4/2019. I’m in the market for a car. I have a truck right now and since I work from home it really

Read More
February 18, 2019February 20, 2019 Jordan Hansen

Setting up Puppeteer on Ubuntu 16.04 and Digital Ocean

Web Scraping

This is going to be a tutorial on how to set up Puppeteer to work on Ubuntu 16.04 using a Digital Ocean droplet. While I

Read More
Ethics of Web Scraping
February 11, 2019February 3, 2019 Jordan Hansen

Ethics of Web Scraping

Web Scraping

As of today, I have three scrapers that I run regularly. Two scrape government websites and one scrapes Amazon. With at least two of these,

Read More
Jordan Scrapes the Idaho Board of Medicine for Newly Licensed Doctors
February 4, 2019February 8, 2019 Jordan Hansen

Jordan Scrapes the Idaho Board of Medicine for Newly Licensed Doctors

Web Scraping

Demo code here I have a physical therapist friend that started me on this idea. He mentioned one time at lunch that most of his

Read More
Jordan Mass Scrapes Amazon for Potential Products (Part 2 of 2)
January 28, 2019February 2, 2019 Jordan Hansen

Jordan Mass Scrapes Amazon for Potential Products (Part 2 of 2)

Amazon Tools, Web Scraping

Demo code here This is the second and final part of mass scraping Amazon. The first part is here. In this part, I want to

Read More
Jordan Mass Scrapes Amazon for Potential Products (Part 1 of 2)
January 21, 2019April 16, 2019 Jordan Hansen

Jordan Mass Scrapes Amazon for Potential Products (Part 1 of 2)

Amazon Tools, Web Scraping

Demo code here A few weeks ago I shared a post I wrote about scraping Amazon for potential products on reddit. It got some cool

Read More
« Prev 1 … 4 5 6 7 Next »

Business Leads

cobaltintelligence

scraperapi

Twitter and Github

  • Twitter
  • Github

Recent Posts

  • Finding tax sales from Tarrant county, TX
  • Ohio – Cobalt Int’s Secretary of State API
  • Seobase, SEO tools that you need
  • Kansas, part 2 – Cobalt Int’s Secretary of State API
  • Kansas, part 1 – Secretary of State API
All Right Reserved 2019