Skip to content
  • Home
  • Real Estate
  • Secretary Of States
  • Learn to Web Scrape

Javascript Web Scraping Guy

Jordan's Adventures Through Web Automation

July 1, 2019June 28, 2019 Jordan Hansen

Jordan Productizes the Link Checker

Link Checking

Sample code here What is productizing? I’ve really started to like this link checker. I decided it was time to make it more product ready.

Read More
Jordan Takes Advantage of Multithreaded I/O in Nodejs
June 24, 2019June 24, 2019 Jordan Hansen

Jordan Takes Advantage of Multithreaded I/O in Nodejs

Link Checking

Sample code here Dead link checking never dies I have been playing with this repository for three to four weeks now. It kind of feels

Read More
Jordan Plays Pool (multi-threading with a pool queue)
June 17, 2019June 23, 2019 Jordan Hansen

Jordan Plays Pool (multi-threading with a pool queue)

Link Checking

Sample code here Reddit commentor I actually love reddit. I love that I can find feedback from real people on almost ANY subject. And a

Read More
Jordan Is Speed (speeding up scraping with multiple threads)
June 10, 2019June 29, 2019 Jordan Hansen

Jordan Is Speed (speeding up scraping with multiple threads)

Link Checking, Threading

Sample code here Story so far This is a follow up on my post about dead link checking. I still do like this piece of

Read More
June 3, 2019June 21, 2019 Jordan Hansen

Jordan Does Dead Link Checking

Link Checking

Update as of June 21, 2019: I moved the branch from master to singlethreaded-io since I decided this wasn’t the ideal way to go. I have several posts trying different

Read More
The Cost of a Software Bug
May 27, 2019May 19, 2019 Jordan Hansen

The Cost of a Software Bug

Integration Tests

I’ve been focusing a lot on testing and web testing in my last few posts. I have a post that talks about the different tests

Read More
Jordan Upgrades Integration Tests and Includes Puppeteer-Firefox
May 20, 2019May 14, 2019 Jordan Hansen

Jordan Upgrades Integration Tests and Includes Puppeteer-Firefox

Integration Tests, Puppeteer

Demo code here – Pull request showing changes This post on further upgrading integration tests is based on the previous article that I did here

Read More
Integration tests are good?
May 13, 2019May 9, 2019 Jordan Hansen

Integration tests are good?

Integration Tests

Yes! No. Well, it all depends. The fact is, generally more testing is better. Integration tests are just a piece of the puzzle. I should

Read More
Puppeteer on Ubuntu 16.04 and Digital Ocean for Integration Tests
May 6, 2019August 12, 2019 Jordan Hansen

Puppeteer on Ubuntu 16.04 and Digital Ocean for Integration Tests

Integration Tests

Demo code here Last week I posted about doing integration tests with Puppeteer. This week I want to go more into how to automate these

Read More
Jordan Does Integration Tests on Citadel Packaging
April 30, 2019April 30, 2019 Jordan Hansen

Jordan Does Integration Tests on Citadel Packaging

Integration Tests

Demo code here The next few posts are going to be on integration testing using Puppeteer. I really, really am loving Puppeteer. It’s a really

Read More
« Prev 1 … 8 9 10 11 12 13 Next »

Business Leads

cobaltintelligence

scraperapi

Twitter and Github

  • Twitter
  • Github

Recent Posts

  • Finding tax sales from Tarrant county, TX
  • Ohio – Cobalt Int’s Secretary of State API
  • Seobase, SEO tools that you need
  • Kansas, part 2 – Cobalt Int’s Secretary of State API
  • Kansas, part 1 – Secretary of State API
All Right Reserved 2019