Scraping the Utah Secretary of State Part 1
Here we go! This is the first of a few parts of scraping the Utah Secretary of State. Utah uses a pretty complicated way to
Web scraping with Puppeteer
Sample code here Another quick video showing the basics of web scraping with Puppeteer.
Basic Web Scraping with Nodejs and Cheerio
Sample code here Very basic code showing how to web scrape with Nodejs and Cheerio.
Using Puppeteer with a proxy
Sample code here This shows how to use Puppeteer with a proxy using both Luminati and Proxycrawl. Video guide: Luminati is a more intense solution
Getting Puppeteer working on Lambda.
Very frustrating slight echo in this video. Sorry! Puppeteer on Lambda. Can it be done? Yes! I ended up using the chrome-aws-lambda package. It was
Jordan Scrapes North Carolina, Part 2. AWS Lambda and Dynamo DB
This is part 2 of the video to scrape North Carolina. This time finished off the scrape and getting the data. I also was able
Jordan Scrapes North Carolina for Lambda. Part 1
This is part 1 of the video to scrape North Carolina. This time it was just working on the scrape. In the next videos we’ll
Jordan Finishes California in AWS Lambda and DynamoDB
Final video for the California Secretary of State. First video and second video. California businesses aren’t always sequential (sosId #7 had a filingDate of 11-11-2020
Jordan Uses Proxycrawl
Demo code here This is a sponsored blog post by Proxycrawl. All reviews and opinions expressed here are, however, based on my personal experience. Video walk through: Proxycrawl is where we
Scraping California, Part 3. Mostly final polish
This post is really the final polish on the code I’ve been working on to scrape the California Secretary of State. Here is the first