Web Scraping Blog

Guides on how to obtain data from all over the web

Secretary of State API

Get business data from the Secretary of States, all via API.
If you have a business name or entity id, you can automate this collection of business data with the Secretary of State API. These tutorials can help you make it happen.

        let url = `https://apigateway.cobaltintelligence.com/search?searchQuery=${encodeURIComponent(businessName)}&state=${state}`;

        if (liveData) {
            url += '&liveData=true';

        const axiosResponse = await axios.get(url, {
            headers: {
                'x-api-key': this.apiKey

        // This will take longer
        if (axiosResponse.data?.retryId) {
            // Handle retryId

        return axiosResponse.data;

Hey there. Want to be friends?

I’ll be straight with you. I’m going to want to show off my web scraping genius. But I want to hear about your web scraping troubles and successes as well.

And I like you. So I won’t be one of those weird friends who is always calling. What do you say?