App

ScrapFly integrations

Connect ScrapFly to any other app, or use it from your AI client over MCP. ScrapFly is a web scraping API for extracting data from web pages through automatic proxy rotation, managed headless browsers, and anti-bot bypass.

Connects with an API keyscrapfly.io

What the catalog holds today. Ask for anything missing and your agent reads the API documentation and adds it.

Build solutions, not workarounds.

What do you want to automate with ScrapFly?

Ask the assistant

You'll sign in before anything runs. What you typed comes with you.

Connect your AI client

Give your AI client this address.

https://mcp.apiant.ai

One connection does both: ask your client to act in an app once, or have it build an automation that keeps running. Any client that takes a remote MCP server. Nothing to install. Create your free account, then sign in once in your browser.

Set it up in your client
Claude Code

Run this in the directory you want to work in.

claude mcp add --transport http -s project apiant-ai https://mcp.apiant.ai

Start Claude Code there, approve the server, and sign in in the browser page it opens.

Claude Code guide (opens in a new tab)
Claude, web and desktop

Open Customize, then Connectors, then Add custom connector, and paste the address. On Team and Enterprise an owner adds it first.

Setup guide (opens in a new tab)
Cursor

Add the address to your MCP configuration as a server URL. Cursor signs you in in your browser.

Setup guide (opens in a new tab)
Zed

Open Settings, then AI, then MCP Servers, then Add Server, then Add Remote Server.

Setup guide (opens in a new tab)
Codex and the ChatGPT desktop app

Open Settings, then MCP servers, then Add server, and choose Streamable HTTP. From the terminal, Codex takes the address with its own add command and then signs you in.

Setup guide (opens in a new tab)
Any other MCP client

Paste the address where the client asks for a remote MCP server URL, and name the server apiant-ai where it lets you. APIANT's skills reach the client over the same connection.

Setup guide (opens in a new tab)

Pair it

Connect ScrapFly with another app

What your agent can do with ScrapFly

Triggers and actions 7 actions

  • Action
    Add crawl

    Start a recursive website crawl job.

  • Action
    AI Data Extraction

    Automatically extract structured data from any text content such as HTML, Text, Markdown using AI, LLM and custom parsing instructions.

  • Action
    Get crawl artifact

    Downloads the finished archive of a crawl: a WARC file (compressed web archive with every request and response) or a HAR file (JSON HTTP archive). The artifact is only available once the crawl has finished.

  • Action
    Get crawl status

    Retrieve the status/progress of a previously started crawl.

  • Action
    Scrape Page

    Scrapes a web page through the Scrapfly Web Scraping API and returns its content, the upstream status and scrape metadata.

  • Action
    Screenshot Web Page

    Captures a screenshot of a web page with ScrapFly's Screenshot API and returns the URL where the stored image can be downloaded.

  • Action
    Send Web Scraping API Request

    Sends a request to any web page through Scrapfly's Web Scraping API, with your choice of HTTP method, request body and custom headers, and returns the scraped content along with the scrape details.

Reviews

What our customers say

Questions

ScrapFly, answered

Is there a ScrapFly MCP server?

APIANT's MCP server at https://mcp.apiant.ai works with ScrapFly. Add that address to any AI client that takes a remote MCP server and sign in once in your browser. Your client can then run ScrapFly actions on demand, or have APIANT build, test and run automations that use ScrapFly. Nothing to install.

What can your agent do in ScrapFly?

Any of ScrapFly's 7 actions, including Send Web Scraping API Request, Add crawl, AI Data Extraction and Get crawl artifact. Your agent maps the data both ways and tests every scenario before it ships.

Can I use ScrapFly directly from Claude, ChatGPT or Cursor?

Yes. Connect your AI client to APIANT once and it works with ScrapFly two ways. Ask it to do something in ScrapFly once and it runs that action on the spot. Ask for an automation and your agent builds it, tests every scenario and keeps it running on its own. A one-off action uses your plan's tasks the same way an automation step does.

Do I need to write code against the ScrapFly API?

No. APIANT connects to the ScrapFly API for you, with your ScrapFly API key. Describe what you want in plain language and your agent builds it on the ScrapFly triggers and actions in the catalog. If you need an endpoint that is not there yet, your agent reads the ScrapFly API documentation and adds it.

Which apps can ScrapFly connect to?

Any app in the catalog; the list on this page pairs ScrapFly with each of them. If the other app is missing, point your agent at its API documentation and it builds the connector.

What happens when something fails?

Your agent works that out for you. It plans the failure paths along with the happy path, then tests every scenario before it ships.

Is there a free plan?

Yes. Every plan includes the agent, including free, and building from your own AI client spends no assistant credits.