Parse a site to LLM-ready text
You can parse a single webpage into LLM-ready markdown, or you can crawl a site and parse all of the crawled pages into markdown. This is useful if you have your own LLM system and just want access to webpage content.
Parse a single webpage
from fixpoint.client import FixpointClient
from fixpoint.client.types import CreateWebpageParseRequest, WebpageSource
client = FixpointClient(api_key="...")
parsed = await client.parses.webpage.create(
CreateWebpageParseRequest(
workflow_id="my-parsing-workflow",
source=WebpageSource(url=site),
)
)
print(parsed.content)
Crawl multiple pages and parse them
from fixpoint.client import AsyncFixpointClient
from fixpoint.client.types import CreateCrawlUrlParseRequest, CrawlUrlSource
parsed = await client.parses.crawl.create(
CreateCrawlUrlParseRequest(
workflow_id="my-parsing-workflow",
source=CrawlUrlSource(
crawl_url=site,
depth=2,
page_limit=3,
),
)
)
for page in parsed.page_contents:
print(page.source.url)
print(page.content)
print("\n\n")