diff --git a/cookbook/company-info/scrapegraph_sdk.ipynb b/cookbook/company-info/scrapegraph_sdk.ipynb
index 50ee223..4e7f5bb 100644
--- a/cookbook/company-info/scrapegraph_sdk.ipynb
+++ b/cookbook/company-info/scrapegraph_sdk.ipynb
@@ -6,7 +6,7 @@
"id": "jEkuKbcRrPcK"
},
"source": [
- "## 🕷️ Extract Company Info with Official Scrapegraph SDK\n"
+ "## 🕷️ Extract Company Info with Official Scrapegraph SDK"
]
},
{
diff --git a/cookbook/homes-forsale/scrapegraph_sdk.ipynb b/cookbook/homes-forsale/scrapegraph_sdk.ipynb
new file mode 100644
index 0000000..59e7b16
--- /dev/null
+++ b/cookbook/homes-forsale/scrapegraph_sdk.ipynb
@@ -0,0 +1,965 @@
+{
+ "cells": [
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "jEkuKbcRrPcK"
+ },
+ "source": [
+ "## \ud83d\udd77\ufe0f Extract Houses Listing with Official Scrapegraph SDK\n",
+ "\n",
+ "[](https://www.runalph.ai/notebooks/scrapegraphai/scrapegraph-sdk-2) [](https://colab.research.google.com/drive/1HHBUSFAHD_IvdeTAF60p6mtmeabo1s9P?usp=sharing)"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "8vZBkAWLq9C1"
+ },
+ "source": [
+ ""
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "IzsyDXEWwPVt"
+ },
+ "source": [
+ "### \ud83d\udd27 Install `dependencies`"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 13,
+ "metadata": {
+ "id": "os_vm0MkIxr9"
+ },
+ "outputs": [],
+ "source": [
+ "%%capture\n",
+ "!pip install scrapegraph-py"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "apBsL-L2KzM7"
+ },
+ "source": [
+ "### \ud83d\udd11 Import `ScrapeGraph` API key"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "ol9gQbAFkh9b"
+ },
+ "source": [
+ "You can find the Scrapegraph API key [here](https://scrapegraphai.com/dashboard)"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 14,
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "id": "sffqFG2EJ8bI",
+ "outputId": "18dfce64-db37-4825-d316-fabd064100d0"
+ },
+ "outputs": [],
+ "source": [
+ "import getpass\n",
+ "import os\n",
+ "\n",
+ "if not os.environ.get(\"SGAI_API_KEY\"):\n",
+ " os.environ[\"SGAI_API_KEY\"] = getpass.getpass(\"Scrapegraph API key:\\n\")"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "jnqMB2-xVYQ7"
+ },
+ "source": [
+ "### \ud83d\udcdd Defining an `Output Schema` for Webpage Content Extraction\n"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "VZvxbjfXvbgd"
+ },
+ "source": [
+ "If you already know what you want to extract from a webpage, you can **define an output schema** using **Pydantic**. This schema acts as a \"blueprint\" that tells the AI how to structure the response.\n",
+ "\n",
+ "\n",
+ " Pydantic Schema Quick Guide
\n",
+ "\n",
+ "Types of Schemas \n",
+ "\n",
+ "1. Simple Schema \n",
+ "Use this when you want to extract straightforward information, such as a single piece of content. \n",
+ "\n",
+ "```python\n",
+ "from pydantic import BaseModel, Field\n",
+ "\n",
+ "# Simple schema for a single webpage\n",
+ "class PageInfoSchema(BaseModel):\n",
+ " title: str = Field(description=\"The title of the webpage\")\n",
+ " description: str = Field(description=\"The description of the webpage\")\n",
+ "\n",
+ "# Example Output JSON after AI extraction\n",
+ "{\n",
+ " \"title\": \"ScrapeGraphAI: The Best Content Extraction Tool\",\n",
+ " \"description\": \"ScrapeGraphAI provides powerful tools for structured content extraction from websites.\"\n",
+ "}\n",
+ "```\n",
+ "\n",
+ "2. Complex Schema (Nested) \n",
+ "If you need to extract structured information with multiple related items (like a list of repositories), you can **nest schemas**.\n",
+ "\n",
+ "```python\n",
+ "from pydantic import BaseModel, Field\n",
+ "from typing import List\n",
+ "\n",
+ "# Define a schema for a single repository\n",
+ "class RepositorySchema(BaseModel):\n",
+ " name: str = Field(description=\"Name of the repository (e.g., 'owner/repo')\")\n",
+ " description: str = Field(description=\"Description of the repository\")\n",
+ " stars: int = Field(description=\"Star count of the repository\")\n",
+ " forks: int = Field(description=\"Fork count of the repository\")\n",
+ " today_stars: int = Field(description=\"Stars gained today\")\n",
+ " language: str = Field(description=\"Programming language used\")\n",
+ "\n",
+ "# Define a schema for a list of repositories\n",
+ "class ListRepositoriesSchema(BaseModel):\n",
+ " repositories: List[RepositorySchema] = Field(description=\"List of GitHub trending repositories\")\n",
+ "\n",
+ "# Example Output JSON after AI extraction\n",
+ "{\n",
+ " \"repositories\": [\n",
+ " {\n",
+ " \"name\": \"google-gemini/cookbook\",\n",
+ " \"description\": \"Examples and guides for using the Gemini API\",\n",
+ " \"stars\": 8036,\n",
+ " \"forks\": 1001,\n",
+ " \"today_stars\": 649,\n",
+ " \"language\": \"Jupyter Notebook\"\n",
+ " },\n",
+ " {\n",
+ " \"name\": \"TEN-framework/TEN-Agent\",\n",
+ " \"description\": \"TEN Agent is a conversational AI powered by TEN, integrating Gemini 2.0 Multimodal Live API, OpenAI Realtime API, RTC, and more.\",\n",
+ " \"stars\": 3224,\n",
+ " \"forks\": 311,\n",
+ " \"today_stars\": 361,\n",
+ " \"language\": \"Python\"\n",
+ " }\n",
+ " ]\n",
+ "}\n",
+ "```\n",
+ "\n",
+ "Key Takeaways \n",
+ "- **Simple Schema**: Perfect for small, straightforward extractions. \n",
+ "- **Complex Schema**: Use nesting to extract lists or structured data, like \"a list of repositories.\" \n",
+ "\n",
+ "Both approaches give the AI a clear structure to follow, ensuring that the extracted content matches exactly what you need.\n",
+ " \n"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 15,
+ "metadata": {
+ "id": "dlrOEgZk_8V4"
+ },
+ "outputs": [],
+ "source": [
+ "from pydantic import BaseModel, Field\n",
+ "from typing import List, Optional\n",
+ "\n",
+ "# Schema for a single house listing\n",
+ "class HouseSchema(BaseModel):\n",
+ " price: int = Field(description=\"Price of the house in USD\")\n",
+ " bedrooms: int = Field(description=\"Number of bedrooms\")\n",
+ " bathrooms: int = Field(description=\"Number of bathrooms\")\n",
+ " square_feet: int = Field(description=\"Total square footage of the house\")\n",
+ " address: str = Field(description=\"Address of the house\")\n",
+ " city: str = Field(description=\"City where the house is located\")\n",
+ " state: str = Field(description=\"State where the house is located\")\n",
+ " zip_code: str = Field(description=\"ZIP code of the house location\")\n",
+ " tags: List[str] = Field(description=\"Tags like 'New construction' or 'Large garage'\")\n",
+ " agent_name: str = Field(description=\"Name of the listing agent. If not present or not sure write NA.\")\n",
+ " agency: str = Field(description=\"Agency listing the house. If not present or not sure write NA.\")\n",
+ "\n",
+ "# Schema containing a list of house listings\n",
+ "class HouseListingsSchema(BaseModel):\n",
+ " houses: List[HouseSchema] = Field(description=\"List of house listings on Homes or similar platforms\")\n"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "cDGH0b2DkY63"
+ },
+ "source": [
+ "### \ud83d\ude80 Initialize `SGAI Client` and start extraction"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "4SLJgXgcob6L"
+ },
+ "source": [
+ "Initialize the client for scraping (an async version using `AsyncScrapeGraphAI` is available [here](https://github.com/ScrapeGraphAI/scrapegraph-py/blob/main/examples/extract/extract_basic_async.py))."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 16,
+ "metadata": {
+ "id": "PQI25GZvoCSk"
+ },
+ "outputs": [],
+ "source": [
+ "from scrapegraph_py import ScrapeGraphAI, FetchConfig\n",
+ "\n",
+ "sgai_client = ScrapeGraphAI()"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "M1KSXffZopUD"
+ },
+ "source": [
+ "Use the `extract` method to pull structured data from a URL with AI. The same method also accepts raw `html=` or `markdown=` if you already have the page content."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 17,
+ "metadata": {
+ "id": "2FIKomclLNFx"
+ },
+ "outputs": [],
+ "source": [
+ "repo_response = sgai_client.extract(\n",
+ " \"Extract info about the houses visible on the page\",\n",
+ " url=\"https://www.homes.com/san-francisco-ca/?bb=nzpwspy0mS749snkvsb\",\n",
+ " schema=HouseListingsSchema.model_json_schema(),\n",
+ " fetch_config=FetchConfig(stealth=True),\n",
+ ")"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "YZz1bqCIpoL8"
+ },
+ "source": [
+ "Print the response"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 18,
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "id": "F1VfD8B4LPc8",
+ "outputId": "1e849a65-6713-486c-e306-bb7c26db4bf9"
+ },
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ "Tokens used: prompt_tokens=35749 completion_tokens=18404\n",
+ "House listings:\n",
+ "{\n",
+ " \"houses\": [\n",
+ " {\n",
+ " \"price\": 409181,\n",
+ " \"bedrooms\": 1,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 608,\n",
+ " \"address\": \"280 Spear St Unit 2B\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94105\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"David Yi\",\n",
+ " \"agency\": \"Light Realty Inc.\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1088000,\n",
+ " \"bedrooms\": 6,\n",
+ " \"bathrooms\": 3,\n",
+ " \"square_feet\": 1306,\n",
+ " \"address\": \"766 Thornton Ave\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94124\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Kriss Miranda\",\n",
+ " \"agency\": \"Century 21 Masters\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1799000,\n",
+ " \"bedrooms\": 3,\n",
+ " \"bathrooms\": 3,\n",
+ " \"square_feet\": 0,\n",
+ " \"address\": \"1151 Fell St\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94117\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Amanda Jones\",\n",
+ " \"agency\": \"Compass\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1198000,\n",
+ " \"bedrooms\": 1,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1114,\n",
+ " \"address\": \"333 Beale St Unit 6I\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94105\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Milan Jezdimirovic\",\n",
+ " \"agency\": \"Compass\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 2099000,\n",
+ " \"bedrooms\": 2,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1865,\n",
+ " \"address\": \"690 Market St Unit 2404\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94104\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Milan Jezdimirovic\",\n",
+ " \"agency\": \"Compass\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 3895000,\n",
+ " \"bedrooms\": 3,\n",
+ " \"bathrooms\": 3,\n",
+ " \"square_feet\": 2390,\n",
+ " \"address\": \"1100 Sacramento St Unit 302\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94108\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Betty Taisch\",\n",
+ " \"agency\": \"Compass\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1399000,\n",
+ " \"bedrooms\": 4,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 2500,\n",
+ " \"address\": \"3755-3759 Mission St\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94110\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Chuck Barberini\",\n",
+ " \"agency\": \"Century21 Masters\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1328888,\n",
+ " \"bedrooms\": 3,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1622,\n",
+ " \"address\": \"493 Cambridge St\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94134\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Guillean Arradaza\",\n",
+ " \"agency\": \"Kinetic Real Estate\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1795000,\n",
+ " \"bedrooms\": 3,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 0,\n",
+ " \"address\": \"170 Pacific Ave Unit 43\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94111\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Beverly Barnett\",\n",
+ " \"agency\": \"Compass\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 699000,\n",
+ " \"bedrooms\": 1,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 650,\n",
+ " \"address\": \"1865 California St Unit 2\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94109\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Raul Isais\",\n",
+ " \"agency\": \"Coldwell Banker Realty\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 525000,\n",
+ " \"bedrooms\": 2,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 710,\n",
+ " \"address\": \"241 14th St\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94103\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Betty Taisch\",\n",
+ " \"agency\": \"Compass\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1098000,\n",
+ " \"bedrooms\": 2,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 936,\n",
+ " \"address\": \"53 Alpine Terrace\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94117\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Amanda Jones\",\n",
+ " \"agency\": \"Compass\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 949000,\n",
+ " \"bedrooms\": 2,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1326,\n",
+ " \"address\": \"60 Rausch St Unit 407\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94103\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Betty Taisch\",\n",
+ " \"agency\": \"Compass\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 998000,\n",
+ " \"bedrooms\": 3,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1414,\n",
+ " \"address\": \"108 Schwerin St\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94134\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Cooper Gaines\",\n",
+ " \"agency\": \"eXp Realty of Northern CA, Inc\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 89000,\n",
+ " \"bedrooms\": 2,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1132,\n",
+ " \"address\": \"900 N Point St Unit 312\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94109\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Houy Kirkpatrick\",\n",
+ " \"agency\": \"Compass\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 2199000,\n",
+ " \"bedrooms\": 8,\n",
+ " \"bathrooms\": 4,\n",
+ " \"square_feet\": 3780,\n",
+ " \"address\": \"1012 Page St\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94117\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Erica Marr\",\n",
+ " \"agency\": \"NA\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1650000,\n",
+ " \"bedrooms\": 2,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1601,\n",
+ " \"address\": \"301 Mission St Unit 36F\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94105\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"The Andrighetto Group\",\n",
+ " \"agency\": \"The Agency\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 360000,\n",
+ " \"bedrooms\": 1,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 554,\n",
+ " \"address\": \"788 Minna St Unit 203\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94103\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"NA\",\n",
+ " \"agency\": \"NA\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1050000,\n",
+ " \"bedrooms\": 1,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 865,\n",
+ " \"address\": \"200 Brannan St Unit 132\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94107\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"The Andrighetto Group\",\n",
+ " \"agency\": \"The Agency\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 449000,\n",
+ " \"bedrooms\": 0,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 0,\n",
+ " \"address\": \"357 Vallejo St Unit 361A\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94133\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Jennifer Jones\",\n",
+ " \"agency\": \"eXp Realty of Northern CA Inc.\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 910000,\n",
+ " \"bedrooms\": 1,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 910,\n",
+ " \"address\": \"403 Main St Unit 506N\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94105\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Kevin Kearney\",\n",
+ " \"agency\": \"Coldwell Banker Realty\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 6000000,\n",
+ " \"bedrooms\": 5,\n",
+ " \"bathrooms\": 4,\n",
+ " \"square_feet\": 4100,\n",
+ " \"address\": \"2830 Buchanan St\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94123\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Travis Hale\",\n",
+ " \"agency\": \"Sotheby's International Realty\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 850000,\n",
+ " \"bedrooms\": 2,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1500,\n",
+ " \"address\": \"1200 Gough St Unit 2A\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94109\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Travis Hale\",\n",
+ " \"agency\": \"Sotheby's International Realty\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1695000,\n",
+ " \"bedrooms\": 3,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 0,\n",
+ " \"address\": \"263 Carl St\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94117\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Beverly Barnett\",\n",
+ " \"agency\": \"Compass\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 995000,\n",
+ " \"bedrooms\": 2,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1957,\n",
+ " \"address\": \"422 Tehama St\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94103\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Luba Muzichenko\",\n",
+ " \"agency\": \"Vanguard Properties\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1750000,\n",
+ " \"bedrooms\": 3,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1657,\n",
+ " \"address\": \"156 Lombard St Unit 37\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94111\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Marsha Williams\",\n",
+ " \"agency\": \"Christie's Int'l Real Estate\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1695000,\n",
+ " \"bedrooms\": 3,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1532,\n",
+ " \"address\": \"958 Teresita Blvd\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94127\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Dan Dodd\",\n",
+ " \"agency\": \"Vanguard Properties\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1298000,\n",
+ " \"bedrooms\": 7,\n",
+ " \"bathrooms\": 4,\n",
+ " \"square_feet\": 2790,\n",
+ " \"address\": \"801 Vienna St\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94112\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Cecilia Mu\",\n",
+ " \"agency\": \"Real Brokerage Technologies\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1185000,\n",
+ " \"bedrooms\": 1,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 666,\n",
+ " \"address\": \"181 Fremont St Unit 54J\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94105\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Milan Jezdimirovic\",\n",
+ " \"agency\": \"Compass\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 949000,\n",
+ " \"bedrooms\": 2,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 883,\n",
+ " \"address\": \"136 Parnassus Ave Unit 4\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94117\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Denis Lancerin\",\n",
+ " \"agency\": \"City Real Estate\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 499000,\n",
+ " \"bedrooms\": 1,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 728,\n",
+ " \"address\": \"30 Mason St Unit 502\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94102\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Guillean Arradaza\",\n",
+ " \"agency\": \"Kinetic Real Estate\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 650000,\n",
+ " \"bedrooms\": 4,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1436,\n",
+ " \"address\": \"1276 Revere Ave\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94124\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Charles Clerkley\",\n",
+ " \"agency\": \"Luxe Places International Real\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1395000,\n",
+ " \"bedrooms\": 3,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 1395,\n",
+ " \"address\": \"239 Mangels Ave\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94131\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Suki Tsang\",\n",
+ " \"agency\": \"Chance Real Estate\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1088000,\n",
+ " \"bedrooms\": 3,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1370,\n",
+ " \"address\": \"117 Sutro Heights Ave Unit 117\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94121\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Peter Goss\",\n",
+ " \"agency\": \"Corcoran Icon Properties\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 995000,\n",
+ " \"bedrooms\": 2,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1041,\n",
+ " \"address\": \"678 Clipper St Unit 1\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94114\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Ed Milestone\",\n",
+ " \"agency\": \"Berkshire Hathaway-Franciscan\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1188000,\n",
+ " \"bedrooms\": 5,\n",
+ " \"bathrooms\": 3,\n",
+ " \"square_feet\": 1720,\n",
+ " \"address\": \"331 Lisbon St\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94112\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Michael Yrazabal\",\n",
+ " \"agency\": \"Compass\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1995000,\n",
+ " \"bedrooms\": 3,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1846,\n",
+ " \"address\": \"619 Connecticut St\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94107\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Laura Lanzone\",\n",
+ " \"agency\": \"North Point Real Estate\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1199000,\n",
+ " \"bedrooms\": 2,\n",
+ " \"bathrooms\": 1,\n",
+ " \"square_feet\": 1304,\n",
+ " \"address\": \"795 Sutter St Unit 602\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94109\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Lance Fulford\",\n",
+ " \"agency\": \"Compass\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 1625000,\n",
+ " \"bedrooms\": 4,\n",
+ " \"bathrooms\": 3,\n",
+ " \"square_feet\": 2217,\n",
+ " \"address\": \"1551 Hampshire St\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94110\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Daniel Kirk Slaughter\",\n",
+ " \"agency\": \"Vanguard Properties\"\n",
+ " },\n",
+ " {\n",
+ " \"price\": 2450000,\n",
+ " \"bedrooms\": 2,\n",
+ " \"bathrooms\": 2,\n",
+ " \"square_feet\": 1549,\n",
+ " \"address\": \"488 Folsom St Unit 4204\",\n",
+ " \"city\": \"San Francisco\",\n",
+ " \"state\": \"CA\",\n",
+ " \"zip_code\": \"94105\",\n",
+ " \"tags\": [],\n",
+ " \"agent_name\": \"Derec Lacio\",\n",
+ " \"agency\": \"Related CA Res. Sales, Inc.\"\n",
+ " }\n",
+ " ]\n",
+ "}\n"
+ ]
+ }
+ ],
+ "source": [
+ "import json\n",
+ "\n",
+ "if repo_response.status != \"success\":\n",
+ " raise RuntimeError(repo_response.error)\n",
+ "\n",
+ "result = repo_response.data.json_data\n",
+ "\n",
+ "print(\"Tokens used:\", repo_response.data.usage)\n",
+ "print(\"House listings:\")\n",
+ "print(json.dumps(result, indent=2))"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "2as65QLypwdb"
+ },
+ "source": [
+ "### \ud83d\udcbe Save the output to a `CSV` file"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "HTLVFgbVLLBR"
+ },
+ "source": [
+ "Let's create a pandas dataframe and show the table with the extracted content"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 7,
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 1000
+ },
+ "id": "1lS9O1KOI51y",
+ "outputId": "89fe200c-deca-45b1-be2e-6cf3e9f97fe2"
+ },
+ "outputs": [
+ {
+ "ename": "NameError",
+ "evalue": "name 'result' is not defined",
+ "output_type": "error",
+ "traceback": [
+ "\u001b[31m---------------------------------------------------------------------------\u001b[39m",
+ "\u001b[31mNameError\u001b[39m Traceback (most recent call last)",
+ "\u001b[36mCell\u001b[39m\u001b[36m \u001b[39m\u001b[32mIn[7]\u001b[39m\u001b[32m, line 4\u001b[39m\n\u001b[32m 1\u001b[39m \u001b[38;5;28;01mimport\u001b[39;00m pandas \u001b[38;5;28;01mas\u001b[39;00m pd\n\u001b[32m 2\u001b[39m \n\u001b[32m 3\u001b[39m \u001b[38;5;66;03m# Convert dictionary to DataFrame\u001b[39;00m\n\u001b[32m----> \u001b[39m\u001b[32m4\u001b[39m df = pd.DataFrame(result[\u001b[33m\"houses\"\u001b[39m])\n\u001b[32m 5\u001b[39m df\n",
+ "\u001b[31mNameError\u001b[39m: name 'result' is not defined"
+ ]
+ }
+ ],
+ "source": [
+ "import pandas as pd\n",
+ "\n",
+ "# Convert dictionary to DataFrame\n",
+ "df = pd.DataFrame(result[\"houses\"])\n",
+ "df"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "v0CBYVk7qA5Z"
+ },
+ "source": [
+ "Save it to CSV"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "id": "BtEbB9pmQGhO",
+ "outputId": "96b40841-381e-49fb-db05-752dfe63ad00"
+ },
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ "Data saved to zillow_forsale.csv\n"
+ ]
+ }
+ ],
+ "source": [
+ "# Save the DataFrame to a CSV file\n",
+ "csv_file = \"houses_forsale.csv\"\n",
+ "df.to_csv(csv_file, index=False)\n",
+ "print(f\"Data saved to {csv_file}\")"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "-1SZT8VzTZNd"
+ },
+ "source": [
+ "## \ud83d\udd17 Resources"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "dUi2LtMLRDDR"
+ },
+ "source": [
+ "\n",
+ "\n",
+ " ![\"ScrapeGraph](\"https://raw.githubusercontent.com/VinciGit00/Scrapegraph-ai/main/docs/assets/api-banner.png\"\n",)
\n",
+ "
\n",
+ "\n",
+ "\n",
+ "- \ud83d\ude80 **Get your API Key:** [ScrapeGraphAI Dashboard](https://scrapegraphai.com/dashboard) \n",
+ "- \ud83d\udc19 **GitHub:** [ScrapeGraphAI GitHub](https://github.com/scrapegraphai) \n",
+ "- \ud83d\udcbc **LinkedIn:** [ScrapeGraphAI LinkedIn](https://www.linkedin.com/company/scrapegraphai/) \n",
+ "- \ud83d\udc26 **Twitter:** [ScrapeGraphAI Twitter](https://twitter.com/scrapegraphai) \n",
+ "- \ud83d\udcac **Discord:** [Join our Discord Community](https://discord.gg/uJN7TYcpNa) \n",
+ "\n",
+ "Made with \u2764\ufe0f by the [ScrapeGraphAI](https://scrapegraphai.com) Team \n"
+ ]
+ }
+ ],
+ "metadata": {
+ "colab": {
+ "provenance": []
+ },
+ "kernelspec": {
+ "display_name": "Python 3 (ipykernel)",
+ "language": "python",
+ "name": "python3"
+ },
+ "language_info": {
+ "codemirror_mode": {
+ "name": "ipython",
+ "version": 3
+ },
+ "file_extension": ".py",
+ "mimetype": "text/x-python",
+ "name": "python",
+ "nbconvert_exporter": "python",
+ "pygments_lexer": "ipython3",
+ "version": "3.12.11"
+ }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 4
+}