We extract public dashboards, SQL queries, execution metrics, and trending Web3 analytics from Dune. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.
Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.
Complete list of extractable fields for Dashboards objects from dune.com. All fields typed and schema-versioned.
"dashboard_id": "d_29481", "title": "Ethereum Gas Tracker", "author": "hildobby", "views": 482910, "stars": 1204, "tags": "['ethereum', 'gas', 'network']"
| # | dashboard_id | title | slug | author | created_at | updated_at |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for SQL Queries objects from dune.com. All fields typed and schema-versioned.
"query_id": "q_847192", "name": "Daily Active Users", "author_handle": "optimism_pbc", "dataset": "dune_sql", "raw_sql": "SELECT date_trunc('day', block_time) AS day, COUNT(DISTINCT "from") AS users FROM optimism.transactions GROUP BY 1", "execution_status": "success"
| # | query_id | name | description | author_handle | raw_sql | dataset |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Query Results objects from dune.com. All fields typed and schema-versioned.
"execution_id": "exec_01h2v3", "query_id": "q_847192", "row_count": 365, "run_time_ms": 4210, "completed_at": "2023-10-12T14:32:01Z", "columns": "['day', 'users']"
| # | execution_id | query_id | columns | row_count | byte_size | run_time_ms |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for User Profiles objects from dune.com. All fields typed and schema-versioned.
"handle": "hildobby", "display_name": "hildobby", "follower_count": 14291, "dashboard_count": 42, "query_count": 312, "joined_date": "2021-04-12T00:00:00Z"
| # | user_id | handle | display_name | bio | twitter_handle | github_handle |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Trending Metrics objects from dune.com. All fields typed and schema-versioned.
"rank_position": 1, "dashboard_id": "d_91823", "title": "Friend.tech metrics", "view_growth": 482, "time_window": "24h", "scraped_at": "2023-10-12T15:00:00Z"
| # | rank_position | dashboard_id | title | author | time_window | view_growth |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Our Dune scraper parses the underlying SQL, dashboard configurations, and raw execution results — bypassing complex client-side rendering and internal API obscuration.
Capture title, author, tags, view counts, and star metrics across thousands of public dashboards.
Extract the raw PostgreSQL or DuneSQL syntax powering every public visualisation on the platform.
Download the actual tabular data returned by executed queries, avoiding manual CSV exports.
Monitor the trending page to identify emerging protocols, narratives, and high-growth dashboards.
Map the top analysts in Web3 by extracting follower counts, social links, and total query output.
Link underlying SQL queries to their specific dashboard chart configurations and parameter inputs.
Identify datasets targeting Ethereum, Solana, Polygon, Arbitrum, and other EVM chains.
Track query forks to understand how complex metrics are derived and modified by the community.
Monitor query run times, byte sizes, and row counts to optimise your own DuneSQL performance.
Run pipelines to capture daily snapshots of dashboard metrics and trending positions.
Brief in. Clean data out.
Provide dashboard URLs, author handles, or target categories. We design the extraction schema together.
We configure Scrapy / Playwright crawlers, proxy rotation, session management, and CAPTCHA handling for dune.com.
Schema validation, null-rate checks, and data type normalisation before full launch.
JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.
Dune relies heavily on Next.js hydration and internal GraphQL APIs. Here is how we extract the data cleanly.
Dune is a heavy Single Page Application. We intercept the Next.js build manifest and extract the raw JSON state hydration props, bypassing the need to scrape the rendered DOM entirely.
Dune employs strict rate limiting and Cloudflare protection on its API routes. We distribute requests across residential IP pools with browser-matched TLS fingerprints to maintain access.
To extract query results, our pipeline maps the internal API calls used by the Dune frontend, allowing us to fetch the raw JSON result sets rather than attempting to parse HTML tables.
Dashboard layouts are stored as deeply nested JSON objects. We flatten these structures into relational formats, linking specific visualisations to their underlying SQL query IDs.
Top analysts have thousands of queries. Our crawlers handle the specific pagination tokens required to extract complete historical query lists without hitting timeout limits.
Track TVL, user growth, and volume metrics across competing chains by aggregating public dashboard data.
Analyse token distribution, staking ratios, and velocity by extracting the underlying SQL logic used by top researchers.
Monitor trending dashboards for emerging narratives and new protocol launches before they hit mainstream crypto media.
Identify top query authors and analysts for recruitment or partnership by tracking view counts and fork metrics.
Aggregate queries tracking exploits, hacks, or wallet movements to build internal security databases.
Feed structured query results into trading models to correlate on-chain activity with price action.
"Dune holds the most comprehensive community-driven Web3 analytics on the internet, but accessing it systematically requires navigating heavy client-side rendering and aggressive rate limits."
Extracting data from Dune requires more than simple HTTP requests. Their Next.js architecture heavily relies on client-side state hydration, internal API routing, and Cloudflare protection. DataFlirt manages the JavaScript execution, proxy rotation, and complex JSON parsing required to turn Dune's dashboards into queryable warehouse tables.
Everything supported by our dune.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.
Open-source tooling on proven cloud infra — no vendor lock-in, full observability.
We parse Next.js __NEXT_DATA__ objects directly from the DOM, avoiding brittle CSS selectors and extracting the raw JSON state.
Residential proxy pools combined with TLS fingerprint spoofing ensure our requests bypass Cloudflare's bot mitigation layers.
Our pipelines flatten deeply nested dashboard configurations and query results into normalised, warehouse-ready schemas.
Data delivered to where your team already works — no new tooling required.
About dune.com scraping, legality, and pipeline operations.
Ask us directly →Scraping publicly available information is generally permissible. DataFlirt only targets public dashboards, queries, and profiles on Dune. We do not attempt to bypass authentication to access private team data. Clients should review Dune's Terms of Service and consult legal counsel for specific use cases.
We utilise residential ISP proxies, browser-matched TLS fingerprints, and automated solvers to navigate WAF challenges without triggering blocks or CAPTCHAs.
Yes. We extract the exact PostgreSQL or DuneSQL syntax written by the author for any public query.
Yes. We intercept the internal API responses to capture the tabular data returned by the query execution, up to the limits displayed on the public frontend.
We can configure pipelines to poll the trending dashboards page at hourly intervals, providing near real-time visibility into emerging narratives.
Engagements typically start with a defined list of target authors, categories, or a continuous feed of the top 1,000 trending dashboards. Contact us to scope your specific volume requirements.
No. DataFlirt strictly targets publicly accessible data. We do not extract information gated behind private team accounts or premium authentication.
20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off export of top DeFi queries or a continuous feed of trending dashboards — we scope, build, and operate the pipeline. Tell us what you need.
