SYSTEM all green source cb-insights.com queue 12,841 profiles p99 latency 218ms dataflirt.com · scraper/cb-insights-com
RUN : 41 active pipelines : cb-insights.com live

Private market intelligence,
at warehouse scale.

We extract startup profiles, funding rounds, investor portfolios, and valuation histories from CB Insights. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Companies tracked
1.2M /day
Funding rounds
84,219 /month
Investor profiles
42,104 /run
Active pipelines
41
Uptime
99.94%
Data Dictionary

Every field we extract from cb-insights.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Company Profiles objects from cb-insights.com. All fields typed and schema-versioned.

company_idcompany_namewebsite_urldescriptionfounded_yeartotal_fundinglast_valuationoperating_statushq_locationprimary_industryemployee_counttech_stack
company_profiles
● 200 OK
"company_id": "CBI-98421",
"company_name": "Stripe",
"founded_year": 2010,
"total_funding": 8700000000.0,
"last_valuation": 50000000000.0,
"operating_status": "Active",
"hq_location": "San Francisco, CA",
"primary_industry": "Fintech"
# company_idcompany_namewebsite_urldescriptionfounded_yeartotal_funding
1
2
3

Complete list of extractable fields for Funding Rounds objects from cb-insights.com. All fields typed and schema-versioned.

round_idcompany_nameround_typeannounced_datemoney_raisedcurrencypre_money_valuationpost_money_valuationlead_investorparticipating_investorsseries_label
funding_rounds
● 200 OK
"round_id": "FR-104928",
"company_name": "Stripe",
"round_type": "Series I",
"announced_date": "2023-03-15",
"money_raised": 6500000000.0,
"currency": "USD",
"post_money_valuation": 50000000000.0,
"lead_investor": "Andreessen Horowitz"
# round_idcompany_nameround_typeannounced_datemoney_raisedcurrency
1
2
3

Complete list of extractable fields for Investor Profiles objects from cb-insights.com. All fields typed and schema-versioned.

investor_idinvestor_nameinvestor_typeaumhq_locationtotal_investmentsactive_portfolio_sizesuccessful_exitspreferred_stagesnotable_investmentswebsite_url
investor_profiles
● 200 OK
"investor_id": "INV-4421",
"investor_name": "Sequoia Capital",
"investor_type": "Venture Capital",
"aum": 85000000000.0,
"total_investments": 1420,
"successful_exits": 312,
"preferred_stages": "['Seed', 'Series A', 'Series B']"
# investor_idinvestor_nameinvestor_typeaumhq_locationtotal_investments
1
2
3

Complete list of extractable fields for M&A Activity objects from cb-insights.com. All fields typed and schema-versioned.

deal_idacquirer_nametarget_nameacquisition_datedeal_amountcurrencydeal_typeadvisorstarget_industrystrategic_rationale
m&a_activity
● 200 OK
"deal_id": "MA-88321",
"acquirer_name": "Adobe",
"target_name": "Figma",
"acquisition_date": "2022-09-15",
"deal_amount": 20000000000.0,
"currency": "USD",
"deal_type": "Acquisition",
"target_industry": "Design Software"
# deal_idacquirer_nametarget_nameacquisition_datedeal_amountcurrency
1
2
3

Complete list of extractable fields for Competitor Graphs objects from cb-insights.com. All fields typed and schema-versioned.

source_companytarget_competitorsimilarity_scoreshared_investorsmarket_overlapcategoryrevenue_range_targetfunding_disparity
competitor_graphs
● 200 OK
"source_company": "Plaid",
"target_competitor": "MX",
"similarity_score": 0.92,
"shared_investors": 2,
"market_overlap": "Financial Data APIs",
"funding_disparity": 210000000.0
# source_companytarget_competitorsimilarity_scoreshared_investorsmarket_overlapcategory
1
2
3

Capabilities

Extract the private market graph

Our CB Insights scraper handles every layer of the platform: startup profiles, funding rounds, cap tables, and investor portfolios. We manage the JavaScript rendering, session management, and anti-bot circumvention.

Company Profile Extraction

Extract founding year, total funding, valuation, employee count, and industry classification for any private company.

Funding Round Tracking

Capture round type, capital raised, pre-money valuation, lead investors, and participating syndicates.

Investor Portfolio Mapping

Map venture capital firms to their active investments, successful exits, and preferred funding stages.

Valuation History

Track step-ups and down-rounds over time with timestamped valuation metrics per funding event.

M&A Event Monitoring

Extract acquisition targets, acquirers, deal amounts, and strategic rationale from the M&A database.

Competitor Graphing

Map competitive landscapes using CB Insights similarity scores and shared investor overlap.

Patent & Tech Tracking

Monitor patent filings and technology trend mentions associated with specific startups.

Executive Team Data

Extract founder backgrounds, board members, and key executive transitions.

Scheduled Diffs

Run continuous pipelines at daily or weekly cadences with change-detection diffing to track new deals.

// engagement pipeline

From target list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide company URLs, investor names, or industry keywords. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, proxy rotation, session management, and Datadome bypass for cb-insights.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, and sample data review before full launch.

Delivery
ongoing

JSON, CSV, or Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our CB Insights pipeline handles the hard parts

CB Insights protects its proprietary data with strict access controls and aggressive bot mitigation. Here is how we stay resilient.

pipeline-monitor · cb-insights.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Anti-bot layer
Residential proxy rotation and Datadome bypass

CB Insights uses sophisticated bot protection to block automated extraction. Our crawlers use residential ISP proxies with realistic browser fingerprints, randomised request timing, and full cookie session management to bypass Datadome.

JavaScript rendering
Full Playwright execution for dynamic content

Company profiles and competitor graphs are heavily JavaScript rendered. We run full Playwright browser sessions with JavaScript execution and lazy-load triggering to capture data that headless HTTP clients miss entirely.

Schema stability
Resilient selectors with fallback chains

The DOM structure changes frequently. Our selector strategy uses multiple fallback chains per field, including CSS selectors, XPath, and text-pattern matching, ensuring layout changes do not break your data pipeline.

Change detection
Only re-scrape what changes

For large company catalogues, we maintain a hash index of last-seen values per field. Subsequent runs only push diffs, reducing compute cost and downstream processing load.

Monitoring & alerting
24/7 pipeline health monitoring

Every run emits structured logs to our observability stack. We alert on null-rate spikes, schema drift, and coverage drops. SLA uptime is contractual.

Applications

Who uses CB Insights data and how

Teams across industries use cb-insights.com data to build competitive products and smarter operations.

01
VC Deal Sourcing

Venture capital firms track early stage funding rounds and founder movements to identify breakout startups before competitors.

02
Competitor Intelligence

Corporate strategy teams monitor competitor funding, valuation step-ups, and M&A activity to benchmark market position.

03
M&A Target Screening

Corporate development teams filter private companies by employee count, funding stage, and industry to build acquisition pipelines.

04
Market Sizing

Analysts aggregate total capital deployed across specific tech verticals to quantify market momentum and investor sentiment.

05
Sales Prospecting

B2B sales teams use recent funding events as trigger signals to pitch high growth startups with fresh capital.

06
PE Due Diligence

Private equity firms map shared investor networks and historical valuation trends to validate target company narratives.

Why DataFlirt

"CB Insights maps the entire private market ecosystem. Extracting that graph into a relational database requires bypassing enterprise grade bot protection."

Extracting intelligence from CB Insights requires more than standard HTTP requests. Their infrastructure relies on aggressive rate limiting, complex JavaScript rendering, and Datadome bot protection. DataFlirt absorbs that complexity, handling session management and proxy rotation so your analysts can focus on market signals.

Technical Spec

CB Insights scraper technical capabilities

Everything supported by our cb-insights.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for dynamic charts and competitor graphs
Supported
CAPTCHA bypass
Automated solver integration for Datadome and Cloudflare challenges
Supported
Residential proxy rotation
ISP grade residential IPs rotated per request to avoid rate limits
Supported
Funding round extraction
Detailed capture of round types, valuations, and investor syndicates
Supported
Investor portfolio mapping
Extraction of full active and exited portfolios per VC firm
Supported
M&A event tracking
Historical database of acquisitions and deal terms
Supported
Change detection (diffs)
Hash based diffing emits only records with changed fields since last run
Supported
Webhook delivery
HTTP POST per record for real-time downstream processing
Supported
Premium research reports
PDFs and analyst reports gated behind enterprise subscription paywalls
Partial
Real-time cap table exports
Deep cap table data restricted to authenticated portfolio company users
Partial
Infrastructure

Infrastructure powering the CB Insights pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright handles JavaScript rendering, cookie sessions, and interaction flows. Combined via scrapy-playwright middleware.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies across US regions. Rotation happens per request with sticky sessions where required. IP score monitoring prevents blacklisted pool contamination.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline delimited or nested schema versioned per run
CSV
Flat file with typed columns Excel compatible
XLS
Legacy spreadsheet format for direct analyst consumption
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoint to query your extracted dataset
BigQuery
Streamed directly into your dataset with schema auto-detect
Snowflake
Stage and COPY INTO workflow incremental or full replace
PostgreSQL
Upsert into your existing schema with conflict resolution
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About cb-insights.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping CB Insights legal?

Scraping publicly available information is generally permissible under applicable law. DataFlirt targets only public, non-authenticated company, funding, and investor data. We do not extract personal data, circumvent authentication walls, or steal proprietary analyst reports. Clients should review CB Insights ToS and consult legal counsel for specific use cases.

How do you handle CB Insights bot protection?

We use residential ISP proxies, full Playwright browser sessions with realistic fingerprints, and request timing modelled on human behaviour. We monitor for rate limits in real time and trigger pool rotation automatically.

Can you extract data hidden behind the enterprise login?

No. DataFlirt focuses strictly on public web data. We do not bypass authentication walls to extract premium research reports or proprietary cap table data restricted to paid users.

How fresh is the funding data?

Pipelines can be configured to run daily or weekly. Our change detection system identifies new funding rounds and valuation updates, delivering diffs to your warehouse within hours of the crawl completing.

Can you map the entire investor portfolio?

Yes. We extract the full list of active investments, historical exits, and co-investor networks for any specified venture capital firm or angel investor.

What is the minimum viable engagement?

Our smallest packages start at a defined list of 5,000 companies or investors with weekly delivery. For larger market mapping requirements, we price based on volume and delivery frequency. Contact us for a scoped quote.

Can I request a sample dataset before committing?

Absolutely. We provide a sample run of up to 100 company profiles as part of the pre-engagement scoping process so you can validate schema fit and data quality before signing any contract.

$ dataflirt scope --new-project --source=cb-insights.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off startup catalogue dump or a continuous funding monitor across 100K companies, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in business directories

Services

Data Extraction for Every Industry

View All Services →