SYSTEM all green source durian.in queue 8,412 pages p99 latency 214ms dataflirt.com · scraper/durian-in
RUN · 14 active pipelines · durian.in live

Durian furniture data,
at warehouse scale.

We extract product specifications, material details, dimension matrices, pricing signals, and inventory status from Durian. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
12.4K /run
Price updates
48.2K /24h
Image assets
142K /run
Active pipelines
14
Uptime
99.94%
Data Dictionary

Every field we extract from durian.in

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Specifications objects from durian.in. All fields typed and schema-versioned.

skutitlecategorysub_categorymaterialfinishdimensionsweightcare_instructionswarrantyseating_capacitystyle
product_specifications
● 200 OK
"sku": "DUR-SOF-00941",
"title": "Winston 3 Seater Leather Sofa",
"category": "Living Room",
"material": "Genuine Leather",
"finish": "Walnut",
"dimensions": "2100mm x 900mm x 850mm",
"warranty": "5 Years",
"seating_capacity": 3
# skutitlecategorysub_categorymaterialfinish
1
2
3

Complete list of extractable fields for Pricing & Offers objects from durian.in. All fields typed and schema-versioned.

skupricelist_pricediscount_pctcurrencyemi_optionsoffer_tagsprice_timestamptax_included
pricing_& offers
● 200 OK
"sku": "DUR-SOF-00941",
"price": 84990.0,
"list_price": 115000.0,
"discount_pct": 26,
"currency": "INR",
"emi_options": "Starts at 4,001/month",
"offer_tags": "['Festive Sale', 'Free Assembly']",
"price_timestamp": "2023-11-04T10:15:00Z"
# skupricelist_pricediscount_pctcurrencyemi_options
1
2
3

Complete list of extractable fields for Inventory & Delivery objects from durian.in. All fields typed and schema-versioned.

skuin_stockstock_depthdelivery_daysassembly_requiredpincode_serviceablereturn_policydispatch_timeshipping_cost
inventory_& delivery
● 200 OK
"sku": "DUR-SOF-00941",
"in_stock": true,
"pincode_serviceable": true,
"delivery_days": "7-10 Days",
"assembly_required": "Carpenter Assembly",
"return_policy": "7 Days Replacement",
"dispatch_time": "48 Hours",
"shipping_cost": 0.0
# skuin_stockstock_depthdelivery_daysassembly_requiredpincode_serviceable
1
2
3

Complete list of extractable fields for Media & Assets objects from durian.in. All fields typed and schema-versioned.

skuprimary_image_urlgallery_urlsvideo_urlar_model_urlmanual_pdfmaterial_swatch_urllifestyle_images
media_& assets
● 200 OK
"sku": "DUR-SOF-00941",
"primary_image_url": "https://durian.in/media/catalog/winston-main.jpg",
"gallery_urls": "['https://durian.in/media/catalog/winston-side.jpg', 'https://durian.in/media/catalog/winston-back.jpg']",
"material_swatch_url": "https://durian.in/media/swatch/leather-brown.jpg",
"manual_pdf": "None",
"video_url": "https://youtube.com/watch?v=example"
# skuprimary_image_urlgallery_urlsvideo_urlar_model_urlmanual_pdf
1
2
3

Complete list of extractable fields for Category Metadata objects from durian.in. All fields typed and schema-versioned.

category_idcategory_namebreadcrumbproduct_countfilter_tagssorting_rankseo_titlescraped_at
category_metadata
● 200 OK
"category_id": "CAT-LIV-01",
"category_name": "Leather Sofas",
"breadcrumb": "Home > Living Room > Sofas > Leather Sofas",
"product_count": 142,
"sorting_rank": 4,
"seo_title": "Buy Premium Leather Sofas Online | Durian",
"scraped_at": "2023-11-04T10:15:33Z"
# category_idcategory_namebreadcrumbproduct_countfilter_tagssorting_rank
1
2
3

Capabilities

Deep extraction for the furniture catalogue

Durian's catalogue relies heavily on structured specifications, high-resolution imagery, and dynamic availability checks. We handle the session state and DOM parsing required to extract clean product records.

Complete Specification Parsing

Extract dimensions, weight, material composition, seating capacity, and care instructions into normalised, queryable fields.

Pincode-Aware Availability

Simulate user sessions across specific Indian pincodes to map delivery timelines, shipping costs, and regional inventory availability.

Pricing & Discount Tracking

Capture base price, discounted price, EMI calculations, and promotional tags timestamped per crawl.

Media Asset Extraction

Scrape primary images, gallery assets, lifestyle shots, and material swatches at their highest available resolution.

Colour & Finish Variants

Map parent-child relationships between product models and their respective colour, fabric, or wood finish variations.

Warranty & Assembly Data

Extract warranty terms, return policies, and assembly requirements (DIY vs Carpenter) for every SKU.

Office vs Home Segmentation

Maintain exact category hierarchies to distinguish between commercial office furniture and residential pieces.

Change Detection Pipeline

Run daily diffs to identify new product launches, discontinued items, and price adjustments without processing the entire catalogue.

High-Concurrency Crawling

Process the entire 15,000+ SKU catalogue within minutes using distributed infrastructure and proxy rotation.

// engagement pipeline

From product categories to warehouse records

Brief in. Clean data out.

Define Scope
d 0

Provide target categories, required pincodes, and desired data fields. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, session management for location data, and structure parsers for durian.in.

Validation & QA
d 4–6

Schema validation, null-rate checks, image URL verification, and dimension standardisation before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Durian pipeline handles the hard parts

Extracting structured data from modern eCommerce storefronts requires handling dynamic state and inconsistent DOM structures. Here is how we build resilient pipelines.

pipeline-monitor · durian.in · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Session state
Handling pincode-based dynamic content

Durian alters delivery timelines and inventory status based on user location. We maintain strict cookie sessions and regional IP routing to simulate specific Indian pincodes, ensuring accurate regional data.

DOM variability
Normalising inconsistent specifications

Furniture specifications often appear in unstructured HTML tables or bulleted lists. Our parsers use regex and text-pattern matching to extract dimensions (W x D x H) and materials into strict numeric and categorical fields.

Asset extraction
Resolving high-res media URLs

Product pages load compressed images for performance. We intercept API responses and parse JSON state blocks to extract the original, high-resolution image URLs required for your downstream applications.

Change detection
Only re-scrape what's changed

For large catalogues, we maintain a hash index of last-seen values per field. Subsequent runs only push diffs, reducing compute cost and storage bloat. You receive a clean changelog rather than full re-dumps.

Monitoring & alerting
24/7 pipeline health with anomaly detection

Every run emits structured logs to our observability stack. We alert on null-rate spikes, missing dimensions, schema drift, and coverage drops, responding before you notice.

Applications

Who uses Durian data — and how

Teams across industries use durian.in data to build competitive products and smarter operations.

01
Competitor Price Intelligence

Furniture retailers monitor Durian's pricing, festive discounts, and EMI structures to adjust their own promotional strategies.

02
Assortment & Gap Analysis

Marketplace category managers analyse Durian's catalogue depth across materials and finishes to identify gaps in their own inventory.

03
Interior Design Aggregation

Proptech and interior design platforms ingest structured dimensions and high-res images to populate their 3D planning software.

04
Supply Chain Forecasting

Logistics teams track delivery timelines across different pincodes to benchmark regional fulfillment performance.

05
Market Research

Analysts track new product launches and category expansion to understand trends in the premium Indian furniture market.

06
AI Training Data

Computer vision teams use classified lifestyle images and product shots to train furniture recognition and style-matching models.

Why DataFlirt

"Durian holds a highly structured catalogue of premium Indian furniture specifications, but extracting precise dimensions and material data requires a dedicated pipeline."

Most teams underestimate the investment required: reliable Durian scraping requires session handling for pincode availability, dynamic specification parsing, daily selector maintenance, and anomaly monitoring. DataFlirt absorbs that complexity so your engineers can focus on the analysis, not the infrastructure.

Technical Spec

Durian scraper — technical capabilities

Everything supported by our durian.in scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for dynamic image galleries and availability checks
Supported
Pincode simulation
Session cookie management to extract region-specific delivery timelines
Supported
Specification normalisation
Parsing raw HTML tables into structured JSON dimension and material fields
Supported
High-res image extraction
Capturing uncompressed asset URLs from background network requests
Supported
Variant mapping
Linking parent product models to their respective colour and finish SKUs
Supported
Change detection (diffs)
Hash-based diff to emit only records with changed fields since the last run
Supported
Webhook delivery
HTTP POST per record or batch for real-time downstream processing
Supported
User cart data
Saved items, past orders, and user-specific promotional codes
Partial
B2B bulk pricing portal
Trade discounts and wholesale pricing requiring authenticated partner login
Partial
Infrastructure

Infrastructure powering the Durian pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright handles JavaScript rendering, cookie sessions, and interaction flows for pincode checks.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies across Indian regions. Rotation happens per-request with sticky sessions where location consistency is required.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state is stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested — schema versioned per run
CSV
Flat file with typed columns — Excel/Sheets compatible
XLS
Excel spreadsheet format for business analysts
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery — compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoint to query the latest extracted catalogue state
BigQuery
Streamed directly into your dataset with schema auto-detect
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About durian.in scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Durian legal?

Scraping publicly available product, pricing, and specification data is generally permissible. DataFlirt targets only public, non-authenticated catalogue data. We do not extract personal user data or circumvent authentication walls.

Can you extract data for specific Indian pincodes?

Yes. We configure pipelines to maintain specific session states, allowing us to extract delivery timelines, shipping costs, and inventory availability for any given set of pincodes.

How do you handle unstructured dimensions?

Our parsers use custom regex and text-pattern matching to normalise inconsistent HTML descriptions into strict width, depth, and height numeric fields, ensuring the data is immediately usable.

How fresh is the data?

Full catalogue refreshes at a daily cadence typically complete within a 2-4 hour window. For specific high-priority categories, we can configure hourly change-detection runs.

Do you extract high-resolution images?

Yes. We intercept network requests and parse JSON objects to extract the raw, uncompressed image URLs rather than the compressed thumbnails displayed on the category pages.

What is the minimum viable engagement?

Our packages start at weekly full-catalogue exports. We price based on delivery frequency and the complexity of the requested schema. Contact us with your specific requirements.

Can I request a sample dataset before committing?

Absolutely. We provide a sample run of up to 500 SKUs as part of the pre-engagement scoping process so you can validate schema fit, field completeness, and dimension accuracy.

$ dataflirt scope --new-project --source=durian.in ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or a continuous price-monitoring feed — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in furniture

Services

Data Extraction for Every Industry

View All Services →