SYSTEM all green source apna.co queue 14,291 URLs p99 latency 184ms dataflirt.com · scraper/apna-co
RUN * 114 active pipelines * apna.co live

Apna job data,
at warehouse scale.

We extract hyperlocal job postings, salary bands, skill prerequisites, and employer metadata from apna.co. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your schedule.

Jobs extracted
142K /day
Salary updates
89K /24h
Employer records
12K /run
Active pipelines
114
Uptime
99.98%
Data Dictionary

Every field we extract from apna.co

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Job Postings objects from apna.co. All fields typed and schema-versioned.

job_idtitlecompanylocation_citylocation_localitysalary_minsalary_maxjob_typeshift_typeexperience_reqenglish_reqdescriptionposted_datepage_url
job_postings
● 200 OK
"job_id": "APN-982374",
"title": "Delivery Executive",
"company": "Zepto",
"location_city": "Bengaluru",
"location_locality": "Koramangala",
"salary_min": 25000,
"salary_max": 35000,
"job_type": "Full Time",
"experience_req": "Fresher"
# job_idtitlecompanylocation_citylocation_localitysalary_min
1
2
3

Complete list of extractable fields for Salary & Compensation objects from apna.co. All fields typed and schema-versioned.

job_idtitlebase_salary_minbase_salary_maxincentives_availablepf_esic_benefitsovertime_paytravel_allowancesalary_frequencycurrency
salary_& compensation
● 200 OK
"job_id": "APN-982374",
"base_salary_min": 25000,
"base_salary_max": 30000,
"incentives_available": true,
"pf_esic_benefits": true,
"travel_allowance": 2000,
"salary_frequency": "Monthly",
"currency": "INR"
# job_idtitlebase_salary_minbase_salary_maxincentives_availablepf_esic_benefits
1
2
3

Complete list of extractable fields for Employer Metadata objects from apna.co. All fields typed and schema-versioned.

company_idcompany_nameindustrycompany_sizeheadquartershr_name_publicactive_jobs_countverified_statusemployer_rating
employer_metadata
● 200 OK
"company_id": "CMP-44512",
"company_name": "Zepto",
"industry": "Logistics & Delivery",
"active_jobs_count": 342,
"verified_status": true,
"hr_name_public": "Rahul S.",
"employer_rating": 4.2
# company_idcompany_nameindustrycompany_sizeheadquartershr_name_public
1
2
3

Complete list of extractable fields for Interview Details objects from apna.co. All fields typed and schema-versioned.

job_idinterview_typewalk_in_addresshr_contact_visiblecontact_timingrequired_documentsselection_roundshiring_urgencyinterview_date_range
interview_details
● 200 OK
"job_id": "APN-982374",
"interview_type": "Walk-In",
"walk_in_address": "Sector 4, HSR Layout, Bengaluru",
"hr_contact_visible": false,
"contact_timing": "10:00 AM to 5:00 PM",
"required_documents": "['Aadhar Card', 'Driving Licence', 'PAN Card']",
"hiring_urgency": "High"
# job_idinterview_typewalk_in_addresshr_contact_visiblecontact_timingrequired_documents
1
2
3

Complete list of extractable fields for Skill Requirements objects from apna.co. All fields typed and schema-versioned.

job_idprimary_skillssecondary_skillseducation_levelcertification_reqvehicle_reqsmartphone_reqgender_preferenceage_limit
skill_requirements
● 200 OK
"job_id": "APN-982374",
"primary_skills": "['Two Wheeler Driving', 'Navigation']",
"education_level": "10th Pass",
"vehicle_req": "Two Wheeler",
"smartphone_req": true,
"gender_preference": "Any",
"age_limit": "18 to 35"
# job_idprimary_skillssecondary_skillseducation_levelcertification_reqvehicle_req
1
2
3

Capabilities

Everything you need from Apna, nothing you do not

Our Apna scraper parses hyperlocal job boards, salary ranges, and skill prerequisites with full JavaScript rendering and regional proxy routing built in.

Hyperlocal Job Extraction

Extract job data down to the city, locality, and ward level for precise geographic mapping of labor demand.

Salary Band Parsing

Capture minimum and maximum salary ranges, along with incentive structures, PF, and ESIC benefit flags.

Skill & Asset Requirements

Track specific prerequisites like two-wheeler ownership, smartphone requirements, education levels, and language proficiency.

Employer Verification Status

Identify trusted employers versus unverified accounts to maintain data quality in your downstream analytics.

Interview Logistics

Extract walk-in addresses, HR contact availability windows, and specific document requirements for candidates.

Shift & Timing Data

Categorise postings by night shift, rotational, part-time, full-time, and gig work models.

Regional Language Support

Capture job descriptions and titles published in local scripts to ensure no data is lost in translation.

Change Detection

Identify new postings and detect expired or filled roles using hash-based diffing across daily runs.

Automated Pipeline

Configure continuous pipelines at daily or weekly cadences to keep your warehouse synchronised with the live platform.

// engagement pipeline

From search parameters to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target cities, job categories, or specific employer lists. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, Indian residential proxies, session management, and API interception for apna.co.

Validation & QA
d 4–6

Schema validation, null-rate checks, and geolocation accuracy verification before full launch.

Delivery
ongoing

JSON, CSV, or Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Apna pipeline handles the hard parts

Job boards deploy aggressive rate limiting to protect their inventory. Here is how we maintain pipeline stability.

pipeline-monitor · apna.co · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Geo-targeted proxies
Indian residential routing

Apna serves highly localised content based on the requester IP. We route traffic through specific Indian city proxies to view accurate job listings for Bengaluru, Delhi, Mumbai, and tier-2 cities.

SPA rendering
Playwright for dynamic hydration

Modern job boards use single-page application architectures. We use Playwright to execute JavaScript, trigger lazy-loading, and hydrate full job lists that simple HTTP clients miss.

API interception
Extracting structured backend data

Instead of relying purely on fragile DOM parsing, our pipeline intercepts the underlying GraphQL and REST API calls made by the Apna frontend, capturing cleaner and more comprehensive JSON payloads.

Schema stability
Fallback selectors for layout changes

Platform updates frequently alter job card layouts. We employ multiple fallback chains per field, combining JSON API extraction with CSS and XPath selectors to ensure pipeline continuity.

Deduplication
Hash-based unique record identification

Employers often post identical jobs across multiple localities. We generate cryptographic hashes based on job descriptions, employer IDs, and coordinates to flag duplicates and maintain dataset integrity.

Applications

Who uses Apna data and how

Teams across industries use apna.co data to build competitive products and smarter operations.

01
Competitor Salary Benchmarking

HR teams and recruiters track local pay scales and incentive structures to remain competitive in high-attrition blue-collar sectors.

02
Labor Market Analytics

Economists and researchers analyse hiring volumes, skill demands, and geographic shifts in the informal and rising workforce economy.

03
Lead Generation

B2B service providers target actively hiring companies to pitch HR software, background verification services, and staffing solutions.

04
Skill Gap Analysis

EdTech and vocational training firms identify frequently requested skills and certifications to design relevant curriculum for job seekers.

05
Hyperlocal Economic Indicators

Investors track job posting velocity by city tier and locality as a proxy for regional economic health and consumer demand.

06
Gig Economy Tracking

Logistics and quick-commerce companies monitor delivery partner demand and compensation across competing platforms.

Why DataFlirt

"Apna maps the informal and blue-collar economy of India at a granular level, but accessing this data at scale requires specialised infrastructure."

Most engineering teams fail at extracting job board data because they rely on simple HTTP clients and datacenter IPs. Reliable Apna scraping requires Indian residential proxies, dynamic JavaScript execution, and daily schema monitoring. DataFlirt manages the infrastructure so your team can query the data directly.

Technical Spec

Apna scraper technical capabilities

Everything supported by our apna.co scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for dynamic job lists and infinite scrolling
Supported
CAPTCHA bypass
Automated integration with CapSolver for rate-limit challenges
Supported
Indian residential IPs
ISP-grade proxies located in target Indian cities for accurate regional data
Supported
API interception
Direct extraction from frontend XHR/Fetch requests for clean JSON
Supported
Change detection
Hash-based diff to emit only new or modified job postings
Supported
Webhook delivery
HTTP POST per record for real-time lead generation workflows
Supported
Candidate profiles
Resumes and personal candidate data are gated and strictly restricted
Partial
Direct HR phone numbers
Requires verified candidate login, OTP verification, and manual application
Partial
Infrastructure

Infrastructure powering the Apna pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and retry logic. Playwright manages JavaScript execution and dynamic content hydration for single-page application architectures.

Residential Proxy Infrastructure

We maintain pools of Indian residential proxies to bypass regional blocks and rate limits. IP score monitoring prevents blacklisted pool contamination.

Cloud-Native Orchestration

Pipelines run on Kubernetes for sustained loads. Airflow handles scheduling, dependency management, and SLA alerting, with all state stored in PostgreSQL.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested, schema versioned per run
CSV
Flat file with typed columns for basic analytics
XLS
Formatted spreadsheet for direct business user consumption
Parquet
Columnar format optimised for BigQuery and Snowflake
AWS S3
Direct bucket delivery compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoints to query your extracted datasets on demand
PostgreSQL
Direct database upserts with conflict resolution
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About apna.co scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Apna legal?

Scraping publicly available job postings is generally permissible for non-destructive use cases. DataFlirt targets only public, non-authenticated job and employer metadata. We do not extract candidate PII, circumvent authentication walls, or violate data protection regulations. Clients should review platform terms of service for specific use cases.

How do you handle rate limits on job boards?

We use Indian residential proxies, randomised request timing, and API interception to minimise the footprint on the target servers. If a block occurs, the system automatically rotates the proxy and retries the request.

Can you filter jobs by specific cities or wards?

Yes. The pipeline can be configured to target specific geographic parameters, extracting jobs only from designated cities, pin codes, or localities as defined in your scope.

How fresh is the job data?

Pipelines typically run on a daily cadence, ensuring that expired jobs are flagged and new postings are captured within 24 hours of publication.

Do you extract salary incentives separately from base pay?

Yes. When the platform provides granular compensation structures, we separate base salary ranges from potential incentives, travel allowances, and statutory benefits.

Can I request a sample dataset before committing?

Absolutely. We provide a sample run of up to 500 job postings for your target region so you can validate schema fit and data quality before signing a contract.

$ dataflirt scope --new-project --source=apna.co ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a daily feed of delivery jobs in Bengaluru or national salary benchmarks across 50 cities, we build and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in job boards

Services

Data Extraction for Every Industry

View All Services →