Campaign ID: 243
đ Direct LinkAPI Endpoint: api/start_background_scraping.php (POST)
Database Table: campaigns_impact (SELECT)
| Field | Value |
|---|---|
| ID | 243 |
| Title | hari |
| Keywords | Harimalvi |
| Platforms | |
| Status | active |
| Date From | 2026-05-14 |
| Date To | 2026-05-20 |
| Client Keywords | |
| Monitor Links | |
| Relevancy Threshold | 0.70 |
âšī¸ This prepares the campaign for data collection. This step must be completed before Step 2.
API Endpoint: api/collect_data_step2.php (POST)
Database Tables: twitter_raw, youtube_raw, instagram_raw, news_raw, blogs_raw, facebook_raw (INSERT, SELECT COUNT)
Database Table: background_jobs (SELECT)
âšī¸ What this means: Background jobs track long-running scraping processes. If no jobs are found, it means either:
âĸ Scraping completed and jobs were cleaned up
âĸ Scraping happened directly without creating job records (this is normal)
âĸ No background scraping has been started yet
â
Check Step 3 (Data Collection Status) to see if data was actually collected - that's what matters!
No background jobs found for this campaign
This is normal! Background jobs are optional tracking records. The important thing is whether data was collected - check Step 3 below.
âšī¸ This collects 100 results from each selected platform. This may take 10-20 minutes.
âšī¸ Limits: Loaded from platform_limits table (managed via Settings > Platform Limit)
| Platform | Table Name | Records Count | Limit | Status | Action |
|---|---|---|---|---|---|
twitter_raw | 5 | 1000 | â Data Collected | ||
| Youtube | youtube_raw | 0 | 100 | â No Data | |
instagram_raw | 0 | 100 | â No Data | ||
facebook_raw | 0 | 100 | â No Data | ||
| News | news_raw | 0 | 1000 | â No Data | |
| Blogs | blogs_raw | 0 | 1000 | â No Data | |
| Total Records | 5 | - | â Data Available | - | |
API Endpoint: api/check_raw_mentions.php (POST)
OpenAI key: loaded from api_keys_db.api_keys (then OPENAI_API_KEY env, then config). Model: gpt-4o-mini.
Database Tables: twitter_raw, youtube_raw, instagram_raw, news_raw, blogs_raw, facebook_raw (SELECT), ai_relevancy_results (INSERT)
âšī¸ Run sends every raw row to the API with force_reprocess (full pass, re-scores by AI). Re-Run does the same. Batches of 50; large campaigns can take 15+ minutes.
Database Table: ai_jobs (SELECT)
No AI jobs found for this campaign. Click the button above to create AI jobs from raw data.
Total AI Relevancy Results: 5
| Platform | Results Count |
|---|---|
| 5 |
| Relevancy Label | Count |
|---|
| Sentiment | Count |
|---|---|
| neutral | 5 |
| Processing State | Count |
|---|---|
| fetched | 5 |
| ID | Platform | Platform Post ID | Relevancy Score | Relevancy Label | Sentiment | Processing State | Raw Item ID | Raw Table | Created At |
|---|---|---|---|---|---|---|---|---|---|
| 103382 | N/A | 1.0000 | N/A | neutral | fetched | N/A | N/A | 2026-05-20 06:26:18 | |
| 103383 | N/A | 1.0000 | N/A | neutral | fetched | N/A | N/A | 2026-05-20 06:26:18 | |
| 103384 | N/A | 1.0000 | N/A | neutral | fetched | N/A | N/A | 2026-05-20 06:26:18 | |
| 103385 | N/A | 1.0000 | N/A | neutral | fetched | N/A | N/A | 2026-05-20 06:26:18 | |
| 103386 | N/A | 1.0000 | N/A | neutral | fetched | N/A | N/A | 2026-05-20 06:26:18 |
API Endpoint: api/sync_campaign_articles.php (POST)
Database Table: campaign_articles (INSERT/UPDATE, SELECT COUNT, SELECT)
âšī¸ This finalizes all collected data and syncs relevant items to campaign_articles.
Total Campaign Articles: 5
âšī¸ This will sync relevant items (relevancy score âĨ 70% - campaign threshold: 0.7) from ai_relevancy_results to campaign_articles. Note: 5 relevant items found, 0 can be synced (others may already exist in campaign_articles).
| Platform | Articles Count |
|---|---|
| 5 |
| ID | Platform | Platform Post ID | Title/Content | Relevancy Score | Relevancy Label | Sentiment | Sentiment Score | Raw Item ID | Raw Table | Created At |
|---|---|---|---|---|---|---|---|---|---|---|
| 51239 | 149 | Harimalvi ketanparyani chandu mansimody karanmath... | 1.0000 | very_high | neutral | 0.5000 | 149 | twitter_x_api_raw | 2026-05-20 06:26:18 | |
| 51240 | 150 | Harimalvi ketanparyani chandu mansimody karanmath... | 1.0000 | very_high | neutral | 0.5000 | 150 | twitter_x_api_raw | 2026-05-20 06:26:18 | |
| 51241 | 151 | Harimalvi ketanparyani chandu mansimody karanmath... | 1.0000 | very_high | neutral | 0.5000 | 151 | twitter_x_api_raw | 2026-05-20 06:26:18 | |
| 51242 | 152 | Harimalvi ketanparyani chandu mansimody karanmath... | 1.0000 | very_high | neutral | 0.5000 | 152 | twitter_x_api_raw | 2026-05-20 06:26:18 | |
| 51243 | 153 | Harimalvi ketanparyani chandu mansimody karanmath... | 1.0000 | very_high | neutral | 0.5000 | 153 | twitter_x_api_raw | 2026-05-20 06:26:18 |
| Relevancy Label | Count |
|---|---|
| very_high | 5 |
Database Table: background_jobs (SELECT)
âšī¸ Background jobs track long-running scraping processes. This is optional tracking.
No background jobs found for this campaign
Database Table: ai_jobs (SELECT)
No AI jobs found for this campaign
| Metric | Value |
|---|---|
| Campaign ID | 243 |
| Campaign Status | active |
| Relevancy Threshold | 0.70 |
| Total Raw Records Collected | 5 |
| AI Relevancy Results | 5 |
| Campaign Articles (Final) | 5 |
| Background Jobs | 0 |
| AI Jobs | 0 |
| API Service | Provider | Usage |
|---|---|---|
apidojo~tweet-scraper | Apify | Twitter data collection (Step 3) |
streamers~youtube-scraper | Apify | YouTube data collection (Step 3) |
apify~instagram-post-scraper | Apify | Instagram data collection (Step 3) |
| ScrapingDog API | ScrapingDog | News & Blogs data collection (Step 3) |
| OpenAI API | OpenAI | AI relevancy analysis (Step 5) |
| Gemini API | AI relevancy analysis (Step 5, alternative) |
| Step | API Endpoint | Table Name | Operation |
|---|---|---|---|
| Step 1 | api/start_background_scraping.php | campaigns_impact (relevancy_threshold) | SELECT |
| Step 2 | api/collect_data_step2.php | twitter_raw, youtube_raw, instagram_raw, news_raw, blogs_raw, facebook_raw | INSERT, SELECT COUNT |
| Step 3 | api/check_raw_mentions.php | twitter_raw, youtube_raw, instagram_raw, news_raw, blogs_raw, facebook_raw, ai_relevancy_results (platform_post_id, content_hash, processing_state, raw_item_id, raw_table_name) | SELECT, INSERT |
| Step 4 | api/sync_campaign_articles.php | campaign_articles (platform_post_id, matched_terms, ai_reasoning, relevancy_label, sentiment_score, raw_item_id, raw_table_name) | INSERT/UPDATE, SELECT COUNT, SELECT |
| Step | Description | API Endpoint | Duration |
|---|---|---|---|
| Step 1 | Initialize scraping process | api/start_background_scraping.php | 10-20 seconds |
| Step 2 | Collect data from platforms (100 results per platform) | api/collect_data_step2.php | 10-20 minutes |
| Step 3 | AI relevancy analysis (50 mentions per batch) | api/check_raw_mentions.php | 5-7 minutes |
| Step 4 | Complete processing & save results | api/sync_campaign_articles.php | 1-2 minutes |
All steps debugged successfully!
Campaign ID: 243 | Raw Records: 5 | AI Results: 5 | Articles: 5