Mission Control

2026-03-14T06:55:42.093944Z

Pipeline Funnel

Data flow from ingestion to publication.
75,657
Products
β†’
92,073
Raw Specs
β†’
58,253
Normalized
β†’
54,452
Reconciled
β†’
54,452
PQS Scored
β†’
26,828
PQS β‰₯ 75
β†’
10,000
Publish Set
Retailer Offers
96,902
Price History Records
836,611

PQS Component Averages

Average points across all scored products. Total max = 100.
Component Max Avg Points %
Spec Completeness 30 14.9
50%
Retailer Depth 15 12.7
85%
Price History 15 12.9
86%
Freshness 10 5.0
50%
Internal Linking 10 9.5
95%
Template Quality 10 9.9
99%
Category Strength 10 9.9
99%
Overall PQS 100 74.5
74%

Feed Status

Per-retailer raw and normalized spec counts.
Retailer Raw Specs Normalized Norm Rate First Seen Last Seen
bestbuy 59,627 52,752 88.5% 2026-03-02T07:33 2026-03-14T05:25
bh 16,339 0 0.0% 2026-03-02T10:40 2026-03-14T02:34
lenovo_us 2,821 1,253 44.4% 2026-03-02T10:58 2026-03-14T03:43
newegg 13,286 4,248 32.0% 2026-03-02T10:42 2026-03-13T02:25

Top Categories

Category Reconciled PQS β‰₯ 75 Publish Set Pass Rate
(none) 27,283 5,249 1 19.2%
audio 3,488 3,157 700 90.5%
range 3,338 3,332 800 99.8%
tablet 2,075 1,148 600 55.3%
laptop 2,000 1,641 1,200 82.0%
refrigerator 1,767 1,381 800 78.2%
range_hood 1,635 1,165 290 71.2%
smartwatch 1,090 3 0 0.3%
phone 1,083 913 800 84.3%
monitor 954 664 435 69.6%
washer 918 774 200 84.3%
car_dash_kit 777 776 200 99.9%
dishwasher 623 530 381 85.1%
microwave 621 567 400 91.3%
grill 579 577 0 99.7%
tv 554 519 400 93.7%
smart_camera 519 398 200 76.7%
car_installation_accessory 465 280 155 60.2%
gaming_controller 427 275 150 64.4%
oven_single 412 412 300 100.0%
ssd 392 298 150 76.0%
car_radio_harness 345 318 173 92.2%
camera 303 303 226 100.0%
wine_cooler 303 0 0 0.0%
freezer 285 186 100 65.3%
oven_double 281 281 200 100.0%
mini_fridge 274 274 100 100.0%
lens 270 268 240 99.3%
networking 258 181 150 70.2%
gaming_headset 258 238 150 92.2%

Data Quality

Spec coverage & constraint violations per category.

Ingest Runs

Last 50 ingestion jobs.
ID Source Status Started Duration Total OK Errors Input Error Summary
42 ir_lenovo_us completed_with_errors 2026-03-14T03:43 12s 5,031 2,782 2,249 data/raw/ir/lenovo_us/20260314T034331Z_LenovoImpactRadiusUSNEW_IR.txt;delimiter= ;has_header=True;retailer=lenovo_us {"rows_invalid_gtin": 0, "delimiter": "\t", "has_header": true, "skip_rows": 0, "upc_field": "UPC", "sku_field": "MPN", "price_field": "Current Price", "title_field": "Product Name"}
41 bh_feed completed_with_errors 2026-03-14T02:34 51s 15,045 14,369 676 data/raw/bh/20260314T023405Z_20260314T023405Z_shopiner20033/shopiner20033.csv;delimiter=,;has_header=True;retailer=bh {"rows_invalid_gtin": 7, "delimiter": ",", "has_header": true, "skip_rows": 0, "upc_field": "upc", "sku_field": "itemcode", "price_field": "price"}
40 bestbuy_all βœ“ ok 2026-03-14T01:14 4h 11m 58,112 58,100 0 {"allow_invalid_gtin":false,"allow_parallel":false,"base_retry_sleep":20.0,"commit_every_pages":1,"max_pages":0,"max_retries":8,"over_quota_sleep_seconds":3600.0,"page_size":100,"resume_from_last_run":true,"sleep":20.0,"sleep_jitter":10.0,"start_page":1,"stop_when_remaining":5,"wait_on_over_quota":true} {"last_page_processed": 582, "pages_done": 582, "pages_total": 582, "rows_invalid_gtin": 12, "gtin_reject_reasons": {"missing": 12}, "error_samples": []}
39 ir_lenovo_us completed_with_errors 2026-03-13T03:51 17s 5,039 2,787 2,252 data/raw/ir/lenovo_us/20260313T035132Z_LenovoImpactRadiusUSNEW_IR.txt;delimiter= ;has_header=True;retailer=lenovo_us {"rows_invalid_gtin": 0, "delimiter": "\t", "has_header": true, "skip_rows": 0, "upc_field": "UPC", "sku_field": "MPN", "price_field": "Current Price", "title_field": "Product Name"}
38 bh_feed completed_with_errors 2026-03-13T02:42 52s 14,963 14,292 671 data/raw/bh/20260313T024242Z_20260313T024242Z_shopiner20033/shopiner20033.csv;delimiter=,;has_header=True;retailer=bh {"rows_invalid_gtin": 8, "delimiter": ",", "has_header": true, "skip_rows": 0, "upc_field": "upc", "sku_field": "itemcode", "price_field": "price"}
37 newegg_feed completed_with_errors 2026-03-13T02:19 6m 26s 866,612 15,231 29,532 data/raw/newegg/20260313T021833Z_44583_3309007_mp.txt;delimiter=|;match_only=True;retailer=newegg {"rows_invalid_gtin": 0, "rows_skipped_no_match": 821849, "delimiter": "|", "match_only": true, "skip_rows": 0}
36 bestbuy_all βœ“ ok 2026-03-13T01:23 4h 12m 58,200 58,189 0 {"allow_invalid_gtin":false,"allow_parallel":false,"base_retry_sleep":20.0,"commit_every_pages":1,"max_pages":0,"max_retries":8,"over_quota_sleep_seconds":3600.0,"page_size":100,"resume_from_last_run":true,"sleep":20.0,"sleep_jitter":10.0,"start_page":1,"stop_when_remaining":5,"wait_on_over_quota":true} {"last_page_processed": 582, "pages_done": 582, "pages_total": 582, "rows_invalid_gtin": 11, "gtin_reject_reasons": {"missing": 11}, "error_samples": []}
35 ir_lenovo_us completed_with_errors 2026-03-12T03:44 6s 5,027 2,775 2,252 data/raw/ir/lenovo_us/20260312T034457Z_LenovoImpactRadiusUSNEW_IR.txt;delimiter= ;has_header=True;retailer=lenovo_us {"rows_invalid_gtin": 0, "delimiter": "\t", "has_header": true, "skip_rows": 0, "upc_field": "UPC", "sku_field": "MPN", "price_field": "Current Price", "title_field": "Product Name"}
34 bh_feed completed_with_errors 2026-03-12T02:38 7s 14,855 14,180 675 data/raw/bh/20260312T023814Z_20260312T023814Z_shopiner20033/shopiner20033.csv;delimiter=,;has_header=True;retailer=bh {"rows_invalid_gtin": 8, "delimiter": ",", "has_header": true, "skip_rows": 0, "upc_field": "upc", "sku_field": "itemcode", "price_field": "price"}
33 newegg_feed completed_with_errors 2026-03-12T02:23 3m 41s 865,932 15,096 29,528 data/raw/newegg/20260312T022239Z_44583_3309007_mp.txt;delimiter=|;match_only=True;retailer=newegg {"rows_invalid_gtin": 0, "rows_skipped_no_match": 821308, "delimiter": "|", "match_only": true, "skip_rows": 0}
32 bestbuy_all βœ“ ok 2026-03-12T01:16 4h 5m 57,900 57,900 0 {"allow_invalid_gtin":false,"allow_parallel":false,"base_retry_sleep":20.0,"commit_every_pages":1,"max_pages":0,"max_retries":8,"over_quota_sleep_seconds":3600.0,"page_size":100,"resume_from_last_run":true,"sleep":20.0,"sleep_jitter":10.0,"start_page":1,"stop_when_remaining":5,"wait_on_over_quota":true} {"last_page_processed": 579, "pages_done": 579, "pages_total": 579, "rows_invalid_gtin": 0, "gtin_reject_reasons": {}, "error_samples": []}
31 ir_lenovo_us completed_with_errors 2026-03-11T03:51 6s 5,019 2,779 2,240 data/raw/ir/lenovo_us/20260311T035127Z_LenovoImpactRadiusUSNEW_IR.txt;delimiter= ;has_header=True;retailer=lenovo_us {"rows_invalid_gtin": 0, "delimiter": "\t", "has_header": true, "skip_rows": 0, "upc_field": "UPC", "sku_field": "MPN", "price_field": "Current Price", "title_field": "Product Name"}
30 bh_feed completed_with_errors 2026-03-11T02:41 14s 14,773 14,093 680 data/raw/bh/20260311T024101Z_20260311T024101Z_shopiner20033/shopiner20033.csv;delimiter=,;has_header=True;retailer=bh {"rows_invalid_gtin": 7, "delimiter": ",", "has_header": true, "skip_rows": 0, "upc_field": "upc", "sku_field": "itemcode", "price_field": "price"}
29 newegg_feed completed_with_errors 2026-03-11T02:13 3m 44s 861,769 14,972 29,522 data/raw/newegg/20260311T021221Z_44583_3309007_mp.txt;delimiter=|;match_only=True;retailer=newegg {"rows_invalid_gtin": 0, "rows_skipped_no_match": 817275, "delimiter": "|", "match_only": true, "skip_rows": 0}
28 bestbuy_all βœ“ ok 2026-03-11T01:15 4h 5m 57,779 57,767 0 {"allow_invalid_gtin":false,"allow_parallel":false,"base_retry_sleep":20.0,"commit_every_pages":1,"max_pages":0,"max_retries":8,"over_quota_sleep_seconds":3600.0,"page_size":100,"resume_from_last_run":true,"sleep":20.0,"sleep_jitter":10.0,"start_page":1,"stop_when_remaining":5,"wait_on_over_quota":true} {"last_page_processed": 578, "pages_done": 578, "pages_total": 579, "rows_invalid_gtin": 12, "gtin_reject_reasons": {"missing": 12}, "error_samples": []}
27 ir_lenovo_us completed_with_errors 2026-03-10T03:53 5s 5,014 2,771 2,243 data/raw/ir/lenovo_us/20260310T035312Z_LenovoImpactRadiusUSNEW_IR.txt;delimiter= ;has_header=True;retailer=lenovo_us {"rows_invalid_gtin": 0, "delimiter": "\t", "has_header": true, "skip_rows": 0, "upc_field": "UPC", "sku_field": "MPN", "price_field": "Current Price", "title_field": "Product Name"}
26 bh_feed completed_with_errors 2026-03-10T02:31 14s 14,724 14,037 687 data/raw/bh/20260310T023154Z_20260310T023154Z_shopiner20033/shopiner20033.csv;delimiter=,;has_header=True;retailer=bh {"rows_invalid_gtin": 7, "delimiter": ",", "has_header": true, "skip_rows": 0, "upc_field": "upc", "sku_field": "itemcode", "price_field": "price"}
25 newegg_feed completed_with_errors 2026-03-10T02:20 2m 10s 859,498 14,890 29,442 data/raw/newegg/20260310T021951Z_44583_3309007_mp.txt;delimiter=|;match_only=True;retailer=newegg {"rows_invalid_gtin": 0, "rows_skipped_no_match": 815166, "delimiter": "|", "match_only": true, "skip_rows": 0}
24 bestbuy_all βœ“ ok 2026-03-10T01:24 4h 5m 57,700 57,700 0 {"allow_invalid_gtin":false,"allow_parallel":false,"base_retry_sleep":20.0,"commit_every_pages":1,"max_pages":0,"max_retries":8,"over_quota_sleep_seconds":3600.0,"page_size":100,"resume_from_last_run":true,"sleep":20.0,"sleep_jitter":10.0,"start_page":1,"stop_when_remaining":5,"wait_on_over_quota":true} {"last_page_processed": 577, "pages_done": 577, "pages_total": 577, "rows_invalid_gtin": 0, "gtin_reject_reasons": {}, "error_samples": []}
23 ir_lenovo_us completed_with_errors 2026-03-09T03:44 13s 5,026 2,781 2,245 data/raw/ir/lenovo_us/20260309T034445Z_LenovoImpactRadiusUSNEW_IR.txt;delimiter= ;has_header=True;retailer=lenovo_us {"rows_invalid_gtin": 0, "delimiter": "\t", "has_header": true, "skip_rows": 0, "upc_field": "UPC", "sku_field": "MPN", "price_field": "Current Price", "title_field": "Product Name"}
22 bh_feed completed_with_errors 2026-03-09T02:39 36s 14,819 14,131 688 data/raw/bh/20260309T023858Z_20260309T023858Z_shopiner20033/shopiner20033.csv;delimiter=,;has_header=True;retailer=bh {"rows_invalid_gtin": 8, "delimiter": ",", "has_header": true, "skip_rows": 0, "upc_field": "upc", "sku_field": "itemcode", "price_field": "price"}
21 newegg_feed completed_with_errors 2026-03-09T02:23 4m 12s 854,336 14,781 29,480 data/raw/newegg/20260309T022206Z_44583_3309007_mp.txt;delimiter=|;match_only=True;retailer=newegg {"rows_invalid_gtin": 0, "rows_skipped_no_match": 810075, "delimiter": "|", "match_only": true, "skip_rows": 0}
20 bestbuy_all βœ“ ok 2026-03-09T01:22 4h 9m 57,638 57,626 0 {"allow_invalid_gtin":false,"allow_parallel":false,"base_retry_sleep":20.0,"commit_every_pages":1,"max_pages":0,"max_retries":8,"over_quota_sleep_seconds":3600.0,"page_size":100,"resume_from_last_run":true,"sleep":20.0,"sleep_jitter":10.0,"start_page":1,"stop_when_remaining":5,"wait_on_over_quota":true} {"last_page_processed": 577, "pages_done": 577, "pages_total": 578, "rows_invalid_gtin": 12, "gtin_reject_reasons": {"missing": 12}, "error_samples": []}
19 newegg_feed completed_with_errors 2026-03-08T05:46 7m 37s 854,526 14,816 29,508 data/raw/newegg/20260308T054524Z_44583_3309007_mp.txt;delimiter=|;match_only=True;retailer=newegg {"rows_invalid_gtin": 0, "rows_skipped_no_match": 810202, "delimiter": "|", "match_only": true, "skip_rows": 0}
18 ir_lenovo_us completed_with_errors 2026-03-08T05:45 32s 5,027 2,781 2,246 data/raw/ir/lenovo_us/20260308T054527Z_LenovoImpactRadiusUSNEW_IR.txt;delimiter= ;has_header=True;retailer=lenovo_us {"rows_invalid_gtin": 0, "delimiter": "\t", "has_header": true, "skip_rows": 0, "upc_field": "UPC", "sku_field": "MPN", "price_field": "Current Price", "title_field": "Product Name"}
17 bh_feed completed_with_errors 2026-03-08T05:45 1m 11s 15,071 14,372 699 data/raw/bh/20260308T054524Z_20260308T054524Z_shopiner20033/shopiner20033.csv;delimiter=,;has_header=True;retailer=bh {"rows_invalid_gtin": 7, "delimiter": ",", "has_header": true, "skip_rows": 0, "upc_field": "upc", "sku_field": "itemcode", "price_field": "price"}
16 bestbuy_all βœ“ ok 2026-03-08T05:44 1s 26 14 0 {"allow_invalid_gtin":false,"allow_parallel":false,"base_retry_sleep":20.0,"commit_every_pages":1,"max_pages":0,"max_retries":8,"over_quota_sleep_seconds":3600.0,"page_size":100,"resume_from_last_run":true,"sleep":20.0,"sleep_jitter":10.0,"start_page":1,"stop_when_remaining":5,"wait_on_over_quota":true} {"last_page_processed": 580, "pages_done": 1, "pages_total": 580, "rows_invalid_gtin": 12, "gtin_reject_reasons": {"missing": 12}, "error_samples": []}
15 bh_feed completed_with_errors 2026-03-06T09:04 53s 15,051 14,352 699 data/raw/bh/20260306T090358Z_20260306T090358Z_shopiner20033/shopiner20033.csv;delimiter=,;has_header=True;retailer=bh {"rows_invalid_gtin": 8, "delimiter": ",", "has_header": true, "skip_rows": 0, "upc_field": "upc", "sku_field": "itemcode", "price_field": "price"}
14 newegg_feed completed_with_errors 2026-03-06T08:40 8m 29s 861,162 14,529 29,559 data/raw/newegg/20260306T083929Z_44583_3309007_mp.txt;delimiter=|;match_only=True;retailer=newegg {"rows_invalid_gtin": 0, "rows_skipped_no_match": 817074, "delimiter": "|", "match_only": true, "skip_rows": 0}
13 bestbuy_all βœ“ ok 2026-03-06T05:19 2h 14m 57,892 57,880 0 {"allow_invalid_gtin":false,"allow_parallel":false,"base_retry_sleep":20.0,"commit_every_pages":1,"max_pages":0,"max_retries":8,"over_quota_sleep_seconds":3600.0,"page_size":100,"resume_from_last_run":true,"sleep":10.0,"sleep_jitter":5.0,"start_page":1,"stop_when_remaining":5,"wait_on_over_quota":true} {"last_page_processed": 579, "pages_done": 579, "pages_total": 581, "rows_invalid_gtin": 12, "gtin_reject_reasons": {"missing": 12}, "error_samples": []}
12 ir_lenovo_us completed_with_errors 2026-03-03T03:45 0s 4,987 2,779 2,208 data/raw/ir/lenovo_us/20260303T034519Z_LenovoImpactRadiusUSNEW_IR.txt;delimiter= ;has_header=True;retailer=lenovo_us {"rows_invalid_gtin": 0, "delimiter": "\t", "has_header": true, "skip_rows": 0, "upc_field": "UPC", "sku_field": "MPN", "price_field": "Current Price", "title_field": "Product Name"}
11 bh_feed completed_with_errors 2026-03-03T02:39 29s 14,567 14,109 458 data/raw/bh/20260303T023913Z_20260303T023913Z_shopiner20033/shopiner20033.csv;delimiter=,;has_header=True;retailer=bh {"rows_invalid_gtin": 8, "delimiter": ",", "has_header": true, "skip_rows": 0, "upc_field": "upc", "sku_field": "itemcode", "price_field": "price"}
10 newegg_feed completed_with_errors 2026-03-03T02:19 4m 15s 858,983 14,197 29,459 data/raw/newegg/20260303T021808Z_44583_3309007_mp.txt;delimiter=|;match_only=True;retailer=newegg {"rows_invalid_gtin": 0, "rows_skipped_no_match": 815327, "delimiter": "|", "match_only": true, "skip_rows": 0}
9 bestbuy_all βœ“ ok 2026-03-03T01:14 2h 7m 57,414 57,402 0 {"allow_invalid_gtin":false,"allow_parallel":false,"base_retry_sleep":20.0,"commit_every_pages":1,"max_pages":0,"max_retries":8,"over_quota_sleep_seconds":3600.0,"page_size":100,"resume_from_last_run":true,"sleep":10.0,"sleep_jitter":5.0,"start_page":1,"stop_when_remaining":5,"wait_on_over_quota":true} {"last_page_processed": 575, "pages_done": 575, "pages_total": 575, "rows_invalid_gtin": 12, "gtin_reject_reasons": {"missing": 12}, "error_samples": []}
8 ir_lenovo_us completed_with_errors 2026-03-02T10:58 0s 4,989 2,781 2,208 data/raw/ir/lenovo_us/20260302T105836Z_LenovoImpactRadiusUSNEW_IR.txt;delimiter= ;has_header=True;retailer=lenovo_us {"rows_invalid_gtin": 0, "delimiter": "\t", "has_header": true, "skip_rows": 0, "upc_field": "UPC", "sku_field": "MPN", "price_field": "Current Price", "title_field": "Product Name"}
7 newegg_feed completed_with_errors 2026-03-02T10:42 8m 32s 857,020 14,117 29,447 data/raw/newegg/20260302T104138Z_44583_3309007_mp.txt;delimiter=|;match_only=True;retailer=newegg {"rows_invalid_gtin": 0, "rows_skipped_no_match": 813456, "delimiter": "|", "match_only": true, "skip_rows": 0}
6 bh_feed completed_with_errors 2026-03-02T10:40 32s 14,670 14,203 467 data/raw/bh/20260302T104047Z_20260302T104047Z_shopiner20033/shopiner20033.csv;delimiter=,;has_header=True;retailer=bh {"rows_invalid_gtin": 9, "delimiter": ",", "has_header": true, "skip_rows": 0, "upc_field": "upc", "sku_field": "itemcode", "price_field": "price"}
5 bestbuy_all βœ“ ok 2026-03-02T06:35 4h 5m 57,074 57,062 0 {"allow_invalid_gtin":false,"allow_parallel":false,"base_retry_sleep":20.0,"commit_every_pages":1,"max_pages":0,"max_retries":8,"over_quota_sleep_seconds":3600.0,"page_size":100,"resume_from_last_run":true,"sleep":20.0,"sleep_jitter":10.0,"start_page":1,"stop_when_remaining":5,"wait_on_over_quota":true} {"last_page_processed": 573, "pages_done": 571, "pages_total": 573, "rows_invalid_gtin": 12, "gtin_reject_reasons": {"missing": 12}, "error_samples": []}
4 ir_lenovo_us completed_with_errors 2026-03-02T06:33 0s 4,988 2,781 2,207 data/raw/ir/lenovo_us/20260302T063339Z_LenovoImpactRadiusUSNEW_IR.txt;delimiter= ;has_header=True;retailer=lenovo_us {"rows_invalid_gtin": 0, "delimiter": "\t", "has_header": true, "skip_rows": 0, "upc_field": "UPC", "sku_field": "MPN", "price_field": "Current Price", "title_field": "Product Name"}
3 newegg_feed βœ“ ok 2026-03-02T06:27 0s 100 4 0 data/raw/newegg/20260302T062609Z_44583_3309007_mp.txt;delimiter=|;match_only=True;retailer=newegg {"rows_invalid_gtin": 0, "rows_skipped_no_match": 96, "delimiter": "|", "match_only": true, "skip_rows": 0}
2 bh_feed completed_with_errors 2026-03-02T06:25 32s 14,670 14,203 467 data/raw/bh/20260302T062502Z_20260302T062502Z_shopiner20033/shopiner20033.csv;delimiter=,;has_header=True;retailer=bh {"rows_invalid_gtin": 9, "delimiter": ",", "has_header": true, "skip_rows": 0, "upc_field": "upc", "sku_field": "itemcode", "price_field": "price"}
1 bestbuy_all paused_max_pages 2026-03-02T06:24 4s 200 200 0 {"allow_invalid_gtin":false,"allow_parallel":false,"base_retry_sleep":20.0,"commit_every_pages":1,"max_pages":2,"max_retries":8,"over_quota_sleep_seconds":3600.0,"page_size":100,"resume_from_last_run":false,"sleep":1.0,"sleep_jitter":0.0,"start_page":1,"stop_when_remaining":5,"wait_on_over_quota":true} {"reason": "max_pages", "max_pages": 2, "last_page_processed": 2, "pages_done": 2, "pages_total": 573, "rows_invalid_gtin": 0, "gtin_reject_reasons": {}}